Sep 09 23:22:23.152002 ip-10-0-133-34 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 23:22:23.534615 ip-10-0-133-34 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 23:22:23.534615 ip-10-0-133-34 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 23:22:23.534615 ip-10-0-133-34 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 23:22:23.534615 ip-10-0-133-34 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 23:22:23.534615 ip-10-0-133-34 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 23:22:23.536269 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.536182    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 23:22:23.539154 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539138    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:22:23.539154 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539154    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539158    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539161    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539165    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539168    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539176    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539179    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539182    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539185    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539188    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539191    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539193    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539196    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539198    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539201    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539205    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539209    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539211    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539214    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:22:23.539218 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539217    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539221    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539225    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539228    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539232    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539235    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539238    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539240    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539243    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539246    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539248    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539251    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539254    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539256    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539259    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539262    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539264    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539267    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539269    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:22:23.539664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539272    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539274    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539277    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539279    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539282    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539284    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539287    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539289    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539292    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539295    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539297    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539300    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539303    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539307    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539310    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539313    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539317    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539320    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539322    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539325    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:22:23.540138 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539328    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539331    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539334    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539336    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539339    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539342    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539345    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539347    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539350    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539353    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539356    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539358    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539361    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539363    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539367    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539369    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539372    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539375    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539378    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539380    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:22:23.540626 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539383    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539386    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539389    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539391    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539394    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539396    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539399    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539404    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539407    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539410    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539413    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539415    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539418    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539421    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539423    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539426    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539429    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539432    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539435    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.539437    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:22:23.541119 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540181    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540188    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540192    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540195    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540198    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540201    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540204    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540207    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540209    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540212    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540215    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540218    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540221    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540223    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540226    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540229    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540232    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540235    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540237    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540240    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:22:23.541625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540243    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540246    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540249    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540251    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540253    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540256    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540258    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540261    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540264    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540266    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540269    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540277    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540280    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540282    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540285    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540287    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540290    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540293    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540295    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540298    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:22:23.542187 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540302    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540305    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540307    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540310    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540312    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540315    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540317    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540320    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540322    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540327    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540331    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540334    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540337    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540340    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540343    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540347    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540350    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540354    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540359    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:22:23.542698 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540362    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540365    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540367    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540370    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540373    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540376    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540379    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540381    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540384    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540387    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540389    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540391    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540394    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540396    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540399    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540401    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540404    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540407    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540409    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540412    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:22:23.543186 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540414    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540417    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540420    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540423    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540426    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540429    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540431    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540434    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540436    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540439    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540441    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540444    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540446    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540449    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540451    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540454    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540456    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540459    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540461    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540464    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:22:23.543682 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540842    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540847    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540852    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540856    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540859    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540862    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540866    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540870    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540873    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540876    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540879    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540882    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540885    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540892    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540895    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540898    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540901    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540903    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540906    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:22:23.544185 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540909    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540912    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540915    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540918    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540921    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540923    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540927    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540930    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540932    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540935    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540938    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540941    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540944    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540947    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540949    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540951    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540954    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540956    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540959    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540961    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:22:23.544653 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540964    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540966    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540970    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540972    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540975    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540978    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540982    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540984    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540987    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540990    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540992    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540995    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.540997    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541000    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541002    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541005    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541007    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541010    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541013    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541015    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:22:23.545153 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541018    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541020    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541022    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541025    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541031    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541033    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541036    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541038    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541041    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541043    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541046    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541048    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541051    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541055    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541058    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541060    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541063    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541073    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541079    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:22:23.545639 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541081    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541084    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541087    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541089    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541092    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541096    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541098    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541101    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541103    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541106    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541109    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541111    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541114    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541117    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541119    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541122    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541124    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541127    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541130    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541133    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541135    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:22:23.546136 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541205    2581 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541239    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541248    2581 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541252    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541256    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541259    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541263    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541267    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541270    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541273    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541277    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541280    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541283    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541286    2581 flags.go:64] FLAG: --cgroup-root=""
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541289    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541292    2581 flags.go:64] FLAG: --client-ca-file=""
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541294    2581 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541297    2581 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541304    2581 flags.go:64] FLAG: --cluster-domain=""
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541307    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541310    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541313    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541316    2581 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541320    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 23:22:23.546648 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541322    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541325    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541329    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541332    2581 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541334    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541337    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541343    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541346    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541350    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541353    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541356    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541359    2581 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541362    2581 flags.go:64] FLAG: --enable-server="true"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541364    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541369    2581 flags.go:64] FLAG: --event-burst="100"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541372    2581 flags.go:64] FLAG: --event-qps="50"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541375    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541378    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541382    2581 flags.go:64] FLAG: --eviction-hard=""
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541385    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541388    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541391    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541394    2581 flags.go:64] FLAG: --eviction-soft=""
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541397    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541400    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 23:22:23.547268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541403    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541406    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541409    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541411    2581 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541414    2581 flags.go:64] FLAG: --feature-gates=""
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541418    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541421    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541423    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541426    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541430    2581 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541433    2581 flags.go:64] FLAG: --help="false"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541435    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-133-34.ec2.internal"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541438    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541441    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541444    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541447    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541451    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541453    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541456    2581 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541459    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541461    2581 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541466    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541469    2581 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541472    2581 flags.go:64] FLAG: --kube-reserved=""
Sep 09 23:22:23.547905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541475    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541479    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541482    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541485    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541487    2581 flags.go:64] FLAG: --lock-file=""
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541490    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541493    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541496    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541502    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541504    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541507    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541510    2581 flags.go:64] FLAG: --logging-format="text"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541513    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541516    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541519    2581 flags.go:64] FLAG: --manifest-url=""
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541521    2581 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541525    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541528    2581 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541532    2581 flags.go:64] FLAG: --max-pods="110"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541534    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541537    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541540    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541543    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541546    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541550    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 23:22:23.548537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541552    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541559    2581 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541562    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541565    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541570    2581 flags.go:64] FLAG: --pod-cidr=""
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541572    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541578    2581 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541581    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541585    2581 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541588    2581 flags.go:64] FLAG: --port="10250"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541591    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541594    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0117533b6cf67e21a"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541597    2581 flags.go:64] FLAG: --qos-reserved=""
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541600    2581 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541603    2581 flags.go:64] FLAG: --register-node="true"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541606    2581 flags.go:64] FLAG: --register-with-taints=""
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541614    2581 flags.go:64] FLAG: --registry-burst="10"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541616    2581 flags.go:64] FLAG: --registry-qps="5"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541619    2581 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541622    2581 flags.go:64] FLAG: --reserved-memory=""
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541625    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541628    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541631    2581 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541634    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541637    2581 flags.go:64] FLAG: --runonce="false"
Sep 09 23:22:23.549167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541640    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541643    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541646    2581 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541648    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541651    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541654    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541658    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541661    2581 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541664    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541667    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541670    2581 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541686    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541693    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541697    2581 flags.go:64] FLAG: --system-cgroups=""
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541700    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541706    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541709    2581 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541712    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541717    2581 flags.go:64] FLAG: --tls-min-version=""
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541719    2581 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541722    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541725    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541728    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541731    2581 flags.go:64] FLAG: --v="2"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541734    2581 flags.go:64] FLAG: --version="false"
Sep 09 23:22:23.550176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541738    2581 flags.go:64] FLAG: --vmodule=""
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541741    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.541745    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541860    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541864    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541867    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541869    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541872    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541876    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541879    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541881    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541884    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541887    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541890    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541893    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541896    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541899    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541901    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541904    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541908    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:22:23.551039 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541910    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541913    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541918    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541921    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541924    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541926    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541930    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541934    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541937    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541940    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541943    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541946    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541949    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541953    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541956    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541959    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541962    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541965    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541967    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541970    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:22:23.551567 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541972    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541975    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541977    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541980    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541982    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541985    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541989    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541993    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541996    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.541999    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542001    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542006    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542009    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542011    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542016    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542019    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542022    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542025    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542027    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:22:23.552083 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542030    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542033    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542035    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542038    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542040    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542043    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542046    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542048    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542051    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542053    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542056    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542058    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542061    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542063    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542066    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542068    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542071    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542073    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542076    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542078    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:22:23.552556 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542081    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542084    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542086    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542089    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542093    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542095    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542098    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542102    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542105    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542107    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542110    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542112    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542115    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542117    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542120    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542122    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542125    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542128    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542130    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:22:23.553076 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542132    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:22:23.553537 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542135    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:22:23.553537 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542137    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:22:23.553537 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.542140    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:22:23.553537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.542696    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 23:22:23.553537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.551515    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 23:22:23.553537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.551530    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 23:22:23.553537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.552093    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 23:22:23.553537 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.552101    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 23:22:23.553537 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552161    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:22:23.553537 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552166    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:22:23.553537 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552169    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:22:23.553537 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552172    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:22:23.553537 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552175    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:22:23.553537 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552177    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552181    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552186    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552189    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552192    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552195    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552198    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552201    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552204    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552206    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552209    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552212    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552215    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552217    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552220    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552222    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552226    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552229    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552231    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:22:23.553906 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552234    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552236    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552239    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552241    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552244    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552247    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552250    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552253    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552255    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552258    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552261    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552263    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552266    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552268    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552271    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552273    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552276    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552278    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552281    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:22:23.554357 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552285    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552289    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552293    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552296    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552299    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552302    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552305    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552308    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552310    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552313    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552315    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552318    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552321    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552323    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552326    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552328    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552331    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552333    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552337    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552339    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:22:23.554947 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552342    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552345    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552347    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552350    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552353    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552355    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552358    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552360    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552363    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552366    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552368    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552371    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552373    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552376    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552378    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552381    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552384    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552387    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552389    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552392    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:22:23.555431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552395    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:22:23.555994 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552397    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:22:23.555994 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552400    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:22:23.555994 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552402    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:22:23.555994 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552405    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:22:23.555994 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552407    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:22:23.555994 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552410    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:22:23.555994 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552412    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:22:23.555994 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552415    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:22:23.555994 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552418    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:22:23.555994 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552421    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:22:23.555994 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552423    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:22:23.555994 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552426    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:22:23.555994 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552428    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:22:23.555994 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552431    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:22:23.555994 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552434    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:22:23.556362 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.552438    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 23:22:23.556362 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552550    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:22:23.556362 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552554    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:22:23.556362 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552557    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:22:23.556362 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552560    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:22:23.556362 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552563    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:22:23.556362 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552566    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:22:23.556362 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552569    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:22:23.556362 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552572    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:22:23.556362 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552574    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:22:23.556362 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552577    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:22:23.556362 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552579    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:22:23.556362 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552582    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:22:23.556362 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552585    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552589    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552593    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552596    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552599    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552601    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552604    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552607    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552611    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552614    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552616    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552619    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552621    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552624    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552627    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552629    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552632    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552634    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552637    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:22:23.556724 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552639    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552642    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552644    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552647    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552650    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552652    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552655    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552657    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552660    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552662    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552664    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552667    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552669    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552682    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552686    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552688    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552691    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552693    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552696    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552699    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:22:23.557231 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552701    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552704    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552706    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552709    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552712    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552715    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552718    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552720    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552723    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552725    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552728    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552730    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552733    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552736    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552739    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552741    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552744    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552746    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552749    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552751    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:22:23.557827 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552754    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552756    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552759    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552761    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552764    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552766    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552769    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552772    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552774    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552776    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552779    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552781    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552784    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552787    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552789    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552793    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552797    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552800    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552803    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:22:23.558625 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552806    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:22:23.559183 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552809    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:22:23.559183 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552811    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:22:23.559183 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552814    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:22:23.559183 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552816    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:22:23.559183 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552819    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:22:23.559183 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552821    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:22:23.559183 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552824    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:22:23.559183 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:23.552826    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:22:23.559183 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.552831    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 23:22:23.559183 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.552935    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 23:22:23.559183 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.556646    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 23:22:23.559183 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.557526    2581 server.go:1019] "Starting client certificate rotation"
Sep 09 23:22:23.559183 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.557648    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 23:22:23.559574 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.557704    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 23:22:23.559854 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.559839    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 23:22:23.560950 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.560931    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 23:22:23.570947 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.570929    2581 log.go:25] "Validated CRI v1 runtime API"
Sep 09 23:22:23.573807 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.573791    2581 log.go:25] "Validated CRI v1 image API"
Sep 09 23:22:23.574730 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.574715    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 23:22:23.578243 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.578219    2581 fs.go:135] Filesystem UUIDs: map[47b70d81-accd-4b25-a1be-6ba9d4599483:/dev/nvme0n1p4 70d4d257-abba-40f6-973a-cd265ffcc34e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 09 23:22:23.578306 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.578241    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 23:22:23.583655 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.583534    2581 manager.go:216] Machine: {Timestamp:2026-09-09 23:22:23.582307897 +0000 UTC m=+0.321030697 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3163314 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d75d277f8c823e48edbb5102df330 SystemUUID:ec2d75d2-77f8-c823-e48e-dbb5102df330 BootID:4c867f6f-2acb-49ad-901d-67df9fc19f24 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:45:14:3f:b8:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:45:14:3f:b8:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:ce:cb:35:e5:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 23:22:23.583655 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.583646    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 23:22:23.583791 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.583742    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 23:22:23.585858 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.585818    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 23:22:23.587507 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.587451    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 23:22:23.587841 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.587696    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-34.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 23:22:23.588953 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.588939    2581 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 23:22:23.589015 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.588961    2581 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 23:22:23.589015 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.588973    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 23:22:23.589540 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.589529    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 23:22:23.591492 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.591480    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 23:22:23.595244 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.595230    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 23:22:23.595385 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.595374    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 23:22:23.595442 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.595413    2581 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 23:22:23.595442 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.595427    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 23:22:23.595442 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.595441    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 23:22:23.595558 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.595453    2581 kubelet.go:398] "Adding apiserver pod source"
Sep 09 23:22:23.595558 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.595467    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 23:22:23.595879 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.595855    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 23:22:23.595879 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.595880    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 23:22:23.598013 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.597996    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 23:22:23.600905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.600891    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 23:22:23.600968 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.600921    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 23:22:23.601790 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.601777    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 23:22:23.601826 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.601799    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 23:22:23.601826 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.601806    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 23:22:23.601826 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.601812    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 23:22:23.601826 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.601821    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 23:22:23.601826 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.601827    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 23:22:23.601961 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.601840    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 23:22:23.601961 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.601846    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 23:22:23.601961 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.601852    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 23:22:23.601961 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.601858    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 23:22:23.601961 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.601866    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 23:22:23.601961 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.601872    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 23:22:23.602465 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.602455    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 23:22:23.602497 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.602467    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 23:22:23.605076 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.605048    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 23:22:23.605141 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.605074    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-34.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 23:22:23.605217 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.605147    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-34.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 23:22:23.606310 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.606295    2581 server.go:1268] "Started kubelet"
Sep 09 23:22:23.606401 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.606355    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 23:22:23.606457 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.606380    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 23:22:23.606457 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.606450    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 23:22:23.607283 ip-10-0-133-34 systemd[1]: Started Kubernetes Kubelet.
Sep 09 23:22:23.607944 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.607915    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 23:22:23.609209 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.609020    2581 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 23:22:23.611846 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.611830    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-58h5q"
Sep 09 23:22:23.613248 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.613181    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 23:22:23.613341 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.613317    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 23:22:23.613813 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.613798    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 23:22:23.613977 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.613955    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-34.ec2.internal\" not found"
Sep 09 23:22:23.614232 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.613300    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-34.ec2.internal.18d3ca839c31f024  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-34.ec2.internal,UID:ip-10-0-133-34.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-34.ec2.internal,},FirstTimestamp:2026-09-09 23:22:23.606263844 +0000 UTC m=+0.344986644,LastTimestamp:2026-09-09 23:22:23.606263844 +0000 UTC m=+0.344986644,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-34.ec2.internal,}"
Sep 09 23:22:23.614552 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.614532    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 23:22:23.614552 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.614552    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 23:22:23.614723 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.614535    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 23:22:23.614723 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.614652    2581 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 23:22:23.614723 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.614666    2581 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 23:22:23.615468 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.615454    2581 factory.go:153] Registering CRI-O factory
Sep 09 23:22:23.615468 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.615470    2581 factory.go:223] Registration of the crio container factory successfully
Sep 09 23:22:23.615587 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.615516    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 23:22:23.615587 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.615527    2581 factory.go:55] Registering systemd factory
Sep 09 23:22:23.615587 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.615535    2581 factory.go:223] Registration of the systemd container factory successfully
Sep 09 23:22:23.615587 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.615553    2581 factory.go:103] Registering Raw factory
Sep 09 23:22:23.615587 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.615567    2581 manager.go:1196] Started watching for new ooms in manager
Sep 09 23:22:23.616601 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.616588    2581 manager.go:349] Starting recovery of all containers
Sep 09 23:22:23.617994 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.617970    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-58h5q"
Sep 09 23:22:23.620587 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.620559    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 23:22:23.620698 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.620661    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-34.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 23:22:23.629126 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.629109    2581 manager.go:354] Recovery completed
Sep 09 23:22:23.635902 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.635757    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:22:23.637821 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.637805    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:22:23.637882 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.637838    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:22:23.637882 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.637852    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:22:23.638382 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.638368    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 23:22:23.638382 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.638380    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:22:23.638460 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.638381    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 23:22:23.638460 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.638416    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 23:22:23.639079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.639061    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:22:23.639145 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.639092    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:22:23.639145 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.639102    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:22:23.639588 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.639577    2581 policy_none.go:49] "None policy: Start"
Sep 09 23:22:23.639624 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.639595    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 23:22:23.639624 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.639608    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 23:22:23.640735 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.640719    2581 policy_none.go:47] "Start"
Sep 09 23:22:23.676194 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.676181    2581 manager.go:337] "Starting Device Plugin manager"
Sep 09 23:22:23.676291 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.676216    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 23:22:23.676291 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.676225    2581 server.go:87] "Starting device plugin registration server"
Sep 09 23:22:23.676425 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.676413    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 23:22:23.676476 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.676426    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 23:22:23.676569 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.676553    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 23:22:23.676642 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.676621    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 23:22:23.676642 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.676629    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 23:22:23.677212 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.677194    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 23:22:23.677284 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.677246    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-34.ec2.internal\" not found"
Sep 09 23:22:23.736740 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.736713    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 23:22:23.737846 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.737828    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 23:22:23.737936 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.737887    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 23:22:23.737936 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.737917    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 23:22:23.738044 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.738006    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 23:22:23.739821 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.739803    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:22:23.777548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.777528    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:22:23.778417 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.778401    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:22:23.778502 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.778435    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:22:23.778502 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.778450    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:22:23.778502 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.778480    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-34.ec2.internal"
Sep 09 23:22:23.784789 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.784735    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-34.ec2.internal"
Sep 09 23:22:23.784789 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.784756    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-34.ec2.internal\": node \"ip-10-0-133-34.ec2.internal\" not found"
Sep 09 23:22:23.798004 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.797983    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-34.ec2.internal\" not found"
Sep 09 23:22:23.838563 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.838541    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-34.ec2.internal"]
Sep 09 23:22:23.838638 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.838600    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:22:23.839345 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.839330    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:22:23.839436 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.839361    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:22:23.839436 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.839374    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:22:23.840625 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.840611    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:22:23.840742 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.840726    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal"
Sep 09 23:22:23.840785 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.840758    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:22:23.841320 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.841303    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:22:23.841378 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.841319    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:22:23.841378 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.841332    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:22:23.841378 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.841341    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:22:23.841378 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.841342    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:22:23.841378 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.841364    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:22:23.842406 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.842391    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-34.ec2.internal"
Sep 09 23:22:23.842484 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.842417    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:22:23.843084 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.843069    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:22:23.843173 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.843093    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:22:23.843173 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.843106    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:22:23.868300 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.868277    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-34.ec2.internal\" not found" node="ip-10-0-133-34.ec2.internal"
Sep 09 23:22:23.872650 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.872633    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-34.ec2.internal\" not found" node="ip-10-0-133-34.ec2.internal"
Sep 09 23:22:23.898943 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.898920    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-34.ec2.internal\" not found"
Sep 09 23:22:23.916945 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.916923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b84762ef1973f07883fb50e7661186a7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal\" (UID: \"b84762ef1973f07883fb50e7661186a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal"
Sep 09 23:22:23.917032 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.916955    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b84762ef1973f07883fb50e7661186a7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal\" (UID: \"b84762ef1973f07883fb50e7661186a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal"
Sep 09 23:22:23.917032 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:23.916979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64fb27010123b0a7a495085cdd91f14e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-34.ec2.internal\" (UID: \"64fb27010123b0a7a495085cdd91f14e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-34.ec2.internal"
Sep 09 23:22:23.999511 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:23.999491    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-34.ec2.internal\" not found"
Sep 09 23:22:24.017867 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.017842    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b84762ef1973f07883fb50e7661186a7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal\" (UID: \"b84762ef1973f07883fb50e7661186a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal"
Sep 09 23:22:24.017934 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.017877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b84762ef1973f07883fb50e7661186a7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal\" (UID: \"b84762ef1973f07883fb50e7661186a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal"
Sep 09 23:22:24.017934 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.017893    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64fb27010123b0a7a495085cdd91f14e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-34.ec2.internal\" (UID: \"64fb27010123b0a7a495085cdd91f14e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-34.ec2.internal"
Sep 09 23:22:24.017934 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.017922    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b84762ef1973f07883fb50e7661186a7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal\" (UID: \"b84762ef1973f07883fb50e7661186a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal"
Sep 09 23:22:24.018085 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.017940    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b84762ef1973f07883fb50e7661186a7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal\" (UID: \"b84762ef1973f07883fb50e7661186a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal"
Sep 09 23:22:24.018085 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.017955    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64fb27010123b0a7a495085cdd91f14e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-34.ec2.internal\" (UID: \"64fb27010123b0a7a495085cdd91f14e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-34.ec2.internal"
Sep 09 23:22:24.100254 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:24.100185    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-34.ec2.internal\" not found"
Sep 09 23:22:24.171715 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.171670    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal"
Sep 09 23:22:24.176745 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.176729    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-34.ec2.internal"
Sep 09 23:22:24.200813 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:24.200787    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-34.ec2.internal\" not found"
Sep 09 23:22:24.301313 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:24.301292    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-34.ec2.internal\" not found"
Sep 09 23:22:24.403482 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:24.403417    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-34.ec2.internal\" not found"
Sep 09 23:22:24.445911 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.445886    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:22:24.507486 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:24.507452    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-34.ec2.internal\" not found"
Sep 09 23:22:24.557649 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.557610    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 23:22:24.558170 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.557779    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 23:22:24.558170 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.557805    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 23:22:24.591633 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.591604    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:22:24.595625 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.595606    2581 apiserver.go:52] "Watching apiserver"
Sep 09 23:22:24.603505 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.603486    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 23:22:24.603854 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.603830    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6cbhf","kube-system/konnectivity-agent-4fjs8","openshift-cluster-node-tuning-operator/tuned-989h8","openshift-dns/node-resolver-2zs45","openshift-image-registry/node-ca-wzn72","openshift-multus/multus-9prfv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7","openshift-multus/multus-additional-cni-plugins-6jdcm","openshift-multus/network-metrics-daemon-5ldkh","openshift-network-diagnostics/network-check-target-gwbns","openshift-network-operator/iptables-alerter-4v92l","openshift-ovn-kubernetes/ovnkube-node-5m2q9"]
Sep 09 23:22:24.605517 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.605487    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:24.605594 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:24.605560    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:24.606733 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.606713    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4fjs8"
Sep 09 23:22:24.608097 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.608076    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.609086 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.609064    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pjczz\""
Sep 09 23:22:24.609188 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.609088    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 23:22:24.609188 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.609094    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 23:22:24.609452 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.609435    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2zs45"
Sep 09 23:22:24.609958 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.609939    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:22:24.610063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.609948    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kwlb8\""
Sep 09 23:22:24.610144 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.610127    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 23:22:24.610740 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.610722    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wzn72"
Sep 09 23:22:24.611439 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.611421    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 23:22:24.611520 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.611459    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 23:22:24.611662 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.611646    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2tblq\""
Sep 09 23:22:24.612097 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.612083    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.612616 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.612600    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 23:22:24.612904 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.612887    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 23:22:24.612981 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.612916    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 23:22:24.613170 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.613155    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gpnj9\""
Sep 09 23:22:24.613386 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.613372    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.613521 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.613504    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 23:22:24.613949 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.613935    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-34.ec2.internal"
Sep 09 23:22:24.614091 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.614073    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 23:22:24.614149 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.614130    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 23:22:24.614300 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.614287    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 23:22:24.614384 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.614369    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2wtft\""
Sep 09 23:22:24.614532 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.614517    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 23:22:24.614660 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.614645    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.615333 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.615317    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 23:22:24.615406 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.615350    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 23:22:24.615456 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.615442    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-55b46\""
Sep 09 23:22:24.616180 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.616162    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 23:22:24.616249 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.616229    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:24.616316 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:24.616287    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:24.616748 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.616732    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 23:22:24.616748 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.616748    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xbdtl\""
Sep 09 23:22:24.616929 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.616909    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 23:22:24.617703 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.617684    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:24.617856 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:24.617832    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:24.619162 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.619144    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4v92l"
Sep 09 23:22:24.620180 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.620125    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 23:17:24 +0000 UTC" deadline="2028-03-07 20:15:18.587049375 +0000 UTC"
Sep 09 23:22:24.620283 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.620177    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13076h52m53.966876922s"
Sep 09 23:22:24.621651 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.620643    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-multus-cni-dir\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.621651 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.620706    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-etc-selinux\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.621651 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.620738    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-sys\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.621651 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.620772    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-multus-conf-dir\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.621651 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.620805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.621651 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.620832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mxv4\" (UniqueName: \"kubernetes.io/projected/f1fcbbeb-26ac-4451-8d92-c633f16dde4b-kube-api-access-2mxv4\") pod \"node-ca-wzn72\" (UID: \"f1fcbbeb-26ac-4451-8d92-c633f16dde4b\") " pod="openshift-image-registry/node-ca-wzn72"
Sep 09 23:22:24.621651 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.620868    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8p64\" (UniqueName: \"kubernetes.io/projected/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-kube-api-access-t8p64\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.621651 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.620881    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.621651 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.620900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5de319a8-ac13-4f30-8292-d061e28495d2-agent-certs\") pod \"konnectivity-agent-4fjs8\" (UID: \"5de319a8-ac13-4f30-8292-d061e28495d2\") " pod="kube-system/konnectivity-agent-4fjs8"
Sep 09 23:22:24.621651 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.620933    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-systemd\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.622742 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.622544    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4947b7f8-3f2c-4834-be65-e836891e734d-tmp\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.622863 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.622780    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fggnw\" (UniqueName: \"kubernetes.io/projected/d746b0d0-998c-4264-8725-e909b06c30e2-kube-api-access-fggnw\") pod \"network-metrics-daemon-5ldkh\" (UID: \"d746b0d0-998c-4264-8725-e909b06c30e2\") " pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:24.622863 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.622824    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-sys-fs\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.622863 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.622855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-cni-binary-copy\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.623027 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.622885    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-run-netns\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.623083 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623032    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 23:22:24.623134 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.622929    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-multus-daemon-config\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.623134 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs\") pod \"network-metrics-daemon-5ldkh\" (UID: \"d746b0d0-998c-4264-8725-e909b06c30e2\") " pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:24.623237 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623148    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5de319a8-ac13-4f30-8292-d061e28495d2-konnectivity-ca\") pod \"konnectivity-agent-4fjs8\" (UID: \"5de319a8-ac13-4f30-8292-d061e28495d2\") " pod="kube-system/konnectivity-agent-4fjs8"
Sep 09 23:22:24.623237 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623161    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 23:22:24.623237 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8a2522f-05c2-49d1-a218-f2d497019b27-tmp-dir\") pod \"node-resolver-2zs45\" (UID: \"e8a2522f-05c2-49d1-a218-f2d497019b27\") " pod="openshift-dns/node-resolver-2zs45"
Sep 09 23:22:24.623237 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623215    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-sysctl-conf\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.623237 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623231    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:22:24.623459 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623244    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-run-k8s-cni-cncf-io\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.623459 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-var-lib-kubelet\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.623459 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623308    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-registration-dir\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.623459 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623341    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-cnibin\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.623459 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623368    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-run\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.623459 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623394    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-lib-modules\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.623459 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623451    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-host\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.623744 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623480    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-cni-binary-copy\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.623744 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623510    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzzl9\" (UniqueName: \"kubernetes.io/projected/d24223fb-e5d8-43f1-96a0-507bf0fdf082-kube-api-access-qzzl9\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.623744 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623536    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8a2522f-05c2-49d1-a218-f2d497019b27-hosts-file\") pod \"node-resolver-2zs45\" (UID: \"e8a2522f-05c2-49d1-a218-f2d497019b27\") " pod="openshift-dns/node-resolver-2zs45"
Sep 09 23:22:24.623744 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623569    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-modprobe-d\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.623930 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-run-multus-certs\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.623930 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmg42\" (UniqueName: \"kubernetes.io/projected/e8a2522f-05c2-49d1-a218-f2d497019b27-kube-api-access-qmg42\") pod \"node-resolver-2zs45\" (UID: \"e8a2522f-05c2-49d1-a218-f2d497019b27\") " pod="openshift-dns/node-resolver-2zs45"
Sep 09 23:22:24.623930 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-hostroot\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.623930 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.623913    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-var-lib-cni-bin\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.624121 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.624100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-socket-dir\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.624165 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.624143    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-34.ec2.internal"]
Sep 09 23:22:24.624272 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.624175    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9c8282ee-a172-4f07-a592-8637893514c8-kubelet-config\") pod \"global-pull-secret-syncer-6cbhf\" (UID: \"9c8282ee-a172-4f07-a592-8637893514c8\") " pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:24.624328 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.624291    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dpd57\""
Sep 09 23:22:24.624429 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.624395    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1fcbbeb-26ac-4451-8d92-c633f16dde4b-host\") pod \"node-ca-wzn72\" (UID: \"f1fcbbeb-26ac-4451-8d92-c633f16dde4b\") " pod="openshift-image-registry/node-ca-wzn72"
Sep 09 23:22:24.624485 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.624456    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret\") pod \"global-pull-secret-syncer-6cbhf\" (UID: \"9c8282ee-a172-4f07-a592-8637893514c8\") " pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:24.624650 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.624632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-var-lib-kubelet\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.624690 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.624670    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f1fcbbeb-26ac-4451-8d92-c633f16dde4b-serviceca\") pod \"node-ca-wzn72\" (UID: \"f1fcbbeb-26ac-4451-8d92-c633f16dde4b\") " pod="openshift-image-registry/node-ca-wzn72"
Sep 09 23:22:24.624729 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.624702    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-sysconfig\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.624807 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.624777    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-sysctl-d\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.624869 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.624850    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 23:22:24.624923 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.624911    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 23:22:24.624987 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.624956    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal"
Sep 09 23:22:24.625340 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.624835    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-var-lib-cni-multus\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.625340 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.625140    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 23:22:24.625340 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.625158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-device-dir\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.625340 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.625198    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-system-cni-dir\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.625340 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.625113    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 23:22:24.625635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.625352    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.625635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.625391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.625635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.625425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9c8282ee-a172-4f07-a592-8637893514c8-dbus\") pod \"global-pull-secret-syncer-6cbhf\" (UID: \"9c8282ee-a172-4f07-a592-8637893514c8\") " pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:24.625635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.625455    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-system-cni-dir\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.625635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.625487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-multus-socket-dir-parent\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.625635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.625551    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgzsd\" (UniqueName: \"kubernetes.io/projected/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-kube-api-access-kgzsd\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.625635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.625568    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 23:22:24.625991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.625780    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.625991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.625885    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-kubernetes\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.625991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.625920    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4947b7f8-3f2c-4834-be65-e836891e734d-etc-tuned\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.626151 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.625991    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rtcq\" (UniqueName: \"kubernetes.io/projected/4947b7f8-3f2c-4834-be65-e836891e734d-kube-api-access-4rtcq\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.626151 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.626091    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 23:22:24.626151 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.626118    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-cnibin\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.626151 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.626124    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 23:22:24.626344 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.626154    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-etc-kubernetes\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.626344 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.626235    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ddwqb\""
Sep 09 23:22:24.628489 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.628464    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 23:22:24.634337 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.634318    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 23:22:24.634531 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.634516    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal"]
Sep 09 23:22:24.659203 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.659185    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9bnhw"
Sep 09 23:22:24.668374 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.668354    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9bnhw"
Sep 09 23:22:24.715316 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.715295    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 23:22:24.726456 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f1fcbbeb-26ac-4451-8d92-c633f16dde4b-serviceca\") pod \"node-ca-wzn72\" (UID: \"f1fcbbeb-26ac-4451-8d92-c633f16dde4b\") " pod="openshift-image-registry/node-ca-wzn72"
Sep 09 23:22:24.726574 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726474    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-run-ovn-kubernetes\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.726574 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-sysconfig\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.726574 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-sysctl-d\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.726574 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-var-lib-cni-multus\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.726574 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726561    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-device-dir\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.726861 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726598    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-sysconfig\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.726861 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726623    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-var-lib-cni-multus\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.726861 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726648    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-system-cni-dir\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.726861 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726679    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-sysctl-d\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.726861 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.726861 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726693    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-device-dir\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.726861 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726728    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.726861 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726766    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9c8282ee-a172-4f07-a592-8637893514c8-dbus\") pod \"global-pull-secret-syncer-6cbhf\" (UID: \"9c8282ee-a172-4f07-a592-8637893514c8\") " pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:24.726861 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726795    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-system-cni-dir\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.726861 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726854    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.727411 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726879    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9c8282ee-a172-4f07-a592-8637893514c8-dbus\") pod \"global-pull-secret-syncer-6cbhf\" (UID: \"9c8282ee-a172-4f07-a592-8637893514c8\") " pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:24.727411 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-system-cni-dir\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.727411 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726907    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-system-cni-dir\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.727411 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-multus-socket-dir-parent\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.727411 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.726996    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgzsd\" (UniqueName: \"kubernetes.io/projected/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-kube-api-access-kgzsd\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.727411 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.727411 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727040    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-multus-socket-dir-parent\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.727411 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-kubernetes\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.727411 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f1fcbbeb-26ac-4451-8d92-c633f16dde4b-serviceca\") pod \"node-ca-wzn72\" (UID: \"f1fcbbeb-26ac-4451-8d92-c633f16dde4b\") " pod="openshift-image-registry/node-ca-wzn72"
Sep 09 23:22:24.727411 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727201    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4947b7f8-3f2c-4834-be65-e836891e734d-etc-tuned\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.727411 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727235    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-kubernetes\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.727411 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rtcq\" (UniqueName: \"kubernetes.io/projected/4947b7f8-3f2c-4834-be65-e836891e734d-kube-api-access-4rtcq\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.727411 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727333    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8rdf\" (UniqueName: \"kubernetes.io/projected/653e8ef9-adb6-478c-af35-a6a1c268f218-kube-api-access-d8rdf\") pod \"iptables-alerter-4v92l\" (UID: \"653e8ef9-adb6-478c-af35-a6a1c268f218\") " pod="openshift-network-operator/iptables-alerter-4v92l"
Sep 09 23:22:24.727411 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727359    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-kubelet\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.727411 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-var-lib-openvswitch\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727456    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-etc-openvswitch\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727455    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727490    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-cni-bin\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727529    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-cni-netd\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-cnibin\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727594    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-cnibin\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-etc-kubernetes\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727619    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-systemd-units\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-slash\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-run-netns\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727726    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-etc-kubernetes\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-multus-cni-dir\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727737    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727795    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-multus-cni-dir\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727795    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-etc-selinux\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727821    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-sys\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.728154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727855    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-etc-selinux\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727886    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-run-systemd\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727906    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3a022bf-71eb-4784-ad71-be1723163abf-ovn-node-metrics-cert\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727922    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-sys\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-multus-conf-dir\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727983    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-multus-conf-dir\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.727966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mxv4\" (UniqueName: \"kubernetes.io/projected/f1fcbbeb-26ac-4451-8d92-c633f16dde4b-kube-api-access-2mxv4\") pod \"node-ca-wzn72\" (UID: \"f1fcbbeb-26ac-4451-8d92-c633f16dde4b\") " pod="openshift-image-registry/node-ca-wzn72"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728038    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8p64\" (UniqueName: \"kubernetes.io/projected/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-kube-api-access-t8p64\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728109    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5de319a8-ac13-4f30-8292-d061e28495d2-agent-certs\") pod \"konnectivity-agent-4fjs8\" (UID: \"5de319a8-ac13-4f30-8292-d061e28495d2\") " pod="kube-system/konnectivity-agent-4fjs8"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-systemd\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728185    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-systemd\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4947b7f8-3f2c-4834-be65-e836891e734d-tmp\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728225    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/653e8ef9-adb6-478c-af35-a6a1c268f218-host-slash\") pod \"iptables-alerter-4v92l\" (UID: \"653e8ef9-adb6-478c-af35-a6a1c268f218\") " pod="openshift-network-operator/iptables-alerter-4v92l"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728325    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728350    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fggnw\" (UniqueName: \"kubernetes.io/projected/d746b0d0-998c-4264-8725-e909b06c30e2-kube-api-access-fggnw\") pod \"network-metrics-daemon-5ldkh\" (UID: \"d746b0d0-998c-4264-8725-e909b06c30e2\") " pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:24.729063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728385    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/653e8ef9-adb6-478c-af35-a6a1c268f218-iptables-alerter-script\") pod \"iptables-alerter-4v92l\" (UID: \"653e8ef9-adb6-478c-af35-a6a1c268f218\") " pod="openshift-network-operator/iptables-alerter-4v92l"
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728414    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3a022bf-71eb-4784-ad71-be1723163abf-ovnkube-config\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728451    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcj5q\" (UniqueName: \"kubernetes.io/projected/f3a022bf-71eb-4784-ad71-be1723163abf-kube-api-access-vcj5q\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728505    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-sys-fs\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728544    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-cni-binary-copy\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3a022bf-71eb-4784-ad71-be1723163abf-env-overrides\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728599    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-sys-fs\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-run-netns\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-multus-daemon-config\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728733    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-run-netns\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs\") pod \"network-metrics-daemon-5ldkh\" (UID: \"d746b0d0-998c-4264-8725-e909b06c30e2\") " pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.728790    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5de319a8-ac13-4f30-8292-d061e28495d2-konnectivity-ca\") pod \"konnectivity-agent-4fjs8\" (UID: \"5de319a8-ac13-4f30-8292-d061e28495d2\") " pod="kube-system/konnectivity-agent-4fjs8"
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:24.728875    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:24.728952    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs podName:d746b0d0-998c-4264-8725-e909b06c30e2 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:25.228916428 +0000 UTC m=+1.967639217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs") pod "network-metrics-daemon-5ldkh" (UID: "d746b0d0-998c-4264-8725-e909b06c30e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729232    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-cni-binary-copy\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729295    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8a2522f-05c2-49d1-a218-f2d497019b27-tmp-dir\") pod \"node-resolver-2zs45\" (UID: \"e8a2522f-05c2-49d1-a218-f2d497019b27\") " pod="openshift-dns/node-resolver-2zs45"
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729527    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-multus-daemon-config\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.729991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729566    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5de319a8-ac13-4f30-8292-d061e28495d2-konnectivity-ca\") pod \"konnectivity-agent-4fjs8\" (UID: \"5de319a8-ac13-4f30-8292-d061e28495d2\") " pod="kube-system/konnectivity-agent-4fjs8"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729576    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-sysctl-conf\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8sfn\" (UniqueName: \"kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn\") pod \"network-check-target-gwbns\" (UID: \"c1771623-e2e6-4795-b247-beed28567e6f\") " pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729658    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-run-k8s-cni-cncf-io\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729699    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-var-lib-kubelet\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729716    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-run-k8s-cni-cncf-io\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729672    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-sysctl-conf\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729724    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-registration-dir\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729773    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-cnibin\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729784    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-var-lib-kubelet\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-run\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729837    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-lib-modules\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729842    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-registration-dir\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-host\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729901    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-cni-binary-copy\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729933    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzzl9\" (UniqueName: \"kubernetes.io/projected/d24223fb-e5d8-43f1-96a0-507bf0fdf082-kube-api-access-qzzl9\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729959    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-run-openvswitch\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.730877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729964    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-lib-modules\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.729986    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-cnibin\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730017    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-host\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-run\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-run-ovn\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-log-socket\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730139    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3a022bf-71eb-4784-ad71-be1723163abf-ovnkube-script-lib\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730167    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8a2522f-05c2-49d1-a218-f2d497019b27-hosts-file\") pod \"node-resolver-2zs45\" (UID: \"e8a2522f-05c2-49d1-a218-f2d497019b27\") " pod="openshift-dns/node-resolver-2zs45"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730205    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-modprobe-d\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-run-multus-certs\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730250    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8a2522f-05c2-49d1-a218-f2d497019b27-tmp-dir\") pod \"node-resolver-2zs45\" (UID: \"e8a2522f-05c2-49d1-a218-f2d497019b27\") " pod="openshift-dns/node-resolver-2zs45"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmg42\" (UniqueName: \"kubernetes.io/projected/e8a2522f-05c2-49d1-a218-f2d497019b27-kube-api-access-qmg42\") pod \"node-resolver-2zs45\" (UID: \"e8a2522f-05c2-49d1-a218-f2d497019b27\") " pod="openshift-dns/node-resolver-2zs45"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730295    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-hostroot\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-var-lib-cni-bin\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730348    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-etc-modprobe-d\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730358    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-socket-dir\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9c8282ee-a172-4f07-a592-8637893514c8-kubelet-config\") pod \"global-pull-secret-syncer-6cbhf\" (UID: \"9c8282ee-a172-4f07-a592-8637893514c8\") " pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730435    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-run-multus-certs\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.731432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730483    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1fcbbeb-26ac-4451-8d92-c633f16dde4b-host\") pod \"node-ca-wzn72\" (UID: \"f1fcbbeb-26ac-4451-8d92-c633f16dde4b\") " pod="openshift-image-registry/node-ca-wzn72"
Sep 09 23:22:24.732205 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730487    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-hostroot\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.732205 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-node-log\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.732205 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret\") pod \"global-pull-secret-syncer-6cbhf\" (UID: \"9c8282ee-a172-4f07-a592-8637893514c8\") " pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:24.732205 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730541    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-cni-binary-copy\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.732205 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730542    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9c8282ee-a172-4f07-a592-8637893514c8-kubelet-config\") pod \"global-pull-secret-syncer-6cbhf\" (UID: \"9c8282ee-a172-4f07-a592-8637893514c8\") " pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:24.732205 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730562    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-var-lib-kubelet\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.732205 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730612    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1fcbbeb-26ac-4451-8d92-c633f16dde4b-host\") pod \"node-ca-wzn72\" (UID: \"f1fcbbeb-26ac-4451-8d92-c633f16dde4b\") " pod="openshift-image-registry/node-ca-wzn72"
Sep 09 23:22:24.732205 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730432    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-host-var-lib-cni-bin\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.732205 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730365    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8a2522f-05c2-49d1-a218-f2d497019b27-hosts-file\") pod \"node-resolver-2zs45\" (UID: \"e8a2522f-05c2-49d1-a218-f2d497019b27\") " pod="openshift-dns/node-resolver-2zs45"
Sep 09 23:22:24.732205 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730644    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d24223fb-e5d8-43f1-96a0-507bf0fdf082-socket-dir\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.732205 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.730711    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4947b7f8-3f2c-4834-be65-e836891e734d-var-lib-kubelet\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.732205 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:24.730717    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:22:24.732205 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:24.730818    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret podName:9c8282ee-a172-4f07-a592-8637893514c8 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:25.230793612 +0000 UTC m=+1.969516406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret") pod "global-pull-secret-syncer-6cbhf" (UID: "9c8282ee-a172-4f07-a592-8637893514c8") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:22:24.732205 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.731634    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4947b7f8-3f2c-4834-be65-e836891e734d-etc-tuned\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.732205 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.731669    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4947b7f8-3f2c-4834-be65-e836891e734d-tmp\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.732205 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.731895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5de319a8-ac13-4f30-8292-d061e28495d2-agent-certs\") pod \"konnectivity-agent-4fjs8\" (UID: \"5de319a8-ac13-4f30-8292-d061e28495d2\") " pod="kube-system/konnectivity-agent-4fjs8"
Sep 09 23:22:24.734823 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.734791    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rtcq\" (UniqueName: \"kubernetes.io/projected/4947b7f8-3f2c-4834-be65-e836891e734d-kube-api-access-4rtcq\") pod \"tuned-989h8\" (UID: \"4947b7f8-3f2c-4834-be65-e836891e734d\") " pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.735076 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.735051    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgzsd\" (UniqueName: \"kubernetes.io/projected/b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc-kube-api-access-kgzsd\") pod \"multus-9prfv\" (UID: \"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc\") " pod="openshift-multus/multus-9prfv"
Sep 09 23:22:24.735168 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.735068    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mxv4\" (UniqueName: \"kubernetes.io/projected/f1fcbbeb-26ac-4451-8d92-c633f16dde4b-kube-api-access-2mxv4\") pod \"node-ca-wzn72\" (UID: \"f1fcbbeb-26ac-4451-8d92-c633f16dde4b\") " pod="openshift-image-registry/node-ca-wzn72"
Sep 09 23:22:24.735971 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.735951    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8p64\" (UniqueName: \"kubernetes.io/projected/49ab7649-13c9-46f3-a00d-ac28e2df0c7b-kube-api-access-t8p64\") pod \"multus-additional-cni-plugins-6jdcm\" (UID: \"49ab7649-13c9-46f3-a00d-ac28e2df0c7b\") " pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:24.737264 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.737240    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fggnw\" (UniqueName: \"kubernetes.io/projected/d746b0d0-998c-4264-8725-e909b06c30e2-kube-api-access-fggnw\") pod \"network-metrics-daemon-5ldkh\" (UID: \"d746b0d0-998c-4264-8725-e909b06c30e2\") " pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:24.737714 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.737691    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzzl9\" (UniqueName: \"kubernetes.io/projected/d24223fb-e5d8-43f1-96a0-507bf0fdf082-kube-api-access-qzzl9\") pod \"aws-ebs-csi-driver-node-kkpc7\" (UID: \"d24223fb-e5d8-43f1-96a0-507bf0fdf082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:24.737951 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.737935    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmg42\" (UniqueName: \"kubernetes.io/projected/e8a2522f-05c2-49d1-a218-f2d497019b27-kube-api-access-qmg42\") pod \"node-resolver-2zs45\" (UID: \"e8a2522f-05c2-49d1-a218-f2d497019b27\") " pod="openshift-dns/node-resolver-2zs45"
Sep 09 23:22:24.819758 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:24.819714    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64fb27010123b0a7a495085cdd91f14e.slice/crio-813e0b6f3ea0230710378777d2e76bb698c0bc750f0c9c2f9ecc717259a3f279 WatchSource:0}: Error finding container 813e0b6f3ea0230710378777d2e76bb698c0bc750f0c9c2f9ecc717259a3f279: Status 404 returned error can't find the container with id 813e0b6f3ea0230710378777d2e76bb698c0bc750f0c9c2f9ecc717259a3f279
Sep 09 23:22:24.820139 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:24.820096    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb84762ef1973f07883fb50e7661186a7.slice/crio-59b4731c17707004d20f62e88b181b7bfc0910cdc0b214208ff0744b7ecef30b WatchSource:0}: Error finding container 59b4731c17707004d20f62e88b181b7bfc0910cdc0b214208ff0744b7ecef30b: Status 404 returned error can't find the container with id 59b4731c17707004d20f62e88b181b7bfc0910cdc0b214208ff0744b7ecef30b
Sep 09 23:22:24.824646 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.824627    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:22:24.831167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831146    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-run-openvswitch\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.831226 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-run-ovn\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.831226 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-log-socket\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.831387 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831248    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-run-openvswitch\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.831387 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831251    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-log-socket\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.831387 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831251    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-run-ovn\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.831387 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831282    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3a022bf-71eb-4784-ad71-be1723163abf-ovnkube-script-lib\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.831387 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-node-log\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.831387 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831383    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-run-ovn-kubernetes\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.831672 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831442    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-run-ovn-kubernetes\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.831672 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831446    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-node-log\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.831672 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8rdf\" (UniqueName: \"kubernetes.io/projected/653e8ef9-adb6-478c-af35-a6a1c268f218-kube-api-access-d8rdf\") pod \"iptables-alerter-4v92l\" (UID: \"653e8ef9-adb6-478c-af35-a6a1c268f218\") " pod="openshift-network-operator/iptables-alerter-4v92l"
Sep 09 23:22:24.831672 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-kubelet\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.831672 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831619    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-kubelet\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.831914 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-var-lib-openvswitch\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.831914 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831834    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-var-lib-openvswitch\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.831914 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831896    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3a022bf-71eb-4784-ad71-be1723163abf-ovnkube-script-lib\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.831914 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-etc-openvswitch\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831944    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-cni-bin\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831958    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-etc-openvswitch\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831971    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-cni-netd\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.831998    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-cni-bin\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832009    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-systemd-units\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-slash\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-run-netns\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832054    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-cni-netd\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-run-systemd\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832069    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-slash\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832032    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-systemd-units\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832089    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-run-systemd\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832100    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3a022bf-71eb-4784-ad71-be1723163abf-ovn-node-metrics-cert\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832116    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-run-netns\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/653e8ef9-adb6-478c-af35-a6a1c268f218-host-slash\") pod \"iptables-alerter-4v92l\" (UID: \"653e8ef9-adb6-478c-af35-a6a1c268f218\") " pod="openshift-network-operator/iptables-alerter-4v92l"
Sep 09 23:22:24.832635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832237    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/653e8ef9-adb6-478c-af35-a6a1c268f218-host-slash\") pod \"iptables-alerter-4v92l\" (UID: \"653e8ef9-adb6-478c-af35-a6a1c268f218\") " pod="openshift-network-operator/iptables-alerter-4v92l"
Sep 09 23:22:24.832635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832246    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3a022bf-71eb-4784-ad71-be1723163abf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/653e8ef9-adb6-478c-af35-a6a1c268f218-iptables-alerter-script\") pod \"iptables-alerter-4v92l\" (UID: \"653e8ef9-adb6-478c-af35-a6a1c268f218\") " pod="openshift-network-operator/iptables-alerter-4v92l"
Sep 09 23:22:24.832635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3a022bf-71eb-4784-ad71-be1723163abf-ovnkube-config\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832318    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcj5q\" (UniqueName: \"kubernetes.io/projected/f3a022bf-71eb-4784-ad71-be1723163abf-kube-api-access-vcj5q\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3a022bf-71eb-4784-ad71-be1723163abf-env-overrides\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.832635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8sfn\" (UniqueName: \"kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn\") pod \"network-check-target-gwbns\" (UID: \"c1771623-e2e6-4795-b247-beed28567e6f\") " pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:24.833149 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832887    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/653e8ef9-adb6-478c-af35-a6a1c268f218-iptables-alerter-script\") pod \"iptables-alerter-4v92l\" (UID: \"653e8ef9-adb6-478c-af35-a6a1c268f218\") " pod="openshift-network-operator/iptables-alerter-4v92l"
Sep 09 23:22:24.833149 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832898    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3a022bf-71eb-4784-ad71-be1723163abf-env-overrides\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.833149 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.832938    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3a022bf-71eb-4784-ad71-be1723163abf-ovnkube-config\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.834552 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.834530    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3a022bf-71eb-4784-ad71-be1723163abf-ovn-node-metrics-cert\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.840208 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:24.840191    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:22:24.840208 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:24.840210    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:22:24.840360 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:24.840221    2581 projected.go:196] Error preparing data for projected volume kube-api-access-x8sfn for pod openshift-network-diagnostics/network-check-target-gwbns: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:22:24.840360 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:24.840279    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn podName:c1771623-e2e6-4795-b247-beed28567e6f nodeName:}" failed. No retries permitted until 2026-09-09 23:22:25.340265179 +0000 UTC m=+2.078987968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x8sfn" (UniqueName: "kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn") pod "network-check-target-gwbns" (UID: "c1771623-e2e6-4795-b247-beed28567e6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:22:24.841197 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.841176    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8rdf\" (UniqueName: \"kubernetes.io/projected/653e8ef9-adb6-478c-af35-a6a1c268f218-kube-api-access-d8rdf\") pod \"iptables-alerter-4v92l\" (UID: \"653e8ef9-adb6-478c-af35-a6a1c268f218\") " pod="openshift-network-operator/iptables-alerter-4v92l"
Sep 09 23:22:24.841439 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.841395    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcj5q\" (UniqueName: \"kubernetes.io/projected/f3a022bf-71eb-4784-ad71-be1723163abf-kube-api-access-vcj5q\") pod \"ovnkube-node-5m2q9\" (UID: \"f3a022bf-71eb-4784-ad71-be1723163abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:24.938432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.938383    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4fjs8"
Sep 09 23:22:24.947979 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:24.947956    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5de319a8_ac13_4f30_8292_d061e28495d2.slice/crio-90b17cb382dc79e513b4673ba852f126983f5370fd5376aee5274fcf1901e869 WatchSource:0}: Error finding container 90b17cb382dc79e513b4673ba852f126983f5370fd5376aee5274fcf1901e869: Status 404 returned error can't find the container with id 90b17cb382dc79e513b4673ba852f126983f5370fd5376aee5274fcf1901e869
Sep 09 23:22:24.957176 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.957159    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-989h8"
Sep 09 23:22:24.964114 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:24.964092    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4947b7f8_3f2c_4834_be65_e836891e734d.slice/crio-831670313df9258f3a5c5bb6c1cef74633f2781bf2460356ce2875370f7d41a5 WatchSource:0}: Error finding container 831670313df9258f3a5c5bb6c1cef74633f2781bf2460356ce2875370f7d41a5: Status 404 returned error can't find the container with id 831670313df9258f3a5c5bb6c1cef74633f2781bf2460356ce2875370f7d41a5
Sep 09 23:22:24.975396 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.975378    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2zs45"
Sep 09 23:22:24.982664 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:24.982642    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a2522f_05c2_49d1_a218_f2d497019b27.slice/crio-65e7472b16d2fc7161f914d208e036dc411a9fc98832466ca4b7bcd3d05c9c10 WatchSource:0}: Error finding container 65e7472b16d2fc7161f914d208e036dc411a9fc98832466ca4b7bcd3d05c9c10: Status 404 returned error can't find the container with id 65e7472b16d2fc7161f914d208e036dc411a9fc98832466ca4b7bcd3d05c9c10
Sep 09 23:22:24.985726 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.985712    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wzn72"
Sep 09 23:22:24.993806 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:24.993784    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1fcbbeb_26ac_4451_8d92_c633f16dde4b.slice/crio-cf106f408cc95992fe16537f4d58507052bd88015ee9e7219e312ec68681363f WatchSource:0}: Error finding container cf106f408cc95992fe16537f4d58507052bd88015ee9e7219e312ec68681363f: Status 404 returned error can't find the container with id cf106f408cc95992fe16537f4d58507052bd88015ee9e7219e312ec68681363f
Sep 09 23:22:24.999830 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:24.999811    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9prfv"
Sep 09 23:22:25.006818 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:25.006796    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0d988e1_d35b_4ba9_a44d_65cd8a3bc1cc.slice/crio-ce686f2d25105a722ef5040b36405642213ac1419112af94a73ebe9723451c0a WatchSource:0}: Error finding container ce686f2d25105a722ef5040b36405642213ac1419112af94a73ebe9723451c0a: Status 404 returned error can't find the container with id ce686f2d25105a722ef5040b36405642213ac1419112af94a73ebe9723451c0a
Sep 09 23:22:25.016408 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.016391    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7"
Sep 09 23:22:25.023933 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.023912    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6jdcm"
Sep 09 23:22:25.024181 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:25.024162    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd24223fb_e5d8_43f1_96a0_507bf0fdf082.slice/crio-490fb1a6fc14b0da46f38ed4972e156c4b1160641977d456e818cf3dead65c7b WatchSource:0}: Error finding container 490fb1a6fc14b0da46f38ed4972e156c4b1160641977d456e818cf3dead65c7b: Status 404 returned error can't find the container with id 490fb1a6fc14b0da46f38ed4972e156c4b1160641977d456e818cf3dead65c7b
Sep 09 23:22:25.031905 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:25.031884    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ab7649_13c9_46f3_a00d_ac28e2df0c7b.slice/crio-adff8566ba43054a16a8eeb1025ec1169f1e3e91231943e4619ee2941f0b4d08 WatchSource:0}: Error finding container adff8566ba43054a16a8eeb1025ec1169f1e3e91231943e4619ee2941f0b4d08: Status 404 returned error can't find the container with id adff8566ba43054a16a8eeb1025ec1169f1e3e91231943e4619ee2941f0b4d08
Sep 09 23:22:25.048052 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.048032    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4v92l"
Sep 09 23:22:25.055820 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.055805    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:25.055997 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:25.055981    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653e8ef9_adb6_478c_af35_a6a1c268f218.slice/crio-cff744320cf8094f70ae340521b0410c563c1bd24c7b21b8a8267e0a99bab902 WatchSource:0}: Error finding container cff744320cf8094f70ae340521b0410c563c1bd24c7b21b8a8267e0a99bab902: Status 404 returned error can't find the container with id cff744320cf8094f70ae340521b0410c563c1bd24c7b21b8a8267e0a99bab902
Sep 09 23:22:25.063873 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:22:25.063846    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a022bf_71eb_4784_ad71_be1723163abf.slice/crio-4250baff4e9fefc63acf1e86153ffd3c875ce6e7ee81d7da5fac0fcb1abc162b WatchSource:0}: Error finding container 4250baff4e9fefc63acf1e86153ffd3c875ce6e7ee81d7da5fac0fcb1abc162b: Status 404 returned error can't find the container with id 4250baff4e9fefc63acf1e86153ffd3c875ce6e7ee81d7da5fac0fcb1abc162b
Sep 09 23:22:25.106728 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.106705    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:22:25.235592 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.235565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs\") pod \"network-metrics-daemon-5ldkh\" (UID: \"d746b0d0-998c-4264-8725-e909b06c30e2\") " pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:25.235715 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.235610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret\") pod \"global-pull-secret-syncer-6cbhf\" (UID: \"9c8282ee-a172-4f07-a592-8637893514c8\") " pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:25.235759 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:25.235722    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:22:25.235808 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:25.235722    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:22:25.235808 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:25.235787    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs podName:d746b0d0-998c-4264-8725-e909b06c30e2 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:26.235765423 +0000 UTC m=+2.974488229 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs") pod "network-metrics-daemon-5ldkh" (UID: "d746b0d0-998c-4264-8725-e909b06c30e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:22:25.235808 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:25.235806    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret podName:9c8282ee-a172-4f07-a592-8637893514c8 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:26.235796391 +0000 UTC m=+2.974519197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret") pod "global-pull-secret-syncer-6cbhf" (UID: "9c8282ee-a172-4f07-a592-8637893514c8") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:22:25.436779 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.436739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8sfn\" (UniqueName: \"kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn\") pod \"network-check-target-gwbns\" (UID: \"c1771623-e2e6-4795-b247-beed28567e6f\") " pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:25.436959 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:25.436901    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:22:25.436959 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:25.436921    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:22:25.436959 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:25.436934    2581 projected.go:196] Error preparing data for projected volume kube-api-access-x8sfn for pod openshift-network-diagnostics/network-check-target-gwbns: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:22:25.437160 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:25.437002    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn podName:c1771623-e2e6-4795-b247-beed28567e6f nodeName:}" failed. No retries permitted until 2026-09-09 23:22:26.436982631 +0000 UTC m=+3.175705435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8sfn" (UniqueName: "kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn") pod "network-check-target-gwbns" (UID: "c1771623-e2e6-4795-b247-beed28567e6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:22:25.600666 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.600576    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:22:25.673241 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.673192    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:17:25 +0000 UTC" deadline="2028-06-22 19:10:14.66615451 +0000 UTC"
Sep 09 23:22:25.673241 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.673242    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15643h47m48.992919044s"
Sep 09 23:22:25.757505 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.757476    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:25.757680 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:25.757616    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:25.780616 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.780541    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9prfv" event={"ID":"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc","Type":"ContainerStarted","Data":"ce686f2d25105a722ef5040b36405642213ac1419112af94a73ebe9723451c0a"}
Sep 09 23:22:25.786634 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.786566    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wzn72" event={"ID":"f1fcbbeb-26ac-4451-8d92-c633f16dde4b","Type":"ContainerStarted","Data":"cf106f408cc95992fe16537f4d58507052bd88015ee9e7219e312ec68681363f"}
Sep 09 23:22:25.803750 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.803665    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-989h8" event={"ID":"4947b7f8-3f2c-4834-be65-e836891e734d","Type":"ContainerStarted","Data":"831670313df9258f3a5c5bb6c1cef74633f2781bf2460356ce2875370f7d41a5"}
Sep 09 23:22:25.817709 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.817641    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-34.ec2.internal" event={"ID":"64fb27010123b0a7a495085cdd91f14e","Type":"ContainerStarted","Data":"813e0b6f3ea0230710378777d2e76bb698c0bc750f0c9c2f9ecc717259a3f279"}
Sep 09 23:22:25.829669 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.829620    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jdcm" event={"ID":"49ab7649-13c9-46f3-a00d-ac28e2df0c7b","Type":"ContainerStarted","Data":"adff8566ba43054a16a8eeb1025ec1169f1e3e91231943e4619ee2941f0b4d08"}
Sep 09 23:22:25.836686 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.836604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2zs45" event={"ID":"e8a2522f-05c2-49d1-a218-f2d497019b27","Type":"ContainerStarted","Data":"65e7472b16d2fc7161f914d208e036dc411a9fc98832466ca4b7bcd3d05c9c10"}
Sep 09 23:22:25.864877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.864686    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4fjs8" event={"ID":"5de319a8-ac13-4f30-8292-d061e28495d2","Type":"ContainerStarted","Data":"90b17cb382dc79e513b4673ba852f126983f5370fd5376aee5274fcf1901e869"}
Sep 09 23:22:25.880268 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.880230    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal" event={"ID":"b84762ef1973f07883fb50e7661186a7","Type":"ContainerStarted","Data":"59b4731c17707004d20f62e88b181b7bfc0910cdc0b214208ff0744b7ecef30b"}
Sep 09 23:22:25.888686 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.888560    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9" event={"ID":"f3a022bf-71eb-4784-ad71-be1723163abf","Type":"ContainerStarted","Data":"4250baff4e9fefc63acf1e86153ffd3c875ce6e7ee81d7da5fac0fcb1abc162b"}
Sep 09 23:22:25.892632 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.892605    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4v92l" event={"ID":"653e8ef9-adb6-478c-af35-a6a1c268f218","Type":"ContainerStarted","Data":"cff744320cf8094f70ae340521b0410c563c1bd24c7b21b8a8267e0a99bab902"}
Sep 09 23:22:25.903252 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:25.903218    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7" event={"ID":"d24223fb-e5d8-43f1-96a0-507bf0fdf082","Type":"ContainerStarted","Data":"490fb1a6fc14b0da46f38ed4972e156c4b1160641977d456e818cf3dead65c7b"}
Sep 09 23:22:26.264885 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:26.264059    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret\") pod \"global-pull-secret-syncer-6cbhf\" (UID: \"9c8282ee-a172-4f07-a592-8637893514c8\") " pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:26.264885 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:26.264147    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs\") pod \"network-metrics-daemon-5ldkh\" (UID: \"d746b0d0-998c-4264-8725-e909b06c30e2\") " pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:26.264885 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:26.264294    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:22:26.264885 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:26.264358    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs podName:d746b0d0-998c-4264-8725-e909b06c30e2 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:28.264338442 +0000 UTC m=+5.003061254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs") pod "network-metrics-daemon-5ldkh" (UID: "d746b0d0-998c-4264-8725-e909b06c30e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:22:26.264885 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:26.264794    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:22:26.264885 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:26.264848    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret podName:9c8282ee-a172-4f07-a592-8637893514c8 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:28.264832655 +0000 UTC m=+5.003555448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret") pod "global-pull-secret-syncer-6cbhf" (UID: "9c8282ee-a172-4f07-a592-8637893514c8") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:22:26.466789 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:26.465227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8sfn\" (UniqueName: \"kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn\") pod \"network-check-target-gwbns\" (UID: \"c1771623-e2e6-4795-b247-beed28567e6f\") " pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:26.466789 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:26.465444    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:22:26.466789 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:26.465473    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:22:26.466789 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:26.465486    2581 projected.go:196] Error preparing data for projected volume kube-api-access-x8sfn for pod openshift-network-diagnostics/network-check-target-gwbns: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:22:26.466789 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:26.465545    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn podName:c1771623-e2e6-4795-b247-beed28567e6f nodeName:}" failed. No retries permitted until 2026-09-09 23:22:28.465525306 +0000 UTC m=+5.204248109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8sfn" (UniqueName: "kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn") pod "network-check-target-gwbns" (UID: "c1771623-e2e6-4795-b247-beed28567e6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:22:26.673918 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:26.673795    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:17:25 +0000 UTC" deadline="2028-05-29 01:28:35.621544222 +0000 UTC"
Sep 09 23:22:26.673918 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:26.673853    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15050h6m8.947695279s"
Sep 09 23:22:26.738295 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:26.738127    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:26.738295 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:26.738273    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:26.739694 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:26.738794    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:26.739694 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:26.738908    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:27.005184 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:27.005149    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:22:27.740741 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:27.740707    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:27.741261 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:27.740909    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:28.285011 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:28.284973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs\") pod \"network-metrics-daemon-5ldkh\" (UID: \"d746b0d0-998c-4264-8725-e909b06c30e2\") " pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:28.285241 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:28.285048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret\") pod \"global-pull-secret-syncer-6cbhf\" (UID: \"9c8282ee-a172-4f07-a592-8637893514c8\") " pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:28.285241 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:28.285182    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:22:28.285371 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:28.285246    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret podName:9c8282ee-a172-4f07-a592-8637893514c8 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:32.285227069 +0000 UTC m=+9.023949864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret") pod "global-pull-secret-syncer-6cbhf" (UID: "9c8282ee-a172-4f07-a592-8637893514c8") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:22:28.285860 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:28.285670    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:22:28.285860 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:28.285731    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs podName:d746b0d0-998c-4264-8725-e909b06c30e2 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:32.285711697 +0000 UTC m=+9.024434491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs") pod "network-metrics-daemon-5ldkh" (UID: "d746b0d0-998c-4264-8725-e909b06c30e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:22:28.487213 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:28.487178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8sfn\" (UniqueName: \"kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn\") pod \"network-check-target-gwbns\" (UID: \"c1771623-e2e6-4795-b247-beed28567e6f\") " pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:28.487412 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:28.487393    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:22:28.487484 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:28.487421    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:22:28.487484 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:28.487436    2581 projected.go:196] Error preparing data for projected volume kube-api-access-x8sfn for pod openshift-network-diagnostics/network-check-target-gwbns: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:22:28.487575 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:28.487499    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn podName:c1771623-e2e6-4795-b247-beed28567e6f nodeName:}" failed. No retries permitted until 2026-09-09 23:22:32.487478026 +0000 UTC m=+9.226200837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8sfn" (UniqueName: "kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn") pod "network-check-target-gwbns" (UID: "c1771623-e2e6-4795-b247-beed28567e6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:22:28.739235 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:28.738979    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:28.739420 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:28.739338    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:28.739751 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:28.739200    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:28.739907 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:28.739878    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:29.738729 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:29.738700    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:29.739298 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:29.738844    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:30.739257 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:30.739219    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:30.739785 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:30.739382    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:30.739785 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:30.739442    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:30.739785 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:30.739614    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:31.739911 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:31.739875    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:31.740420 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:31.740016    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:32.320870 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:32.320832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs\") pod \"network-metrics-daemon-5ldkh\" (UID: \"d746b0d0-998c-4264-8725-e909b06c30e2\") " pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:32.321075 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:32.320921    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret\") pod \"global-pull-secret-syncer-6cbhf\" (UID: \"9c8282ee-a172-4f07-a592-8637893514c8\") " pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:32.321075 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:32.321039    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:22:32.321207 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:32.321090    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:22:32.321207 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:32.321115    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs podName:d746b0d0-998c-4264-8725-e909b06c30e2 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:40.32109319 +0000 UTC m=+17.059815987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs") pod "network-metrics-daemon-5ldkh" (UID: "d746b0d0-998c-4264-8725-e909b06c30e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:22:32.321207 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:32.321147    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret podName:9c8282ee-a172-4f07-a592-8637893514c8 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:40.32113006 +0000 UTC m=+17.059852853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret") pod "global-pull-secret-syncer-6cbhf" (UID: "9c8282ee-a172-4f07-a592-8637893514c8") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:22:32.523513 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:32.523468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8sfn\" (UniqueName: \"kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn\") pod \"network-check-target-gwbns\" (UID: \"c1771623-e2e6-4795-b247-beed28567e6f\") " pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:32.523733 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:32.523689    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:22:32.523733 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:32.523710    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:22:32.523840 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:32.523742    2581 projected.go:196] Error preparing data for projected volume kube-api-access-x8sfn for pod openshift-network-diagnostics/network-check-target-gwbns: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:22:32.523840 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:32.523804    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn podName:c1771623-e2e6-4795-b247-beed28567e6f nodeName:}" failed. No retries permitted until 2026-09-09 23:22:40.523783342 +0000 UTC m=+17.262506135 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8sfn" (UniqueName: "kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn") pod "network-check-target-gwbns" (UID: "c1771623-e2e6-4795-b247-beed28567e6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:22:32.738553 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:32.738520    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:32.738782 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:32.738677    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:32.738782 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:32.738747    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:32.738899 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:32.738828    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:33.739777 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:33.739743    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:33.740267 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:33.739943    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:34.738192 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:34.738151    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:34.738380 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:34.738151    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:34.738380 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:34.738315    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:34.738512 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:34.738395    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:35.739076 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:35.739038    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:35.739546 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:35.739224    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:36.738331 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:36.738293    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:36.738506 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:36.738300    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:36.738506 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:36.738419    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:36.738637 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:36.738546    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:37.738671 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:37.738634    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:37.739126 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:37.738776    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:38.738956 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:38.738913    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:38.738956 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:38.738951    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:38.739373 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:38.739047    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:38.739373 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:38.739173    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:39.738878 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:39.738846    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:39.739056 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:39.738995    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:40.382354 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:40.382314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret\") pod \"global-pull-secret-syncer-6cbhf\" (UID: \"9c8282ee-a172-4f07-a592-8637893514c8\") " pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:40.382580 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:40.382393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs\") pod \"network-metrics-daemon-5ldkh\" (UID: \"d746b0d0-998c-4264-8725-e909b06c30e2\") " pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:40.382580 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:40.382491    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:22:40.382580 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:40.382511    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:22:40.382580 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:40.382560    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret podName:9c8282ee-a172-4f07-a592-8637893514c8 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:56.382544612 +0000 UTC m=+33.121267398 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret") pod "global-pull-secret-syncer-6cbhf" (UID: "9c8282ee-a172-4f07-a592-8637893514c8") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:22:40.382580 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:40.382581    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs podName:d746b0d0-998c-4264-8725-e909b06c30e2 nodeName:}" failed. No retries permitted until 2026-09-09 23:22:56.382571181 +0000 UTC m=+33.121293969 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs") pod "network-metrics-daemon-5ldkh" (UID: "d746b0d0-998c-4264-8725-e909b06c30e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:22:40.583998 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:40.583960    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8sfn\" (UniqueName: \"kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn\") pod \"network-check-target-gwbns\" (UID: \"c1771623-e2e6-4795-b247-beed28567e6f\") " pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:40.584159 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:40.584120    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:22:40.584159 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:40.584152    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:22:40.584255 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:40.584165    2581 projected.go:196] Error preparing data for projected volume kube-api-access-x8sfn for pod openshift-network-diagnostics/network-check-target-gwbns: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:22:40.584255 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:40.584231    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn podName:c1771623-e2e6-4795-b247-beed28567e6f nodeName:}" failed. No retries permitted until 2026-09-09 23:22:56.584211418 +0000 UTC m=+33.322934225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8sfn" (UniqueName: "kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn") pod "network-check-target-gwbns" (UID: "c1771623-e2e6-4795-b247-beed28567e6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:22:40.738401 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:40.738370    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:40.738578 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:40.738484    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:40.738578 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:40.738521    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:40.738715 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:40.738590    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:41.738457 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:41.738414    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:41.739028 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:41.738535    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:42.738752 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:42.738714    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:42.739198 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:42.738763    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:42.739198 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:42.738844    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:42.739198 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:42.738998    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:43.739612 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:43.739586    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:43.740005 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:43.739709    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:44.738482 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:44.738459    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:44.738579 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:44.738459    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:44.738579 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:44.738566    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:44.738666 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:44.738647    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:44.953923 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:44.953568    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/ovn-acl-logging/0.log"
Sep 09 23:22:44.954826 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:44.954800    2581 generic.go:356] "Generic (PLEG): container finished" podID="f3a022bf-71eb-4784-ad71-be1723163abf" containerID="61363b6c040ed1760ea65b12f2d895186cf47da72cb39166416234aeed7527cf" exitCode=1
Sep 09 23:22:44.954939 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:44.954874    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9" event={"ID":"f3a022bf-71eb-4784-ad71-be1723163abf","Type":"ContainerStarted","Data":"88378ee1d32a4105ffb04c15acd0ccea611739f7b200dfeb0335080d692b5559"}
Sep 09 23:22:44.955003 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:44.954955    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9" event={"ID":"f3a022bf-71eb-4784-ad71-be1723163abf","Type":"ContainerDied","Data":"61363b6c040ed1760ea65b12f2d895186cf47da72cb39166416234aeed7527cf"}
Sep 09 23:22:44.955003 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:44.954985    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9" event={"ID":"f3a022bf-71eb-4784-ad71-be1723163abf","Type":"ContainerStarted","Data":"9a5379d9dbdb872d7ba96623d249794497b8ba1cf79ce43710e4f1b5203c2d41"}
Sep 09 23:22:44.956498 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:44.956475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9prfv" event={"ID":"b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc","Type":"ContainerStarted","Data":"badf26b3be7eb627c13547306d35d05c61a39e2c3a7ef5380ad2f74420a572fe"}
Sep 09 23:22:44.958182 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:44.958161    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-989h8" event={"ID":"4947b7f8-3f2c-4834-be65-e836891e734d","Type":"ContainerStarted","Data":"48aee1191b64f74a34c31daabf735e4158c9625739a7c782c8ffcf3ffac7fd31"}
Sep 09 23:22:44.959637 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:44.959615    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-34.ec2.internal" event={"ID":"64fb27010123b0a7a495085cdd91f14e","Type":"ContainerStarted","Data":"b6e8e3b90863fe7bdd0651d39e48afb24298915d64b77ecba8a1da9497f7a124"}
Sep 09 23:22:44.974483 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:44.974444    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9prfv" podStartSLOduration=1.216734738 podStartE2EDuration="20.974433334s" totalImagesPullingTime="19.757698596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:44.97407132 +0000 UTC m=+21.712794130" watchObservedRunningTime="2026-09-09 23:22:44.974433334 +0000 UTC m=+21.713156143"
Sep 09 23:22:44.987391 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:44.987353    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-34.ec2.internal" podStartSLOduration=19.987338672 podStartE2EDuration="19.987338672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:44.987166979 +0000 UTC m=+21.725889789" watchObservedRunningTime="2026-09-09 23:22:44.987338672 +0000 UTC m=+21.726061482"
Sep 09 23:22:45.004616 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:45.004391    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-989h8" podStartSLOduration=1.405368773 podStartE2EDuration="21.00437386s" totalImagesPullingTime="19.599005087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:45.00336784 +0000 UTC m=+21.742090641" watchObservedRunningTime="2026-09-09 23:22:45.00437386 +0000 UTC m=+21.743096670"
Sep 09 23:22:45.739102 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:45.738929    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:45.739256 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:45.739178    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:45.963727 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:45.963669    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wzn72" event={"ID":"f1fcbbeb-26ac-4451-8d92-c633f16dde4b","Type":"ContainerStarted","Data":"055cd1317f62b71c04a4e334a488a771312cad84a7fb315cf20f5920c4af8704"}
Sep 09 23:22:45.965652 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:45.965629    2581 generic.go:356] "Generic (PLEG): container finished" podID="49ab7649-13c9-46f3-a00d-ac28e2df0c7b" containerID="1ffc2ac33d1d3defbf5a2159d0fa80154daff803f5c0883fc82a277fb4b61e9f" exitCode=0
Sep 09 23:22:45.965788 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:45.965731    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jdcm" event={"ID":"49ab7649-13c9-46f3-a00d-ac28e2df0c7b","Type":"ContainerDied","Data":"1ffc2ac33d1d3defbf5a2159d0fa80154daff803f5c0883fc82a277fb4b61e9f"}
Sep 09 23:22:45.967628 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:45.967604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2zs45" event={"ID":"e8a2522f-05c2-49d1-a218-f2d497019b27","Type":"ContainerStarted","Data":"a1fca6c7e80c881df21c4ec1d215a5ac4ed4c0746cba06c4a27f2d6fc209c785"}
Sep 09 23:22:45.969291 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:45.969257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4fjs8" event={"ID":"5de319a8-ac13-4f30-8292-d061e28495d2","Type":"ContainerStarted","Data":"7e3b4c9e4fa528e104862084c3f1bf2f814472923d2bd9e79f4fccb94caff45d"}
Sep 09 23:22:45.971032 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:45.971007    2581 generic.go:356] "Generic (PLEG): container finished" podID="b84762ef1973f07883fb50e7661186a7" containerID="9cd55986cafb046c26277faa9dd4a8bf3c5f5c6b21e2a47b1e94a632efa7e1b4" exitCode=0
Sep 09 23:22:45.971123 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:45.971066    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal" event={"ID":"b84762ef1973f07883fb50e7661186a7","Type":"ContainerDied","Data":"9cd55986cafb046c26277faa9dd4a8bf3c5f5c6b21e2a47b1e94a632efa7e1b4"}
Sep 09 23:22:45.974232 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:45.974214    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/ovn-acl-logging/0.log"
Sep 09 23:22:45.974639 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:45.974605    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9" event={"ID":"f3a022bf-71eb-4784-ad71-be1723163abf","Type":"ContainerStarted","Data":"bb8bf64d97ba144d9ab738744e448c91f6eee5ea512c6028a08ab31c0e92e6ca"}
Sep 09 23:22:45.974757 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:45.974697    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9" event={"ID":"f3a022bf-71eb-4784-ad71-be1723163abf","Type":"ContainerStarted","Data":"bac6a39b2d7b0da13c7294288d144b33bb79d2f8ab3f59ad9d67078b8b20a6da"}
Sep 09 23:22:45.974757 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:45.974747    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9" event={"ID":"f3a022bf-71eb-4784-ad71-be1723163abf","Type":"ContainerStarted","Data":"7dfe7c2b24b40ea0ffe809e015783ea25d931b5e564a6459e75f0c13e1a0c63a"}
Sep 09 23:22:45.976158 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:45.976138    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4v92l" event={"ID":"653e8ef9-adb6-478c-af35-a6a1c268f218","Type":"ContainerStarted","Data":"e93b2a44fb13458f9060baa42cb103bc5f4550a64f0c19afd442886b64ac9ac8"}
Sep 09 23:22:45.977121 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:45.977082    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wzn72" podStartSLOduration=2.429106965 podStartE2EDuration="21.977068734s" totalImagesPullingTime="19.547961769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:45.976838146 +0000 UTC m=+22.715560955" watchObservedRunningTime="2026-09-09 23:22:45.977068734 +0000 UTC m=+22.715791543"
Sep 09 23:22:45.977795 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:45.977741    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7" event={"ID":"d24223fb-e5d8-43f1-96a0-507bf0fdf082","Type":"ContainerStarted","Data":"f5bff407994f2c9867bb8498fb97c8b240764f620e2ea6055a192ea501555eca"}
Sep 09 23:22:46.024098 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:46.024057    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4fjs8" podStartSLOduration=9.803109018 podStartE2EDuration="22.024020535s" totalImagesPullingTime="12.220911517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:46.02362542 +0000 UTC m=+22.762348220" watchObservedRunningTime="2026-09-09 23:22:46.024020535 +0000 UTC m=+22.762743343"
Sep 09 23:22:46.037059 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:46.037024    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4v92l" podStartSLOduration=2.533165696 podStartE2EDuration="22.037012983s" totalImagesPullingTime="19.503847287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:46.036950463 +0000 UTC m=+22.775673271" watchObservedRunningTime="2026-09-09 23:22:46.037012983 +0000 UTC m=+22.775735791"
Sep 09 23:22:46.180937 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:46.180883    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 23:22:46.182413 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:46.182384    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:46.400750 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:46.400721    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:46.503040 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:46.503005    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:46.690690 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:46.690582    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T23:22:46.18090369Z","UUID":"52d26503-1f82-4ed2-a0c5-6315268953a7","Handler":null,"Name":"","Endpoint":""}
Sep 09 23:22:46.691988 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:46.691970    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 23:22:46.692097 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:46.692001    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 23:22:46.738865 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:46.738835    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:46.738865 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:46.738857    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:46.739067 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:46.738984    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:46.739128 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:46.739108    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:46.982293 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:46.982255    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7" event={"ID":"d24223fb-e5d8-43f1-96a0-507bf0fdf082","Type":"ContainerStarted","Data":"02934c274504858fb07b80ed663490f5bdf6fe66704fb196aa957bdd4522ecdb"}
Sep 09 23:22:46.984510 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:46.984441    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal" event={"ID":"b84762ef1973f07883fb50e7661186a7","Type":"ContainerStarted","Data":"d0f70a0538b9cf142090b159e3fc0f723b30398897c06d013f22d1a1faeb7084"}
Sep 09 23:22:46.998100 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:46.998056    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2zs45" podStartSLOduration=3.450751302 podStartE2EDuration="22.998040121s" totalImagesPullingTime="19.547288819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:46.057813482 +0000 UTC m=+22.796536288" watchObservedRunningTime="2026-09-09 23:22:46.998040121 +0000 UTC m=+23.736762930"
Sep 09 23:22:46.998294 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:46.998268    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-34.ec2.internal" podStartSLOduration=21.998259919 podStartE2EDuration="21.998259919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:46.997562929 +0000 UTC m=+23.736285739" watchObservedRunningTime="2026-09-09 23:22:46.998259919 +0000 UTC m=+23.736982728"
Sep 09 23:22:47.490188 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:47.490116    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:47.591167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:47.591136    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:47.690108 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:47.690078    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:47.738490 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:47.738461    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:47.738696 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:47.738598    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:47.991591 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:47.991558    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/ovn-acl-logging/0.log"
Sep 09 23:22:47.992044 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:47.991997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9" event={"ID":"f3a022bf-71eb-4784-ad71-be1723163abf","Type":"ContainerStarted","Data":"67c2253f0a4f881bf9705cf3d909f6975f112182b79a93227d0f90fedccc00c6"}
Sep 09 23:22:47.994454 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:47.994428    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7" event={"ID":"d24223fb-e5d8-43f1-96a0-507bf0fdf082","Type":"ContainerStarted","Data":"88c5402779c374b88cc7a1bd510311687e846acee6c9d3992dda80ad0ff59b6b"}
Sep 09 23:22:48.011335 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:48.011293    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kkpc7" podStartSLOduration=2.633837997 podStartE2EDuration="24.011276158s" totalImagesPullingTime="21.377438161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:48.011244948 +0000 UTC m=+24.749967759" watchObservedRunningTime="2026-09-09 23:22:48.011276158 +0000 UTC m=+24.749998949"
Sep 09 23:22:48.457821 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:48.457591    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:48.738943 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:48.738917    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:48.739110 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:48.738944    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:48.739110 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:48.739034    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:48.739223 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:48.739168    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:49.502814 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:49.502735    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:49.566144 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:49.566106    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:49.738795 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:49.738761    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:49.738961 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:49.738892    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:50.596760 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:50.596725    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4fjs8"
Sep 09 23:22:50.597429 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:50.597413    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4fjs8"
Sep 09 23:22:50.739137 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:50.739107    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:50.739305 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:50.739228    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:50.739515 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:50.739107    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:50.739515 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:50.739480    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:51.006409 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:51.006383    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/ovn-acl-logging/0.log"
Sep 09 23:22:51.006966 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:51.006836    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9" event={"ID":"f3a022bf-71eb-4784-ad71-be1723163abf","Type":"ContainerStarted","Data":"0ec51de2e12b50e5ca1747be22b2cd2f159798b5be03b5062ea953f7c658daca"}
Sep 09 23:22:51.007117 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:51.007097    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4fjs8"
Sep 09 23:22:51.007406 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:51.007385    2581 scope.go:117] "RemoveContainer" containerID="61363b6c040ed1760ea65b12f2d895186cf47da72cb39166416234aeed7527cf"
Sep 09 23:22:51.007663 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:51.007644    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4fjs8"
Sep 09 23:22:51.092210 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:51.092031    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:51.738527 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:51.738495    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:51.739049 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:51.738595    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:51.825443 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:51.825412    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:51.927350 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:51.927323    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:52.012865 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.012805    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/ovn-acl-logging/0.log"
Sep 09 23:22:52.013200 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.013182    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9" event={"ID":"f3a022bf-71eb-4784-ad71-be1723163abf","Type":"ContainerStarted","Data":"c5b0ae57a88ff702df3c2956db4da50dd12213a050914c0a966dc58d6f64f801"}
Sep 09 23:22:52.013279 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.013257    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:52.013381 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.013366    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:52.013454 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.013439    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:52.015214 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.015192    2581 generic.go:356] "Generic (PLEG): container finished" podID="49ab7649-13c9-46f3-a00d-ac28e2df0c7b" containerID="9998d68c54ff7741385f4bf63f917716872d350ab2c6efdd0c2d3eace64e86a4" exitCode=0
Sep 09 23:22:52.015321 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.015223    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jdcm" event={"ID":"49ab7649-13c9-46f3-a00d-ac28e2df0c7b","Type":"ContainerDied","Data":"9998d68c54ff7741385f4bf63f917716872d350ab2c6efdd0c2d3eace64e86a4"}
Sep 09 23:22:52.028271 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.028252    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:52.028406 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.028392    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:22:52.039567 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.039530    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9" podStartSLOduration=8.509592005 podStartE2EDuration="28.039519404s" totalImagesPullingTime="19.529927399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:52.039354317 +0000 UTC m=+28.778077117" watchObservedRunningTime="2026-09-09 23:22:52.039519404 +0000 UTC m=+28.778242212"
Sep 09 23:22:52.209491 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.209460    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:52.411326 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.411298    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:52.523307 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.523242    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:52.625173 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.625129    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:52.739072 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.739047    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:52.739696 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:52.739160    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:52.739696 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.739218    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:52.739696 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:52.739346    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:52.943305 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.943090    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6cbhf"]
Sep 09 23:22:52.943474 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.943403    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:52.943560 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:52.943517    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:52.943761 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.943733    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gwbns"]
Sep 09 23:22:52.945647 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:52.945622    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5ldkh"]
Sep 09 23:22:53.019690 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:53.019643    2581 generic.go:356] "Generic (PLEG): container finished" podID="49ab7649-13c9-46f3-a00d-ac28e2df0c7b" containerID="1594d8e6b3f8c09abb4f886db8dc54464498030fe9dc198cc8dc39799f5b6e6d" exitCode=0
Sep 09 23:22:53.019806 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:53.019705    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jdcm" event={"ID":"49ab7649-13c9-46f3-a00d-ac28e2df0c7b","Type":"ContainerDied","Data":"1594d8e6b3f8c09abb4f886db8dc54464498030fe9dc198cc8dc39799f5b6e6d"}
Sep 09 23:22:53.019806 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:53.019792    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:53.019969 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:53.019950    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:53.020027 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:53.019991    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:53.020132 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:53.020112    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:53.107750 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:53.107697    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2zs45_e8a2522f-05c2-49d1-a218-f2d497019b27/dns-node-resolver/0.log"
Sep 09 23:22:53.186986 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:53.186964    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:53.282947 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:53.282923    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:53.698720 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:53.698665    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:53.778892 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:53.778825    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:53.838926 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:53.838894    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:53.997850 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:53.997809    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:54.025496 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:54.025462    2581 generic.go:356] "Generic (PLEG): container finished" podID="49ab7649-13c9-46f3-a00d-ac28e2df0c7b" containerID="a59cca76668c43f4ad9c6360dde09f1a44e04f13f7e1d9d29fce3d09765973cc" exitCode=0
Sep 09 23:22:54.025637 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:54.025540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jdcm" event={"ID":"49ab7649-13c9-46f3-a00d-ac28e2df0c7b","Type":"ContainerDied","Data":"a59cca76668c43f4ad9c6360dde09f1a44e04f13f7e1d9d29fce3d09765973cc"}
Sep 09 23:22:54.058011 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:54.057986    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:54.507461 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:54.507434    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wzn72_f1fcbbeb-26ac-4451-8d92-c633f16dde4b/node-ca/0.log"
Sep 09 23:22:54.738337 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:54.738300    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:54.738337 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:54.738336    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:54.738561 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:54.738336    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:54.738561 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:54.738424    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:54.738561 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:54.738518    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:54.738721 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:54.738597    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:54.823394 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:54.823351    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:55.662483 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:55.662450    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:56.411158 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:56.411129    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret\") pod \"global-pull-secret-syncer-6cbhf\" (UID: \"9c8282ee-a172-4f07-a592-8637893514c8\") " pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:56.411719 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:56.411178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs\") pod \"network-metrics-daemon-5ldkh\" (UID: \"d746b0d0-998c-4264-8725-e909b06c30e2\") " pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:56.411719 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:56.411272    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:22:56.411719 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:56.411272    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:22:56.411719 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:56.411319    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs podName:d746b0d0-998c-4264-8725-e909b06c30e2 nodeName:}" failed. No retries permitted until 2026-09-09 23:23:28.411305385 +0000 UTC m=+65.150028172 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs") pod "network-metrics-daemon-5ldkh" (UID: "d746b0d0-998c-4264-8725-e909b06c30e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:22:56.411719 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:56.411333    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret podName:9c8282ee-a172-4f07-a592-8637893514c8 nodeName:}" failed. No retries permitted until 2026-09-09 23:23:28.411326456 +0000 UTC m=+65.150049243 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret") pod "global-pull-secret-syncer-6cbhf" (UID: "9c8282ee-a172-4f07-a592-8637893514c8") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:22:56.613189 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:56.613158    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8sfn\" (UniqueName: \"kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn\") pod \"network-check-target-gwbns\" (UID: \"c1771623-e2e6-4795-b247-beed28567e6f\") " pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:56.613346 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:56.613295    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:22:56.613346 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:56.613312    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:22:56.613346 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:56.613320    2581 projected.go:196] Error preparing data for projected volume kube-api-access-x8sfn for pod openshift-network-diagnostics/network-check-target-gwbns: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:22:56.613447 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:56.613369    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn podName:c1771623-e2e6-4795-b247-beed28567e6f nodeName:}" failed. No retries permitted until 2026-09-09 23:23:28.613354649 +0000 UTC m=+65.352077442 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8sfn" (UniqueName: "kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn") pod "network-check-target-gwbns" (UID: "c1771623-e2e6-4795-b247-beed28567e6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:22:56.738861 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:56.738834    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:56.738861 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:56.738852    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:56.738861 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:56.738834    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:56.739133 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:56.738957    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:56.739133 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:56.739015    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:56.739133 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:56.739078    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:56.867296 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:56.867263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:56.968401 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:56.968341    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:57.168312 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:57.168201    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:57.226584 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:57.226548    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:57.437052 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:57.436980    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:57.575022 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:57.574993    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:58.101121 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:58.101085    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:58.585096 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:58.585061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:58.738543 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:58.738511    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:22:58.738697 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:58.738511    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:22:58.738697 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:58.738518    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:22:58.738770 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:58.738701    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:22:58.738770 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:58.738599    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:22:58.738837 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:22:58.738757    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:22:58.968350 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:58.968293    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:59.161954 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:59.161912    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:59.370301 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:59.370254    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:22:59.780890 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:22:59.780845    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:00.043454 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:00.043375    2581 generic.go:356] "Generic (PLEG): container finished" podID="49ab7649-13c9-46f3-a00d-ac28e2df0c7b" containerID="ca7ed0f2f53082a70ec22e8b50a2307e6c900186e9536f034eb9559d31ac6c98" exitCode=0
Sep 09 23:23:00.043454 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:00.043431    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jdcm" event={"ID":"49ab7649-13c9-46f3-a00d-ac28e2df0c7b","Type":"ContainerDied","Data":"ca7ed0f2f53082a70ec22e8b50a2307e6c900186e9536f034eb9559d31ac6c98"}
Sep 09 23:23:00.555987 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:00.555959    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:00.615142 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:00.615119    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:00.739033 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:00.739010    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:23:00.739162 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:00.739010    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:23:00.739162 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:00.739097    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:23:00.739237 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:00.739185    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:23:00.739237 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:00.739010    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:23:00.739298 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:00.739268    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:23:00.774646 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:00.774617    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:00.976216 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:00.976184    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:01.049324 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:01.049295    2581 generic.go:356] "Generic (PLEG): container finished" podID="49ab7649-13c9-46f3-a00d-ac28e2df0c7b" containerID="236f5e4cd5eeeaf4847356e30e7f1ea3b1d928d076507cfa1f56b446b66fb55f" exitCode=0
Sep 09 23:23:01.049470 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:01.049378    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jdcm" event={"ID":"49ab7649-13c9-46f3-a00d-ac28e2df0c7b","Type":"ContainerDied","Data":"236f5e4cd5eeeaf4847356e30e7f1ea3b1d928d076507cfa1f56b446b66fb55f"}
Sep 09 23:23:01.078072 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:01.078054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:01.148153 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:01.148119    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:01.413244 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:01.413145    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:01.513318 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:01.513287    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:02.018595 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:02.018564    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:02.055123 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:02.055091    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6jdcm" event={"ID":"49ab7649-13c9-46f3-a00d-ac28e2df0c7b","Type":"ContainerStarted","Data":"27df349f5337fe2f581438708c9473e8cbcdaf812a11023989b1daa5812ce6ec"}
Sep 09 23:23:02.074753 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:02.074715    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6jdcm" podStartSLOduration=7.058315795 podStartE2EDuration="38.074696814s" totalImagesPullingTime="31.016381019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:02.074392979 +0000 UTC m=+38.813115800" watchObservedRunningTime="2026-09-09 23:23:02.074696814 +0000 UTC m=+38.813419623"
Sep 09 23:23:02.565666 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:02.565636    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:02.738451 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:02.738423    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:23:02.738451 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:02.738454    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:23:02.738669 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:02.738422    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:23:02.738669 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:02.738527    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:23:02.738669 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:02.738617    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:23:02.738669 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:02.738657    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:23:02.780885 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:02.780851    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:02.881910 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:02.881876    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:02.983812 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:02.983781    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:03.169012 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:03.168938    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:03.227471 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:03.227443    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:03.366505 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:03.366476    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:03.767591 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:03.767564    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:04.163389 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:04.163309    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:04.738645 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:04.738617    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:23:04.738645 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:04.738643    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:23:04.739132 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:04.738618    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:23:04.739132 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:04.738716    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:23:04.739132 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:04.738792    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:23:04.739132 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:04.738851    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:23:04.760900 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:04.760877    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:04.880742 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:04.880713    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:04.981419 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:04.981392    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:05.169478 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:05.169410    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:05.328965 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:05.328929    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:05.560897 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:05.560867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:05.990072 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:05.990043    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:06.165148 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:06.165120    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:06.738408 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:06.738380    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:23:06.738570 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:06.738477    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:23:06.738570 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:06.738485    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:23:06.738570 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:06.738564    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:23:06.738717 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:06.738559    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:23:06.738717 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:06.738641    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:23:06.769502 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:06.769479    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:06.962437 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:06.962403    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:07.362528 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:07.362497    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:07.568214 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:07.568182    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:07.623120 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:07.623059    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:08.184532 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:08.184501    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:08.234305 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:08.234274    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:08.738954 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:08.738916    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:23:08.739418 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:08.738925    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:23:08.739418 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:08.739027    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:23:08.739418 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:08.739049    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:23:08.739418 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:08.739115    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:23:08.739418 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:08.739170    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:23:10.738579 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:10.738549    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:23:10.738973 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:10.738580    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:23:10.738973 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:10.738668    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:23:10.738973 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:10.738705    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:23:10.738973 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:10.738774    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:23:10.738973 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:10.738829    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:23:12.738404 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:12.738374    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:23:12.738853 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:12.738374    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:23:12.738853 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:12.738464    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:23:12.738853 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:12.738378    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:23:12.738853 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:12.738549    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:23:12.738853 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:12.738646    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:23:14.738901 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:14.738868    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:23:14.738901 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:14.738897    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:23:14.739367 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:14.738868    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:23:14.739367 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:14.738965    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6cbhf" podUID="9c8282ee-a172-4f07-a592-8637893514c8"
Sep 09 23:23:14.739367 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:14.739052    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ldkh" podUID="d746b0d0-998c-4264-8725-e909b06c30e2"
Sep 09 23:23:14.739367 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:14.739102    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gwbns" podUID="c1771623-e2e6-4795-b247-beed28567e6f"
Sep 09 23:23:15.558282 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:15.558225    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:15.753359 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:15.753284    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:15.852750 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:15.852652    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:15.953639 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:15.953611    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:16.242475 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.242413    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:16.573401 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.573325    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-34.ec2.internal" event="NodeReady"
Sep 09 23:23:16.573556 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.573416    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 23:23:16.621842 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.621810    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qgj56"]
Sep 09 23:23:16.623586 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.623570    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m5ww8"]
Sep 09 23:23:16.623717 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.623699    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgj56"
Sep 09 23:23:16.625415 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.625389    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.626339 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.626318    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c92sf\""
Sep 09 23:23:16.626435 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.626409    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 23:23:16.627342 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.627327    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 23:23:16.628061 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.628039    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 23:23:16.628181 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.628092    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 23:23:16.628181 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.628149    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vzwm7\""
Sep 09 23:23:16.628490 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.628472    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 23:23:16.628585 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.628508    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 23:23:16.634356 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.634338    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m5ww8"]
Sep 09 23:23:16.634962 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.634940    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qgj56"]
Sep 09 23:23:16.647109 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.647092    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-glpf9"]
Sep 09 23:23:16.648724 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.648710    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-glpf9"
Sep 09 23:23:16.650846 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.650821    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 23:23:16.651111 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.651094    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jdkjc\""
Sep 09 23:23:16.651667 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.651646    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 23:23:16.651777 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.651714    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 23:23:16.657406 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.657388    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z858g\" (UniqueName: \"kubernetes.io/projected/a075cc78-0534-4aae-a0fa-6bcb7ef674bc-kube-api-access-z858g\") pod \"dns-default-qgj56\" (UID: \"a075cc78-0534-4aae-a0fa-6bcb7ef674bc\") " pod="openshift-dns/dns-default-qgj56"
Sep 09 23:23:16.657480 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.657440    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a075cc78-0534-4aae-a0fa-6bcb7ef674bc-metrics-tls\") pod \"dns-default-qgj56\" (UID: \"a075cc78-0534-4aae-a0fa-6bcb7ef674bc\") " pod="openshift-dns/dns-default-qgj56"
Sep 09 23:23:16.657480 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.657464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a075cc78-0534-4aae-a0fa-6bcb7ef674bc-config-volume\") pod \"dns-default-qgj56\" (UID: \"a075cc78-0534-4aae-a0fa-6bcb7ef674bc\") " pod="openshift-dns/dns-default-qgj56"
Sep 09 23:23:16.657547 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.657489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a075cc78-0534-4aae-a0fa-6bcb7ef674bc-tmp-dir\") pod \"dns-default-qgj56\" (UID: \"a075cc78-0534-4aae-a0fa-6bcb7ef674bc\") " pod="openshift-dns/dns-default-qgj56"
Sep 09 23:23:16.659744 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.659725    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-glpf9"]
Sep 09 23:23:16.738595 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.738569    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:23:16.738770 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.738571    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:23:16.738831 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.738571    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:23:16.741484 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.741467    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 23:23:16.741666 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.741639    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 23:23:16.741792 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.741750    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 23:23:16.742036 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.742019    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6xzm9\""
Sep 09 23:23:16.742081 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.742049    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8xjv6\""
Sep 09 23:23:16.742251 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.742238    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 23:23:16.758115 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.758098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a075cc78-0534-4aae-a0fa-6bcb7ef674bc-metrics-tls\") pod \"dns-default-qgj56\" (UID: \"a075cc78-0534-4aae-a0fa-6bcb7ef674bc\") " pod="openshift-dns/dns-default-qgj56"
Sep 09 23:23:16.758436 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.758123    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdsdv\" (UniqueName: \"kubernetes.io/projected/dbb2fd75-c34f-4a5e-a9ae-4739e58b655c-kube-api-access-wdsdv\") pod \"ingress-canary-glpf9\" (UID: \"dbb2fd75-c34f-4a5e-a9ae-4739e58b655c\") " pod="openshift-ingress-canary/ingress-canary-glpf9"
Sep 09 23:23:16.758436 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.758141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a075cc78-0534-4aae-a0fa-6bcb7ef674bc-config-volume\") pod \"dns-default-qgj56\" (UID: \"a075cc78-0534-4aae-a0fa-6bcb7ef674bc\") " pod="openshift-dns/dns-default-qgj56"
Sep 09 23:23:16.758436 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.758158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cd5d867-6be3-4ec9-be93-f1fcd6e01aef-data-volume\") pod \"insights-runtime-extractor-m5ww8\" (UID: \"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef\") " pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.758436 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.758263    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8cd5d867-6be3-4ec9-be93-f1fcd6e01aef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5ww8\" (UID: \"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef\") " pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.758436 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.758302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a075cc78-0534-4aae-a0fa-6bcb7ef674bc-tmp-dir\") pod \"dns-default-qgj56\" (UID: \"a075cc78-0534-4aae-a0fa-6bcb7ef674bc\") " pod="openshift-dns/dns-default-qgj56"
Sep 09 23:23:16.758436 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.758361    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8cd5d867-6be3-4ec9-be93-f1fcd6e01aef-crio-socket\") pod \"insights-runtime-extractor-m5ww8\" (UID: \"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef\") " pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.758436 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.758383    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8cd5d867-6be3-4ec9-be93-f1fcd6e01aef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5ww8\" (UID: \"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef\") " pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.758436 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.758406    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdzqs\" (UniqueName: \"kubernetes.io/projected/8cd5d867-6be3-4ec9-be93-f1fcd6e01aef-kube-api-access-zdzqs\") pod \"insights-runtime-extractor-m5ww8\" (UID: \"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef\") " pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.758872 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.758479    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z858g\" (UniqueName: \"kubernetes.io/projected/a075cc78-0534-4aae-a0fa-6bcb7ef674bc-kube-api-access-z858g\") pod \"dns-default-qgj56\" (UID: \"a075cc78-0534-4aae-a0fa-6bcb7ef674bc\") " pod="openshift-dns/dns-default-qgj56"
Sep 09 23:23:16.758872 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.758563    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbb2fd75-c34f-4a5e-a9ae-4739e58b655c-cert\") pod \"ingress-canary-glpf9\" (UID: \"dbb2fd75-c34f-4a5e-a9ae-4739e58b655c\") " pod="openshift-ingress-canary/ingress-canary-glpf9"
Sep 09 23:23:16.758872 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.758598    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a075cc78-0534-4aae-a0fa-6bcb7ef674bc-tmp-dir\") pod \"dns-default-qgj56\" (UID: \"a075cc78-0534-4aae-a0fa-6bcb7ef674bc\") " pod="openshift-dns/dns-default-qgj56"
Sep 09 23:23:16.758872 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.758864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a075cc78-0534-4aae-a0fa-6bcb7ef674bc-config-volume\") pod \"dns-default-qgj56\" (UID: \"a075cc78-0534-4aae-a0fa-6bcb7ef674bc\") " pod="openshift-dns/dns-default-qgj56"
Sep 09 23:23:16.761964 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.761947    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a075cc78-0534-4aae-a0fa-6bcb7ef674bc-metrics-tls\") pod \"dns-default-qgj56\" (UID: \"a075cc78-0534-4aae-a0fa-6bcb7ef674bc\") " pod="openshift-dns/dns-default-qgj56"
Sep 09 23:23:16.766747 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.766725    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z858g\" (UniqueName: \"kubernetes.io/projected/a075cc78-0534-4aae-a0fa-6bcb7ef674bc-kube-api-access-z858g\") pod \"dns-default-qgj56\" (UID: \"a075cc78-0534-4aae-a0fa-6bcb7ef674bc\") " pod="openshift-dns/dns-default-qgj56"
Sep 09 23:23:16.809092 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.809068    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:16.859887 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.859831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8cd5d867-6be3-4ec9-be93-f1fcd6e01aef-crio-socket\") pod \"insights-runtime-extractor-m5ww8\" (UID: \"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef\") " pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.859887 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.859867    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8cd5d867-6be3-4ec9-be93-f1fcd6e01aef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5ww8\" (UID: \"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef\") " pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.859887 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.859885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdzqs\" (UniqueName: \"kubernetes.io/projected/8cd5d867-6be3-4ec9-be93-f1fcd6e01aef-kube-api-access-zdzqs\") pod \"insights-runtime-extractor-m5ww8\" (UID: \"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef\") " pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.860065 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.859961    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8cd5d867-6be3-4ec9-be93-f1fcd6e01aef-crio-socket\") pod \"insights-runtime-extractor-m5ww8\" (UID: \"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef\") " pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.860154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.860139    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbb2fd75-c34f-4a5e-a9ae-4739e58b655c-cert\") pod \"ingress-canary-glpf9\" (UID: \"dbb2fd75-c34f-4a5e-a9ae-4739e58b655c\") " pod="openshift-ingress-canary/ingress-canary-glpf9"
Sep 09 23:23:16.860224 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.860171    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdsdv\" (UniqueName: \"kubernetes.io/projected/dbb2fd75-c34f-4a5e-a9ae-4739e58b655c-kube-api-access-wdsdv\") pod \"ingress-canary-glpf9\" (UID: \"dbb2fd75-c34f-4a5e-a9ae-4739e58b655c\") " pod="openshift-ingress-canary/ingress-canary-glpf9"
Sep 09 23:23:16.860351 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.860322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cd5d867-6be3-4ec9-be93-f1fcd6e01aef-data-volume\") pod \"insights-runtime-extractor-m5ww8\" (UID: \"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef\") " pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.860351 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.860341    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8cd5d867-6be3-4ec9-be93-f1fcd6e01aef-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5ww8\" (UID: \"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef\") " pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.860464 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.860380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8cd5d867-6be3-4ec9-be93-f1fcd6e01aef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5ww8\" (UID: \"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef\") " pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.860576 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.860561    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8cd5d867-6be3-4ec9-be93-f1fcd6e01aef-data-volume\") pod \"insights-runtime-extractor-m5ww8\" (UID: \"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef\") " pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.862326 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.862308    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbb2fd75-c34f-4a5e-a9ae-4739e58b655c-cert\") pod \"ingress-canary-glpf9\" (UID: \"dbb2fd75-c34f-4a5e-a9ae-4739e58b655c\") " pod="openshift-ingress-canary/ingress-canary-glpf9"
Sep 09 23:23:16.862414 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.862393    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8cd5d867-6be3-4ec9-be93-f1fcd6e01aef-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5ww8\" (UID: \"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef\") " pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.895863 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.895831    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdzqs\" (UniqueName: \"kubernetes.io/projected/8cd5d867-6be3-4ec9-be93-f1fcd6e01aef-kube-api-access-zdzqs\") pod \"insights-runtime-extractor-m5ww8\" (UID: \"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef\") " pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.896452 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.896434    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdsdv\" (UniqueName: \"kubernetes.io/projected/dbb2fd75-c34f-4a5e-a9ae-4739e58b655c-kube-api-access-wdsdv\") pod \"ingress-canary-glpf9\" (UID: \"dbb2fd75-c34f-4a5e-a9ae-4739e58b655c\") " pod="openshift-ingress-canary/ingress-canary-glpf9"
Sep 09 23:23:16.934380 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.934359    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgj56"
Sep 09 23:23:16.940877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.940805    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m5ww8"
Sep 09 23:23:16.956580 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.956557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-glpf9"
Sep 09 23:23:16.959976 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:16.959951    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:17.217920 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:17.217851    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qgj56"]
Sep 09 23:23:17.221026 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:17.220984    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m5ww8"]
Sep 09 23:23:17.221718 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:23:17.221690    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda075cc78_0534_4aae_a0fa_6bcb7ef674bc.slice/crio-461bab5fa64c27afadc7f6ba7517f3172d92b235d9df8c17794638585e5e188c WatchSource:0}: Error finding container 461bab5fa64c27afadc7f6ba7517f3172d92b235d9df8c17794638585e5e188c: Status 404 returned error can't find the container with id 461bab5fa64c27afadc7f6ba7517f3172d92b235d9df8c17794638585e5e188c
Sep 09 23:23:17.225228 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:23:17.225197    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd5d867_6be3_4ec9_be93_f1fcd6e01aef.slice/crio-f7d08d28fb57d57ae9c03e46878f6cb8d0ad011147ce060ab07d199b1d160e94 WatchSource:0}: Error finding container f7d08d28fb57d57ae9c03e46878f6cb8d0ad011147ce060ab07d199b1d160e94: Status 404 returned error can't find the container with id f7d08d28fb57d57ae9c03e46878f6cb8d0ad011147ce060ab07d199b1d160e94
Sep 09 23:23:17.250262 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:17.250236    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-glpf9"]
Sep 09 23:23:17.253531 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:23:17.253496    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb2fd75_c34f_4a5e_a9ae_4739e58b655c.slice/crio-16b97ac7e5fd0943c8b912701c4dbd88e4938d17a1e39508e8ebce4483a9c46f WatchSource:0}: Error finding container 16b97ac7e5fd0943c8b912701c4dbd88e4938d17a1e39508e8ebce4483a9c46f: Status 404 returned error can't find the container with id 16b97ac7e5fd0943c8b912701c4dbd88e4938d17a1e39508e8ebce4483a9c46f
Sep 09 23:23:18.092593 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:18.092553    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5ww8" event={"ID":"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef","Type":"ContainerStarted","Data":"460a93a55a235c92565e24b93e6be1f0a99ec68114d7dc7203f92470ed68633b"}
Sep 09 23:23:18.093155 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:18.092658    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5ww8" event={"ID":"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef","Type":"ContainerStarted","Data":"33dcc8ae671603fc8f330be0d6028ca0f8e98cba4024c82645d28fb28c3865c4"}
Sep 09 23:23:18.093155 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:18.092707    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5ww8" event={"ID":"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef","Type":"ContainerStarted","Data":"f7d08d28fb57d57ae9c03e46878f6cb8d0ad011147ce060ab07d199b1d160e94"}
Sep 09 23:23:18.094712 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:18.094574    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgj56" event={"ID":"a075cc78-0534-4aae-a0fa-6bcb7ef674bc","Type":"ContainerStarted","Data":"461bab5fa64c27afadc7f6ba7517f3172d92b235d9df8c17794638585e5e188c"}
Sep 09 23:23:18.096154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:18.096097    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-glpf9" event={"ID":"dbb2fd75-c34f-4a5e-a9ae-4739e58b655c","Type":"ContainerStarted","Data":"16b97ac7e5fd0943c8b912701c4dbd88e4938d17a1e39508e8ebce4483a9c46f"}
Sep 09 23:23:20.105138 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:20.105075    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-glpf9" event={"ID":"dbb2fd75-c34f-4a5e-a9ae-4739e58b655c","Type":"ContainerStarted","Data":"8f7ddd1b381c30af9c06530f1a756f4088db0060c86b924b6aabf1d32957252c"}
Sep 09 23:23:20.108539 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:20.108473    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5ww8" event={"ID":"8cd5d867-6be3-4ec9-be93-f1fcd6e01aef","Type":"ContainerStarted","Data":"3a8513b1b9a3dd5dcf9d45bb57edcdef3e40c90b10886e08dcb9ff4df9a4a901"}
Sep 09 23:23:20.110225 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:20.110196    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:20.110494 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:20.110468    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgj56" event={"ID":"a075cc78-0534-4aae-a0fa-6bcb7ef674bc","Type":"ContainerStarted","Data":"5bd62306775c2402e0cd61a45d7bc611beadfb36ca09eb064b18baa6826ace50"}
Sep 09 23:23:20.147132 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:20.147076    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m5ww8" podStartSLOduration=1.5008664619999998 podStartE2EDuration="4.147054242s" totalImagesPullingTime="2.64618778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:23:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:20.146278641 +0000 UTC m=+56.885001450" watchObservedRunningTime="2026-09-09 23:23:20.147054242 +0000 UTC m=+56.885777052"
Sep 09 23:23:20.147309 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:20.147229    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-glpf9" podStartSLOduration=1.402657807 podStartE2EDuration="4.14721987s" totalImagesPullingTime="2.744562063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:20.124914532 +0000 UTC m=+56.863637342" watchObservedRunningTime="2026-09-09 23:23:20.14721987 +0000 UTC m=+56.885942676"
Sep 09 23:23:20.218219 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:20.218189    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:20.360435 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:20.360354    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-76mwn"]
Sep 09 23:23:20.362375 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:20.362360    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-76mwn"
Sep 09 23:23:20.364905 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:20.364883    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 09 23:23:20.364999 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:20.364939    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-t5stp\""
Sep 09 23:23:20.375944 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:20.375895    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-76mwn"]
Sep 09 23:23:20.403811 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:20.403786    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:20.491910 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:20.491883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8d676199-e179-4d0e-a0e4-06cd739711a3-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-76mwn\" (UID: \"8d676199-e179-4d0e-a0e4-06cd739711a3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-76mwn"
Sep 09 23:23:20.592484 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:20.592457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8d676199-e179-4d0e-a0e4-06cd739711a3-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-76mwn\" (UID: \"8d676199-e179-4d0e-a0e4-06cd739711a3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-76mwn"
Sep 09 23:23:20.592594 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:20.592579    2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 09 23:23:20.592653 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:20.592634    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d676199-e179-4d0e-a0e4-06cd739711a3-tls-certificates podName:8d676199-e179-4d0e-a0e4-06cd739711a3 nodeName:}" failed. No retries permitted until 2026-09-09 23:23:21.09262029 +0000 UTC m=+57.831343078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8d676199-e179-4d0e-a0e4-06cd739711a3-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-76mwn" (UID: "8d676199-e179-4d0e-a0e4-06cd739711a3") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 09 23:23:20.993235 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:20.993206    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:21.095840 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:21.095812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8d676199-e179-4d0e-a0e4-06cd739711a3-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-76mwn\" (UID: \"8d676199-e179-4d0e-a0e4-06cd739711a3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-76mwn"
Sep 09 23:23:21.098059 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:21.098037    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8d676199-e179-4d0e-a0e4-06cd739711a3-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-76mwn\" (UID: \"8d676199-e179-4d0e-a0e4-06cd739711a3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-76mwn"
Sep 09 23:23:21.117489 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:21.117456    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgj56" event={"ID":"a075cc78-0534-4aae-a0fa-6bcb7ef674bc","Type":"ContainerStarted","Data":"35c43611fa1a0ae00de23351d0a51bf46ab7b91b6d45bb2679af5e161df0f6ca"}
Sep 09 23:23:21.124538 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:21.124514    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:21.139031 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:21.138997    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qgj56" podStartSLOduration=2.369734646 podStartE2EDuration="5.138983501s" totalImagesPullingTime="2.769248855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:21.138284898 +0000 UTC m=+57.877007706" watchObservedRunningTime="2026-09-09 23:23:21.138983501 +0000 UTC m=+57.877706289"
Sep 09 23:23:21.270504 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:21.270428    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-76mwn"
Sep 09 23:23:21.539335 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:21.539139    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-76mwn"]
Sep 09 23:23:21.541734 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:23:21.541704    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d676199_e179_4d0e_a0e4_06cd739711a3.slice/crio-94d0ef5965dc702d386132d84649a2856d768422d4aaba7eb1cdf2bb5598d36c WatchSource:0}: Error finding container 94d0ef5965dc702d386132d84649a2856d768422d4aaba7eb1cdf2bb5598d36c: Status 404 returned error can't find the container with id 94d0ef5965dc702d386132d84649a2856d768422d4aaba7eb1cdf2bb5598d36c
Sep 09 23:23:22.121531 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:22.121496    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-76mwn" event={"ID":"8d676199-e179-4d0e-a0e4-06cd739711a3","Type":"ContainerStarted","Data":"94d0ef5965dc702d386132d84649a2856d768422d4aaba7eb1cdf2bb5598d36c"}
Sep 09 23:23:22.122004 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:22.121709    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qgj56"
Sep 09 23:23:23.126033 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.125999    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-76mwn" event={"ID":"8d676199-e179-4d0e-a0e4-06cd739711a3","Type":"ContainerStarted","Data":"e451f0d825e38e2950a9db46f59582b9aedea1a770c0c46770c270140c295813"}
Sep 09 23:23:23.126456 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.126227    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-76mwn"
Sep 09 23:23:23.130642 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.130618    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-76mwn"
Sep 09 23:23:23.139572 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.139539    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-76mwn" podStartSLOduration=1.78340713 podStartE2EDuration="3.139524745s" totalImagesPullingTime="1.356117615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:23.13937843 +0000 UTC m=+59.878101238" watchObservedRunningTime="2026-09-09 23:23:23.139524745 +0000 UTC m=+59.878247548"
Sep 09 23:23:23.340501 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.340458    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:23.371612 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.371587    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"]
Sep 09 23:23:23.373341 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.373326    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"
Sep 09 23:23:23.376194 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.376170    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 09 23:23:23.376279 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.376175    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 23:23:23.376279 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.376177    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 23:23:23.376488 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.376466    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 09 23:23:23.376583 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.376478    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 23:23:23.376583 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.376553    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-w4mdq\""
Sep 09 23:23:23.385437 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.385420    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"]
Sep 09 23:23:23.405962 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.405937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:23.513733 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.513702    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e39063e-15fb-42c7-a026-dc2d9cd9644e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-r8ld6\" (UID: \"1e39063e-15fb-42c7-a026-dc2d9cd9644e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"
Sep 09 23:23:23.513840 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.513740    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e39063e-15fb-42c7-a026-dc2d9cd9644e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-r8ld6\" (UID: \"1e39063e-15fb-42c7-a026-dc2d9cd9644e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"
Sep 09 23:23:23.513840 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.513816    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e39063e-15fb-42c7-a026-dc2d9cd9644e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-r8ld6\" (UID: \"1e39063e-15fb-42c7-a026-dc2d9cd9644e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"
Sep 09 23:23:23.513903 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.513875    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g8xd\" (UniqueName: \"kubernetes.io/projected/1e39063e-15fb-42c7-a026-dc2d9cd9644e-kube-api-access-8g8xd\") pod \"prometheus-operator-6f4946db56-r8ld6\" (UID: \"1e39063e-15fb-42c7-a026-dc2d9cd9644e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"
Sep 09 23:23:23.614834 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.614202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g8xd\" (UniqueName: \"kubernetes.io/projected/1e39063e-15fb-42c7-a026-dc2d9cd9644e-kube-api-access-8g8xd\") pod \"prometheus-operator-6f4946db56-r8ld6\" (UID: \"1e39063e-15fb-42c7-a026-dc2d9cd9644e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"
Sep 09 23:23:23.614834 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.614266    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e39063e-15fb-42c7-a026-dc2d9cd9644e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-r8ld6\" (UID: \"1e39063e-15fb-42c7-a026-dc2d9cd9644e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"
Sep 09 23:23:23.614834 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.614293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e39063e-15fb-42c7-a026-dc2d9cd9644e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-r8ld6\" (UID: \"1e39063e-15fb-42c7-a026-dc2d9cd9644e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"
Sep 09 23:23:23.614834 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.614351    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e39063e-15fb-42c7-a026-dc2d9cd9644e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-r8ld6\" (UID: \"1e39063e-15fb-42c7-a026-dc2d9cd9644e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"
Sep 09 23:23:23.618813 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.618790    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 09 23:23:23.618947 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.618856    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 23:23:23.618947 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.618915    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 09 23:23:23.623949 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.623931    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 23:23:23.625618 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.625596    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e39063e-15fb-42c7-a026-dc2d9cd9644e-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-r8ld6\" (UID: \"1e39063e-15fb-42c7-a026-dc2d9cd9644e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"
Sep 09 23:23:23.627228 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.627204    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e39063e-15fb-42c7-a026-dc2d9cd9644e-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-r8ld6\" (UID: \"1e39063e-15fb-42c7-a026-dc2d9cd9644e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"
Sep 09 23:23:23.627331 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.627230    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e39063e-15fb-42c7-a026-dc2d9cd9644e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-r8ld6\" (UID: \"1e39063e-15fb-42c7-a026-dc2d9cd9644e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"
Sep 09 23:23:23.635267 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.635247    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 23:23:23.645352 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.645328    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g8xd\" (UniqueName: \"kubernetes.io/projected/1e39063e-15fb-42c7-a026-dc2d9cd9644e-kube-api-access-8g8xd\") pod \"prometheus-operator-6f4946db56-r8ld6\" (UID: \"1e39063e-15fb-42c7-a026-dc2d9cd9644e\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"
Sep 09 23:23:23.661400 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.661380    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:23.684466 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.684444    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-w4mdq\""
Sep 09 23:23:23.692345 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.692328    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"
Sep 09 23:23:23.956559 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:23.956490    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-r8ld6"]
Sep 09 23:23:23.959962 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:23:23.959940    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e39063e_15fb_42c7_a026_dc2d9cd9644e.slice/crio-dffda654a0b01418f238f13f7e3648ffd5b9cf88e12b06bbbb5530b0cf051a01 WatchSource:0}: Error finding container dffda654a0b01418f238f13f7e3648ffd5b9cf88e12b06bbbb5530b0cf051a01: Status 404 returned error can't find the container with id dffda654a0b01418f238f13f7e3648ffd5b9cf88e12b06bbbb5530b0cf051a01
Sep 09 23:23:24.035580 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:24.035558    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5m2q9"
Sep 09 23:23:24.130232 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:24.130195    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6" event={"ID":"1e39063e-15fb-42c7-a026-dc2d9cd9644e","Type":"ContainerStarted","Data":"dffda654a0b01418f238f13f7e3648ffd5b9cf88e12b06bbbb5530b0cf051a01"}
Sep 09 23:23:24.219024 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:24.218943    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:24.320366 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:24.320333    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:25.416956 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:25.416886    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:26.141381 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:26.141345    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6" event={"ID":"1e39063e-15fb-42c7-a026-dc2d9cd9644e","Type":"ContainerStarted","Data":"88e01f0108b82ffdeb539db4120dcca5e34cda2f36403447b14445127f0024be"}
Sep 09 23:23:26.141549 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:26.141420    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6" event={"ID":"1e39063e-15fb-42c7-a026-dc2d9cd9644e","Type":"ContainerStarted","Data":"399c0772314e987ab4eeb2088a5d4c41024809d15117836f600896d0649c51f1"}
Sep 09 23:23:26.157124 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:26.157075    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-r8ld6" podStartSLOduration=2.012243364 podStartE2EDuration="3.157060887s" totalImagesPullingTime="1.144817523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:26.156214405 +0000 UTC m=+62.894937214" watchObservedRunningTime="2026-09-09 23:23:26.157060887 +0000 UTC m=+62.895783696"
Sep 09 23:23:26.535062 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:26.535035    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:26.596729 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:26.596695    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:27.468620 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.468577    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:27.698113 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.698051    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:27.744891 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.744861    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"]
Sep 09 23:23:27.747029 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.747009    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.749100 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.749075    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 09 23:23:27.749201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.749075    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 09 23:23:27.749258 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.749244    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 09 23:23:27.749362 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.749349    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gt7td\""
Sep 09 23:23:27.754805 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.754784    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-96r89"]
Sep 09 23:23:27.756748 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.756727    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.758484 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.758462    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"]
Sep 09 23:23:27.758780 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.758761    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 23:23:27.758912 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.758895    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-89p5w\""
Sep 09 23:23:27.758970 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.758915    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 23:23:27.759011 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.758899    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 23:23:27.781383 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.781356    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:27.843991 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.843963    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:27.845027 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.845006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/346b0488-bb51-4bf6-b4f4-575be946928f-sys\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.845136 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.845061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8df005d-478a-4289-87bb-48842c63039e-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.845136 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.845086    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/346b0488-bb51-4bf6-b4f4-575be946928f-metrics-client-ca\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.845258 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.845138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/346b0488-bb51-4bf6-b4f4-575be946928f-node-exporter-textfile\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.845258 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.845219    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8df005d-478a-4289-87bb-48842c63039e-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.845339 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.845265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/346b0488-bb51-4bf6-b4f4-575be946928f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.845339 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.845321    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/346b0488-bb51-4bf6-b4f4-575be946928f-node-exporter-tls\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.845403 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.845347    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b8df005d-478a-4289-87bb-48842c63039e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.845403 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.845381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m85f\" (UniqueName: \"kubernetes.io/projected/b8df005d-478a-4289-87bb-48842c63039e-kube-api-access-8m85f\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.845403 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.845398    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/346b0488-bb51-4bf6-b4f4-575be946928f-node-exporter-wtmp\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.845493 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.845420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/346b0488-bb51-4bf6-b4f4-575be946928f-node-exporter-accelerators-collector-config\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.845493 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.845444    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b8df005d-478a-4289-87bb-48842c63039e-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.845493 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.845460    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8df005d-478a-4289-87bb-48842c63039e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.845493 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.845474    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/346b0488-bb51-4bf6-b4f4-575be946928f-root\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.845632 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.845496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkz4l\" (UniqueName: \"kubernetes.io/projected/346b0488-bb51-4bf6-b4f4-575be946928f-kube-api-access-bkz4l\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.946778 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.946745    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/346b0488-bb51-4bf6-b4f4-575be946928f-node-exporter-textfile\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.946918 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.946796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8df005d-478a-4289-87bb-48842c63039e-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.946955 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.946916    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/346b0488-bb51-4bf6-b4f4-575be946928f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.946998 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.946955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/346b0488-bb51-4bf6-b4f4-575be946928f-node-exporter-tls\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.947111 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b8df005d-478a-4289-87bb-48842c63039e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.947189 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947112    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/346b0488-bb51-4bf6-b4f4-575be946928f-node-exporter-textfile\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.947189 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m85f\" (UniqueName: \"kubernetes.io/projected/b8df005d-478a-4289-87bb-48842c63039e-kube-api-access-8m85f\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.947189 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947177    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/346b0488-bb51-4bf6-b4f4-575be946928f-node-exporter-wtmp\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.947337 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/346b0488-bb51-4bf6-b4f4-575be946928f-node-exporter-accelerators-collector-config\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.947337 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b8df005d-478a-4289-87bb-48842c63039e-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.947440 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947347    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/346b0488-bb51-4bf6-b4f4-575be946928f-node-exporter-wtmp\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.947440 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947389    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8df005d-478a-4289-87bb-48842c63039e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.947440 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/346b0488-bb51-4bf6-b4f4-575be946928f-root\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.947590 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkz4l\" (UniqueName: \"kubernetes.io/projected/346b0488-bb51-4bf6-b4f4-575be946928f-kube-api-access-bkz4l\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.947590 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/346b0488-bb51-4bf6-b4f4-575be946928f-sys\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.947590 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8df005d-478a-4289-87bb-48842c63039e-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.947590 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947541    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8df005d-478a-4289-87bb-48842c63039e-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.947590 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/346b0488-bb51-4bf6-b4f4-575be946928f-metrics-client-ca\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.947869 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947633    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/346b0488-bb51-4bf6-b4f4-575be946928f-root\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.947869 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:27.947655    2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 09 23:23:27.947869 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947784    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/346b0488-bb51-4bf6-b4f4-575be946928f-node-exporter-accelerators-collector-config\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.947869 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947818    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b8df005d-478a-4289-87bb-48842c63039e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.947869 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.947830    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/346b0488-bb51-4bf6-b4f4-575be946928f-sys\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.947869 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:23:27.947855    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8df005d-478a-4289-87bb-48842c63039e-kube-state-metrics-tls podName:b8df005d-478a-4289-87bb-48842c63039e nodeName:}" failed. No retries permitted until 2026-09-09 23:23:28.447834089 +0000 UTC m=+65.186556878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b8df005d-478a-4289-87bb-48842c63039e-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-hwshn" (UID: "b8df005d-478a-4289-87bb-48842c63039e") : secret "kube-state-metrics-tls" not found
Sep 09 23:23:27.948130 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.948110    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b8df005d-478a-4289-87bb-48842c63039e-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.948130 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.948121    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/346b0488-bb51-4bf6-b4f4-575be946928f-metrics-client-ca\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.949467 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.949439    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/346b0488-bb51-4bf6-b4f4-575be946928f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.949562 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.949527    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/346b0488-bb51-4bf6-b4f4-575be946928f-node-exporter-tls\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.949988 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.949967    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8df005d-478a-4289-87bb-48842c63039e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:27.955391 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.955369    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkz4l\" (UniqueName: \"kubernetes.io/projected/346b0488-bb51-4bf6-b4f4-575be946928f-kube-api-access-bkz4l\") pod \"node-exporter-96r89\" (UID: \"346b0488-bb51-4bf6-b4f4-575be946928f\") " pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:27.955523 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:27.955506    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m85f\" (UniqueName: \"kubernetes.io/projected/b8df005d-478a-4289-87bb-48842c63039e-kube-api-access-8m85f\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:28.007230 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.007134    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:28.065515 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.065480    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-96r89"
Sep 09 23:23:28.074806 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:23:28.074780    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346b0488_bb51_4bf6_b4f4_575be946928f.slice/crio-263e1e1a053c6827a44092d2270b3e4a1efb272d1d85e2bea3af62015b6f8074 WatchSource:0}: Error finding container 263e1e1a053c6827a44092d2270b3e4a1efb272d1d85e2bea3af62015b6f8074: Status 404 returned error can't find the container with id 263e1e1a053c6827a44092d2270b3e4a1efb272d1d85e2bea3af62015b6f8074
Sep 09 23:23:28.108095 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.108070    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:28.148585 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.148555    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96r89" event={"ID":"346b0488-bb51-4bf6-b4f4-575be946928f","Type":"ContainerStarted","Data":"263e1e1a053c6827a44092d2270b3e4a1efb272d1d85e2bea3af62015b6f8074"}
Sep 09 23:23:28.208940 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.208901    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:28.335605 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.335514    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:28.450256 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.450224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs\") pod \"network-metrics-daemon-5ldkh\" (UID: \"d746b0d0-998c-4264-8725-e909b06c30e2\") " pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:23:28.450392 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.450259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8df005d-478a-4289-87bb-48842c63039e-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:28.450392 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.450308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret\") pod \"global-pull-secret-syncer-6cbhf\" (UID: \"9c8282ee-a172-4f07-a592-8637893514c8\") " pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:23:28.452330 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.452308    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 23:23:28.452441 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.452354    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 23:23:28.452656 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.452640    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8df005d-478a-4289-87bb-48842c63039e-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-hwshn\" (UID: \"b8df005d-478a-4289-87bb-48842c63039e\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:28.463120 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.463096    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d746b0d0-998c-4264-8725-e909b06c30e2-metrics-certs\") pod \"network-metrics-daemon-5ldkh\" (UID: \"d746b0d0-998c-4264-8725-e909b06c30e2\") " pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:23:28.463206 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.463133    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9c8282ee-a172-4f07-a592-8637893514c8-original-pull-secret\") pod \"global-pull-secret-syncer-6cbhf\" (UID: \"9c8282ee-a172-4f07-a592-8637893514c8\") " pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:23:28.525286 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.525248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:28.652225 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.652141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8sfn\" (UniqueName: \"kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn\") pod \"network-check-target-gwbns\" (UID: \"c1771623-e2e6-4795-b247-beed28567e6f\") " pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:23:28.654526 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.654484    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 23:23:28.655520 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.655496    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"
Sep 09 23:23:28.664979 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.664716    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 23:23:28.677763 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.677741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8sfn\" (UniqueName: \"kubernetes.io/projected/c1771623-e2e6-4795-b247-beed28567e6f-kube-api-access-x8sfn\") pod \"network-check-target-gwbns\" (UID: \"c1771623-e2e6-4795-b247-beed28567e6f\") " pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:23:28.695816 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.695788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:28.747819 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.747785    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6cbhf"
Sep 09 23:23:28.755025 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.754995    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8xjv6\""
Sep 09 23:23:28.759395 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.759377    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6xzm9\""
Sep 09 23:23:28.762968 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.762949    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:23:28.767817 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.767793    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ldkh"
Sep 09 23:23:28.768171 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.768145    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:28.934911 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:28.934883    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-hwshn"]
Sep 09 23:23:28.937296 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:23:28.937272    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8df005d_478a_4289_87bb_48842c63039e.slice/crio-862a344fdfd610f321dab2b8383f5bda2cb6f66ab51f20ec4a221efe89ec1ed5 WatchSource:0}: Error finding container 862a344fdfd610f321dab2b8383f5bda2cb6f66ab51f20ec4a221efe89ec1ed5: Status 404 returned error can't find the container with id 862a344fdfd610f321dab2b8383f5bda2cb6f66ab51f20ec4a221efe89ec1ed5
Sep 09 23:23:29.048624 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:29.048546    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6cbhf"]
Sep 09 23:23:29.073643 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:29.073608    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gwbns"]
Sep 09 23:23:29.103863 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:29.103022    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5ldkh"]
Sep 09 23:23:29.139298 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:29.139265    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:29.156296 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:29.156260    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn" event={"ID":"b8df005d-478a-4289-87bb-48842c63039e","Type":"ContainerStarted","Data":"862a344fdfd610f321dab2b8383f5bda2cb6f66ab51f20ec4a221efe89ec1ed5"}
Sep 09 23:23:29.271601 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:23:29.271564    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd746b0d0_998c_4264_8725_e909b06c30e2.slice/crio-3ba382ab3e1eae1e97561b409aec06d2eea00db3fe311848fdbdff12c656cf5a WatchSource:0}: Error finding container 3ba382ab3e1eae1e97561b409aec06d2eea00db3fe311848fdbdff12c656cf5a: Status 404 returned error can't find the container with id 3ba382ab3e1eae1e97561b409aec06d2eea00db3fe311848fdbdff12c656cf5a
Sep 09 23:23:29.272562 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:23:29.272533    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c8282ee_a172_4f07_a592_8637893514c8.slice/crio-634f5385ab0ed2befc6d9b243ae31db3d02326388c90324ff86cf291f374232d WatchSource:0}: Error finding container 634f5385ab0ed2befc6d9b243ae31db3d02326388c90324ff86cf291f374232d: Status 404 returned error can't find the container with id 634f5385ab0ed2befc6d9b243ae31db3d02326388c90324ff86cf291f374232d
Sep 09 23:23:29.273431 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:23:29.273374    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1771623_e2e6_4795_b247_beed28567e6f.slice/crio-124b4d4b12c100a61e71e9068aa6cb7c5481fac79a2afd4b27cdbad9b73b2f90 WatchSource:0}: Error finding container 124b4d4b12c100a61e71e9068aa6cb7c5481fac79a2afd4b27cdbad9b73b2f90: Status 404 returned error can't find the container with id 124b4d4b12c100a61e71e9068aa6cb7c5481fac79a2afd4b27cdbad9b73b2f90
Sep 09 23:23:30.162388 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:30.162350    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gwbns" event={"ID":"c1771623-e2e6-4795-b247-beed28567e6f","Type":"ContainerStarted","Data":"124b4d4b12c100a61e71e9068aa6cb7c5481fac79a2afd4b27cdbad9b73b2f90"}
Sep 09 23:23:30.164770 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:30.164740    2581 generic.go:356] "Generic (PLEG): container finished" podID="346b0488-bb51-4bf6-b4f4-575be946928f" containerID="9411fd0e0d59e4c290254857a650699bddd4d7ca0e76af0c518b41508b04d0b6" exitCode=0
Sep 09 23:23:30.164907 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:30.164871    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96r89" event={"ID":"346b0488-bb51-4bf6-b4f4-575be946928f","Type":"ContainerDied","Data":"9411fd0e0d59e4c290254857a650699bddd4d7ca0e76af0c518b41508b04d0b6"}
Sep 09 23:23:30.166839 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:30.166776    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6cbhf" event={"ID":"9c8282ee-a172-4f07-a592-8637893514c8","Type":"ContainerStarted","Data":"634f5385ab0ed2befc6d9b243ae31db3d02326388c90324ff86cf291f374232d"}
Sep 09 23:23:30.168847 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:30.168822    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5ldkh" event={"ID":"d746b0d0-998c-4264-8725-e909b06c30e2","Type":"ContainerStarted","Data":"3ba382ab3e1eae1e97561b409aec06d2eea00db3fe311848fdbdff12c656cf5a"}
Sep 09 23:23:30.620953 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:30.620874    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:30.694160 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:30.694087    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:30.817709 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:30.817658    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:30.978325 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:30.978295    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:31.178204 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:31.178175    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96r89" event={"ID":"346b0488-bb51-4bf6-b4f4-575be946928f","Type":"ContainerStarted","Data":"01355fde9d9f2cca022313f0befe3f44fbad58a07f31e190520e7b1cf38b91a9"}
Sep 09 23:23:31.178628 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:31.178241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96r89" event={"ID":"346b0488-bb51-4bf6-b4f4-575be946928f","Type":"ContainerStarted","Data":"ce01c66c564ae59e72a13865b2e193d832cd13349e9330be3493d8a97ce07c61"}
Sep 09 23:23:31.181705 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:31.181614    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5ldkh" event={"ID":"d746b0d0-998c-4264-8725-e909b06c30e2","Type":"ContainerStarted","Data":"8abdfce96d99123c528a8f1370bb7075075434ba973961bb8cc18fe4d34fa5d5"}
Sep 09 23:23:31.181705 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:31.181662    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5ldkh" event={"ID":"d746b0d0-998c-4264-8725-e909b06c30e2","Type":"ContainerStarted","Data":"4b53c0e32c35a63e1a14d7bc31996a0d1b83e4d6164ed5a60957f40246269ebc"}
Sep 09 23:23:31.185261 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:31.185226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn" event={"ID":"b8df005d-478a-4289-87bb-48842c63039e","Type":"ContainerStarted","Data":"eb6287d09f93523e2a082a9b42f36f85faa94be4c452f2577102fe6824c1c6b7"}
Sep 09 23:23:31.185366 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:31.185286    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn" event={"ID":"b8df005d-478a-4289-87bb-48842c63039e","Type":"ContainerStarted","Data":"f7b4da3e53e516eef445b1a92cb781bcc72fd5cb7ac309da02d071179ccc5546"}
Sep 09 23:23:31.185366 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:31.185333    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn" event={"ID":"b8df005d-478a-4289-87bb-48842c63039e","Type":"ContainerStarted","Data":"43203e850b3cc32eb059d0a2a2126bc28965842e66e04b1a4c0548ba4affc4b2"}
Sep 09 23:23:31.198967 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:31.198751    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-96r89" podStartSLOduration=2.5431868140000002 podStartE2EDuration="4.198729465s" totalImagesPullingTime="1.553165492s" totalInitContainerRuntime="102.377159ms" isStatefulPod=true podCreationTimestamp="2026-09-09 23:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:31.196104814 +0000 UTC m=+67.934827624" watchObservedRunningTime="2026-09-09 23:23:31.198729465 +0000 UTC m=+67.937452273"
Sep 09 23:23:31.212778 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:31.212725    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5ldkh" podStartSLOduration=65.631960353 podStartE2EDuration="1m7.212704815s" totalImagesPullingTime="1.580744462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:31.211802484 +0000 UTC m=+67.950525293" watchObservedRunningTime="2026-09-09 23:23:31.212704815 +0000 UTC m=+67.951427627"
Sep 09 23:23:31.231164 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:31.231102    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-hwshn" podStartSLOduration=2.316763724 podStartE2EDuration="4.231081247s" totalImagesPullingTime="1.914317523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:31.230625275 +0000 UTC m=+67.969348086" watchObservedRunningTime="2026-09-09 23:23:31.231081247 +0000 UTC m=+67.969804057"
Sep 09 23:23:31.301618 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:31.301532    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:31.353984 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:31.353944    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:32.128085 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:32.128056    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qgj56"
Sep 09 23:23:32.484461 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:32.484417    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-g7w6b"]
Sep 09 23:23:32.487962 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:32.487936    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7w6b"
Sep 09 23:23:32.490571 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:32.490162    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:32.490571 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:32.490321    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sr6kx\""
Sep 09 23:23:32.490571 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:32.490417    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 09 23:23:32.501436 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:32.501411    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-g7w6b"]
Sep 09 23:23:32.584357 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:32.584322    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d6b2e84-0c7a-4fa9-8dc0-6308a0f9ec90-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-g7w6b\" (UID: \"1d6b2e84-0c7a-4fa9-8dc0-6308a0f9ec90\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7w6b"
Sep 09 23:23:32.584357 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:32.584361    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl9mg\" (UniqueName: \"kubernetes.io/projected/1d6b2e84-0c7a-4fa9-8dc0-6308a0f9ec90-kube-api-access-tl9mg\") pod \"monitoring-plugin-85bbbbbf4-g7w6b\" (UID: \"1d6b2e84-0c7a-4fa9-8dc0-6308a0f9ec90\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7w6b"
Sep 09 23:23:32.685041 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:32.685008    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d6b2e84-0c7a-4fa9-8dc0-6308a0f9ec90-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-g7w6b\" (UID: \"1d6b2e84-0c7a-4fa9-8dc0-6308a0f9ec90\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7w6b"
Sep 09 23:23:32.685041 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:32.685043    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl9mg\" (UniqueName: \"kubernetes.io/projected/1d6b2e84-0c7a-4fa9-8dc0-6308a0f9ec90-kube-api-access-tl9mg\") pod \"monitoring-plugin-85bbbbbf4-g7w6b\" (UID: \"1d6b2e84-0c7a-4fa9-8dc0-6308a0f9ec90\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7w6b"
Sep 09 23:23:32.687729 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:32.687700    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d6b2e84-0c7a-4fa9-8dc0-6308a0f9ec90-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-g7w6b\" (UID: \"1d6b2e84-0c7a-4fa9-8dc0-6308a0f9ec90\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7w6b"
Sep 09 23:23:32.693113 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:32.693087    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl9mg\" (UniqueName: \"kubernetes.io/projected/1d6b2e84-0c7a-4fa9-8dc0-6308a0f9ec90-kube-api-access-tl9mg\") pod \"monitoring-plugin-85bbbbbf4-g7w6b\" (UID: \"1d6b2e84-0c7a-4fa9-8dc0-6308a0f9ec90\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7w6b"
Sep 09 23:23:32.701107 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:32.701079    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:32.804232 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:32.804148    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7w6b"
Sep 09 23:23:33.888854 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.888820    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:23:33.892615 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.892582    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:33.892900 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.892863    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:33.894803 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.894777    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 09 23:23:33.894926 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.894835    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 09 23:23:33.895506 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.895487    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5svw5\""
Sep 09 23:23:33.895602 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.895543    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 09 23:23:33.896086 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.896064    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 09 23:23:33.896167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.896099    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 09 23:23:33.896167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.896160    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 09 23:23:33.896300 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.896286    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 09 23:23:33.896344 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.896331    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 09 23:23:33.896474 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.896461    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 09 23:23:33.896515 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.896505    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 09 23:23:33.896567 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.896526    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 09 23:23:33.896737 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.896721    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 23:23:33.896808 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.896771    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 09 23:23:33.896863 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.896818    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 09 23:23:33.897495 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.897476    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1vrh1j2jtgafv\""
Sep 09 23:23:33.899085 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.899065    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 09 23:23:33.906976 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.906908    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:23:33.997627 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.996435    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:33.997627 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.996534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:33.997627 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.996574    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-web-config\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:33.997627 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.996667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:33.997627 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.996722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-config\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:33.997627 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.996902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:33.997627 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.996931    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:33.997627 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.997117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvqwg\" (UniqueName: \"kubernetes.io/projected/f8d49f61-b61d-46e5-ae84-3c17276a99fe-kube-api-access-tvqwg\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:33.997627 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.997154    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:33.997627 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.997324    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:33.997627 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.997528    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:33.997627 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.997576    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8d49f61-b61d-46e5-ae84-3c17276a99fe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:33.998318 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.997813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.003018 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:33.997853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8d49f61-b61d-46e5-ae84-3c17276a99fe-config-out\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.003913 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.003237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.003913 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.003667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.003913 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.003715    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.003913 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.003756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.003913 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.003791    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.003913 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.003817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.105720 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.105661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.105891 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.105744    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.105891 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.105777    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.105891 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.105805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.105891 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.105828    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.105891 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.105861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-web-config\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.105891 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.105890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.105905    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-config\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.105923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.105942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.105961    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvqwg\" (UniqueName: \"kubernetes.io/projected/f8d49f61-b61d-46e5-ae84-3c17276a99fe-kube-api-access-tvqwg\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.105982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.105998    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.106013    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.106050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8d49f61-b61d-46e5-ae84-3c17276a99fe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.106074    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.106099    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8d49f61-b61d-46e5-ae84-3c17276a99fe-config-out\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.106123    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.106146    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.106157    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106797 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.106482    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106797 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.106168    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106797 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.106665    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.106797 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.106768    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.107468 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.107215    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.107468 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.107346    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.108559 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.108538    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.111728 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.111703    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.113970 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.113946    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.116585 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.114281    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-web-config\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.116585 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.114490    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.116585 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.114623    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-config\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.116585 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.114786    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8d49f61-b61d-46e5-ae84-3c17276a99fe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.116585 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.115032    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.116585 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.115113    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.116585 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.115523    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8d49f61-b61d-46e5-ae84-3c17276a99fe-config-out\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.117105 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.117082    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.117289 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.117268    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.118998 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.118967    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvqwg\" (UniqueName: \"kubernetes.io/projected/f8d49f61-b61d-46e5-ae84-3c17276a99fe-kube-api-access-tvqwg\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.119963 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.119943    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.207276 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.207014    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:34.936724 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.936700    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-g7w6b"]
Sep 09 23:23:34.939170 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:23:34.939141    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6b2e84_0c7a_4fa9_8dc0_6308a0f9ec90.slice/crio-e64014deae51b014aee94bb86d2c8e71552a0c126b62054820c1d84556ee0abb WatchSource:0}: Error finding container e64014deae51b014aee94bb86d2c8e71552a0c126b62054820c1d84556ee0abb: Status 404 returned error can't find the container with id e64014deae51b014aee94bb86d2c8e71552a0c126b62054820c1d84556ee0abb
Sep 09 23:23:34.947454 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:34.947358    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:23:34.949767 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:23:34.949744    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d49f61_b61d_46e5_ae84_3c17276a99fe.slice/crio-ad99496a5a4b066f13c757db8a4c7c5bd09fe83fe4a0e68ba07b6f3c60511050 WatchSource:0}: Error finding container ad99496a5a4b066f13c757db8a4c7c5bd09fe83fe4a0e68ba07b6f3c60511050: Status 404 returned error can't find the container with id ad99496a5a4b066f13c757db8a4c7c5bd09fe83fe4a0e68ba07b6f3c60511050
Sep 09 23:23:35.202841 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:35.202754    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gwbns" event={"ID":"c1771623-e2e6-4795-b247-beed28567e6f","Type":"ContainerStarted","Data":"3124f434139aef3397a32274a3073cedf5e2a412a84a906eeb36f78704e321a8"}
Sep 09 23:23:35.202984 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:35.202877    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:23:35.204065 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:35.204041    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8d49f61-b61d-46e5-ae84-3c17276a99fe","Type":"ContainerStarted","Data":"ad99496a5a4b066f13c757db8a4c7c5bd09fe83fe4a0e68ba07b6f3c60511050"}
Sep 09 23:23:35.205116 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:35.205098    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7w6b" event={"ID":"1d6b2e84-0c7a-4fa9-8dc0-6308a0f9ec90","Type":"ContainerStarted","Data":"e64014deae51b014aee94bb86d2c8e71552a0c126b62054820c1d84556ee0abb"}
Sep 09 23:23:35.206635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:35.206616    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6cbhf" event={"ID":"9c8282ee-a172-4f07-a592-8637893514c8","Type":"ContainerStarted","Data":"a7be2b1754ff98336f797abd3eada3921bc46f58658291b41d3b1263b46b67ca"}
Sep 09 23:23:35.229406 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:35.229362    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6cbhf" podStartSLOduration=65.824368931 podStartE2EDuration="1m11.229346203s" totalImagesPullingTime="5.404977272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:35.228960386 +0000 UTC m=+71.967683199" watchObservedRunningTime="2026-09-09 23:23:35.229346203 +0000 UTC m=+71.968069013"
Sep 09 23:23:35.229784 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:35.229757    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gwbns" podStartSLOduration=65.837900778 podStartE2EDuration="1m11.229747348s" totalImagesPullingTime="5.39184657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:35.215990684 +0000 UTC m=+71.954713654" watchObservedRunningTime="2026-09-09 23:23:35.229747348 +0000 UTC m=+71.968470157"
Sep 09 23:23:36.213361 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:36.213272    2581 generic.go:356] "Generic (PLEG): container finished" podID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerID="1d3ca95795f46239e7f37bf742f66f486c2a7f05f3d5f15bac5fc809af9a0a62" exitCode=0
Sep 09 23:23:36.213795 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:36.213401    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8d49f61-b61d-46e5-ae84-3c17276a99fe","Type":"ContainerDied","Data":"1d3ca95795f46239e7f37bf742f66f486c2a7f05f3d5f15bac5fc809af9a0a62"}
Sep 09 23:23:36.868821 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:36.868776    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:36.919707 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:36.919658    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:37.219467 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:37.219372    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7w6b" event={"ID":"1d6b2e84-0c7a-4fa9-8dc0-6308a0f9ec90","Type":"ContainerStarted","Data":"7cab4cc16080a05a1c1494df1c0c75c6a7eeaf5558d795754bd39ec6d35c1bba"}
Sep 09 23:23:37.219916 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:37.219587    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7w6b"
Sep 09 23:23:37.225035 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:37.225012    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7w6b"
Sep 09 23:23:37.246799 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:37.246755    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7w6b" podStartSLOduration=3.853601119 podStartE2EDuration="5.246742312s" totalImagesPullingTime="1.393141193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:37.232871204 +0000 UTC m=+73.971594005" watchObservedRunningTime="2026-09-09 23:23:37.246742312 +0000 UTC m=+73.985465120"
Sep 09 23:23:38.192033 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:38.192000    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:38.292141 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:38.292108    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:38.602736 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:38.602703    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:38.684013 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:38.683976    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:38.829473 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:38.829436    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:38.930066 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:38.929990    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:39.230072 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:39.230047    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8d49f61-b61d-46e5-ae84-3c17276a99fe","Type":"ContainerStarted","Data":"9e97baa7b8fda5a4769af6ba60f6146307264e34ea1a212f5148fbb314414250"}
Sep 09 23:23:39.230186 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:39.230111    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8d49f61-b61d-46e5-ae84-3c17276a99fe","Type":"ContainerStarted","Data":"e55062dc76d3f08260846fe0a00fa8ad22ccbbcc91ee5d3e23ce7933a1a4293c"}
Sep 09 23:23:39.606575 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:39.606542    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:39.707618 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:39.707585    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:41.241094 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:41.241067    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8d49f61-b61d-46e5-ae84-3c17276a99fe","Type":"ContainerStarted","Data":"b885f9299f570c9995930f51e4c1ae49b801c48db6e45b18ec7dc4c3fc17713a"}
Sep 09 23:23:41.241464 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:41.241157    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8d49f61-b61d-46e5-ae84-3c17276a99fe","Type":"ContainerStarted","Data":"d17d675631c1cf771f920dda79205d8de037c78dfa9503291a7b4a859a9fe401"}
Sep 09 23:23:42.247808 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:42.247773    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8d49f61-b61d-46e5-ae84-3c17276a99fe","Type":"ContainerStarted","Data":"ffe6b215564a2ace3336854161481fd3d34a0a8ece7de45e17a3705c517a9006"}
Sep 09 23:23:42.248187 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:42.247853    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8d49f61-b61d-46e5-ae84-3c17276a99fe","Type":"ContainerStarted","Data":"5e4c7ec49d878d2b6ebae5a9d95d21787e337b744a19bba2384a983b233d73e1"}
Sep 09 23:23:42.278742 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:42.278669    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.585070537 podStartE2EDuration="9.278653542s" totalImagesPullingTime="5.670468776s" totalInitContainerRuntime="23.114229ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:42.276368338 +0000 UTC m=+79.015091148" watchObservedRunningTime="2026-09-09 23:23:42.278653542 +0000 UTC m=+79.017376351"
Sep 09 23:23:43.132470 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:43.132441    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:43.784088 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:43.784051    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:43.833665 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:43.833634    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:44.014254 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:44.014219    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:44.060068 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:44.059993    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:44.196859 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:44.196821    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:44.207733 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:44.207711    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:23:44.387552 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:44.387477    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:44.439237 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:44.439206    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:44.692783 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:44.692691    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:44.793874 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:44.793847    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:44.846990 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:44.846954    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:44.944914 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:44.944838    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:45.044456 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:45.044424    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:46.613735 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:46.613598    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:46.664762 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:46.664737    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:48.118560 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:48.118526    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:48.220645 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:48.220612    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:48.628950 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:48.628917    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:48.728942 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:48.728898    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:53.084038 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:53.084002    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:53.138283 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:53.138254    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:53.193450 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:53.193427    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:53.251043 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:53.251016    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:53.617146 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:53.617118    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:54.074625 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:54.074592    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:55.870194 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:55.870161    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:23:55.925571 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:23:55.925542    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:00.219228 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:00.219192    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:00.319185 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:00.319156    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:05.020092 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:05.020054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:05.121231 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:05.121194    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:06.216688 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:06.216647    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gwbns"
Sep 09 23:24:07.590069 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:07.590044    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-glpf9_dbb2fd75-c34f-4a5e-a9ae-4739e58b655c/serve-healthcheck-canary/0.log"
Sep 09 23:24:08.235837 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:08.235802    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:08.336486 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:08.336445    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:11.432488 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:11.432455    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:11.534500 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:11.534467    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:15.572485 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:15.572452    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:15.673309 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:15.673278    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:15.723332 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:15.723303    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:18.021424 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:18.021396    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:18.071710 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:18.071665    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:18.433333 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:18.433252    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:34.208110 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:34.208073    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:34.227287 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:34.227264    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:34.446756 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:34.446719    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:38.189456 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:38.189421    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:38.256453 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:38.256422    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:46.867217 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:46.867180    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:47.639195 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:47.639158    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:52.286993 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.286951    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:24:52.287868 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.287831    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="kube-rbac-proxy" containerID="cri-o://5e4c7ec49d878d2b6ebae5a9d95d21787e337b744a19bba2384a983b233d73e1" gracePeriod=600
Sep 09 23:24:52.288005 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.287839    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="config-reloader" containerID="cri-o://9e97baa7b8fda5a4769af6ba60f6146307264e34ea1a212f5148fbb314414250" gracePeriod=600
Sep 09 23:24:52.288005 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.287902    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ffe6b215564a2ace3336854161481fd3d34a0a8ece7de45e17a3705c517a9006" gracePeriod=600
Sep 09 23:24:52.288005 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.287838    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="prometheus" containerID="cri-o://e55062dc76d3f08260846fe0a00fa8ad22ccbbcc91ee5d3e23ce7933a1a4293c" gracePeriod=600
Sep 09 23:24:52.288005 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.287997    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="thanos-sidecar" containerID="cri-o://d17d675631c1cf771f920dda79205d8de037c78dfa9503291a7b4a859a9fe401" gracePeriod=600
Sep 09 23:24:52.288213 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.288152    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="kube-rbac-proxy-web" containerID="cri-o://b885f9299f570c9995930f51e4c1ae49b801c48db6e45b18ec7dc4c3fc17713a" gracePeriod=600
Sep 09 23:24:52.509368 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.508948    2581 generic.go:356] "Generic (PLEG): container finished" podID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerID="ffe6b215564a2ace3336854161481fd3d34a0a8ece7de45e17a3705c517a9006" exitCode=0
Sep 09 23:24:52.509368 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.508975    2581 generic.go:356] "Generic (PLEG): container finished" podID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerID="5e4c7ec49d878d2b6ebae5a9d95d21787e337b744a19bba2384a983b233d73e1" exitCode=0
Sep 09 23:24:52.509368 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.508987    2581 generic.go:356] "Generic (PLEG): container finished" podID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerID="b885f9299f570c9995930f51e4c1ae49b801c48db6e45b18ec7dc4c3fc17713a" exitCode=0
Sep 09 23:24:52.509368 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.508996    2581 generic.go:356] "Generic (PLEG): container finished" podID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerID="d17d675631c1cf771f920dda79205d8de037c78dfa9503291a7b4a859a9fe401" exitCode=0
Sep 09 23:24:52.509368 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.509003    2581 generic.go:356] "Generic (PLEG): container finished" podID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerID="9e97baa7b8fda5a4769af6ba60f6146307264e34ea1a212f5148fbb314414250" exitCode=0
Sep 09 23:24:52.509368 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.509011    2581 generic.go:356] "Generic (PLEG): container finished" podID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerID="e55062dc76d3f08260846fe0a00fa8ad22ccbbcc91ee5d3e23ce7933a1a4293c" exitCode=0
Sep 09 23:24:52.509368 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.509048    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8d49f61-b61d-46e5-ae84-3c17276a99fe","Type":"ContainerDied","Data":"ffe6b215564a2ace3336854161481fd3d34a0a8ece7de45e17a3705c517a9006"}
Sep 09 23:24:52.509368 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.509149    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8d49f61-b61d-46e5-ae84-3c17276a99fe","Type":"ContainerDied","Data":"5e4c7ec49d878d2b6ebae5a9d95d21787e337b744a19bba2384a983b233d73e1"}
Sep 09 23:24:52.509368 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.509190    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8d49f61-b61d-46e5-ae84-3c17276a99fe","Type":"ContainerDied","Data":"b885f9299f570c9995930f51e4c1ae49b801c48db6e45b18ec7dc4c3fc17713a"}
Sep 09 23:24:52.509368 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.509228    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8d49f61-b61d-46e5-ae84-3c17276a99fe","Type":"ContainerDied","Data":"d17d675631c1cf771f920dda79205d8de037c78dfa9503291a7b4a859a9fe401"}
Sep 09 23:24:52.509368 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.509265    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8d49f61-b61d-46e5-ae84-3c17276a99fe","Type":"ContainerDied","Data":"9e97baa7b8fda5a4769af6ba60f6146307264e34ea1a212f5148fbb314414250"}
Sep 09 23:24:52.509368 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.509303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8d49f61-b61d-46e5-ae84-3c17276a99fe","Type":"ContainerDied","Data":"e55062dc76d3f08260846fe0a00fa8ad22ccbbcc91ee5d3e23ce7933a1a4293c"}
Sep 09 23:24:52.540511 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.540452    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:52.690074 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690039    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-0\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690251 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690085    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8d49f61-b61d-46e5-ae84-3c17276a99fe-tls-assets\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690251 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690115    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690251 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690139    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-kube-rbac-proxy\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690251 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690163    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-serving-certs-ca-bundle\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690251 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690185    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-db\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690251 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690218    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-tls\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690251 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690240    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-trusted-ca-bundle\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690591 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690262    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-grpc-tls\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690591 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690300    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-kubelet-serving-ca-bundle\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690591 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690331    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-web-config\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690591 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690357    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-metrics-client-certs\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690591 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690384    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvqwg\" (UniqueName: \"kubernetes.io/projected/f8d49f61-b61d-46e5-ae84-3c17276a99fe-kube-api-access-tvqwg\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690591 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690410    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-2\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690591 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690438    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-config\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690591 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690464    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-metrics-client-ca\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690591 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690523    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690591 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690552    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-1\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.690591 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690548    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:24:52.690591 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690584    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8d49f61-b61d-46e5-ae84-3c17276a99fe-config-out\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.691179 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690624    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-thanos-prometheus-http-client-file\") pod \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\" (UID: \"f8d49f61-b61d-46e5-ae84-3c17276a99fe\") "
Sep 09 23:24:52.691179 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.690874    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.691281 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.691220    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:24:52.691480 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.691447    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:24:52.691480 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.691457    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:24:52.691622 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.691534    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:24:52.691727 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.691699    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:24:52.692328 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.692242    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:24:52.693039 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.693004    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:24:52.693143 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.693048    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:24:52.693263 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.693236    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8d49f61-b61d-46e5-ae84-3c17276a99fe-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:24:52.693327 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.693254    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:24:52.693978 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.693949    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:24:52.694399 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.694366    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:24:52.694561 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.694537    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8d49f61-b61d-46e5-ae84-3c17276a99fe-kube-api-access-tvqwg" (OuterVolumeSpecName: "kube-api-access-tvqwg") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "kube-api-access-tvqwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:24:52.694668 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.694647    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:24:52.695184 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.695160    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:24:52.695494 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.695475    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8d49f61-b61d-46e5-ae84-3c17276a99fe-config-out" (OuterVolumeSpecName: "config-out") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:24:52.696017 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.695993    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:24:52.696100 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.696044    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-config" (OuterVolumeSpecName: "config") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:24:52.704300 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.704279    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-web-config" (OuterVolumeSpecName: "web-config") pod "f8d49f61-b61d-46e5-ae84-3c17276a99fe" (UID: "f8d49f61-b61d-46e5-ae84-3c17276a99fe"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:24:52.791302 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791239    2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791302 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791264    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791302 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791278    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8d49f61-b61d-46e5-ae84-3c17276a99fe-tls-assets\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791302 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791291    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791306    2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-kube-rbac-proxy\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791319    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-db\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791331    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791342    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791354    2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-grpc-tls\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791368    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791381    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-web-config\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791393    2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-metrics-client-certs\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791404    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvqwg\" (UniqueName: \"kubernetes.io/projected/f8d49f61-b61d-46e5-ae84-3c17276a99fe-kube-api-access-tvqwg\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791416    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791428    2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-config\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791441    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-configmap-metrics-client-ca\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791455    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8d49f61-b61d-46e5-ae84-3c17276a99fe-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791468    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f8d49f61-b61d-46e5-ae84-3c17276a99fe-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:52.791548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:52.791481    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8d49f61-b61d-46e5-ae84-3c17276a99fe-config-out\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:24:53.515120 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.515084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8d49f61-b61d-46e5-ae84-3c17276a99fe","Type":"ContainerDied","Data":"ad99496a5a4b066f13c757db8a4c7c5bd09fe83fe4a0e68ba07b6f3c60511050"}
Sep 09 23:24:53.515461 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.515161    2581 scope.go:117] "RemoveContainer" containerID="ffe6b215564a2ace3336854161481fd3d34a0a8ece7de45e17a3705c517a9006"
Sep 09 23:24:53.515461 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.515093    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.523240 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.523157    2581 scope.go:117] "RemoveContainer" containerID="5e4c7ec49d878d2b6ebae5a9d95d21787e337b744a19bba2384a983b233d73e1"
Sep 09 23:24:53.529833 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.529814    2581 scope.go:117] "RemoveContainer" containerID="b885f9299f570c9995930f51e4c1ae49b801c48db6e45b18ec7dc4c3fc17713a"
Sep 09 23:24:53.535972 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.535954    2581 scope.go:117] "RemoveContainer" containerID="d17d675631c1cf771f920dda79205d8de037c78dfa9503291a7b4a859a9fe401"
Sep 09 23:24:53.538577 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.538549    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:24:53.542729 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.542714    2581 scope.go:117] "RemoveContainer" containerID="9e97baa7b8fda5a4769af6ba60f6146307264e34ea1a212f5148fbb314414250"
Sep 09 23:24:53.545082 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.545063    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:24:53.549292 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.549276    2581 scope.go:117] "RemoveContainer" containerID="e55062dc76d3f08260846fe0a00fa8ad22ccbbcc91ee5d3e23ce7933a1a4293c"
Sep 09 23:24:53.556110 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.556096    2581 scope.go:117] "RemoveContainer" containerID="1d3ca95795f46239e7f37bf742f66f486c2a7f05f3d5f15bac5fc809af9a0a62"
Sep 09 23:24:53.571915 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.571895    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:24:53.572159 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572146    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="config-reloader"
Sep 09 23:24:53.572208 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572161    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="config-reloader"
Sep 09 23:24:53.572208 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572168    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="kube-rbac-proxy-web"
Sep 09 23:24:53.572208 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572174    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="kube-rbac-proxy-web"
Sep 09 23:24:53.572208 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572179    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="kube-rbac-proxy-thanos"
Sep 09 23:24:53.572208 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572185    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="kube-rbac-proxy-thanos"
Sep 09 23:24:53.572208 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572194    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="prometheus"
Sep 09 23:24:53.572208 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572200    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="prometheus"
Sep 09 23:24:53.572208 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572209    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="thanos-sidecar"
Sep 09 23:24:53.572429 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572214    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="thanos-sidecar"
Sep 09 23:24:53.572429 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572220    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="kube-rbac-proxy"
Sep 09 23:24:53.572429 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572225    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="kube-rbac-proxy"
Sep 09 23:24:53.572429 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572231    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="init-config-reloader"
Sep 09 23:24:53.572429 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572236    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="init-config-reloader"
Sep 09 23:24:53.572429 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572275    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="kube-rbac-proxy-thanos"
Sep 09 23:24:53.572429 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572282    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="config-reloader"
Sep 09 23:24:53.572429 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572286    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="kube-rbac-proxy"
Sep 09 23:24:53.572429 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572292    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="thanos-sidecar"
Sep 09 23:24:53.572429 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572298    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="kube-rbac-proxy-web"
Sep 09 23:24:53.572429 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.572303    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" containerName="prometheus"
Sep 09 23:24:53.574191 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.574177    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.576326 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.576309    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 09 23:24:53.576493 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.576462    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 09 23:24:53.576618 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.576517    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 09 23:24:53.576618 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.576465    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 23:24:53.577005 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.576973    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 09 23:24:53.577005 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.576994    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 09 23:24:53.577199 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.577047    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 09 23:24:53.577199 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.577051    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 09 23:24:53.577199 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.577097    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 09 23:24:53.577397 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.577378    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 09 23:24:53.577397 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.577382    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5svw5\""
Sep 09 23:24:53.577517 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.577382    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 09 23:24:53.577517 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.577384    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 09 23:24:53.577517 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.577385    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1vrh1j2jtgafv\""
Sep 09 23:24:53.577748 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.577694    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 09 23:24:53.580156 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.580134    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 09 23:24:53.583955 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.583697    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 09 23:24:53.592826 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.592808    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:24:53.698085 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698085 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698086    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698257 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698102    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698257 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698118    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698257 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698141    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-config\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698257 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698195    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698257 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698230    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9537937-e50a-46ec-b28d-a0a3c694fb88-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698439 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698263    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9537937-e50a-46ec-b28d-a0a3c694fb88-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698439 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698278    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698439 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh9zn\" (UniqueName: \"kubernetes.io/projected/b9537937-e50a-46ec-b28d-a0a3c694fb88-kube-api-access-dh9zn\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698439 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698308    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9537937-e50a-46ec-b28d-a0a3c694fb88-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698439 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698326    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698439 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698341    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698439 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698362    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698439 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698725 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698443    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698725 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698466    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698725 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698725 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698512    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.698725 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.698557    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.746811 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.746769    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8d49f61-b61d-46e5-ae84-3c17276a99fe" path="/var/lib/kubelet/pods/f8d49f61-b61d-46e5-ae84-3c17276a99fe/volumes"
Sep 09 23:24:53.799877 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.799845    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-config\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.799979 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.799887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.799979 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.799903    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9537937-e50a-46ec-b28d-a0a3c694fb88-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.799979 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.799928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9537937-e50a-46ec-b28d-a0a3c694fb88-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.799979 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.799949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800132 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh9zn\" (UniqueName: \"kubernetes.io/projected/b9537937-e50a-46ec-b28d-a0a3c694fb88-kube-api-access-dh9zn\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800132 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800113    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9537937-e50a-46ec-b28d-a0a3c694fb88-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800238 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800238 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800238 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800206    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800373 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800373 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800268    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800373 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800373 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800373 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800353    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800598 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800598 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800397    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9537937-e50a-46ec-b28d-a0a3c694fb88-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800598 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800598 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800598 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800598 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800537    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800927 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800659    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.800927 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.800796    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.801246 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.801221    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.804158 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.801561    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.804158 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.802192    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.804158 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.802781    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9537937-e50a-46ec-b28d-a0a3c694fb88-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.804158 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.801226    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.804158 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.803036    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-config\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.804158 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.803226    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.804158 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.803977    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.804158 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.804085    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.804158 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.804153    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.804912 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.804891    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.805142 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.805125    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9537937-e50a-46ec-b28d-a0a3c694fb88-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.805620 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.805601    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9537937-e50a-46ec-b28d-a0a3c694fb88-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.805717 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.805697    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.805765 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.805703    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.806510 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.806489    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9537937-e50a-46ec-b28d-a0a3c694fb88-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.808131 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.808086    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh9zn\" (UniqueName: \"kubernetes.io/projected/b9537937-e50a-46ec-b28d-a0a3c694fb88-kube-api-access-dh9zn\") pod \"prometheus-k8s-0\" (UID: \"b9537937-e50a-46ec-b28d-a0a3c694fb88\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:53.887250 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:53.887216    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:24:54.167138 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:54.167116    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 23:24:54.169369 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:24:54.169332    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9537937_e50a_46ec_b28d_a0a3c694fb88.slice/crio-c7cbc7b075133dfb9419686df98ff95e0bf44540c489437cccdfa438547660f7 WatchSource:0}: Error finding container c7cbc7b075133dfb9419686df98ff95e0bf44540c489437cccdfa438547660f7: Status 404 returned error can't find the container with id c7cbc7b075133dfb9419686df98ff95e0bf44540c489437cccdfa438547660f7
Sep 09 23:24:54.521045 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:54.521011    2581 generic.go:356] "Generic (PLEG): container finished" podID="b9537937-e50a-46ec-b28d-a0a3c694fb88" containerID="5c608f86857669962272e05985bf40ec8d7929b11f1a6cc2bd75ebb635d8e06c" exitCode=0
Sep 09 23:24:54.521372 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:54.521056    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9537937-e50a-46ec-b28d-a0a3c694fb88","Type":"ContainerDied","Data":"5c608f86857669962272e05985bf40ec8d7929b11f1a6cc2bd75ebb635d8e06c"}
Sep 09 23:24:54.521372 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:54.521122    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9537937-e50a-46ec-b28d-a0a3c694fb88","Type":"ContainerStarted","Data":"c7cbc7b075133dfb9419686df98ff95e0bf44540c489437cccdfa438547660f7"}
Sep 09 23:24:55.122626 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:55.122540    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:55.187509 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:55.187482    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:55.264386 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:55.264360    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:55.317709 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:55.317664    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:55.532571 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:55.532543    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9537937-e50a-46ec-b28d-a0a3c694fb88","Type":"ContainerStarted","Data":"02ab99ad5c597f890ed4035cc3b5bc4e0e43544c8f1ea165e82ab1e954f5e8f4"}
Sep 09 23:24:55.533002 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:55.532646    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9537937-e50a-46ec-b28d-a0a3c694fb88","Type":"ContainerStarted","Data":"0831d5fe898a2346158d08a8b10ab2e3f7cfc160ad911815b9481e21d5105f3a"}
Sep 09 23:24:55.533002 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:55.532713    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9537937-e50a-46ec-b28d-a0a3c694fb88","Type":"ContainerStarted","Data":"3bbaec76dcbab7f04bd605f199e7bba22f24a8e298926538274242e9d7272e45"}
Sep 09 23:24:55.533002 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:55.532761    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9537937-e50a-46ec-b28d-a0a3c694fb88","Type":"ContainerStarted","Data":"3d763e0bd35cf09a569df525b99dd620e765c43de18d891934c809a3acfc27eb"}
Sep 09 23:24:55.533002 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:55.532800    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9537937-e50a-46ec-b28d-a0a3c694fb88","Type":"ContainerStarted","Data":"5bcf6a42120a20805139d7ac50d50b9f2c4f7a59631f598bddffabbff432ed57"}
Sep 09 23:24:55.533002 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:55.532844    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9537937-e50a-46ec-b28d-a0a3c694fb88","Type":"ContainerStarted","Data":"93b35fcf1eaee08e47e0db92d6cef3f4af6cbb93cf27f05a8c6b57871cc0a649"}
Sep 09 23:24:55.567273 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:55.567233    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5450852250000002 podStartE2EDuration="2.567218453s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.133228ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:24:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:24:55.566803518 +0000 UTC m=+152.305526326" watchObservedRunningTime="2026-09-09 23:24:55.567218453 +0000 UTC m=+152.305941261"
Sep 09 23:24:55.867994 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:55.867922    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:24:58.887749 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:24:58.887707    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:25:06.143854 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:25:06.143824    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:25:06.250842 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:25:06.250814    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:25:06.352505 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:25:06.352472    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:25:37.707427 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:25:37.707388    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:25:37.757366 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:25:37.757330    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:25:53.888442 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:25:53.888401    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:25:53.903415 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:25:53.903394    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:25:54.746641 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:25:54.746615    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 23:25:55.486957 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:25:55.486930    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:26:02.092001 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:26:02.091942    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:26:02.193501 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:26:02.193466    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:26:13.969417 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:26:13.969367    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:26:14.020512 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:26:14.020482    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:26:23.200378 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:26:23.200333    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:26:23.300079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:26:23.300040    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:26:30.937557 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:26:30.937517    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:26:30.994099 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:26:30.994064    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:26:41.528260 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:26:41.528227    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:26:41.581668 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:26:41.581630    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:03.618712 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:03.618661    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:03.714550 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:03.714520    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:23.628707 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:23.628664    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/ovn-acl-logging/0.log"
Sep 09 23:27:23.629800 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:23.629779    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/ovn-acl-logging/0.log"
Sep 09 23:27:23.636493 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:23.636465    2581 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 23:27:30.210791 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:30.210755    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:31.665984 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:31.665950    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:33.896644 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:33.896604    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:33.944798 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:33.944766    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:35.024785 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:35.024738    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:35.132817 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:35.132778    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:35.982178 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:35.982147    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:36.082775 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:36.082742    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:36.971405 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:36.971372    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5f5hs"]
Sep 09 23:27:36.973404 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:36.973381    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5f5hs"
Sep 09 23:27:36.975434 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:36.975411    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 23:27:36.975536 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:36.975414    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 23:27:36.976041 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:36.976025    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-t8z4n\""
Sep 09 23:27:36.984270 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:36.984252    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5f5hs"]
Sep 09 23:27:37.046576 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:37.046549    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4901c2fb-4c73-4414-bec4-4360020b067f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5f5hs\" (UID: \"4901c2fb-4c73-4414-bec4-4360020b067f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5f5hs"
Sep 09 23:27:37.046712 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:37.046623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv476\" (UniqueName: \"kubernetes.io/projected/4901c2fb-4c73-4414-bec4-4360020b067f-kube-api-access-gv476\") pod \"cert-manager-webhook-6486ffd997-5f5hs\" (UID: \"4901c2fb-4c73-4414-bec4-4360020b067f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5f5hs"
Sep 09 23:27:37.147279 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:37.147243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv476\" (UniqueName: \"kubernetes.io/projected/4901c2fb-4c73-4414-bec4-4360020b067f-kube-api-access-gv476\") pod \"cert-manager-webhook-6486ffd997-5f5hs\" (UID: \"4901c2fb-4c73-4414-bec4-4360020b067f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5f5hs"
Sep 09 23:27:37.147647 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:37.147291    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4901c2fb-4c73-4414-bec4-4360020b067f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5f5hs\" (UID: \"4901c2fb-4c73-4414-bec4-4360020b067f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5f5hs"
Sep 09 23:27:37.154996 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:37.154967    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4901c2fb-4c73-4414-bec4-4360020b067f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5f5hs\" (UID: \"4901c2fb-4c73-4414-bec4-4360020b067f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5f5hs"
Sep 09 23:27:37.155105 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:37.155074    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv476\" (UniqueName: \"kubernetes.io/projected/4901c2fb-4c73-4414-bec4-4360020b067f-kube-api-access-gv476\") pod \"cert-manager-webhook-6486ffd997-5f5hs\" (UID: \"4901c2fb-4c73-4414-bec4-4360020b067f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5f5hs"
Sep 09 23:27:37.302381 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:37.302351    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5f5hs"
Sep 09 23:27:37.572691 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:37.572602    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5f5hs"]
Sep 09 23:27:37.575593 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:27:37.575567    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4901c2fb_4c73_4414_bec4_4360020b067f.slice/crio-fdb2628cb78020a139e3193c7428fabc8b87a2dd8d5bbf8418131bf62a6ec575 WatchSource:0}: Error finding container fdb2628cb78020a139e3193c7428fabc8b87a2dd8d5bbf8418131bf62a6ec575: Status 404 returned error can't find the container with id fdb2628cb78020a139e3193c7428fabc8b87a2dd8d5bbf8418131bf62a6ec575
Sep 09 23:27:37.577692 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:37.577656    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:27:38.076236 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:38.076203    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5f5hs" event={"ID":"4901c2fb-4c73-4414-bec4-4360020b067f","Type":"ContainerStarted","Data":"fdb2628cb78020a139e3193c7428fabc8b87a2dd8d5bbf8418131bf62a6ec575"}
Sep 09 23:27:38.183948 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:38.183915    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:38.378949 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:38.378837    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:40.410512 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:40.410471    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:40.512394 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:40.512362    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:41.093450 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:41.093406    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5f5hs" event={"ID":"4901c2fb-4c73-4414-bec4-4360020b067f","Type":"ContainerStarted","Data":"f1c041429da397edd4acfafdbeb9abe1a8106232a7053713e9fc3ec8a09c7cf4"}
Sep 09 23:27:41.093662 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:41.093495    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5f5hs"
Sep 09 23:27:41.110371 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:41.110325    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-5f5hs" podStartSLOduration=2.057995522 podStartE2EDuration="5.110310598s" totalImagesPullingTime="3.052315076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:27:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:27:41.109215554 +0000 UTC m=+317.847938363" watchObservedRunningTime="2026-09-09 23:27:41.110310598 +0000 UTC m=+317.849033406"
Sep 09 23:27:46.385186 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:46.385155    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:46.827248 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:46.827217    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:46.925901 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:46.925876    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:47.099203 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:47.099129    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5f5hs"
Sep 09 23:27:48.368823 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:48.368771    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:48.428080 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:48.428055    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:49.046344 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:49.046304    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g28v9"]
Sep 09 23:27:49.050167 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:49.050140    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g28v9"
Sep 09 23:27:49.052418 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:49.052382    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 23:27:49.052585 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:49.052562    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-pst5t\""
Sep 09 23:27:49.052669 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:49.052562    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:27:49.058341 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:49.058324    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g28v9"]
Sep 09 23:27:49.143641 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:49.143609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pssk9\" (UniqueName: \"kubernetes.io/projected/2a7480d2-bf52-48d7-8f4e-ee4b583bca8f-kube-api-access-pssk9\") pod \"openshift-lws-operator-fd8ccff4c-g28v9\" (UID: \"2a7480d2-bf52-48d7-8f4e-ee4b583bca8f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g28v9"
Sep 09 23:27:49.143798 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:49.143700    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a7480d2-bf52-48d7-8f4e-ee4b583bca8f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g28v9\" (UID: \"2a7480d2-bf52-48d7-8f4e-ee4b583bca8f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g28v9"
Sep 09 23:27:49.244286 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:49.244257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pssk9\" (UniqueName: \"kubernetes.io/projected/2a7480d2-bf52-48d7-8f4e-ee4b583bca8f-kube-api-access-pssk9\") pod \"openshift-lws-operator-fd8ccff4c-g28v9\" (UID: \"2a7480d2-bf52-48d7-8f4e-ee4b583bca8f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g28v9"
Sep 09 23:27:49.244459 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:49.244325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a7480d2-bf52-48d7-8f4e-ee4b583bca8f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g28v9\" (UID: \"2a7480d2-bf52-48d7-8f4e-ee4b583bca8f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g28v9"
Sep 09 23:27:49.244657 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:49.244640    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a7480d2-bf52-48d7-8f4e-ee4b583bca8f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g28v9\" (UID: \"2a7480d2-bf52-48d7-8f4e-ee4b583bca8f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g28v9"
Sep 09 23:27:49.251745 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:49.251723    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pssk9\" (UniqueName: \"kubernetes.io/projected/2a7480d2-bf52-48d7-8f4e-ee4b583bca8f-kube-api-access-pssk9\") pod \"openshift-lws-operator-fd8ccff4c-g28v9\" (UID: \"2a7480d2-bf52-48d7-8f4e-ee4b583bca8f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g28v9"
Sep 09 23:27:49.360718 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:49.360654    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g28v9"
Sep 09 23:27:49.628241 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:49.628160    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g28v9"]
Sep 09 23:27:49.630946 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:27:49.630923    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a7480d2_bf52_48d7_8f4e_ee4b583bca8f.slice/crio-caa53031823788f7d1d0fb9d1aa550e129626a278a7376c221c1bda3ca9ac6fd WatchSource:0}: Error finding container caa53031823788f7d1d0fb9d1aa550e129626a278a7376c221c1bda3ca9ac6fd: Status 404 returned error can't find the container with id caa53031823788f7d1d0fb9d1aa550e129626a278a7376c221c1bda3ca9ac6fd
Sep 09 23:27:50.126795 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:50.126758    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g28v9" event={"ID":"2a7480d2-bf52-48d7-8f4e-ee4b583bca8f","Type":"ContainerStarted","Data":"caa53031823788f7d1d0fb9d1aa550e129626a278a7376c221c1bda3ca9ac6fd"}
Sep 09 23:27:53.145392 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:53.145361    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g28v9" event={"ID":"2a7480d2-bf52-48d7-8f4e-ee4b583bca8f","Type":"ContainerStarted","Data":"36255c4f63a97806d1c47b94398889ee0609b828eddb91068578896c41bbc5fd"}
Sep 09 23:27:53.165828 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:53.165773    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g28v9" podStartSLOduration=1.675860095 podStartE2EDuration="4.165752591s" totalImagesPullingTime="2.489892496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:27:53.163758116 +0000 UTC m=+329.902480930" watchObservedRunningTime="2026-09-09 23:27:53.165752591 +0000 UTC m=+329.904475401"
Sep 09 23:27:53.810023 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:53.809991    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:53.910654 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:53.910625    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:27:55.590038 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:27:55.590005    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:07.974448 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:07.974416    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:08.075690 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.075646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:08.544872 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.544835    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:08.783808 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.783776    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:08.890267 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.890187    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:08.924297 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.924249    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"]
Sep 09 23:28:08.928624 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.928604    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:08.930970 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.930947    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 23:28:08.930970 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.930959    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 23:28:08.931447 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.931428    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 23:28:08.931778 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.931756    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-drfht\""
Sep 09 23:28:08.931870 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.931781    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 23:28:08.942622 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.942603    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"]
Sep 09 23:28:08.998367 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.998340    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-nzgmw\" (UID: \"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:08.998736 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.998381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-nzgmw\" (UID: \"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:08.998736 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.998407    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0-tmp\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-nzgmw\" (UID: \"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:08.998736 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.998476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0-manifests\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-nzgmw\" (UID: \"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:08.998736 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:08.998515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz7xx\" (UniqueName: \"kubernetes.io/projected/1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0-kube-api-access-nz7xx\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-nzgmw\" (UID: \"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:09.050977 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.050951    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:09.099138 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.099116    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-nzgmw\" (UID: \"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:09.099231 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.099148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-nzgmw\" (UID: \"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:09.099231 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.099166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0-tmp\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-nzgmw\" (UID: \"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:09.099231 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.099184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0-manifests\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-nzgmw\" (UID: \"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:09.099231 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.099210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz7xx\" (UniqueName: \"kubernetes.io/projected/1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0-kube-api-access-nz7xx\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-nzgmw\" (UID: \"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:09.099590 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.099571    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0-manifests\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-nzgmw\" (UID: \"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:09.101472 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.101445    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0-tmp\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-nzgmw\" (UID: \"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:09.101717 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.101700    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-nzgmw\" (UID: \"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:09.101717 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.101712    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-nzgmw\" (UID: \"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:09.107075 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.107050    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz7xx\" (UniqueName: \"kubernetes.io/projected/1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0-kube-api-access-nz7xx\") pod \"opendatahub-operator-controller-manager-6fb6f955c9-nzgmw\" (UID: \"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0\") " pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:09.162236 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.162185    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:09.238437 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.238417    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:09.251565 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.251540    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:09.355455 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.355425    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:09.452741 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.452653    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:09.512445 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:09.512418    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"]
Sep 09 23:28:09.515765 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:28:09.515738    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1282cfe3_ecf4_4a0d_8adb_1a1ad76306b0.slice/crio-7acc477513d8ebb1bed51d98476e3bc90c46a79223b3e3d1131112adadc7dcfa WatchSource:0}: Error finding container 7acc477513d8ebb1bed51d98476e3bc90c46a79223b3e3d1131112adadc7dcfa: Status 404 returned error can't find the container with id 7acc477513d8ebb1bed51d98476e3bc90c46a79223b3e3d1131112adadc7dcfa
Sep 09 23:28:10.213752 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:10.213714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw" event={"ID":"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0","Type":"ContainerStarted","Data":"7acc477513d8ebb1bed51d98476e3bc90c46a79223b3e3d1131112adadc7dcfa"}
Sep 09 23:28:13.226328 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:13.226293    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw" event={"ID":"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0","Type":"ContainerStarted","Data":"034fedc9f1f6d9b5e36f1dac71482751c7eae22bfaa0a1d8bbe6a2f8a40c0e03"}
Sep 09 23:28:14.231377 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:14.231347    2581 generic.go:356] "Generic (PLEG): container finished" podID="1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0" containerID="034fedc9f1f6d9b5e36f1dac71482751c7eae22bfaa0a1d8bbe6a2f8a40c0e03" exitCode=0
Sep 09 23:28:14.231744 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:14.231393    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw" event={"ID":"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0","Type":"ContainerDied","Data":"034fedc9f1f6d9b5e36f1dac71482751c7eae22bfaa0a1d8bbe6a2f8a40c0e03"}
Sep 09 23:28:15.237102 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:15.237070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw" event={"ID":"1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0","Type":"ContainerStarted","Data":"0fb97db1d92d38a0ce81737bdc0129ddebe0d271e3a24a7c1244bedf4457768f"}
Sep 09 23:28:15.237449 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:15.237193    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:15.257748 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:15.257704    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw" podStartSLOduration=3.000332375 podStartE2EDuration="7.25769157s" totalImagesPullingTime="3.202716552s" totalInitContainerRuntime="1.054642643s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:28:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:28:15.255658231 +0000 UTC m=+351.994381041" watchObservedRunningTime="2026-09-09 23:28:15.25769157 +0000 UTC m=+351.996414373"
Sep 09 23:28:15.826414 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:15.826375    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:15.914036 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:15.914002    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:19.403373 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:19.403338    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:19.502004 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:19.501964    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:26.243525 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:26.243493    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fb6f955c9-nzgmw"
Sep 09 23:28:27.715604 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:27.715567    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:27.827220 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:27.827189    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:28.288752 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.288706    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"]
Sep 09 23:28:28.296396 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.296369    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"
Sep 09 23:28:28.298979 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.298952    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 09 23:28:28.298979 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.298954    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 09 23:28:28.299360 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.299337    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8mbm6\""
Sep 09 23:28:28.299520 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.299368    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 09 23:28:28.299725 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.299705    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"]
Sep 09 23:28:28.347774 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.347748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4629\" (UniqueName: \"kubernetes.io/projected/05152955-fd48-4ac2-91ff-5c578715cc96-kube-api-access-z4629\") pod \"lws-controller-manager-b488669bf-hf4tw\" (UID: \"05152955-fd48-4ac2-91ff-5c578715cc96\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"
Sep 09 23:28:28.347885 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.347785    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05152955-fd48-4ac2-91ff-5c578715cc96-cert\") pod \"lws-controller-manager-b488669bf-hf4tw\" (UID: \"05152955-fd48-4ac2-91ff-5c578715cc96\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"
Sep 09 23:28:28.347885 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.347810    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/05152955-fd48-4ac2-91ff-5c578715cc96-metrics-cert\") pod \"lws-controller-manager-b488669bf-hf4tw\" (UID: \"05152955-fd48-4ac2-91ff-5c578715cc96\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"
Sep 09 23:28:28.347969 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.347881    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/05152955-fd48-4ac2-91ff-5c578715cc96-manager-config\") pod \"lws-controller-manager-b488669bf-hf4tw\" (UID: \"05152955-fd48-4ac2-91ff-5c578715cc96\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"
Sep 09 23:28:28.448661 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.448631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4629\" (UniqueName: \"kubernetes.io/projected/05152955-fd48-4ac2-91ff-5c578715cc96-kube-api-access-z4629\") pod \"lws-controller-manager-b488669bf-hf4tw\" (UID: \"05152955-fd48-4ac2-91ff-5c578715cc96\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"
Sep 09 23:28:28.448814 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.448669    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05152955-fd48-4ac2-91ff-5c578715cc96-cert\") pod \"lws-controller-manager-b488669bf-hf4tw\" (UID: \"05152955-fd48-4ac2-91ff-5c578715cc96\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"
Sep 09 23:28:28.448814 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.448714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/05152955-fd48-4ac2-91ff-5c578715cc96-metrics-cert\") pod \"lws-controller-manager-b488669bf-hf4tw\" (UID: \"05152955-fd48-4ac2-91ff-5c578715cc96\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"
Sep 09 23:28:28.448814 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.448740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/05152955-fd48-4ac2-91ff-5c578715cc96-manager-config\") pod \"lws-controller-manager-b488669bf-hf4tw\" (UID: \"05152955-fd48-4ac2-91ff-5c578715cc96\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"
Sep 09 23:28:28.449475 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.449453    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/05152955-fd48-4ac2-91ff-5c578715cc96-manager-config\") pod \"lws-controller-manager-b488669bf-hf4tw\" (UID: \"05152955-fd48-4ac2-91ff-5c578715cc96\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"
Sep 09 23:28:28.451466 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.451446    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/05152955-fd48-4ac2-91ff-5c578715cc96-metrics-cert\") pod \"lws-controller-manager-b488669bf-hf4tw\" (UID: \"05152955-fd48-4ac2-91ff-5c578715cc96\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"
Sep 09 23:28:28.451466 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.451460    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05152955-fd48-4ac2-91ff-5c578715cc96-cert\") pod \"lws-controller-manager-b488669bf-hf4tw\" (UID: \"05152955-fd48-4ac2-91ff-5c578715cc96\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"
Sep 09 23:28:28.461499 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.461476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4629\" (UniqueName: \"kubernetes.io/projected/05152955-fd48-4ac2-91ff-5c578715cc96-kube-api-access-z4629\") pod \"lws-controller-manager-b488669bf-hf4tw\" (UID: \"05152955-fd48-4ac2-91ff-5c578715cc96\") " pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"
Sep 09 23:28:28.607161 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.607088    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"
Sep 09 23:28:28.874135 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:28.874068    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"]
Sep 09 23:28:28.878611 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:28:28.878584    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05152955_fd48_4ac2_91ff_5c578715cc96.slice/crio-b473df992c63fff3adcf4b9fd83c209b62666e048539e49fa9c327dfe31d1c95 WatchSource:0}: Error finding container b473df992c63fff3adcf4b9fd83c209b62666e048539e49fa9c327dfe31d1c95: Status 404 returned error can't find the container with id b473df992c63fff3adcf4b9fd83c209b62666e048539e49fa9c327dfe31d1c95
Sep 09 23:28:29.297446 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:29.297359    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw" event={"ID":"05152955-fd48-4ac2-91ff-5c578715cc96","Type":"ContainerStarted","Data":"b473df992c63fff3adcf4b9fd83c209b62666e048539e49fa9c327dfe31d1c95"}
Sep 09 23:28:31.306629 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:31.306590    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw" event={"ID":"05152955-fd48-4ac2-91ff-5c578715cc96","Type":"ContainerStarted","Data":"ce7449c2d540e00c3548b50bbec97421b5f414df93c8dc237a5a09e26d1dae1e"}
Sep 09 23:28:31.306990 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:31.306718    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"
Sep 09 23:28:31.321721 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:31.321655    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw" podStartSLOduration=1.677095426 podStartE2EDuration="3.321641884s" totalImagesPullingTime="1.644546458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:28:31.320938101 +0000 UTC m=+368.059660909" watchObservedRunningTime="2026-09-09 23:28:31.321641884 +0000 UTC m=+368.060364693"
Sep 09 23:28:34.768115 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:34.768085    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:34.868253 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:34.868222    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:38.423974 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.423942    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:38.533239 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.533201    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:38.543615 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.543586    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm"]
Sep 09 23:28:38.545864 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.545845    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm"
Sep 09 23:28:38.548099 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.548080    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 23:28:38.548858 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.548842    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jr9f6\""
Sep 09 23:28:38.549135 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.549110    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 23:28:38.549241 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.549198    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 23:28:38.549298 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.549257    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 09 23:28:38.557563 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.557544    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm"]
Sep 09 23:28:38.627805 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.627774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6282a7ea-b903-4e79-90c9-a1c4e4f46cc8-tmp\") pod \"kube-auth-proxy-5fbb956d86-jnfhm\" (UID: \"6282a7ea-b903-4e79-90c9-a1c4e4f46cc8\") " pod="openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm"
Sep 09 23:28:38.627947 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.627817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn7w5\" (UniqueName: \"kubernetes.io/projected/6282a7ea-b903-4e79-90c9-a1c4e4f46cc8-kube-api-access-xn7w5\") pod \"kube-auth-proxy-5fbb956d86-jnfhm\" (UID: \"6282a7ea-b903-4e79-90c9-a1c4e4f46cc8\") " pod="openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm"
Sep 09 23:28:38.627947 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.627851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6282a7ea-b903-4e79-90c9-a1c4e4f46cc8-tls-certs\") pod \"kube-auth-proxy-5fbb956d86-jnfhm\" (UID: \"6282a7ea-b903-4e79-90c9-a1c4e4f46cc8\") " pod="openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm"
Sep 09 23:28:38.699339 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.699270    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:38.729102 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.729068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6282a7ea-b903-4e79-90c9-a1c4e4f46cc8-tmp\") pod \"kube-auth-proxy-5fbb956d86-jnfhm\" (UID: \"6282a7ea-b903-4e79-90c9-a1c4e4f46cc8\") " pod="openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm"
Sep 09 23:28:38.729270 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.729218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn7w5\" (UniqueName: \"kubernetes.io/projected/6282a7ea-b903-4e79-90c9-a1c4e4f46cc8-kube-api-access-xn7w5\") pod \"kube-auth-proxy-5fbb956d86-jnfhm\" (UID: \"6282a7ea-b903-4e79-90c9-a1c4e4f46cc8\") " pod="openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm"
Sep 09 23:28:38.729270 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.729262    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6282a7ea-b903-4e79-90c9-a1c4e4f46cc8-tls-certs\") pod \"kube-auth-proxy-5fbb956d86-jnfhm\" (UID: \"6282a7ea-b903-4e79-90c9-a1c4e4f46cc8\") " pod="openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm"
Sep 09 23:28:38.731374 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.731345    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6282a7ea-b903-4e79-90c9-a1c4e4f46cc8-tmp\") pod \"kube-auth-proxy-5fbb956d86-jnfhm\" (UID: \"6282a7ea-b903-4e79-90c9-a1c4e4f46cc8\") " pod="openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm"
Sep 09 23:28:38.731614 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.731597    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6282a7ea-b903-4e79-90c9-a1c4e4f46cc8-tls-certs\") pod \"kube-auth-proxy-5fbb956d86-jnfhm\" (UID: \"6282a7ea-b903-4e79-90c9-a1c4e4f46cc8\") " pod="openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm"
Sep 09 23:28:38.737364 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.737342    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn7w5\" (UniqueName: \"kubernetes.io/projected/6282a7ea-b903-4e79-90c9-a1c4e4f46cc8-kube-api-access-xn7w5\") pod \"kube-auth-proxy-5fbb956d86-jnfhm\" (UID: \"6282a7ea-b903-4e79-90c9-a1c4e4f46cc8\") " pod="openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm"
Sep 09 23:28:38.799601 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.799573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:38.854966 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.854939    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm"
Sep 09 23:28:38.898927 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:38.898860    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:39.062620 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:39.062588    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:39.125092 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:39.125070    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm"]
Sep 09 23:28:39.127657 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:28:39.127627    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6282a7ea_b903_4e79_90c9_a1c4e4f46cc8.slice/crio-1994138f058346b8397fe1375f73a3cc7687517241a37430b6552922da4f1f1e WatchSource:0}: Error finding container 1994138f058346b8397fe1375f73a3cc7687517241a37430b6552922da4f1f1e: Status 404 returned error can't find the container with id 1994138f058346b8397fe1375f73a3cc7687517241a37430b6552922da4f1f1e
Sep 09 23:28:39.306774 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:39.306727    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:39.337094 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:39.337016    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm" event={"ID":"6282a7ea-b903-4e79-90c9-a1c4e4f46cc8","Type":"ContainerStarted","Data":"1994138f058346b8397fe1375f73a3cc7687517241a37430b6552922da4f1f1e"}
Sep 09 23:28:39.519854 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:39.519820    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:39.577474 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:39.577441    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:40.526170 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:40.526133    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:42.312197 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:42.312169    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-b488669bf-hf4tw"
Sep 09 23:28:42.354190 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:42.354161    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm" event={"ID":"6282a7ea-b903-4e79-90c9-a1c4e4f46cc8","Type":"ContainerStarted","Data":"358583eff84d34e65b830fd9570561f366bad29753dda56aff5047b570adea39"}
Sep 09 23:28:42.369250 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:42.369198    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5fbb956d86-jnfhm" podStartSLOduration=1.645980925 podStartE2EDuration="4.369181184s" totalImagesPullingTime="2.723200259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:28:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:28:42.367975473 +0000 UTC m=+379.106698286" watchObservedRunningTime="2026-09-09 23:28:42.369181184 +0000 UTC m=+379.107903993"
Sep 09 23:28:49.287552 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:49.287512    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:49.357698 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:49.357640    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp"]
Sep 09 23:28:49.366724 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:49.366698    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp"
Sep 09 23:28:49.368918 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:49.368893    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 09 23:28:49.368918 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:49.368909    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-tqt5m\""
Sep 09 23:28:49.372950 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:49.372922    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp"]
Sep 09 23:28:49.378796 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:49.378771    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:49.499731 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:49.499700    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:49.522419 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:49.522382    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wpgr\" (UniqueName: \"kubernetes.io/projected/6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78-kube-api-access-7wpgr\") pod \"llmisvc-controller-manager-777c6bd7d5-fnlqp\" (UID: \"6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp"
Sep 09 23:28:49.522587 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:49.522440    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fnlqp\" (UID: \"6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp"
Sep 09 23:28:49.621236 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:49.621161    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:49.623327 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:49.623307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wpgr\" (UniqueName: \"kubernetes.io/projected/6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78-kube-api-access-7wpgr\") pod \"llmisvc-controller-manager-777c6bd7d5-fnlqp\" (UID: \"6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp"
Sep 09 23:28:49.623393 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:49.623369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fnlqp\" (UID: \"6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp"
Sep 09 23:28:49.623495 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:28:49.623482    2581 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 09 23:28:49.623547 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:28:49.623539    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78-cert podName:6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78 nodeName:}" failed. No retries permitted until 2026-09-09 23:28:50.123522613 +0000 UTC m=+386.862245401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78-cert") pod "llmisvc-controller-manager-777c6bd7d5-fnlqp" (UID: "6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78") : secret "llmisvc-webhook-server-cert" not found
Sep 09 23:28:49.638179 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:49.638151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wpgr\" (UniqueName: \"kubernetes.io/projected/6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78-kube-api-access-7wpgr\") pod \"llmisvc-controller-manager-777c6bd7d5-fnlqp\" (UID: \"6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp"
Sep 09 23:28:49.761945 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:49.761910    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:49.908343 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:49.908256    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:50.128616 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:50.128585    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fnlqp\" (UID: \"6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp"
Sep 09 23:28:50.131033 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:50.131008    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fnlqp\" (UID: \"6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp"
Sep 09 23:28:50.278119 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:50.278083    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp"
Sep 09 23:28:50.558732 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:50.558702    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp"]
Sep 09 23:28:50.561139 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:28:50.561112    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6dc802f1_1409_4f4b_a11b_b9bd1cc7ee78.slice/crio-e016347ba21701dc08e8461d63b65d1e17b977d4068645605908c0fec14110f6 WatchSource:0}: Error finding container e016347ba21701dc08e8461d63b65d1e17b977d4068645605908c0fec14110f6: Status 404 returned error can't find the container with id e016347ba21701dc08e8461d63b65d1e17b977d4068645605908c0fec14110f6
Sep 09 23:28:50.621650 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:50.621617    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:50.714671 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:50.714641    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:50.936558 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:50.936472    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:51.089887 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:51.089854    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:51.394690 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:51.394644    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp" event={"ID":"6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78","Type":"ContainerStarted","Data":"e016347ba21701dc08e8461d63b65d1e17b977d4068645605908c0fec14110f6"}
Sep 09 23:28:51.437661 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:51.437626    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:28:54.410224 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:54.410183    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp" event={"ID":"6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78","Type":"ContainerStarted","Data":"c62e828ca6609aa3b09df7602d1c2ddee242bda77493ef346c755be226e9eece"}
Sep 09 23:28:54.410694 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:54.410321    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp"
Sep 09 23:28:54.438326 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:28:54.438277    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp" podStartSLOduration=2.57014474 podStartE2EDuration="5.438262024s" totalImagesPullingTime="2.868117284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:28:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:28:54.438186365 +0000 UTC m=+391.176909176" watchObservedRunningTime="2026-09-09 23:28:54.438262024 +0000 UTC m=+391.176984833"
Sep 09 23:29:02.432748 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:02.432713    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:13.291121 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:13.291088    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:13.348109 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:13.348074    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:13.402645 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:13.402618    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:25.416798 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:25.416764    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fnlqp"
Sep 09 23:29:39.780192 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:39.780158    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:39.883099 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:39.883063    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:42.650741 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:42.650709    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:42.752632 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:42.752605    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:44.602642 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:44.602606    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:44.703193 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:44.703160    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:52.657762 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:52.657668    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:53.465692 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:53.465641    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:54.267706 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:54.267644    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:56.520127 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:56.520092    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:56.623254 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:56.623215    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:57.882027 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:57.881990    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:59.735880 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:59.735848    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:29:59.894201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:29:59.894166    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:01.673578 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:01.673548    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:01.920564 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:01.920528    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:02.080425 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:02.080390    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:02.291263 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:02.291229    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:03.324894 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:03.324861    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:05.052177 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:05.052142    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:05.282621 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:05.282568    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:07.678254 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:07.678220    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:07.731741 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:07.731708    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:08.072733 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:08.072698    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:08.126112 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:08.126076    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:08.477848 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:08.477816    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:08.528335 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:08.528307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:14.753509 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:14.753469    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:14.848772 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:14.848743    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:17.135797 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:17.135766    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:17.236114 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:17.236077    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:24.237270 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:24.237232    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:24.337435 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:24.337386    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:24.835748 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:24.835711    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:24.937332 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:24.937300    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:31.631868 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:31.631834    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:31.685634 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:31.685606    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:32.229124 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:32.229090    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:32.328615 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:32.328584    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:32.832259 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:32.832224    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:32.955157 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:32.955125    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:40.432286 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:40.432252    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:40.532796 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:40.532764    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:42.291532 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:42.291498    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:42.351831 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:42.351799    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:43.118789 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:43.118752    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:44.912487 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:44.912453    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:45.033690 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:45.033649    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:46.608633 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.608600    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:46.618936 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.618904    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-f2twc"]
Sep 09 23:30:46.622044 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.622029    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-f2twc"
Sep 09 23:30:46.624197 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.624170    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5hfgm\""
Sep 09 23:30:46.624321 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.624243    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 23:30:46.624321 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.624254    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 23:30:46.624321 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.624314    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 23:30:46.630824 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.630806    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-f2twc"]
Sep 09 23:30:46.714154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.714123    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-f2twc"]
Sep 09 23:30:46.723203 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.723169    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:46.745225 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.745199    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33290c2f-a2ea-4065-8986-9b35262c1b66-config-file\") pod \"limitador-limitador-8588749977-f2twc\" (UID: \"33290c2f-a2ea-4065-8986-9b35262c1b66\") " pod="kuadrant-system/limitador-limitador-8588749977-f2twc"
Sep 09 23:30:46.745366 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.745251    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6nwg\" (UniqueName: \"kubernetes.io/projected/33290c2f-a2ea-4065-8986-9b35262c1b66-kube-api-access-v6nwg\") pod \"limitador-limitador-8588749977-f2twc\" (UID: \"33290c2f-a2ea-4065-8986-9b35262c1b66\") " pod="kuadrant-system/limitador-limitador-8588749977-f2twc"
Sep 09 23:30:46.777754 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.777725    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:46.846076 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.846054    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33290c2f-a2ea-4065-8986-9b35262c1b66-config-file\") pod \"limitador-limitador-8588749977-f2twc\" (UID: \"33290c2f-a2ea-4065-8986-9b35262c1b66\") " pod="kuadrant-system/limitador-limitador-8588749977-f2twc"
Sep 09 23:30:46.846209 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.846105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6nwg\" (UniqueName: \"kubernetes.io/projected/33290c2f-a2ea-4065-8986-9b35262c1b66-kube-api-access-v6nwg\") pod \"limitador-limitador-8588749977-f2twc\" (UID: \"33290c2f-a2ea-4065-8986-9b35262c1b66\") " pod="kuadrant-system/limitador-limitador-8588749977-f2twc"
Sep 09 23:30:46.846796 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.846780    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33290c2f-a2ea-4065-8986-9b35262c1b66-config-file\") pod \"limitador-limitador-8588749977-f2twc\" (UID: \"33290c2f-a2ea-4065-8986-9b35262c1b66\") " pod="kuadrant-system/limitador-limitador-8588749977-f2twc"
Sep 09 23:30:46.853046 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.853020    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6nwg\" (UniqueName: \"kubernetes.io/projected/33290c2f-a2ea-4065-8986-9b35262c1b66-kube-api-access-v6nwg\") pod \"limitador-limitador-8588749977-f2twc\" (UID: \"33290c2f-a2ea-4065-8986-9b35262c1b66\") " pod="kuadrant-system/limitador-limitador-8588749977-f2twc"
Sep 09 23:30:46.932635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:46.932575    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-f2twc"
Sep 09 23:30:47.202063 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.202011    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-f2twc"]
Sep 09 23:30:47.204950 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:30:47.204922    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33290c2f_a2ea_4065_8986_9b35262c1b66.slice/crio-c6be3bc22025977c8fcd16d33d79edc63719d167de81cc46147bc3757deae2c1 WatchSource:0}: Error finding container c6be3bc22025977c8fcd16d33d79edc63719d167de81cc46147bc3757deae2c1: Status 404 returned error can't find the container with id c6be3bc22025977c8fcd16d33d79edc63719d167de81cc46147bc3757deae2c1
Sep 09 23:30:47.407932 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.407897    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-4hpc8"]
Sep 09 23:30:47.410903 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.410873    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-4hpc8"
Sep 09 23:30:47.412884 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.412857    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ldn7p\""
Sep 09 23:30:47.418026 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.417874    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-4hpc8"]
Sep 09 23:30:47.440471 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.440444    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:47.545329 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.545301    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:47.553403 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.553379    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm8vk\" (UniqueName: \"kubernetes.io/projected/458d913f-54b6-4c29-ac30-1ac4343eba8b-kube-api-access-nm8vk\") pod \"authorino-7bcfd8f9cd-4hpc8\" (UID: \"458d913f-54b6-4c29-ac30-1ac4343eba8b\") " pod="kuadrant-system/authorino-7bcfd8f9cd-4hpc8"
Sep 09 23:30:47.591230 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.591202    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-mcjzm"]
Sep 09 23:30:47.594460 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.594445    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-mcjzm"
Sep 09 23:30:47.600288 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.600266    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-mcjzm"]
Sep 09 23:30:47.654494 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.654470    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm8vk\" (UniqueName: \"kubernetes.io/projected/458d913f-54b6-4c29-ac30-1ac4343eba8b-kube-api-access-nm8vk\") pod \"authorino-7bcfd8f9cd-4hpc8\" (UID: \"458d913f-54b6-4c29-ac30-1ac4343eba8b\") " pod="kuadrant-system/authorino-7bcfd8f9cd-4hpc8"
Sep 09 23:30:47.661555 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.661529    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm8vk\" (UniqueName: \"kubernetes.io/projected/458d913f-54b6-4c29-ac30-1ac4343eba8b-kube-api-access-nm8vk\") pod \"authorino-7bcfd8f9cd-4hpc8\" (UID: \"458d913f-54b6-4c29-ac30-1ac4343eba8b\") " pod="kuadrant-system/authorino-7bcfd8f9cd-4hpc8"
Sep 09 23:30:47.720473 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.720444    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-4hpc8"
Sep 09 23:30:47.755694 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.755641    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k4ll\" (UniqueName: \"kubernetes.io/projected/076f375b-8f20-48d5-8c38-0fc960b3bb90-kube-api-access-9k4ll\") pod \"authorino-59c974bd48-mcjzm\" (UID: \"076f375b-8f20-48d5-8c38-0fc960b3bb90\") " pod="kuadrant-system/authorino-59c974bd48-mcjzm"
Sep 09 23:30:47.856364 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.856277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k4ll\" (UniqueName: \"kubernetes.io/projected/076f375b-8f20-48d5-8c38-0fc960b3bb90-kube-api-access-9k4ll\") pod \"authorino-59c974bd48-mcjzm\" (UID: \"076f375b-8f20-48d5-8c38-0fc960b3bb90\") " pod="kuadrant-system/authorino-59c974bd48-mcjzm"
Sep 09 23:30:47.856936 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.856910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-f2twc" event={"ID":"33290c2f-a2ea-4065-8986-9b35262c1b66","Type":"ContainerStarted","Data":"c6be3bc22025977c8fcd16d33d79edc63719d167de81cc46147bc3757deae2c1"}
Sep 09 23:30:47.865203 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.865174    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k4ll\" (UniqueName: \"kubernetes.io/projected/076f375b-8f20-48d5-8c38-0fc960b3bb90-kube-api-access-9k4ll\") pod \"authorino-59c974bd48-mcjzm\" (UID: \"076f375b-8f20-48d5-8c38-0fc960b3bb90\") " pod="kuadrant-system/authorino-59c974bd48-mcjzm"
Sep 09 23:30:47.903819 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.903784    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-mcjzm"
Sep 09 23:30:47.985250 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:47.985230    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-4hpc8"]
Sep 09 23:30:47.987609 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:30:47.987576    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod458d913f_54b6_4c29_ac30_1ac4343eba8b.slice/crio-9a1f7f526f5e5acab45f12f497941f2f8079c98dc9e3d66be7a4e2f8d958f932 WatchSource:0}: Error finding container 9a1f7f526f5e5acab45f12f497941f2f8079c98dc9e3d66be7a4e2f8d958f932: Status 404 returned error can't find the container with id 9a1f7f526f5e5acab45f12f497941f2f8079c98dc9e3d66be7a4e2f8d958f932
Sep 09 23:30:48.172699 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:48.172594    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-mcjzm"]
Sep 09 23:30:48.177804 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:30:48.177765    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod076f375b_8f20_48d5_8c38_0fc960b3bb90.slice/crio-716d349ccba9cbeb9e22429c5df3010d8d818268c0a1fb15f883eb084b4423a0 WatchSource:0}: Error finding container 716d349ccba9cbeb9e22429c5df3010d8d818268c0a1fb15f883eb084b4423a0: Status 404 returned error can't find the container with id 716d349ccba9cbeb9e22429c5df3010d8d818268c0a1fb15f883eb084b4423a0
Sep 09 23:30:48.844189 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:48.844154    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:48.864183 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:48.864149    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-mcjzm" event={"ID":"076f375b-8f20-48d5-8c38-0fc960b3bb90","Type":"ContainerStarted","Data":"716d349ccba9cbeb9e22429c5df3010d8d818268c0a1fb15f883eb084b4423a0"}
Sep 09 23:30:48.865509 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:48.865470    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-4hpc8" event={"ID":"458d913f-54b6-4c29-ac30-1ac4343eba8b","Type":"ContainerStarted","Data":"9a1f7f526f5e5acab45f12f497941f2f8079c98dc9e3d66be7a4e2f8d958f932"}
Sep 09 23:30:48.943116 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:48.943082    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:30:49.872808 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:49.872728    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-f2twc" event={"ID":"33290c2f-a2ea-4065-8986-9b35262c1b66","Type":"ContainerStarted","Data":"78f93d111e9e63c037938857a00c58c3fc58a629ad883347257b8b25a9885a33"}
Sep 09 23:30:49.873272 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:49.872895    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-f2twc"
Sep 09 23:30:49.889020 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:49.888964    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-f2twc" podStartSLOduration=1.54203464 podStartE2EDuration="3.888944025s" totalImagesPullingTime="2.346909385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:30:49.887555313 +0000 UTC m=+506.626278122" watchObservedRunningTime="2026-09-09 23:30:49.888944025 +0000 UTC m=+506.627666835"
Sep 09 23:30:50.878046 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:50.877959    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-mcjzm" event={"ID":"076f375b-8f20-48d5-8c38-0fc960b3bb90","Type":"ContainerStarted","Data":"c85dd30ba5af888dd66e61c9df36f908de8ea5291a99d6ff92135dbbd130fa10"}
Sep 09 23:30:50.879461 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:50.879431    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-4hpc8" event={"ID":"458d913f-54b6-4c29-ac30-1ac4343eba8b","Type":"ContainerStarted","Data":"3c2ff40128ae24e0c7a5f251a1159c736ce53a1526e95bba9bcf1b1135d9b8b1"}
Sep 09 23:30:50.894169 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:50.894121    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-mcjzm" podStartSLOduration=1.58935347 podStartE2EDuration="3.894108258s" totalImagesPullingTime="2.304754788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:30:50.893444618 +0000 UTC m=+507.632167427" watchObservedRunningTime="2026-09-09 23:30:50.894108258 +0000 UTC m=+507.632831096"
Sep 09 23:30:50.908043 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:50.908001    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-4hpc8" podStartSLOduration=1.407945438 podStartE2EDuration="3.907987338s" totalImagesPullingTime="2.5000419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:30:50.906643365 +0000 UTC m=+507.645366165" watchObservedRunningTime="2026-09-09 23:30:50.907987338 +0000 UTC m=+507.646710147"
Sep 09 23:30:50.925089 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:50.925062    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-4hpc8"]
Sep 09 23:30:52.887552 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:52.887511    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-4hpc8" podUID="458d913f-54b6-4c29-ac30-1ac4343eba8b" containerName="authorino" containerID="cri-o://3c2ff40128ae24e0c7a5f251a1159c736ce53a1526e95bba9bcf1b1135d9b8b1" gracePeriod=30
Sep 09 23:30:53.122056 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:53.122034    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-4hpc8"
Sep 09 23:30:53.202046 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:53.201968    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm8vk\" (UniqueName: \"kubernetes.io/projected/458d913f-54b6-4c29-ac30-1ac4343eba8b-kube-api-access-nm8vk\") pod \"458d913f-54b6-4c29-ac30-1ac4343eba8b\" (UID: \"458d913f-54b6-4c29-ac30-1ac4343eba8b\") "
Sep 09 23:30:53.204069 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:53.204049    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/458d913f-54b6-4c29-ac30-1ac4343eba8b-kube-api-access-nm8vk" (OuterVolumeSpecName: "kube-api-access-nm8vk") pod "458d913f-54b6-4c29-ac30-1ac4343eba8b" (UID: "458d913f-54b6-4c29-ac30-1ac4343eba8b"). InnerVolumeSpecName "kube-api-access-nm8vk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:30:53.302610 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:53.302577    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm8vk\" (UniqueName: \"kubernetes.io/projected/458d913f-54b6-4c29-ac30-1ac4343eba8b-kube-api-access-nm8vk\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:30:53.892508 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:53.892474    2581 generic.go:356] "Generic (PLEG): container finished" podID="458d913f-54b6-4c29-ac30-1ac4343eba8b" containerID="3c2ff40128ae24e0c7a5f251a1159c736ce53a1526e95bba9bcf1b1135d9b8b1" exitCode=0
Sep 09 23:30:53.892508 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:53.892510    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-4hpc8"
Sep 09 23:30:53.892936 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:53.892551    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-4hpc8" event={"ID":"458d913f-54b6-4c29-ac30-1ac4343eba8b","Type":"ContainerDied","Data":"3c2ff40128ae24e0c7a5f251a1159c736ce53a1526e95bba9bcf1b1135d9b8b1"}
Sep 09 23:30:53.892936 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:53.892593    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-4hpc8" event={"ID":"458d913f-54b6-4c29-ac30-1ac4343eba8b","Type":"ContainerDied","Data":"9a1f7f526f5e5acab45f12f497941f2f8079c98dc9e3d66be7a4e2f8d958f932"}
Sep 09 23:30:53.892936 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:53.892619    2581 scope.go:117] "RemoveContainer" containerID="3c2ff40128ae24e0c7a5f251a1159c736ce53a1526e95bba9bcf1b1135d9b8b1"
Sep 09 23:30:53.900862 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:53.900830    2581 scope.go:117] "RemoveContainer" containerID="3c2ff40128ae24e0c7a5f251a1159c736ce53a1526e95bba9bcf1b1135d9b8b1"
Sep 09 23:30:53.901157 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:30:53.901130    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c2ff40128ae24e0c7a5f251a1159c736ce53a1526e95bba9bcf1b1135d9b8b1\": container with ID starting with 3c2ff40128ae24e0c7a5f251a1159c736ce53a1526e95bba9bcf1b1135d9b8b1 not found: ID does not exist" containerID="3c2ff40128ae24e0c7a5f251a1159c736ce53a1526e95bba9bcf1b1135d9b8b1"
Sep 09 23:30:53.901229 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:53.901163    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c2ff40128ae24e0c7a5f251a1159c736ce53a1526e95bba9bcf1b1135d9b8b1"} err="failed to get container status \"3c2ff40128ae24e0c7a5f251a1159c736ce53a1526e95bba9bcf1b1135d9b8b1\": rpc error: code = NotFound desc = could not find container \"3c2ff40128ae24e0c7a5f251a1159c736ce53a1526e95bba9bcf1b1135d9b8b1\": container with ID starting with 3c2ff40128ae24e0c7a5f251a1159c736ce53a1526e95bba9bcf1b1135d9b8b1 not found: ID does not exist"
Sep 09 23:30:53.906745 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:53.906723    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-4hpc8"]
Sep 09 23:30:53.910100 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:53.910079    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-4hpc8"]
Sep 09 23:30:55.743555 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:30:55.743518    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="458d913f-54b6-4c29-ac30-1ac4343eba8b" path="/var/lib/kubelet/pods/458d913f-54b6-4c29-ac30-1ac4343eba8b/volumes"
Sep 09 23:31:00.705644 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:00.705607    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-f2twc"]
Sep 09 23:31:00.706035 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:00.705865    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-f2twc" podUID="33290c2f-a2ea-4065-8986-9b35262c1b66" containerName="limitador" containerID="cri-o://78f93d111e9e63c037938857a00c58c3fc58a629ad883347257b8b25a9885a33" gracePeriod=30
Sep 09 23:31:00.706600 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:00.706513    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-f2twc"
Sep 09 23:31:01.237736 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:01.237714    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-f2twc"
Sep 09 23:31:01.368981 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:01.368905    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6nwg\" (UniqueName: \"kubernetes.io/projected/33290c2f-a2ea-4065-8986-9b35262c1b66-kube-api-access-v6nwg\") pod \"33290c2f-a2ea-4065-8986-9b35262c1b66\" (UID: \"33290c2f-a2ea-4065-8986-9b35262c1b66\") "
Sep 09 23:31:01.369115 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:01.369032    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33290c2f-a2ea-4065-8986-9b35262c1b66-config-file\") pod \"33290c2f-a2ea-4065-8986-9b35262c1b66\" (UID: \"33290c2f-a2ea-4065-8986-9b35262c1b66\") "
Sep 09 23:31:01.369369 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:01.369346    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33290c2f-a2ea-4065-8986-9b35262c1b66-config-file" (OuterVolumeSpecName: "config-file") pod "33290c2f-a2ea-4065-8986-9b35262c1b66" (UID: "33290c2f-a2ea-4065-8986-9b35262c1b66"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:31:01.371050 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:01.371020    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33290c2f-a2ea-4065-8986-9b35262c1b66-kube-api-access-v6nwg" (OuterVolumeSpecName: "kube-api-access-v6nwg") pod "33290c2f-a2ea-4065-8986-9b35262c1b66" (UID: "33290c2f-a2ea-4065-8986-9b35262c1b66"). InnerVolumeSpecName "kube-api-access-v6nwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:31:01.470373 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:01.470330    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/33290c2f-a2ea-4065-8986-9b35262c1b66-config-file\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:31:01.470373 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:01.470367    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6nwg\" (UniqueName: \"kubernetes.io/projected/33290c2f-a2ea-4065-8986-9b35262c1b66-kube-api-access-v6nwg\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:31:01.929016 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:01.928979    2581 generic.go:356] "Generic (PLEG): container finished" podID="33290c2f-a2ea-4065-8986-9b35262c1b66" containerID="78f93d111e9e63c037938857a00c58c3fc58a629ad883347257b8b25a9885a33" exitCode=0
Sep 09 23:31:01.929532 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:01.929024    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-f2twc"
Sep 09 23:31:01.929532 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:01.929032    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-f2twc" event={"ID":"33290c2f-a2ea-4065-8986-9b35262c1b66","Type":"ContainerDied","Data":"78f93d111e9e63c037938857a00c58c3fc58a629ad883347257b8b25a9885a33"}
Sep 09 23:31:01.929532 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:01.929085    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-f2twc" event={"ID":"33290c2f-a2ea-4065-8986-9b35262c1b66","Type":"ContainerDied","Data":"c6be3bc22025977c8fcd16d33d79edc63719d167de81cc46147bc3757deae2c1"}
Sep 09 23:31:01.929532 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:01.929119    2581 scope.go:117] "RemoveContainer" containerID="78f93d111e9e63c037938857a00c58c3fc58a629ad883347257b8b25a9885a33"
Sep 09 23:31:01.937060 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:01.937037    2581 scope.go:117] "RemoveContainer" containerID="78f93d111e9e63c037938857a00c58c3fc58a629ad883347257b8b25a9885a33"
Sep 09 23:31:01.937353 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:31:01.937333    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78f93d111e9e63c037938857a00c58c3fc58a629ad883347257b8b25a9885a33\": container with ID starting with 78f93d111e9e63c037938857a00c58c3fc58a629ad883347257b8b25a9885a33 not found: ID does not exist" containerID="78f93d111e9e63c037938857a00c58c3fc58a629ad883347257b8b25a9885a33"
Sep 09 23:31:01.937408 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:01.937362    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f93d111e9e63c037938857a00c58c3fc58a629ad883347257b8b25a9885a33"} err="failed to get container status \"78f93d111e9e63c037938857a00c58c3fc58a629ad883347257b8b25a9885a33\": rpc error: code = NotFound desc = could not find container \"78f93d111e9e63c037938857a00c58c3fc58a629ad883347257b8b25a9885a33\": container with ID starting with 78f93d111e9e63c037938857a00c58c3fc58a629ad883347257b8b25a9885a33 not found: ID does not exist"
Sep 09 23:31:01.943797 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:01.943773    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-f2twc"]
Sep 09 23:31:01.949503 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:01.949482    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-f2twc"]
Sep 09 23:31:02.706420 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:02.706347    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:02.803413 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:02.803380    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:03.121042 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.121012    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jjfbk"]
Sep 09 23:31:03.121387 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.121343    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="458d913f-54b6-4c29-ac30-1ac4343eba8b" containerName="authorino"
Sep 09 23:31:03.121387 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.121357    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="458d913f-54b6-4c29-ac30-1ac4343eba8b" containerName="authorino"
Sep 09 23:31:03.121387 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.121372    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33290c2f-a2ea-4065-8986-9b35262c1b66" containerName="limitador"
Sep 09 23:31:03.121387 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.121378    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="33290c2f-a2ea-4065-8986-9b35262c1b66" containerName="limitador"
Sep 09 23:31:03.121596 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.121422    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="33290c2f-a2ea-4065-8986-9b35262c1b66" containerName="limitador"
Sep 09 23:31:03.121596 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.121430    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="458d913f-54b6-4c29-ac30-1ac4343eba8b" containerName="authorino"
Sep 09 23:31:03.125662 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.125643    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjfbk"
Sep 09 23:31:03.128032 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.127990    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 09 23:31:03.128032 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.128013    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-25ss6\""
Sep 09 23:31:03.128320 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.128052    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 23:31:03.128821 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.128806    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 23:31:03.133272 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.133247    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jjfbk"]
Sep 09 23:31:03.152775 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.152751    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:03.183987 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.183958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8btwn\" (UniqueName: \"kubernetes.io/projected/fe78f86e-81b2-474c-af0c-3667a4204a15-kube-api-access-8btwn\") pod \"postgres-69fb4594cf-jjfbk\" (UID: \"fe78f86e-81b2-474c-af0c-3667a4204a15\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjfbk"
Sep 09 23:31:03.184098 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.183994    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fe78f86e-81b2-474c-af0c-3667a4204a15-data\") pod \"postgres-69fb4594cf-jjfbk\" (UID: \"fe78f86e-81b2-474c-af0c-3667a4204a15\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjfbk"
Sep 09 23:31:03.284869 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.284833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8btwn\" (UniqueName: \"kubernetes.io/projected/fe78f86e-81b2-474c-af0c-3667a4204a15-kube-api-access-8btwn\") pod \"postgres-69fb4594cf-jjfbk\" (UID: \"fe78f86e-81b2-474c-af0c-3667a4204a15\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjfbk"
Sep 09 23:31:03.285055 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.284875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fe78f86e-81b2-474c-af0c-3667a4204a15-data\") pod \"postgres-69fb4594cf-jjfbk\" (UID: \"fe78f86e-81b2-474c-af0c-3667a4204a15\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjfbk"
Sep 09 23:31:03.285206 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.285190    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fe78f86e-81b2-474c-af0c-3667a4204a15-data\") pod \"postgres-69fb4594cf-jjfbk\" (UID: \"fe78f86e-81b2-474c-af0c-3667a4204a15\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjfbk"
Sep 09 23:31:03.292258 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.292231    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8btwn\" (UniqueName: \"kubernetes.io/projected/fe78f86e-81b2-474c-af0c-3667a4204a15-kube-api-access-8btwn\") pod \"postgres-69fb4594cf-jjfbk\" (UID: \"fe78f86e-81b2-474c-af0c-3667a4204a15\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjfbk"
Sep 09 23:31:03.438091 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.438003    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjfbk"
Sep 09 23:31:03.709188 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.709119    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jjfbk"]
Sep 09 23:31:03.712780 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:31:03.712753    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe78f86e_81b2_474c_af0c_3667a4204a15.slice/crio-32b47b23f7f9244089e4a17f4d5cadc97698b17f972a1ac89780257d8a21bcb6 WatchSource:0}: Error finding container 32b47b23f7f9244089e4a17f4d5cadc97698b17f972a1ac89780257d8a21bcb6: Status 404 returned error can't find the container with id 32b47b23f7f9244089e4a17f4d5cadc97698b17f972a1ac89780257d8a21bcb6
Sep 09 23:31:03.745718 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.745689    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33290c2f-a2ea-4065-8986-9b35262c1b66" path="/var/lib/kubelet/pods/33290c2f-a2ea-4065-8986-9b35262c1b66/volumes"
Sep 09 23:31:03.939634 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:03.939600    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjfbk" event={"ID":"fe78f86e-81b2-474c-af0c-3667a4204a15","Type":"ContainerStarted","Data":"32b47b23f7f9244089e4a17f4d5cadc97698b17f972a1ac89780257d8a21bcb6"}
Sep 09 23:31:08.971216 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:08.971182    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjfbk" event={"ID":"fe78f86e-81b2-474c-af0c-3667a4204a15","Type":"ContainerStarted","Data":"da21c4cdd2d083aa98403dafd55e37962375f11194ee6110afa36c5367d900ad"}
Sep 09 23:31:08.971593 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:08.971323    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjfbk"
Sep 09 23:31:08.985967 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:08.985923    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjfbk" podStartSLOduration=1.2701338340000001 podStartE2EDuration="5.985908612s" totalImagesPullingTime="4.715774778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:31:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:31:08.985272243 +0000 UTC m=+525.723995054" watchObservedRunningTime="2026-09-09 23:31:08.985908612 +0000 UTC m=+525.724631420"
Sep 09 23:31:12.118144 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:12.118113    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:15.003850 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.003822    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jjfbk"
Sep 09 23:31:15.305558 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.305477    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:15.511175 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.511141    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:15.517415 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.517390    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-s6ph6"]
Sep 09 23:31:15.523871 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.523846    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-s6ph6"
Sep 09 23:31:15.524700 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.524664    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-s6ph6"]
Sep 09 23:31:15.572262 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.572203    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-s6ph6"]
Sep 09 23:31:15.572397 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:31:15.572380    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-df2xs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-s6ph6" podUID="fecd2b3c-2988-4315-82fe-14164b5d9943"
Sep 09 23:31:15.585082 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.585060    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df2xs\" (UniqueName: \"kubernetes.io/projected/fecd2b3c-2988-4315-82fe-14164b5d9943-kube-api-access-df2xs\") pod \"authorino-557f876f69-s6ph6\" (UID: \"fecd2b3c-2988-4315-82fe-14164b5d9943\") " pod="kuadrant-system/authorino-557f876f69-s6ph6"
Sep 09 23:31:15.598058 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.598027    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-vg8dj"]
Sep 09 23:31:15.601729 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.601710    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-vg8dj"
Sep 09 23:31:15.603800 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.603782    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 09 23:31:15.608195 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.608172    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-vg8dj"]
Sep 09 23:31:15.685663 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.685632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tszgw\" (UniqueName: \"kubernetes.io/projected/e23bcfac-2944-44fc-b47b-c0525f4d27fe-kube-api-access-tszgw\") pod \"authorino-6d4dfc649f-vg8dj\" (UID: \"e23bcfac-2944-44fc-b47b-c0525f4d27fe\") " pod="kuadrant-system/authorino-6d4dfc649f-vg8dj"
Sep 09 23:31:15.685815 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.685704    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e23bcfac-2944-44fc-b47b-c0525f4d27fe-tls-cert\") pod \"authorino-6d4dfc649f-vg8dj\" (UID: \"e23bcfac-2944-44fc-b47b-c0525f4d27fe\") " pod="kuadrant-system/authorino-6d4dfc649f-vg8dj"
Sep 09 23:31:15.685815 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.685737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df2xs\" (UniqueName: \"kubernetes.io/projected/fecd2b3c-2988-4315-82fe-14164b5d9943-kube-api-access-df2xs\") pod \"authorino-557f876f69-s6ph6\" (UID: \"fecd2b3c-2988-4315-82fe-14164b5d9943\") " pod="kuadrant-system/authorino-557f876f69-s6ph6"
Sep 09 23:31:15.693760 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.693732    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df2xs\" (UniqueName: \"kubernetes.io/projected/fecd2b3c-2988-4315-82fe-14164b5d9943-kube-api-access-df2xs\") pod \"authorino-557f876f69-s6ph6\" (UID: \"fecd2b3c-2988-4315-82fe-14164b5d9943\") " pod="kuadrant-system/authorino-557f876f69-s6ph6"
Sep 09 23:31:15.736684 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.736644    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-vg8dj"]
Sep 09 23:31:15.736914 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:31:15.736895    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-tszgw tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-vg8dj" podUID="e23bcfac-2944-44fc-b47b-c0525f4d27fe"
Sep 09 23:31:15.767249 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.767223    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6cbc54bbc5-82mvp"]
Sep 09 23:31:15.770917 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.770899    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cbc54bbc5-82mvp"
Sep 09 23:31:15.777472 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.777443    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cbc54bbc5-82mvp"]
Sep 09 23:31:15.786228 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.786209    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tszgw\" (UniqueName: \"kubernetes.io/projected/e23bcfac-2944-44fc-b47b-c0525f4d27fe-kube-api-access-tszgw\") pod \"authorino-6d4dfc649f-vg8dj\" (UID: \"e23bcfac-2944-44fc-b47b-c0525f4d27fe\") " pod="kuadrant-system/authorino-6d4dfc649f-vg8dj"
Sep 09 23:31:15.786324 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.786244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e23bcfac-2944-44fc-b47b-c0525f4d27fe-tls-cert\") pod \"authorino-6d4dfc649f-vg8dj\" (UID: \"e23bcfac-2944-44fc-b47b-c0525f4d27fe\") " pod="kuadrant-system/authorino-6d4dfc649f-vg8dj"
Sep 09 23:31:15.788546 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.788528    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e23bcfac-2944-44fc-b47b-c0525f4d27fe-tls-cert\") pod \"authorino-6d4dfc649f-vg8dj\" (UID: \"e23bcfac-2944-44fc-b47b-c0525f4d27fe\") " pod="kuadrant-system/authorino-6d4dfc649f-vg8dj"
Sep 09 23:31:15.792818 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.792798    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tszgw\" (UniqueName: \"kubernetes.io/projected/e23bcfac-2944-44fc-b47b-c0525f4d27fe-kube-api-access-tszgw\") pod \"authorino-6d4dfc649f-vg8dj\" (UID: \"e23bcfac-2944-44fc-b47b-c0525f4d27fe\") " pod="kuadrant-system/authorino-6d4dfc649f-vg8dj"
Sep 09 23:31:15.887623 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.887539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxxcm\" (UniqueName: \"kubernetes.io/projected/7e49be6d-c3ca-47fd-9657-10d54940a938-kube-api-access-cxxcm\") pod \"authorino-6cbc54bbc5-82mvp\" (UID: \"7e49be6d-c3ca-47fd-9657-10d54940a938\") " pod="kuadrant-system/authorino-6cbc54bbc5-82mvp"
Sep 09 23:31:15.887623 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.887586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7e49be6d-c3ca-47fd-9657-10d54940a938-tls-cert\") pod \"authorino-6cbc54bbc5-82mvp\" (UID: \"7e49be6d-c3ca-47fd-9657-10d54940a938\") " pod="kuadrant-system/authorino-6cbc54bbc5-82mvp"
Sep 09 23:31:15.988131 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.988078    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxxcm\" (UniqueName: \"kubernetes.io/projected/7e49be6d-c3ca-47fd-9657-10d54940a938-kube-api-access-cxxcm\") pod \"authorino-6cbc54bbc5-82mvp\" (UID: \"7e49be6d-c3ca-47fd-9657-10d54940a938\") " pod="kuadrant-system/authorino-6cbc54bbc5-82mvp"
Sep 09 23:31:15.988131 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.988118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7e49be6d-c3ca-47fd-9657-10d54940a938-tls-cert\") pod \"authorino-6cbc54bbc5-82mvp\" (UID: \"7e49be6d-c3ca-47fd-9657-10d54940a938\") " pod="kuadrant-system/authorino-6cbc54bbc5-82mvp"
Sep 09 23:31:15.990394 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.990375    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7e49be6d-c3ca-47fd-9657-10d54940a938-tls-cert\") pod \"authorino-6cbc54bbc5-82mvp\" (UID: \"7e49be6d-c3ca-47fd-9657-10d54940a938\") " pod="kuadrant-system/authorino-6cbc54bbc5-82mvp"
Sep 09 23:31:15.995802 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.995780    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxxcm\" (UniqueName: \"kubernetes.io/projected/7e49be6d-c3ca-47fd-9657-10d54940a938-kube-api-access-cxxcm\") pod \"authorino-6cbc54bbc5-82mvp\" (UID: \"7e49be6d-c3ca-47fd-9657-10d54940a938\") " pod="kuadrant-system/authorino-6cbc54bbc5-82mvp"
Sep 09 23:31:15.999078 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.999057    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-s6ph6"
Sep 09 23:31:15.999078 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:15.999070    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-vg8dj"
Sep 09 23:31:16.010072 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:16.010055    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-s6ph6"
Sep 09 23:31:16.012762 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:16.012737    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-vg8dj"
Sep 09 23:31:16.080769 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:16.080745    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cbc54bbc5-82mvp"
Sep 09 23:31:16.088851 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:16.088831    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e23bcfac-2944-44fc-b47b-c0525f4d27fe-tls-cert\") pod \"e23bcfac-2944-44fc-b47b-c0525f4d27fe\" (UID: \"e23bcfac-2944-44fc-b47b-c0525f4d27fe\") "
Sep 09 23:31:16.088914 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:16.088871    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tszgw\" (UniqueName: \"kubernetes.io/projected/e23bcfac-2944-44fc-b47b-c0525f4d27fe-kube-api-access-tszgw\") pod \"e23bcfac-2944-44fc-b47b-c0525f4d27fe\" (UID: \"e23bcfac-2944-44fc-b47b-c0525f4d27fe\") "
Sep 09 23:31:16.088952 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:16.088918    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df2xs\" (UniqueName: \"kubernetes.io/projected/fecd2b3c-2988-4315-82fe-14164b5d9943-kube-api-access-df2xs\") pod \"fecd2b3c-2988-4315-82fe-14164b5d9943\" (UID: \"fecd2b3c-2988-4315-82fe-14164b5d9943\") "
Sep 09 23:31:16.090827 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:16.090798    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e23bcfac-2944-44fc-b47b-c0525f4d27fe-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e23bcfac-2944-44fc-b47b-c0525f4d27fe" (UID: "e23bcfac-2944-44fc-b47b-c0525f4d27fe"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:31:16.091008 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:16.090978    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fecd2b3c-2988-4315-82fe-14164b5d9943-kube-api-access-df2xs" (OuterVolumeSpecName: "kube-api-access-df2xs") pod "fecd2b3c-2988-4315-82fe-14164b5d9943" (UID: "fecd2b3c-2988-4315-82fe-14164b5d9943"). InnerVolumeSpecName "kube-api-access-df2xs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:31:16.091066 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:16.090998    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e23bcfac-2944-44fc-b47b-c0525f4d27fe-kube-api-access-tszgw" (OuterVolumeSpecName: "kube-api-access-tszgw") pod "e23bcfac-2944-44fc-b47b-c0525f4d27fe" (UID: "e23bcfac-2944-44fc-b47b-c0525f4d27fe"). InnerVolumeSpecName "kube-api-access-tszgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:31:16.190140 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:16.190075    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df2xs\" (UniqueName: \"kubernetes.io/projected/fecd2b3c-2988-4315-82fe-14164b5d9943-kube-api-access-df2xs\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:31:16.190140 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:16.190099    2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e23bcfac-2944-44fc-b47b-c0525f4d27fe-tls-cert\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:31:16.190140 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:16.190108    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tszgw\" (UniqueName: \"kubernetes.io/projected/e23bcfac-2944-44fc-b47b-c0525f4d27fe-kube-api-access-tszgw\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:31:16.345707 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:16.345664    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cbc54bbc5-82mvp"]
Sep 09 23:31:16.348012 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:31:16.347992    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e49be6d_c3ca_47fd_9657_10d54940a938.slice/crio-cb319cb6e473a2c041c64805aad44c9271ec7107d3950fe863440d373025708d WatchSource:0}: Error finding container cb319cb6e473a2c041c64805aad44c9271ec7107d3950fe863440d373025708d: Status 404 returned error can't find the container with id cb319cb6e473a2c041c64805aad44c9271ec7107d3950fe863440d373025708d
Sep 09 23:31:17.004123 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:17.004093    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cbc54bbc5-82mvp" event={"ID":"7e49be6d-c3ca-47fd-9657-10d54940a938","Type":"ContainerStarted","Data":"cb319cb6e473a2c041c64805aad44c9271ec7107d3950fe863440d373025708d"}
Sep 09 23:31:17.004230 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:17.004128    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-vg8dj"
Sep 09 23:31:17.004230 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:17.004129    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-s6ph6"
Sep 09 23:31:17.053984 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:17.053957    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-vg8dj"]
Sep 09 23:31:17.059634 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:17.059613    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-vg8dj"]
Sep 09 23:31:17.078898 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:17.078872    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-s6ph6"]
Sep 09 23:31:17.082823 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:17.082795    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-s6ph6"]
Sep 09 23:31:17.744865 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:17.744832    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e23bcfac-2944-44fc-b47b-c0525f4d27fe" path="/var/lib/kubelet/pods/e23bcfac-2944-44fc-b47b-c0525f4d27fe/volumes"
Sep 09 23:31:17.745065 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:17.745053    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fecd2b3c-2988-4315-82fe-14164b5d9943" path="/var/lib/kubelet/pods/fecd2b3c-2988-4315-82fe-14164b5d9943/volumes"
Sep 09 23:31:18.009660 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:18.009581    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cbc54bbc5-82mvp" event={"ID":"7e49be6d-c3ca-47fd-9657-10d54940a938","Type":"ContainerStarted","Data":"b51106127e8d9c4b1eaa5d08333f7a3a2f194e2152182b2df4cad0b42dbab192"}
Sep 09 23:31:18.024120 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:18.024073    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6cbc54bbc5-82mvp" podStartSLOduration=2.378380777 podStartE2EDuration="3.024056431s" totalImagesPullingTime="645.675654ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:31:18.022572212 +0000 UTC m=+534.761295022" watchObservedRunningTime="2026-09-09 23:31:18.024056431 +0000 UTC m=+534.762779240"
Sep 09 23:31:18.047533 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:18.047501    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-mcjzm"]
Sep 09 23:31:18.047730 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:18.047707    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-mcjzm" podUID="076f375b-8f20-48d5-8c38-0fc960b3bb90" containerName="authorino" containerID="cri-o://c85dd30ba5af888dd66e61c9df36f908de8ea5291a99d6ff92135dbbd130fa10" gracePeriod=30
Sep 09 23:31:18.303107 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:18.303081    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-mcjzm"
Sep 09 23:31:18.408786 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:18.408760    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k4ll\" (UniqueName: \"kubernetes.io/projected/076f375b-8f20-48d5-8c38-0fc960b3bb90-kube-api-access-9k4ll\") pod \"076f375b-8f20-48d5-8c38-0fc960b3bb90\" (UID: \"076f375b-8f20-48d5-8c38-0fc960b3bb90\") "
Sep 09 23:31:18.410770 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:18.410741    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/076f375b-8f20-48d5-8c38-0fc960b3bb90-kube-api-access-9k4ll" (OuterVolumeSpecName: "kube-api-access-9k4ll") pod "076f375b-8f20-48d5-8c38-0fc960b3bb90" (UID: "076f375b-8f20-48d5-8c38-0fc960b3bb90"). InnerVolumeSpecName "kube-api-access-9k4ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:31:18.509889 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:18.509863    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k4ll\" (UniqueName: \"kubernetes.io/projected/076f375b-8f20-48d5-8c38-0fc960b3bb90-kube-api-access-9k4ll\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:31:19.023909 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:19.023865    2581 generic.go:356] "Generic (PLEG): container finished" podID="076f375b-8f20-48d5-8c38-0fc960b3bb90" containerID="c85dd30ba5af888dd66e61c9df36f908de8ea5291a99d6ff92135dbbd130fa10" exitCode=0
Sep 09 23:31:19.024093 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:19.023914    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-mcjzm"
Sep 09 23:31:19.024093 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:19.023955    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-mcjzm" event={"ID":"076f375b-8f20-48d5-8c38-0fc960b3bb90","Type":"ContainerDied","Data":"c85dd30ba5af888dd66e61c9df36f908de8ea5291a99d6ff92135dbbd130fa10"}
Sep 09 23:31:19.024093 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:19.024003    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-mcjzm" event={"ID":"076f375b-8f20-48d5-8c38-0fc960b3bb90","Type":"ContainerDied","Data":"716d349ccba9cbeb9e22429c5df3010d8d818268c0a1fb15f883eb084b4423a0"}
Sep 09 23:31:19.024093 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:19.024029    2581 scope.go:117] "RemoveContainer" containerID="c85dd30ba5af888dd66e61c9df36f908de8ea5291a99d6ff92135dbbd130fa10"
Sep 09 23:31:19.047583 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:19.047559    2581 scope.go:117] "RemoveContainer" containerID="c85dd30ba5af888dd66e61c9df36f908de8ea5291a99d6ff92135dbbd130fa10"
Sep 09 23:31:19.048078 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:31:19.048056    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c85dd30ba5af888dd66e61c9df36f908de8ea5291a99d6ff92135dbbd130fa10\": container with ID starting with c85dd30ba5af888dd66e61c9df36f908de8ea5291a99d6ff92135dbbd130fa10 not found: ID does not exist" containerID="c85dd30ba5af888dd66e61c9df36f908de8ea5291a99d6ff92135dbbd130fa10"
Sep 09 23:31:19.048178 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:19.048099    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c85dd30ba5af888dd66e61c9df36f908de8ea5291a99d6ff92135dbbd130fa10"} err="failed to get container status \"c85dd30ba5af888dd66e61c9df36f908de8ea5291a99d6ff92135dbbd130fa10\": rpc error: code = NotFound desc = could not find container \"c85dd30ba5af888dd66e61c9df36f908de8ea5291a99d6ff92135dbbd130fa10\": container with ID starting with c85dd30ba5af888dd66e61c9df36f908de8ea5291a99d6ff92135dbbd130fa10 not found: ID does not exist"
Sep 09 23:31:19.056774 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:19.056750    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-mcjzm"]
Sep 09 23:31:19.059948 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:19.059907    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-mcjzm"]
Sep 09 23:31:19.744301 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:19.744270    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="076f375b-8f20-48d5-8c38-0fc960b3bb90" path="/var/lib/kubelet/pods/076f375b-8f20-48d5-8c38-0fc960b3bb90/volumes"
Sep 09 23:31:22.065797 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.065766    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:22.739080 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.739041    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:22.764687 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.764655    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b9cd6f55b-zg94j"]
Sep 09 23:31:22.765012 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.764997    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="076f375b-8f20-48d5-8c38-0fc960b3bb90" containerName="authorino"
Sep 09 23:31:22.765054 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.765015    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="076f375b-8f20-48d5-8c38-0fc960b3bb90" containerName="authorino"
Sep 09 23:31:22.765087 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.765080    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="076f375b-8f20-48d5-8c38-0fc960b3bb90" containerName="authorino"
Sep 09 23:31:22.781177 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.781136    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b9cd6f55b-zg94j"]
Sep 09 23:31:22.781334 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.781271    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:22.783546 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.783524    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 23:31:22.783700 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.783632    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xw8lt\""
Sep 09 23:31:22.783765 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.783704    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 23:31:22.784270 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.784198    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 23:31:22.800459 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.800439    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:22.842941 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.842918    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-webhook-cert\") pod \"maas-controller-7b9cd6f55b-zg94j\" (UID: \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\") " pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:22.843026 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.842952    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rstcp\" (UniqueName: \"kubernetes.io/projected/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-kube-api-access-rstcp\") pod \"maas-controller-7b9cd6f55b-zg94j\" (UID: \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\") " pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:22.843026 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.842991    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-metrics-certs\") pod \"maas-controller-7b9cd6f55b-zg94j\" (UID: \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\") " pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:22.851265 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.851246    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:22.931808 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.931780    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55dfbc648b-ct4sn"]
Sep 09 23:31:22.934299 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.934284    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55dfbc648b-ct4sn"
Sep 09 23:31:22.943514 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.943492    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55dfbc648b-ct4sn"]
Sep 09 23:31:22.943725 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.943706    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-metrics-certs\") pod \"maas-controller-7b9cd6f55b-zg94j\" (UID: \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\") " pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:22.943797 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.943768    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-webhook-cert\") pod \"maas-controller-7b9cd6f55b-zg94j\" (UID: \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\") " pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:22.943853 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.943823    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rstcp\" (UniqueName: \"kubernetes.io/projected/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-kube-api-access-rstcp\") pod \"maas-controller-7b9cd6f55b-zg94j\" (UID: \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\") " pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:22.943909 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:31:22.943875    2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 09 23:31:22.943963 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:31:22.943922    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-metrics-certs podName:af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5 nodeName:}" failed. No retries permitted until 2026-09-09 23:31:23.443907762 +0000 UTC m=+540.182630548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-metrics-certs") pod "maas-controller-7b9cd6f55b-zg94j" (UID: "af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5") : secret "maas-controller-metrics-tls" not found
Sep 09 23:31:22.944070 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:31:22.944057    2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 09 23:31:22.944129 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:31:22.944089    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-webhook-cert podName:af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5 nodeName:}" failed. No retries permitted until 2026-09-09 23:31:23.444080598 +0000 UTC m=+540.182803385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-webhook-cert") pod "maas-controller-7b9cd6f55b-zg94j" (UID: "af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5") : secret "maas-controller-webhook-cert" not found
Sep 09 23:31:22.951955 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:22.951930    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rstcp\" (UniqueName: \"kubernetes.io/projected/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-kube-api-access-rstcp\") pod \"maas-controller-7b9cd6f55b-zg94j\" (UID: \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\") " pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:23.045202 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.045130    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8846e96-6964-41c4-b087-cccfb83cd58e-metrics-certs\") pod \"maas-controller-55dfbc648b-ct4sn\" (UID: \"f8846e96-6964-41c4-b087-cccfb83cd58e\") " pod="opendatahub/maas-controller-55dfbc648b-ct4sn"
Sep 09 23:31:23.045202 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.045174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nwwq\" (UniqueName: \"kubernetes.io/projected/f8846e96-6964-41c4-b087-cccfb83cd58e-kube-api-access-4nwwq\") pod \"maas-controller-55dfbc648b-ct4sn\" (UID: \"f8846e96-6964-41c4-b087-cccfb83cd58e\") " pod="opendatahub/maas-controller-55dfbc648b-ct4sn"
Sep 09 23:31:23.045202 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.045199    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8846e96-6964-41c4-b087-cccfb83cd58e-webhook-cert\") pod \"maas-controller-55dfbc648b-ct4sn\" (UID: \"f8846e96-6964-41c4-b087-cccfb83cd58e\") " pod="opendatahub/maas-controller-55dfbc648b-ct4sn"
Sep 09 23:31:23.120360 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.120327    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:23.146068 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.146029    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8846e96-6964-41c4-b087-cccfb83cd58e-webhook-cert\") pod \"maas-controller-55dfbc648b-ct4sn\" (UID: \"f8846e96-6964-41c4-b087-cccfb83cd58e\") " pod="opendatahub/maas-controller-55dfbc648b-ct4sn"
Sep 09 23:31:23.146222 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.146091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8846e96-6964-41c4-b087-cccfb83cd58e-metrics-certs\") pod \"maas-controller-55dfbc648b-ct4sn\" (UID: \"f8846e96-6964-41c4-b087-cccfb83cd58e\") " pod="opendatahub/maas-controller-55dfbc648b-ct4sn"
Sep 09 23:31:23.146222 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.146126    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nwwq\" (UniqueName: \"kubernetes.io/projected/f8846e96-6964-41c4-b087-cccfb83cd58e-kube-api-access-4nwwq\") pod \"maas-controller-55dfbc648b-ct4sn\" (UID: \"f8846e96-6964-41c4-b087-cccfb83cd58e\") " pod="opendatahub/maas-controller-55dfbc648b-ct4sn"
Sep 09 23:31:23.146344 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:31:23.146221    2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 09 23:31:23.146344 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:31:23.146278    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8846e96-6964-41c4-b087-cccfb83cd58e-metrics-certs podName:f8846e96-6964-41c4-b087-cccfb83cd58e nodeName:}" failed. No retries permitted until 2026-09-09 23:31:23.64626118 +0000 UTC m=+540.384983967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8846e96-6964-41c4-b087-cccfb83cd58e-metrics-certs") pod "maas-controller-55dfbc648b-ct4sn" (UID: "f8846e96-6964-41c4-b087-cccfb83cd58e") : secret "maas-controller-metrics-tls" not found
Sep 09 23:31:23.148468 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.148444    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f8846e96-6964-41c4-b087-cccfb83cd58e-webhook-cert\") pod \"maas-controller-55dfbc648b-ct4sn\" (UID: \"f8846e96-6964-41c4-b087-cccfb83cd58e\") " pod="opendatahub/maas-controller-55dfbc648b-ct4sn"
Sep 09 23:31:23.154216 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.154196    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nwwq\" (UniqueName: \"kubernetes.io/projected/f8846e96-6964-41c4-b087-cccfb83cd58e-kube-api-access-4nwwq\") pod \"maas-controller-55dfbc648b-ct4sn\" (UID: \"f8846e96-6964-41c4-b087-cccfb83cd58e\") " pod="opendatahub/maas-controller-55dfbc648b-ct4sn"
Sep 09 23:31:23.449390 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.449309    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-metrics-certs\") pod \"maas-controller-7b9cd6f55b-zg94j\" (UID: \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\") " pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:23.449390 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.449363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-webhook-cert\") pod \"maas-controller-7b9cd6f55b-zg94j\" (UID: \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\") " pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:23.451749 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.451726    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-metrics-certs\") pod \"maas-controller-7b9cd6f55b-zg94j\" (UID: \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\") " pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:23.451870 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.451851    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-webhook-cert\") pod \"maas-controller-7b9cd6f55b-zg94j\" (UID: \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\") " pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:23.470233 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.470210    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:23.650868 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.650841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8846e96-6964-41c4-b087-cccfb83cd58e-metrics-certs\") pod \"maas-controller-55dfbc648b-ct4sn\" (UID: \"f8846e96-6964-41c4-b087-cccfb83cd58e\") " pod="opendatahub/maas-controller-55dfbc648b-ct4sn"
Sep 09 23:31:23.653044 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.653026    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8846e96-6964-41c4-b087-cccfb83cd58e-metrics-certs\") pod \"maas-controller-55dfbc648b-ct4sn\" (UID: \"f8846e96-6964-41c4-b087-cccfb83cd58e\") " pod="opendatahub/maas-controller-55dfbc648b-ct4sn"
Sep 09 23:31:23.694319 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.694300    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-xw8lt\""
Sep 09 23:31:23.703330 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.703289    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:23.844233 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.844201    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55dfbc648b-ct4sn"
Sep 09 23:31:23.971335 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:23.971312    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b9cd6f55b-zg94j"]
Sep 09 23:31:23.973239 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:31:23.973203    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf5f681c_9f54_4a31_a5ae_bfa62ebf6ff5.slice/crio-05956be011829c637148f077ad8fac1725fe5cd080c46234fbca51ddc6374cac WatchSource:0}: Error finding container 05956be011829c637148f077ad8fac1725fe5cd080c46234fbca51ddc6374cac: Status 404 returned error can't find the container with id 05956be011829c637148f077ad8fac1725fe5cd080c46234fbca51ddc6374cac
Sep 09 23:31:24.046588 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:24.046557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b9cd6f55b-zg94j" event={"ID":"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5","Type":"ContainerStarted","Data":"05956be011829c637148f077ad8fac1725fe5cd080c46234fbca51ddc6374cac"}
Sep 09 23:31:24.111754 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:24.111724    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55dfbc648b-ct4sn"]
Sep 09 23:31:24.114528 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:31:24.114502    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8846e96_6964_41c4_b087_cccfb83cd58e.slice/crio-21ba3733b64d238619b7d8cd123ff64c8be50615c6060251b25ded5ff8ac295e WatchSource:0}: Error finding container 21ba3733b64d238619b7d8cd123ff64c8be50615c6060251b25ded5ff8ac295e: Status 404 returned error can't find the container with id 21ba3733b64d238619b7d8cd123ff64c8be50615c6060251b25ded5ff8ac295e
Sep 09 23:31:25.056430 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:25.056330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55dfbc648b-ct4sn" event={"ID":"f8846e96-6964-41c4-b087-cccfb83cd58e","Type":"ContainerStarted","Data":"21ba3733b64d238619b7d8cd123ff64c8be50615c6060251b25ded5ff8ac295e"}
Sep 09 23:31:26.266287 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:26.266237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:26.608653 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:26.608630    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 23:31:26.783650 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:26.783614    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:26.882604 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:26.882528    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:27.067372 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:27.067332    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55dfbc648b-ct4sn" event={"ID":"f8846e96-6964-41c4-b087-cccfb83cd58e","Type":"ContainerStarted","Data":"116e8379fe7eb991b6875e223209a5e35fd1da42e52f5b9c6f1adc0cd5ca3002"}
Sep 09 23:31:27.067559 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:27.067401    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55dfbc648b-ct4sn"
Sep 09 23:31:27.068737 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:27.068714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b9cd6f55b-zg94j" event={"ID":"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5","Type":"ContainerStarted","Data":"2819c5464a00a181ff588260913e02c1b5f317a244fbf0f0c5f669e0b1c0b218"}
Sep 09 23:31:27.068881 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:27.068863    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:27.084031 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:27.083986    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55dfbc648b-ct4sn" podStartSLOduration=2.5937692610000003 podStartE2EDuration="5.083972489s" totalImagesPullingTime="2.490203228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:31:27.083263535 +0000 UTC m=+543.821986344" watchObservedRunningTime="2026-09-09 23:31:27.083972489 +0000 UTC m=+543.822695297"
Sep 09 23:31:27.100383 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:27.100339    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b9cd6f55b-zg94j" podStartSLOduration=2.462214875 podStartE2EDuration="5.100298632s" totalImagesPullingTime="2.638083757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:31:27.100006236 +0000 UTC m=+543.838729046" watchObservedRunningTime="2026-09-09 23:31:27.100298632 +0000 UTC m=+543.839021420"
Sep 09 23:31:38.075129 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:38.075097    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:38.075506 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:38.075182    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55dfbc648b-ct4sn"
Sep 09 23:31:38.129803 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:38.129766    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b9cd6f55b-zg94j"]
Sep 09 23:31:38.130169 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:38.130130    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7b9cd6f55b-zg94j" podUID="af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5" containerName="manager" containerID="cri-o://2819c5464a00a181ff588260913e02c1b5f317a244fbf0f0c5f669e0b1c0b218" gracePeriod=30
Sep 09 23:31:38.366669 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:38.366647    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:38.476096 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:38.476066    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-metrics-certs\") pod \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\" (UID: \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\") "
Sep 09 23:31:38.476236 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:38.476128    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rstcp\" (UniqueName: \"kubernetes.io/projected/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-kube-api-access-rstcp\") pod \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\" (UID: \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\") "
Sep 09 23:31:38.476315 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:38.476295    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-webhook-cert\") pod \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\" (UID: \"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5\") "
Sep 09 23:31:38.478265 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:38.478232    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5" (UID: "af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:31:38.478385 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:38.478280    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5" (UID: "af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:31:38.478385 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:38.478299    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-kube-api-access-rstcp" (OuterVolumeSpecName: "kube-api-access-rstcp") pod "af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5" (UID: "af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5"). InnerVolumeSpecName "kube-api-access-rstcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:31:38.577629 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:38.577601    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-metrics-certs\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:31:38.577629 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:38.577628    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rstcp\" (UniqueName: \"kubernetes.io/projected/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-kube-api-access-rstcp\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:31:38.577806 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:38.577639    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5-webhook-cert\") on node \"ip-10-0-133-34.ec2.internal\" DevicePath \"\""
Sep 09 23:31:39.123225 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:39.123190    2581 generic.go:356] "Generic (PLEG): container finished" podID="af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5" containerID="2819c5464a00a181ff588260913e02c1b5f317a244fbf0f0c5f669e0b1c0b218" exitCode=0
Sep 09 23:31:39.123655 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:39.123236    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b9cd6f55b-zg94j"
Sep 09 23:31:39.123655 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:39.123274    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b9cd6f55b-zg94j" event={"ID":"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5","Type":"ContainerDied","Data":"2819c5464a00a181ff588260913e02c1b5f317a244fbf0f0c5f669e0b1c0b218"}
Sep 09 23:31:39.123655 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:39.123338    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b9cd6f55b-zg94j" event={"ID":"af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5","Type":"ContainerDied","Data":"05956be011829c637148f077ad8fac1725fe5cd080c46234fbca51ddc6374cac"}
Sep 09 23:31:39.123655 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:39.123376    2581 scope.go:117] "RemoveContainer" containerID="2819c5464a00a181ff588260913e02c1b5f317a244fbf0f0c5f669e0b1c0b218"
Sep 09 23:31:39.132460 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:39.132322    2581 scope.go:117] "RemoveContainer" containerID="2819c5464a00a181ff588260913e02c1b5f317a244fbf0f0c5f669e0b1c0b218"
Sep 09 23:31:39.132584 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:31:39.132569    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2819c5464a00a181ff588260913e02c1b5f317a244fbf0f0c5f669e0b1c0b218\": container with ID starting with 2819c5464a00a181ff588260913e02c1b5f317a244fbf0f0c5f669e0b1c0b218 not found: ID does not exist" containerID="2819c5464a00a181ff588260913e02c1b5f317a244fbf0f0c5f669e0b1c0b218"
Sep 09 23:31:39.132623 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:39.132592    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2819c5464a00a181ff588260913e02c1b5f317a244fbf0f0c5f669e0b1c0b218"} err="failed to get container status \"2819c5464a00a181ff588260913e02c1b5f317a244fbf0f0c5f669e0b1c0b218\": rpc error: code = NotFound desc = could not find container \"2819c5464a00a181ff588260913e02c1b5f317a244fbf0f0c5f669e0b1c0b218\": container with ID starting with 2819c5464a00a181ff588260913e02c1b5f317a244fbf0f0c5f669e0b1c0b218 not found: ID does not exist"
Sep 09 23:31:39.142965 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:39.142942    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b9cd6f55b-zg94j"]
Sep 09 23:31:39.148968 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:39.148947    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7b9cd6f55b-zg94j"]
Sep 09 23:31:39.743940 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:39.743906    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5" path="/var/lib/kubelet/pods/af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5/volumes"
Sep 09 23:31:55.302627 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:55.302595    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:55.402722 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:55.402690    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:56.993277 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:56.993236    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:57.093613 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.093577    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:57.130179 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.130142    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"]
Sep 09 23:31:57.130513 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.130496    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5" containerName="manager"
Sep 09 23:31:57.130595 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.130516    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5" containerName="manager"
Sep 09 23:31:57.130650 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.130620    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="af5f681c-9f54-4a31-a5ae-bfa62ebf6ff5" containerName="manager"
Sep 09 23:31:57.133466 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.133435    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"
Sep 09 23:31:57.135713 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.135668    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 23:31:57.135830 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.135762    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 23:31:57.135960 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.135947    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mkqcb\""
Sep 09 23:31:57.141744 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.141717    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"]
Sep 09 23:31:57.229340 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.229309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg95g\" (UniqueName: \"kubernetes.io/projected/efedc0b7-4500-4133-8b4c-613e9360378e-kube-api-access-kg95g\") pod \"maas-api-6644b6994f-6dk82\" (UID: \"efedc0b7-4500-4133-8b4c-613e9360378e\") " pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"
Sep 09 23:31:57.229511 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.229357    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efedc0b7-4500-4133-8b4c-613e9360378e-metrics-certs\") pod \"maas-api-6644b6994f-6dk82\" (UID: \"efedc0b7-4500-4133-8b4c-613e9360378e\") " pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"
Sep 09 23:31:57.229511 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.229413    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efedc0b7-4500-4133-8b4c-613e9360378e-maas-api-tls\") pod \"maas-api-6644b6994f-6dk82\" (UID: \"efedc0b7-4500-4133-8b4c-613e9360378e\") " pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"
Sep 09 23:31:57.229511 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.229429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efedc0b7-4500-4133-8b4c-613e9360378e-openshift-service-ca\") pod \"maas-api-6644b6994f-6dk82\" (UID: \"efedc0b7-4500-4133-8b4c-613e9360378e\") " pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"
Sep 09 23:31:57.326110 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.326043    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:57.330170 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.330150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg95g\" (UniqueName: \"kubernetes.io/projected/efedc0b7-4500-4133-8b4c-613e9360378e-kube-api-access-kg95g\") pod \"maas-api-6644b6994f-6dk82\" (UID: \"efedc0b7-4500-4133-8b4c-613e9360378e\") " pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"
Sep 09 23:31:57.330237 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.330196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efedc0b7-4500-4133-8b4c-613e9360378e-metrics-certs\") pod \"maas-api-6644b6994f-6dk82\" (UID: \"efedc0b7-4500-4133-8b4c-613e9360378e\") " pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"
Sep 09 23:31:57.330276 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.330244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efedc0b7-4500-4133-8b4c-613e9360378e-maas-api-tls\") pod \"maas-api-6644b6994f-6dk82\" (UID: \"efedc0b7-4500-4133-8b4c-613e9360378e\") " pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"
Sep 09 23:31:57.330276 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.330267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efedc0b7-4500-4133-8b4c-613e9360378e-openshift-service-ca\") pod \"maas-api-6644b6994f-6dk82\" (UID: \"efedc0b7-4500-4133-8b4c-613e9360378e\") " pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"
Sep 09 23:31:57.330992 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.330972    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efedc0b7-4500-4133-8b4c-613e9360378e-openshift-service-ca\") pod \"maas-api-6644b6994f-6dk82\" (UID: \"efedc0b7-4500-4133-8b4c-613e9360378e\") " pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"
Sep 09 23:31:57.332824 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.332802    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efedc0b7-4500-4133-8b4c-613e9360378e-maas-api-tls\") pod \"maas-api-6644b6994f-6dk82\" (UID: \"efedc0b7-4500-4133-8b4c-613e9360378e\") " pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"
Sep 09 23:31:57.332907 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.332831    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efedc0b7-4500-4133-8b4c-613e9360378e-metrics-certs\") pod \"maas-api-6644b6994f-6dk82\" (UID: \"efedc0b7-4500-4133-8b4c-613e9360378e\") " pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"
Sep 09 23:31:57.337037 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.337015    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg95g\" (UniqueName: \"kubernetes.io/projected/efedc0b7-4500-4133-8b4c-613e9360378e-kube-api-access-kg95g\") pod \"maas-api-6644b6994f-6dk82\" (UID: \"efedc0b7-4500-4133-8b4c-613e9360378e\") " pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"
Sep 09 23:31:57.377575 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.377545    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:57.443562 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.443532    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"
Sep 09 23:31:57.583850 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.583774    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:57.683218 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.683179    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:31:57.728467 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:57.728437    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"]
Sep 09 23:31:57.732792 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:31:57.732765    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefedc0b7_4500_4133_8b4c_613e9360378e.slice/crio-9a9f5a2d0d9b41dc591e359bad8e2d619d3208de315698e600c42c58ccfb2ba1 WatchSource:0}: Error finding container 9a9f5a2d0d9b41dc591e359bad8e2d619d3208de315698e600c42c58ccfb2ba1: Status 404 returned error can't find the container with id 9a9f5a2d0d9b41dc591e359bad8e2d619d3208de315698e600c42c58ccfb2ba1
Sep 09 23:31:58.201700 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:31:58.201657    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82" event={"ID":"efedc0b7-4500-4133-8b4c-613e9360378e","Type":"ContainerStarted","Data":"9a9f5a2d0d9b41dc591e359bad8e2d619d3208de315698e600c42c58ccfb2ba1"}
Sep 09 23:32:00.211614 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:00.211583    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82" event={"ID":"efedc0b7-4500-4133-8b4c-613e9360378e","Type":"ContainerStarted","Data":"d3654ff384b9a40bd8279194201cd524dc2a627a17c891814aeba74ff4b0d8d6"}
Sep 09 23:32:00.212017 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:00.211718    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"
Sep 09 23:32:00.228251 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:00.228204    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82" podStartSLOduration=1.7430337009999999 podStartE2EDuration="3.228189946s" totalImagesPullingTime="1.485156245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:32:00.22659301 +0000 UTC m=+576.965315821" watchObservedRunningTime="2026-09-09 23:32:00.228189946 +0000 UTC m=+576.966912752"
Sep 09 23:32:06.220638 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:06.220610    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6644b6994f-6dk82"
Sep 09 23:32:07.203138 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:07.203104    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:32:07.302962 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:07.302922    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:32:12.791751 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:12.791717    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:32:19.451994 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.451962    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"]
Sep 09 23:32:19.455696 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.455664    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.459339 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.459316    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 23:32:19.459477 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.459394    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 09 23:32:19.460458 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.460439    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vbsg8\""
Sep 09 23:32:19.460458 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.460458    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 23:32:19.471336 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.471315    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"]
Sep 09 23:32:19.491327 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.491304    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:32:19.518636 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.518615    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571da427-260b-4330-956b-82bbc2f4d919-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.518766 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.518645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/571da427-260b-4330-956b-82bbc2f4d919-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.518766 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.518662    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571da427-260b-4330-956b-82bbc2f4d919-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.518766 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.518697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/571da427-260b-4330-956b-82bbc2f4d919-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.518766 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.518736    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bklk\" (UniqueName: \"kubernetes.io/projected/571da427-260b-4330-956b-82bbc2f4d919-kube-api-access-8bklk\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.518981 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.518838    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/571da427-260b-4330-956b-82bbc2f4d919-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.619240 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.619212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571da427-260b-4330-956b-82bbc2f4d919-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.619358 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.619251    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/571da427-260b-4330-956b-82bbc2f4d919-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.619358 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.619273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571da427-260b-4330-956b-82bbc2f4d919-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.619358 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.619296    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/571da427-260b-4330-956b-82bbc2f4d919-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.619358 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.619319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bklk\" (UniqueName: \"kubernetes.io/projected/571da427-260b-4330-956b-82bbc2f4d919-kube-api-access-8bklk\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.619542 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.619410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/571da427-260b-4330-956b-82bbc2f4d919-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.619632 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.619613    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571da427-260b-4330-956b-82bbc2f4d919-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.619706 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.619661    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/571da427-260b-4330-956b-82bbc2f4d919-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.619807 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.619757    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/571da427-260b-4330-956b-82bbc2f4d919-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.621612 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.621595    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/571da427-260b-4330-956b-82bbc2f4d919-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.621903 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.621883    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571da427-260b-4330-956b-82bbc2f4d919-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.626341 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.626319    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bklk\" (UniqueName: \"kubernetes.io/projected/571da427-260b-4330-956b-82bbc2f4d919-kube-api-access-8bklk\") pod \"e2e-distinct-simulated-kserve-6685d86975-qgb86\" (UID: \"571da427-260b-4330-956b-82bbc2f4d919\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:19.766668 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:19.766646    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:20.041554 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:20.040782    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"]
Sep 09 23:32:20.046609 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:32:20.046577    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod571da427_260b_4330_956b_82bbc2f4d919.slice/crio-bab6c6617c858769670662d9bde0dd833a28b5be65251e93d663748d7f767ef1 WatchSource:0}: Error finding container bab6c6617c858769670662d9bde0dd833a28b5be65251e93d663748d7f767ef1: Status 404 returned error can't find the container with id bab6c6617c858769670662d9bde0dd833a28b5be65251e93d663748d7f767ef1
Sep 09 23:32:20.300894 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:20.300804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" event={"ID":"571da427-260b-4330-956b-82bbc2f4d919","Type":"ContainerStarted","Data":"bab6c6617c858769670662d9bde0dd833a28b5be65251e93d663748d7f767ef1"}
Sep 09 23:32:21.306807 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:21.306774    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" event={"ID":"571da427-260b-4330-956b-82bbc2f4d919","Type":"ContainerStarted","Data":"657466c0936b9fe2fb3c1004819b69fcb518836d5e76eb92f4bf038a2f25072d"}
Sep 09 23:32:21.323046 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:21.322996    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podStartSLOduration=1.179812236 podStartE2EDuration="2.322975182s" totalImagesPullingTime="1.143162946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:32:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:32:21.321423576 +0000 UTC m=+598.060146386" watchObservedRunningTime="2026-09-09 23:32:21.322975182 +0000 UTC m=+598.061697992"
Sep 09 23:32:22.312553 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:22.312518    2581 generic.go:356] "Generic (PLEG): container finished" podID="571da427-260b-4330-956b-82bbc2f4d919" containerID="657466c0936b9fe2fb3c1004819b69fcb518836d5e76eb92f4bf038a2f25072d" exitCode=0
Sep 09 23:32:22.312978 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:22.312604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" event={"ID":"571da427-260b-4330-956b-82bbc2f4d919","Type":"ContainerDied","Data":"657466c0936b9fe2fb3c1004819b69fcb518836d5e76eb92f4bf038a2f25072d"}
Sep 09 23:32:22.312978 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:22.312915    2581 scope.go:117] "RemoveContainer" containerID="657466c0936b9fe2fb3c1004819b69fcb518836d5e76eb92f4bf038a2f25072d"
Sep 09 23:32:23.319022 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:23.318989    2581 generic.go:356] "Generic (PLEG): container finished" podID="571da427-260b-4330-956b-82bbc2f4d919" containerID="b7fa5e442bb9ebae977f60979fc82a83a4edc36d61060059820853d788b884a7" exitCode=0
Sep 09 23:32:23.319413 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:23.319030    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" event={"ID":"571da427-260b-4330-956b-82bbc2f4d919","Type":"ContainerDied","Data":"b7fa5e442bb9ebae977f60979fc82a83a4edc36d61060059820853d788b884a7"}
Sep 09 23:32:23.319413 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:23.319094    2581 scope.go:117] "RemoveContainer" containerID="657466c0936b9fe2fb3c1004819b69fcb518836d5e76eb92f4bf038a2f25072d"
Sep 09 23:32:23.319413 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:23.319340    2581 scope.go:117] "RemoveContainer" containerID="b7fa5e442bb9ebae977f60979fc82a83a4edc36d61060059820853d788b884a7"
Sep 09 23:32:23.319540 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:32:23.319523    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:32:23.657579 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:23.657503    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/ovn-acl-logging/0.log"
Sep 09 23:32:23.657748 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:23.657583    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/ovn-acl-logging/0.log"
Sep 09 23:32:24.325365 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:24.325342    2581 scope.go:117] "RemoveContainer" containerID="b7fa5e442bb9ebae977f60979fc82a83a4edc36d61060059820853d788b884a7"
Sep 09 23:32:24.325759 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:32:24.325515    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:32:28.385735 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:28.385695    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:32:29.767780 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:29.767741    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:29.768165 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:29.767801    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:29.768165 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:29.767818    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:29.768165 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:29.767831    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:29.768261 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:29.768168    2581 scope.go:117] "RemoveContainer" containerID="b7fa5e442bb9ebae977f60979fc82a83a4edc36d61060059820853d788b884a7"
Sep 09 23:32:29.768341 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:32:29.768320    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:32:38.700059 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:38.700009    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:32:40.739169 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:40.739138    2581 scope.go:117] "RemoveContainer" containerID="b7fa5e442bb9ebae977f60979fc82a83a4edc36d61060059820853d788b884a7"
Sep 09 23:32:40.739577 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:40.739558    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:32:41.406023 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:41.405952    2581 generic.go:356] "Generic (PLEG): container finished" podID="571da427-260b-4330-956b-82bbc2f4d919" containerID="affff6c7e12fa385e41562bb0a70e3203fed04c80ea70b7f0b96fff8ddd6949a" exitCode=0
Sep 09 23:32:41.406023 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:41.405987    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" event={"ID":"571da427-260b-4330-956b-82bbc2f4d919","Type":"ContainerDied","Data":"affff6c7e12fa385e41562bb0a70e3203fed04c80ea70b7f0b96fff8ddd6949a"}
Sep 09 23:32:41.406023 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:41.406032    2581 scope.go:117] "RemoveContainer" containerID="b7fa5e442bb9ebae977f60979fc82a83a4edc36d61060059820853d788b884a7"
Sep 09 23:32:41.406340 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:41.406323    2581 scope.go:117] "RemoveContainer" containerID="affff6c7e12fa385e41562bb0a70e3203fed04c80ea70b7f0b96fff8ddd6949a"
Sep 09 23:32:41.406525 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:32:41.406505    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:32:46.266408 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:46.266329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:32:49.767045 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:49.767016    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:49.767387 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:49.767071    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:49.767387 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:49.767089    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:49.767387 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:49.767105    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:32:49.767499 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:49.767394    2581 scope.go:117] "RemoveContainer" containerID="affff6c7e12fa385e41562bb0a70e3203fed04c80ea70b7f0b96fff8ddd6949a"
Sep 09 23:32:49.767561 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:32:49.767543    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:32:58.958867 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:58.958835    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"]
Sep 09 23:32:58.964638 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:58.964615    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:58.966833 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:58.966805    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 09 23:32:58.971977 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:58.971942    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"]
Sep 09 23:32:58.988118 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:58.988093    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:32:59.035502 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.035472    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c643b476-9118-4757-b380-6ba18823cc24-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.035636 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.035545    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsxzc\" (UniqueName: \"kubernetes.io/projected/c643b476-9118-4757-b380-6ba18823cc24-kube-api-access-xsxzc\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.035636 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.035591    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c643b476-9118-4757-b380-6ba18823cc24-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.035636 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.035617    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c643b476-9118-4757-b380-6ba18823cc24-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.035828 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.035665    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c643b476-9118-4757-b380-6ba18823cc24-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.035828 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.035706    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c643b476-9118-4757-b380-6ba18823cc24-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.136826 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.136796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c643b476-9118-4757-b380-6ba18823cc24-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.136826 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.136829    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c643b476-9118-4757-b380-6ba18823cc24-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.137079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.136883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c643b476-9118-4757-b380-6ba18823cc24-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.137079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.136935    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsxzc\" (UniqueName: \"kubernetes.io/projected/c643b476-9118-4757-b380-6ba18823cc24-kube-api-access-xsxzc\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.137079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.136977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c643b476-9118-4757-b380-6ba18823cc24-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.137079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.137004    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c643b476-9118-4757-b380-6ba18823cc24-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.137360 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.137339    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c643b476-9118-4757-b380-6ba18823cc24-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.137489 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.137463    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c643b476-9118-4757-b380-6ba18823cc24-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.137614 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.137594    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c643b476-9118-4757-b380-6ba18823cc24-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.139360 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.139337    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c643b476-9118-4757-b380-6ba18823cc24-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.139499 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.139481    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c643b476-9118-4757-b380-6ba18823cc24-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.143930 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.143911    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsxzc\" (UniqueName: \"kubernetes.io/projected/c643b476-9118-4757-b380-6ba18823cc24-kube-api-access-xsxzc\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms\" (UID: \"c643b476-9118-4757-b380-6ba18823cc24\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.276252 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.276226    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:32:59.543722 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:32:59.543694    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"]
Sep 09 23:32:59.546320 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:32:59.546299    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc643b476_9118_4757_b380_6ba18823cc24.slice/crio-ff3578636c4b1e61c100ed124f7dfa90f9e257a24a60e23f017483928f267b9a WatchSource:0}: Error finding container ff3578636c4b1e61c100ed124f7dfa90f9e257a24a60e23f017483928f267b9a: Status 404 returned error can't find the container with id ff3578636c4b1e61c100ed124f7dfa90f9e257a24a60e23f017483928f267b9a
Sep 09 23:33:00.494432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:00.494393    2581 generic.go:356] "Generic (PLEG): container finished" podID="c643b476-9118-4757-b380-6ba18823cc24" containerID="25459c82a1efcd5460573dc681d91fa0e2388678f944bde56a7d9959cd455e93" exitCode=0
Sep 09 23:33:00.494890 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:00.494489    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" event={"ID":"c643b476-9118-4757-b380-6ba18823cc24","Type":"ContainerDied","Data":"25459c82a1efcd5460573dc681d91fa0e2388678f944bde56a7d9959cd455e93"}
Sep 09 23:33:00.494890 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:00.494560    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" event={"ID":"c643b476-9118-4757-b380-6ba18823cc24","Type":"ContainerStarted","Data":"ff3578636c4b1e61c100ed124f7dfa90f9e257a24a60e23f017483928f267b9a"}
Sep 09 23:33:00.494890 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:00.494713    2581 scope.go:117] "RemoveContainer" containerID="25459c82a1efcd5460573dc681d91fa0e2388678f944bde56a7d9959cd455e93"
Sep 09 23:33:00.738702 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:00.738651    2581 scope.go:117] "RemoveContainer" containerID="affff6c7e12fa385e41562bb0a70e3203fed04c80ea70b7f0b96fff8ddd6949a"
Sep 09 23:33:00.738966 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:00.738942    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:33:01.500961 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:01.500921    2581 generic.go:356] "Generic (PLEG): container finished" podID="c643b476-9118-4757-b380-6ba18823cc24" containerID="9445744a6398a7baa688d855e7a7334bab4dda2e0bf7ee1bb05595883ac2a66a" exitCode=0
Sep 09 23:33:01.501371 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:01.501002    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" event={"ID":"c643b476-9118-4757-b380-6ba18823cc24","Type":"ContainerDied","Data":"9445744a6398a7baa688d855e7a7334bab4dda2e0bf7ee1bb05595883ac2a66a"}
Sep 09 23:33:01.501371 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:01.501052    2581 scope.go:117] "RemoveContainer" containerID="25459c82a1efcd5460573dc681d91fa0e2388678f944bde56a7d9959cd455e93"
Sep 09 23:33:01.501371 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:01.501316    2581 scope.go:117] "RemoveContainer" containerID="9445744a6398a7baa688d855e7a7334bab4dda2e0bf7ee1bb05595883ac2a66a"
Sep 09 23:33:01.501537 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:01.501518    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:33:02.507723 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:02.507697    2581 scope.go:117] "RemoveContainer" containerID="9445744a6398a7baa688d855e7a7334bab4dda2e0bf7ee1bb05595883ac2a66a"
Sep 09 23:33:02.508167 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:02.507857    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:33:09.067296 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:09.067264    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:33:09.277287 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:09.277254    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:33:09.277444 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:09.277320    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:33:09.277444 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:09.277342    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:33:09.277444 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:09.277377    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:33:09.277796 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:09.277776    2581 scope.go:117] "RemoveContainer" containerID="9445744a6398a7baa688d855e7a7334bab4dda2e0bf7ee1bb05595883ac2a66a"
Sep 09 23:33:09.277978 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:09.277958    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:33:09.538518 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:09.538490    2581 scope.go:117] "RemoveContainer" containerID="9445744a6398a7baa688d855e7a7334bab4dda2e0bf7ee1bb05595883ac2a66a"
Sep 09 23:33:09.538710 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:09.538653    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:33:12.739271 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:12.739244    2581 scope.go:117] "RemoveContainer" containerID="affff6c7e12fa385e41562bb0a70e3203fed04c80ea70b7f0b96fff8ddd6949a"
Sep 09 23:33:13.556816 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:13.556782    2581 generic.go:356] "Generic (PLEG): container finished" podID="571da427-260b-4330-956b-82bbc2f4d919" containerID="fb55eb04795078b998e76b965416d02a5063c8335c473af728d834679084fa19" exitCode=0
Sep 09 23:33:13.557037 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:13.556855    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" event={"ID":"571da427-260b-4330-956b-82bbc2f4d919","Type":"ContainerDied","Data":"fb55eb04795078b998e76b965416d02a5063c8335c473af728d834679084fa19"}
Sep 09 23:33:13.557037 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:13.556921    2581 scope.go:117] "RemoveContainer" containerID="affff6c7e12fa385e41562bb0a70e3203fed04c80ea70b7f0b96fff8ddd6949a"
Sep 09 23:33:13.557302 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:13.557286    2581 scope.go:117] "RemoveContainer" containerID="fb55eb04795078b998e76b965416d02a5063c8335c473af728d834679084fa19"
Sep 09 23:33:13.557519 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:13.557499    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:33:19.767141 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:19.767098    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:33:19.767727 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:19.767175    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:33:19.767727 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:19.767199    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:33:19.767727 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:19.767219    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:33:19.767727 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:19.767637    2581 scope.go:117] "RemoveContainer" containerID="fb55eb04795078b998e76b965416d02a5063c8335c473af728d834679084fa19"
Sep 09 23:33:19.767941 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:19.767894    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:33:21.671841 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.671810    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"]
Sep 09 23:33:21.675320 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.675294    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.677499 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.677470    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 09 23:33:21.686392 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.686370    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"]
Sep 09 23:33:21.768522 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.768491    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:33:21.839492 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.839461    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/059d817e-b89e-4447-8930-ee8df173cc53-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.839655 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.839573    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/059d817e-b89e-4447-8930-ee8df173cc53-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.839655 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.839611    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/059d817e-b89e-4447-8930-ee8df173cc53-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.839750 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.839654    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/059d817e-b89e-4447-8930-ee8df173cc53-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.839750 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.839693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhgj6\" (UniqueName: \"kubernetes.io/projected/059d817e-b89e-4447-8930-ee8df173cc53-kube-api-access-dhgj6\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.839816 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.839795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/059d817e-b89e-4447-8930-ee8df173cc53-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.940903 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.940819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/059d817e-b89e-4447-8930-ee8df173cc53-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.940903 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.940855    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/059d817e-b89e-4447-8930-ee8df173cc53-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.940903 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.940880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/059d817e-b89e-4447-8930-ee8df173cc53-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.941166 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.940910    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhgj6\" (UniqueName: \"kubernetes.io/projected/059d817e-b89e-4447-8930-ee8df173cc53-kube-api-access-dhgj6\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.941166 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.940943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/059d817e-b89e-4447-8930-ee8df173cc53-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.941166 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.940978    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/059d817e-b89e-4447-8930-ee8df173cc53-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.941381 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.941327    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/059d817e-b89e-4447-8930-ee8df173cc53-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.941381 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.941365    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/059d817e-b89e-4447-8930-ee8df173cc53-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.941449 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.941394    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/059d817e-b89e-4447-8930-ee8df173cc53-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.943228 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.943206    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/059d817e-b89e-4447-8930-ee8df173cc53-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.943481 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.943462    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/059d817e-b89e-4447-8930-ee8df173cc53-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.949624 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.949597    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhgj6\" (UniqueName: \"kubernetes.io/projected/059d817e-b89e-4447-8930-ee8df173cc53-kube-api-access-dhgj6\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh\" (UID: \"059d817e-b89e-4447-8930-ee8df173cc53\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:21.984563 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:21.984539    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:22.260154 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:22.260106    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"]
Sep 09 23:33:22.266833 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:33:22.266806    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod059d817e_b89e_4447_8930_ee8df173cc53.slice/crio-bd141da369005fecba817a8271a56985f8b3b60517db3491e5f9229787bc6acf WatchSource:0}: Error finding container bd141da369005fecba817a8271a56985f8b3b60517db3491e5f9229787bc6acf: Status 404 returned error can't find the container with id bd141da369005fecba817a8271a56985f8b3b60517db3491e5f9229787bc6acf
Sep 09 23:33:22.599547 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:22.599512    2581 generic.go:356] "Generic (PLEG): container finished" podID="059d817e-b89e-4447-8930-ee8df173cc53" containerID="6198e2970578d4fcabdbfc014b9309d338b691eb770dfdaf74a0410ec9f4a827" exitCode=0
Sep 09 23:33:22.599745 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:22.599571    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" event={"ID":"059d817e-b89e-4447-8930-ee8df173cc53","Type":"ContainerDied","Data":"6198e2970578d4fcabdbfc014b9309d338b691eb770dfdaf74a0410ec9f4a827"}
Sep 09 23:33:22.599745 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:22.599603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" event={"ID":"059d817e-b89e-4447-8930-ee8df173cc53","Type":"ContainerStarted","Data":"bd141da369005fecba817a8271a56985f8b3b60517db3491e5f9229787bc6acf"}
Sep 09 23:33:22.599870 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:22.599841    2581 scope.go:117] "RemoveContainer" containerID="6198e2970578d4fcabdbfc014b9309d338b691eb770dfdaf74a0410ec9f4a827"
Sep 09 23:33:23.606354 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:23.606322    2581 generic.go:356] "Generic (PLEG): container finished" podID="059d817e-b89e-4447-8930-ee8df173cc53" containerID="1403cc14b0c8f97c7d30325f35b6ccc52e4b05e1aa1560638975ae6a9c8a1b8d" exitCode=0
Sep 09 23:33:23.606827 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:23.606395    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" event={"ID":"059d817e-b89e-4447-8930-ee8df173cc53","Type":"ContainerDied","Data":"1403cc14b0c8f97c7d30325f35b6ccc52e4b05e1aa1560638975ae6a9c8a1b8d"}
Sep 09 23:33:23.606827 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:23.606445    2581 scope.go:117] "RemoveContainer" containerID="6198e2970578d4fcabdbfc014b9309d338b691eb770dfdaf74a0410ec9f4a827"
Sep 09 23:33:23.606827 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:23.606691    2581 scope.go:117] "RemoveContainer" containerID="1403cc14b0c8f97c7d30325f35b6ccc52e4b05e1aa1560638975ae6a9c8a1b8d"
Sep 09 23:33:23.606963 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:23.606886    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:33:24.612477 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:24.612444    2581 scope.go:117] "RemoveContainer" containerID="1403cc14b0c8f97c7d30325f35b6ccc52e4b05e1aa1560638975ae6a9c8a1b8d"
Sep 09 23:33:24.612852 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:24.612639    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:33:24.739393 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:24.739368    2581 scope.go:117] "RemoveContainer" containerID="9445744a6398a7baa688d855e7a7334bab4dda2e0bf7ee1bb05595883ac2a66a"
Sep 09 23:33:25.624759 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:25.624724    2581 generic.go:356] "Generic (PLEG): container finished" podID="c643b476-9118-4757-b380-6ba18823cc24" containerID="db04a2e6fc6773fc0e0afad1891839062e461ee03497705d8a52fd06b647fa23" exitCode=0
Sep 09 23:33:25.625201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:25.624781    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" event={"ID":"c643b476-9118-4757-b380-6ba18823cc24","Type":"ContainerDied","Data":"db04a2e6fc6773fc0e0afad1891839062e461ee03497705d8a52fd06b647fa23"}
Sep 09 23:33:25.625201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:25.624872    2581 scope.go:117] "RemoveContainer" containerID="9445744a6398a7baa688d855e7a7334bab4dda2e0bf7ee1bb05595883ac2a66a"
Sep 09 23:33:25.625201 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:25.625177    2581 scope.go:117] "RemoveContainer" containerID="db04a2e6fc6773fc0e0afad1891839062e461ee03497705d8a52fd06b647fa23"
Sep 09 23:33:25.625412 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:25.625388    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:33:29.276951 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:29.276923    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:33:29.277323 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:29.276983    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:33:29.277323 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:29.277002    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:33:29.277323 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:29.277015    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:33:29.277443 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:29.277335    2581 scope.go:117] "RemoveContainer" containerID="db04a2e6fc6773fc0e0afad1891839062e461ee03497705d8a52fd06b647fa23"
Sep 09 23:33:29.277529 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:29.277509    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:33:31.985117 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:31.985082    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:31.985573 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:31.985129    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:31.985573 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:31.985143    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:31.985573 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:31.985154    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:31.985573 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:31.985456    2581 scope.go:117] "RemoveContainer" containerID="1403cc14b0c8f97c7d30325f35b6ccc52e4b05e1aa1560638975ae6a9c8a1b8d"
Sep 09 23:33:31.985743 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:31.985604    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:33:32.739087 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:32.739049    2581 scope.go:117] "RemoveContainer" containerID="fb55eb04795078b998e76b965416d02a5063c8335c473af728d834679084fa19"
Sep 09 23:33:32.739266 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:32.739242    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:33:39.738663 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:39.738630    2581 scope.go:117] "RemoveContainer" containerID="db04a2e6fc6773fc0e0afad1891839062e461ee03497705d8a52fd06b647fa23"
Sep 09 23:33:39.739025 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:39.738875    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:33:46.739128 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:46.739100    2581 scope.go:117] "RemoveContainer" containerID="1403cc14b0c8f97c7d30325f35b6ccc52e4b05e1aa1560638975ae6a9c8a1b8d"
Sep 09 23:33:47.727019 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:47.726984    2581 generic.go:356] "Generic (PLEG): container finished" podID="059d817e-b89e-4447-8930-ee8df173cc53" containerID="2d0891bbeac75b35721ff4c8ef6e5f1da20581e12340dbc8e5537400f4ac041c" exitCode=0
Sep 09 23:33:47.727188 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:47.727054    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" event={"ID":"059d817e-b89e-4447-8930-ee8df173cc53","Type":"ContainerDied","Data":"2d0891bbeac75b35721ff4c8ef6e5f1da20581e12340dbc8e5537400f4ac041c"}
Sep 09 23:33:47.727188 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:47.727103    2581 scope.go:117] "RemoveContainer" containerID="1403cc14b0c8f97c7d30325f35b6ccc52e4b05e1aa1560638975ae6a9c8a1b8d"
Sep 09 23:33:47.727432 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:47.727415    2581 scope.go:117] "RemoveContainer" containerID="2d0891bbeac75b35721ff4c8ef6e5f1da20581e12340dbc8e5537400f4ac041c"
Sep 09 23:33:47.727630 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:47.727608    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:33:47.739267 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:47.739253    2581 scope.go:117] "RemoveContainer" containerID="fb55eb04795078b998e76b965416d02a5063c8335c473af728d834679084fa19"
Sep 09 23:33:47.739512 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:47.739398    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:33:51.985401 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:51.985351    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:51.985902 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:51.985428    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:51.985902 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:51.985446    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:51.985902 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:51.985458    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:33:51.985902 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:51.985889    2581 scope.go:117] "RemoveContainer" containerID="2d0891bbeac75b35721ff4c8ef6e5f1da20581e12340dbc8e5537400f4ac041c"
Sep 09 23:33:51.986118 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:51.986092    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:33:54.739053 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:54.739022    2581 scope.go:117] "RemoveContainer" containerID="db04a2e6fc6773fc0e0afad1891839062e461ee03497705d8a52fd06b647fa23"
Sep 09 23:33:55.764815 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:55.764783    2581 generic.go:356] "Generic (PLEG): container finished" podID="c643b476-9118-4757-b380-6ba18823cc24" containerID="7540ce57de496359760fc561174da541d84e515c807415a48c1e18aeceb75b4d" exitCode=0
Sep 09 23:33:55.765242 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:55.764825    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" event={"ID":"c643b476-9118-4757-b380-6ba18823cc24","Type":"ContainerDied","Data":"7540ce57de496359760fc561174da541d84e515c807415a48c1e18aeceb75b4d"}
Sep 09 23:33:55.765242 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:55.764868    2581 scope.go:117] "RemoveContainer" containerID="db04a2e6fc6773fc0e0afad1891839062e461ee03497705d8a52fd06b647fa23"
Sep 09 23:33:55.765242 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:55.765196    2581 scope.go:117] "RemoveContainer" containerID="7540ce57de496359760fc561174da541d84e515c807415a48c1e18aeceb75b4d"
Sep 09 23:33:55.765418 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:55.765375    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:33:59.276510 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:59.276478    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:33:59.276893 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:59.276537    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:33:59.276893 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:59.276553    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:33:59.276893 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:59.276567    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:33:59.277006 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:59.276894    2581 scope.go:117] "RemoveContainer" containerID="7540ce57de496359760fc561174da541d84e515c807415a48c1e18aeceb75b4d"
Sep 09 23:33:59.277077 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:33:59.277057    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:33:59.738789 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:33:59.738761    2581 scope.go:117] "RemoveContainer" containerID="fb55eb04795078b998e76b965416d02a5063c8335c473af728d834679084fa19"
Sep 09 23:34:00.790059 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:00.790029    2581 generic.go:356] "Generic (PLEG): container finished" podID="571da427-260b-4330-956b-82bbc2f4d919" containerID="30b4f3ac9c4800181999cc734610b1783bbb80de8ad3071d42afa386ad2c7a60" exitCode=0
Sep 09 23:34:00.790534 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:00.790081    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" event={"ID":"571da427-260b-4330-956b-82bbc2f4d919","Type":"ContainerDied","Data":"30b4f3ac9c4800181999cc734610b1783bbb80de8ad3071d42afa386ad2c7a60"}
Sep 09 23:34:00.790534 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:00.790125    2581 scope.go:117] "RemoveContainer" containerID="fb55eb04795078b998e76b965416d02a5063c8335c473af728d834679084fa19"
Sep 09 23:34:00.790534 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:00.790505    2581 scope.go:117] "RemoveContainer" containerID="30b4f3ac9c4800181999cc734610b1783bbb80de8ad3071d42afa386ad2c7a60"
Sep 09 23:34:00.790762 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:34:00.790740    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:34:03.741070 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:03.741040    2581 scope.go:117] "RemoveContainer" containerID="2d0891bbeac75b35721ff4c8ef6e5f1da20581e12340dbc8e5537400f4ac041c"
Sep 09 23:34:03.741644 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:34:03.741228    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:34:09.767151 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:09.767120    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:34:09.767512 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:09.767173    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:34:09.767512 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:09.767189    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:34:09.767512 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:09.767202    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:34:09.767609 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:09.767538    2581 scope.go:117] "RemoveContainer" containerID="30b4f3ac9c4800181999cc734610b1783bbb80de8ad3071d42afa386ad2c7a60"
Sep 09 23:34:09.767750 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:34:09.767730    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:34:13.740459 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:13.740431    2581 scope.go:117] "RemoveContainer" containerID="7540ce57de496359760fc561174da541d84e515c807415a48c1e18aeceb75b4d"
Sep 09 23:34:13.740849 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:34:13.740607    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:34:18.739165 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:18.739092    2581 scope.go:117] "RemoveContainer" containerID="2d0891bbeac75b35721ff4c8ef6e5f1da20581e12340dbc8e5537400f4ac041c"
Sep 09 23:34:19.873165 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:19.873129    2581 generic.go:356] "Generic (PLEG): container finished" podID="059d817e-b89e-4447-8930-ee8df173cc53" containerID="3682a98838aa29703efef4d0f9bbb7af4d8784b3bbfd97614544d5e9cadcf159" exitCode=0
Sep 09 23:34:19.873668 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:19.873183    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" event={"ID":"059d817e-b89e-4447-8930-ee8df173cc53","Type":"ContainerDied","Data":"3682a98838aa29703efef4d0f9bbb7af4d8784b3bbfd97614544d5e9cadcf159"}
Sep 09 23:34:19.873668 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:19.873222    2581 scope.go:117] "RemoveContainer" containerID="2d0891bbeac75b35721ff4c8ef6e5f1da20581e12340dbc8e5537400f4ac041c"
Sep 09 23:34:19.873668 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:19.873599    2581 scope.go:117] "RemoveContainer" containerID="3682a98838aa29703efef4d0f9bbb7af4d8784b3bbfd97614544d5e9cadcf159"
Sep 09 23:34:19.873864 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:34:19.873838    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:34:20.739410 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:20.739374    2581 scope.go:117] "RemoveContainer" containerID="30b4f3ac9c4800181999cc734610b1783bbb80de8ad3071d42afa386ad2c7a60"
Sep 09 23:34:20.739599 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:34:20.739574    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:34:21.984819 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:21.984786    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:34:21.984819 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:21.984824    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:34:21.985422 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:21.984839    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:34:21.985422 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:21.984850    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:34:21.985422 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:21.985214    2581 scope.go:117] "RemoveContainer" containerID="3682a98838aa29703efef4d0f9bbb7af4d8784b3bbfd97614544d5e9cadcf159"
Sep 09 23:34:21.985422 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:34:21.985382    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:34:25.739038 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:25.739003    2581 scope.go:117] "RemoveContainer" containerID="7540ce57de496359760fc561174da541d84e515c807415a48c1e18aeceb75b4d"
Sep 09 23:34:25.739637 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:34:25.739168    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:34:32.739157 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:32.739126    2581 scope.go:117] "RemoveContainer" containerID="30b4f3ac9c4800181999cc734610b1783bbb80de8ad3071d42afa386ad2c7a60"
Sep 09 23:34:32.739586 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:34:32.739305    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:34:34.738667 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:34.738634    2581 scope.go:117] "RemoveContainer" containerID="3682a98838aa29703efef4d0f9bbb7af4d8784b3bbfd97614544d5e9cadcf159"
Sep 09 23:34:34.739119 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:34:34.738879    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:34:36.738639 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:36.738611    2581 scope.go:117] "RemoveContainer" containerID="7540ce57de496359760fc561174da541d84e515c807415a48c1e18aeceb75b4d"
Sep 09 23:34:37.952532 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:37.952502    2581 generic.go:356] "Generic (PLEG): container finished" podID="c643b476-9118-4757-b380-6ba18823cc24" containerID="3cab793fa7111639062029a66ba7629a93e95d1b7ac216b781b9f6c25e01bb46" exitCode=0
Sep 09 23:34:37.952958 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:37.952573    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" event={"ID":"c643b476-9118-4757-b380-6ba18823cc24","Type":"ContainerDied","Data":"3cab793fa7111639062029a66ba7629a93e95d1b7ac216b781b9f6c25e01bb46"}
Sep 09 23:34:37.952958 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:37.952632    2581 scope.go:117] "RemoveContainer" containerID="7540ce57de496359760fc561174da541d84e515c807415a48c1e18aeceb75b4d"
Sep 09 23:34:37.953055 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:37.952958    2581 scope.go:117] "RemoveContainer" containerID="3cab793fa7111639062029a66ba7629a93e95d1b7ac216b781b9f6c25e01bb46"
Sep 09 23:34:37.953166 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:34:37.953145    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:34:39.277078 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:39.277045    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:34:39.277455 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:39.277124    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:34:39.277455 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:39.277146    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:34:39.277455 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:39.277159    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:34:39.277571 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:39.277479    2581 scope.go:117] "RemoveContainer" containerID="3cab793fa7111639062029a66ba7629a93e95d1b7ac216b781b9f6c25e01bb46"
Sep 09 23:34:39.277664 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:34:39.277644    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:34:44.738544 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:44.738514    2581 scope.go:117] "RemoveContainer" containerID="30b4f3ac9c4800181999cc734610b1783bbb80de8ad3071d42afa386ad2c7a60"
Sep 09 23:34:44.738918 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:34:44.738711    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:34:47.201907 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:47.201873    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:34:47.302940 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:47.302894    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:34:47.738753 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:47.738720    2581 scope.go:117] "RemoveContainer" containerID="3682a98838aa29703efef4d0f9bbb7af4d8784b3bbfd97614544d5e9cadcf159"
Sep 09 23:34:47.738959 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:34:47.738931    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:34:53.741158 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:53.741126    2581 scope.go:117] "RemoveContainer" containerID="3cab793fa7111639062029a66ba7629a93e95d1b7ac216b781b9f6c25e01bb46"
Sep 09 23:34:53.741560 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:34:53.741292    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:34:54.896885 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:54.896853    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:34:54.948287 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:54.948257    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:34:58.739098 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:58.739066    2581 scope.go:117] "RemoveContainer" containerID="30b4f3ac9c4800181999cc734610b1783bbb80de8ad3071d42afa386ad2c7a60"
Sep 09 23:34:58.739565 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:34:58.739283    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:34:59.738641 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:34:59.738592    2581 scope.go:117] "RemoveContainer" containerID="3682a98838aa29703efef4d0f9bbb7af4d8784b3bbfd97614544d5e9cadcf159"
Sep 09 23:35:00.055908 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:00.055870    2581 generic.go:356] "Generic (PLEG): container finished" podID="059d817e-b89e-4447-8930-ee8df173cc53" containerID="898765bc62a2e43acae8abf4415d8cf45aeb7d4b48d6f203e8518775d3e03c8c" exitCode=0
Sep 09 23:35:00.056329 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:00.055944    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" event={"ID":"059d817e-b89e-4447-8930-ee8df173cc53","Type":"ContainerDied","Data":"898765bc62a2e43acae8abf4415d8cf45aeb7d4b48d6f203e8518775d3e03c8c"}
Sep 09 23:35:00.056329 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:00.055991    2581 scope.go:117] "RemoveContainer" containerID="3682a98838aa29703efef4d0f9bbb7af4d8784b3bbfd97614544d5e9cadcf159"
Sep 09 23:35:00.056452 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:00.056330    2581 scope.go:117] "RemoveContainer" containerID="898765bc62a2e43acae8abf4415d8cf45aeb7d4b48d6f203e8518775d3e03c8c"
Sep 09 23:35:00.056515 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:35:00.056492    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:35:01.985141 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:01.985110    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:35:01.985538 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:01.985155    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:35:01.985538 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:01.985167    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:35:01.985538 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:01.985176    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:35:01.985538 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:01.985471    2581 scope.go:117] "RemoveContainer" containerID="898765bc62a2e43acae8abf4415d8cf45aeb7d4b48d6f203e8518775d3e03c8c"
Sep 09 23:35:01.985751 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:35:01.985623    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:35:07.738981 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:07.738949    2581 scope.go:117] "RemoveContainer" containerID="3cab793fa7111639062029a66ba7629a93e95d1b7ac216b781b9f6c25e01bb46"
Sep 09 23:35:07.739475 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:35:07.739119    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:35:11.738842 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:11.738803    2581 scope.go:117] "RemoveContainer" containerID="30b4f3ac9c4800181999cc734610b1783bbb80de8ad3071d42afa386ad2c7a60"
Sep 09 23:35:11.739217 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:35:11.739063    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:35:14.738364 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:14.738338    2581 scope.go:117] "RemoveContainer" containerID="898765bc62a2e43acae8abf4415d8cf45aeb7d4b48d6f203e8518775d3e03c8c"
Sep 09 23:35:14.738755 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:35:14.738505    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:35:19.739630 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:19.739599    2581 scope.go:117] "RemoveContainer" containerID="3cab793fa7111639062029a66ba7629a93e95d1b7ac216b781b9f6c25e01bb46"
Sep 09 23:35:19.739996 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:35:19.739862    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:35:22.739015 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:22.738979    2581 scope.go:117] "RemoveContainer" containerID="30b4f3ac9c4800181999cc734610b1783bbb80de8ad3071d42afa386ad2c7a60"
Sep 09 23:35:23.158256 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:23.158221    2581 generic.go:356] "Generic (PLEG): container finished" podID="571da427-260b-4330-956b-82bbc2f4d919" containerID="93930b2be29fc55864ba29813eef4c68727175bed9673637eb6a14818b5a3221" exitCode=0
Sep 09 23:35:23.158400 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:23.158284    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" event={"ID":"571da427-260b-4330-956b-82bbc2f4d919","Type":"ContainerDied","Data":"93930b2be29fc55864ba29813eef4c68727175bed9673637eb6a14818b5a3221"}
Sep 09 23:35:23.158400 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:23.158333    2581 scope.go:117] "RemoveContainer" containerID="30b4f3ac9c4800181999cc734610b1783bbb80de8ad3071d42afa386ad2c7a60"
Sep 09 23:35:23.158724 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:23.158703    2581 scope.go:117] "RemoveContainer" containerID="93930b2be29fc55864ba29813eef4c68727175bed9673637eb6a14818b5a3221"
Sep 09 23:35:23.158933 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:35:23.158915    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:35:25.739261 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:25.739231    2581 scope.go:117] "RemoveContainer" containerID="898765bc62a2e43acae8abf4415d8cf45aeb7d4b48d6f203e8518775d3e03c8c"
Sep 09 23:35:25.739643 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:35:25.739408    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:35:29.767313 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:29.767284    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:35:29.767727 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:29.767329    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:35:29.767727 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:29.767347    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:35:29.767727 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:29.767361    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86"
Sep 09 23:35:29.767727 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:29.767652    2581 scope.go:117] "RemoveContainer" containerID="93930b2be29fc55864ba29813eef4c68727175bed9673637eb6a14818b5a3221"
Sep 09 23:35:29.767905 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:35:29.767828    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:35:34.738942 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:34.738911    2581 scope.go:117] "RemoveContainer" containerID="3cab793fa7111639062029a66ba7629a93e95d1b7ac216b781b9f6c25e01bb46"
Sep 09 23:35:34.739291 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:35:34.739097    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:35:36.738777 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:36.738746    2581 scope.go:117] "RemoveContainer" containerID="898765bc62a2e43acae8abf4415d8cf45aeb7d4b48d6f203e8518775d3e03c8c"
Sep 09 23:35:36.739167 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:35:36.738925    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:35:41.739469 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:41.739430    2581 scope.go:117] "RemoveContainer" containerID="93930b2be29fc55864ba29813eef4c68727175bed9673637eb6a14818b5a3221"
Sep 09 23:35:41.740017 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:35:41.739662    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:35:48.738968 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:48.738938    2581 scope.go:117] "RemoveContainer" containerID="3cab793fa7111639062029a66ba7629a93e95d1b7ac216b781b9f6c25e01bb46"
Sep 09 23:35:48.739440 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:35:48.739108    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:35:50.738948 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:50.738918    2581 scope.go:117] "RemoveContainer" containerID="898765bc62a2e43acae8abf4415d8cf45aeb7d4b48d6f203e8518775d3e03c8c"
Sep 09 23:35:50.739314 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:35:50.739078    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:35:52.738438 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:35:52.738410    2581 scope.go:117] "RemoveContainer" containerID="93930b2be29fc55864ba29813eef4c68727175bed9673637eb6a14818b5a3221"
Sep 09 23:35:52.738827 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:35:52.738588    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:36:00.738699 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:00.738627    2581 scope.go:117] "RemoveContainer" containerID="3cab793fa7111639062029a66ba7629a93e95d1b7ac216b781b9f6c25e01bb46"
Sep 09 23:36:01.337584 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:01.337498    2581 generic.go:356] "Generic (PLEG): container finished" podID="c643b476-9118-4757-b380-6ba18823cc24" containerID="a946ac8046aca0d338cdbf859150093a7fb71595b28b565597e10dea6440b136" exitCode=0
Sep 09 23:36:01.337780 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:01.337574    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" event={"ID":"c643b476-9118-4757-b380-6ba18823cc24","Type":"ContainerDied","Data":"a946ac8046aca0d338cdbf859150093a7fb71595b28b565597e10dea6440b136"}
Sep 09 23:36:01.337780 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:01.337643    2581 scope.go:117] "RemoveContainer" containerID="3cab793fa7111639062029a66ba7629a93e95d1b7ac216b781b9f6c25e01bb46"
Sep 09 23:36:01.338023 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:01.338008    2581 scope.go:117] "RemoveContainer" containerID="a946ac8046aca0d338cdbf859150093a7fb71595b28b565597e10dea6440b136"
Sep 09 23:36:01.338224 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:36:01.338206    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:36:03.740666 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:03.740637    2581 scope.go:117] "RemoveContainer" containerID="898765bc62a2e43acae8abf4415d8cf45aeb7d4b48d6f203e8518775d3e03c8c"
Sep 09 23:36:03.741057 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:36:03.740810    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:36:04.739410 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:04.739382    2581 scope.go:117] "RemoveContainer" containerID="93930b2be29fc55864ba29813eef4c68727175bed9673637eb6a14818b5a3221"
Sep 09 23:36:04.739600 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:36:04.739574    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:36:09.276977 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:09.276945    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:36:09.277355 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:09.276998    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:36:09.277355 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:09.277013    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:36:09.277355 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:09.277026    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms"
Sep 09 23:36:09.277355 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:09.277314    2581 scope.go:117] "RemoveContainer" containerID="a946ac8046aca0d338cdbf859150093a7fb71595b28b565597e10dea6440b136"
Sep 09 23:36:09.277495 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:36:09.277474    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:36:16.739324 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:16.739292    2581 scope.go:117] "RemoveContainer" containerID="93930b2be29fc55864ba29813eef4c68727175bed9673637eb6a14818b5a3221"
Sep 09 23:36:16.739892 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:36:16.739447    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:36:16.739892 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:16.739458    2581 scope.go:117] "RemoveContainer" containerID="898765bc62a2e43acae8abf4415d8cf45aeb7d4b48d6f203e8518775d3e03c8c"
Sep 09 23:36:16.739892 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:36:16.739639    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:36:21.739075 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:21.739041    2581 scope.go:117] "RemoveContainer" containerID="a946ac8046aca0d338cdbf859150093a7fb71595b28b565597e10dea6440b136"
Sep 09 23:36:21.739445 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:36:21.739256    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:36:27.738952 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:27.738913    2581 scope.go:117] "RemoveContainer" containerID="898765bc62a2e43acae8abf4415d8cf45aeb7d4b48d6f203e8518775d3e03c8c"
Sep 09 23:36:28.458556 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:28.458466    2581 generic.go:356] "Generic (PLEG): container finished" podID="059d817e-b89e-4447-8930-ee8df173cc53" containerID="1756f792647b5a845c2ebf58bd959803ef1edaeb73c3493c7b167446e0c65583" exitCode=0
Sep 09 23:36:28.458745 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:28.458542    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" event={"ID":"059d817e-b89e-4447-8930-ee8df173cc53","Type":"ContainerDied","Data":"1756f792647b5a845c2ebf58bd959803ef1edaeb73c3493c7b167446e0c65583"}
Sep 09 23:36:28.458745 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:28.458601    2581 scope.go:117] "RemoveContainer" containerID="898765bc62a2e43acae8abf4415d8cf45aeb7d4b48d6f203e8518775d3e03c8c"
Sep 09 23:36:28.459009 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:28.458987    2581 scope.go:117] "RemoveContainer" containerID="1756f792647b5a845c2ebf58bd959803ef1edaeb73c3493c7b167446e0c65583"
Sep 09 23:36:28.459214 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:36:28.459190    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:36:31.739253 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:31.739217    2581 scope.go:117] "RemoveContainer" containerID="93930b2be29fc55864ba29813eef4c68727175bed9673637eb6a14818b5a3221"
Sep 09 23:36:31.739740 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:36:31.739438    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:36:31.924171 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:31.924138    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:36:31.985099 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:31.985076    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:36:31.985240 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:31.985113    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:36:31.985240 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:31.985125    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:36:31.985240 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:31.985136    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh"
Sep 09 23:36:31.985434 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:31.985423    2581 scope.go:117] "RemoveContainer" containerID="1756f792647b5a845c2ebf58bd959803ef1edaeb73c3493c7b167446e0c65583"
Sep 09 23:36:31.985602 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:36:31.985584    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:36:32.738744 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:32.738716    2581 scope.go:117] "RemoveContainer" containerID="a946ac8046aca0d338cdbf859150093a7fb71595b28b565597e10dea6440b136"
Sep 09 23:36:32.743694 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:36:32.739356    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:36:44.738926 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:44.738896    2581 scope.go:117] "RemoveContainer" containerID="1756f792647b5a845c2ebf58bd959803ef1edaeb73c3493c7b167446e0c65583"
Sep 09 23:36:44.739290 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:36:44.739097    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:36:45.738831 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:45.738798    2581 scope.go:117] "RemoveContainer" containerID="93930b2be29fc55864ba29813eef4c68727175bed9673637eb6a14818b5a3221"
Sep 09 23:36:45.739000 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:36:45.738964    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:36:47.738864 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:47.738833    2581 scope.go:117] "RemoveContainer" containerID="a946ac8046aca0d338cdbf859150093a7fb71595b28b565597e10dea6440b136"
Sep 09 23:36:47.739331 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:36:47.739007    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:36:57.738809 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:36:57.738780    2581 scope.go:117] "RemoveContainer" containerID="1756f792647b5a845c2ebf58bd959803ef1edaeb73c3493c7b167446e0c65583"
Sep 09 23:36:57.739280 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:36:57.738933    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:37:00.739130 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:00.739091    2581 scope.go:117] "RemoveContainer" containerID="93930b2be29fc55864ba29813eef4c68727175bed9673637eb6a14818b5a3221"
Sep 09 23:37:00.739592 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:37:00.739334    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:37:02.738794 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:02.738758    2581 scope.go:117] "RemoveContainer" containerID="a946ac8046aca0d338cdbf859150093a7fb71595b28b565597e10dea6440b136"
Sep 09 23:37:02.739261 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:37:02.738981    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:37:10.342052 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:10.342019    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_c643b476-9118-4757-b380-6ba18823cc24/main/5.log"
Sep 09 23:37:10.453021 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:10.452993    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_c643b476-9118-4757-b380-6ba18823cc24/main/5.log"
Sep 09 23:37:10.739068 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:10.739037    2581 scope.go:117] "RemoveContainer" containerID="1756f792647b5a845c2ebf58bd959803ef1edaeb73c3493c7b167446e0c65583"
Sep 09 23:37:10.739257 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:37:10.739233    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:37:11.447436 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:11.447389    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cbc54bbc5-82mvp_7e49be6d-c3ca-47fd-9657-10d54940a938/authorino/0.log"
Sep 09 23:37:13.742138 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:13.742111    2581 scope.go:117] "RemoveContainer" containerID="93930b2be29fc55864ba29813eef4c68727175bed9673637eb6a14818b5a3221"
Sep 09 23:37:13.742587 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:37:13.742309    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:37:14.738740 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:14.738715    2581 scope.go:117] "RemoveContainer" containerID="a946ac8046aca0d338cdbf859150093a7fb71595b28b565597e10dea6440b136"
Sep 09 23:37:14.738950 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:37:14.738895    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:37:16.675642 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:16.675558    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fnlqp_6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78/manager/0.log"
Sep 09 23:37:16.788720 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:16.788690    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55dfbc648b-ct4sn_f8846e96-6964-41c4-b087-cccfb83cd58e/manager/0.log"
Sep 09 23:37:17.233046 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:17.233018    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fb6f955c9-nzgmw_1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0/copy-manifests/0.log"
Sep 09 23:37:17.238888 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:17.238864    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fb6f955c9-nzgmw_1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0/manager/0.log"
Sep 09 23:37:17.679925 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:17.679852    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6644b6994f-6dk82_efedc0b7-4500-4133-8b4c-613e9360378e/maas-api/0.log"
Sep 09 23:37:17.785368 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:17.785341    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-jjfbk_fe78f86e-81b2-474c-af0c-3667a4204a15/postgres/0.log"
Sep 09 23:37:18.533324 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:18.533291    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cbc54bbc5-82mvp_7e49be6d-c3ca-47fd-9657-10d54940a938/authorino/0.log"
Sep 09 23:37:19.847225 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:19.847198    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fbb956d86-jnfhm_6282a7ea-b903-4e79-90c9-a1c4e4f46cc8/kube-auth-proxy/0.log"
Sep 09 23:37:20.707413 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:20.707386    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-6685d86975-qgb86_571da427-260b-4330-956b-82bbc2f4d919/main/5.log"
Sep 09 23:37:21.138514 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:21.138483    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_c643b476-9118-4757-b380-6ba18823cc24/main/5.log"
Sep 09 23:37:21.249986 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:21.249962    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_059d817e-b89e-4447-8930-ee8df173cc53/main/5.log"
Sep 09 23:37:23.684343 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:23.684317    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/ovn-acl-logging/0.log"
Sep 09 23:37:23.684773 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:23.684755    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/ovn-acl-logging/0.log"
Sep 09 23:37:24.739049 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:24.739020    2581 scope.go:117] "RemoveContainer" containerID="93930b2be29fc55864ba29813eef4c68727175bed9673637eb6a14818b5a3221"
Sep 09 23:37:24.739401 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:37:24.739206    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:37:25.744020 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:25.743991    2581 scope.go:117] "RemoveContainer" containerID="1756f792647b5a845c2ebf58bd959803ef1edaeb73c3493c7b167446e0c65583"
Sep 09 23:37:25.744411 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:37:25.744145    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:37:26.375535 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:26.375496    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:37:26.475331 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:26.475298    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log" limit=1024
Sep 09 23:37:29.195966 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:29.195940    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6cbhf_9c8282ee-a172-4f07-a592-8637893514c8/global-pull-secret-syncer/0.log"
Sep 09 23:37:29.309050 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:29.309023    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4fjs8_5de319a8-ac13-4f30-8292-d061e28495d2/konnectivity-agent/0.log"
Sep 09 23:37:29.375362 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:29.375333    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-34.ec2.internal_64fb27010123b0a7a495085cdd91f14e/haproxy/0.log"
Sep 09 23:37:29.738439 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:29.738413    2581 scope.go:117] "RemoveContainer" containerID="a946ac8046aca0d338cdbf859150093a7fb71595b28b565597e10dea6440b136"
Sep 09 23:37:29.738630 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:37:29.738573    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:37:33.785842 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:33.785766    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cbc54bbc5-82mvp_7e49be6d-c3ca-47fd-9657-10d54940a938/authorino/0.log"
Sep 09 23:37:35.546718 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:35.546686    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-hwshn_b8df005d-478a-4289-87bb-48842c63039e/kube-state-metrics/0.log"
Sep 09 23:37:35.562073 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:35.562052    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-hwshn_b8df005d-478a-4289-87bb-48842c63039e/kube-rbac-proxy-main/0.log"
Sep 09 23:37:35.579170 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:35.579151    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-hwshn_b8df005d-478a-4289-87bb-48842c63039e/kube-rbac-proxy-self/0.log"
Sep 09 23:37:35.632323 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:35.632301    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-g7w6b_1d6b2e84-0c7a-4fa9-8dc0-6308a0f9ec90/monitoring-plugin/0.log"
Sep 09 23:37:35.739025 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:35.738992    2581 scope.go:117] "RemoveContainer" containerID="93930b2be29fc55864ba29813eef4c68727175bed9673637eb6a14818b5a3221"
Sep 09 23:37:35.739215 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:37:35.739193    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:37:35.742314 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:35.742292    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-96r89_346b0488-bb51-4bf6-b4f4-575be946928f/node-exporter/0.log"
Sep 09 23:37:35.758610 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:35.758587    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-96r89_346b0488-bb51-4bf6-b4f4-575be946928f/kube-rbac-proxy/0.log"
Sep 09 23:37:35.778130 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:35.778111    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-96r89_346b0488-bb51-4bf6-b4f4-575be946928f/init-textfile/0.log"
Sep 09 23:37:35.978043 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:35.977996    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9537937-e50a-46ec-b28d-a0a3c694fb88/prometheus/0.log"
Sep 09 23:37:36.002239 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:36.002217    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9537937-e50a-46ec-b28d-a0a3c694fb88/config-reloader/0.log"
Sep 09 23:37:36.025638 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:36.025616    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9537937-e50a-46ec-b28d-a0a3c694fb88/thanos-sidecar/0.log"
Sep 09 23:37:36.057372 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:36.057320    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9537937-e50a-46ec-b28d-a0a3c694fb88/kube-rbac-proxy-web/0.log"
Sep 09 23:37:36.077493 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:36.077461    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9537937-e50a-46ec-b28d-a0a3c694fb88/kube-rbac-proxy/0.log"
Sep 09 23:37:36.098934 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:36.098910    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9537937-e50a-46ec-b28d-a0a3c694fb88/kube-rbac-proxy-thanos/0.log"
Sep 09 23:37:36.118493 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:36.118474    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9537937-e50a-46ec-b28d-a0a3c694fb88/init-config-reloader/0.log"
Sep 09 23:37:36.145548 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:36.145514    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-r8ld6_1e39063e-15fb-42c7-a026-dc2d9cd9644e/prometheus-operator/0.log"
Sep 09 23:37:36.167556 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:36.167536    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-r8ld6_1e39063e-15fb-42c7-a026-dc2d9cd9644e/kube-rbac-proxy/0.log"
Sep 09 23:37:36.203274 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:36.203248    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-76mwn_8d676199-e179-4d0e-a0e4-06cd739711a3/prometheus-operator-admission-webhook/0.log"
Sep 09 23:37:36.738593 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:36.738565    2581 scope.go:117] "RemoveContainer" containerID="1756f792647b5a845c2ebf58bd959803ef1edaeb73c3493c7b167446e0c65583"
Sep 09 23:37:36.739008 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:37:36.738753    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:37:39.285157 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.285124    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"]
Sep 09 23:37:39.288417 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.288401    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.290439 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.290412    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vllbr\"/\"openshift-service-ca.crt\""
Sep 09 23:37:39.291146 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.291126    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vllbr\"/\"default-dockercfg-x4s7z\""
Sep 09 23:37:39.291234 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.291128    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vllbr\"/\"kube-root-ca.crt\""
Sep 09 23:37:39.298699 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.298660    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"]
Sep 09 23:37:39.374079 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.374048    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49a2194a-2e1d-45aa-869d-04cb2d7d0223-proc\") pod \"perf-node-gather-daemonset-vqpft\" (UID: \"49a2194a-2e1d-45aa-869d-04cb2d7d0223\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.374261 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.374093    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49a2194a-2e1d-45aa-869d-04cb2d7d0223-lib-modules\") pod \"perf-node-gather-daemonset-vqpft\" (UID: \"49a2194a-2e1d-45aa-869d-04cb2d7d0223\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.374261 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.374113    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49a2194a-2e1d-45aa-869d-04cb2d7d0223-podres\") pod \"perf-node-gather-daemonset-vqpft\" (UID: \"49a2194a-2e1d-45aa-869d-04cb2d7d0223\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.374261 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.374217    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n44x\" (UniqueName: \"kubernetes.io/projected/49a2194a-2e1d-45aa-869d-04cb2d7d0223-kube-api-access-5n44x\") pod \"perf-node-gather-daemonset-vqpft\" (UID: \"49a2194a-2e1d-45aa-869d-04cb2d7d0223\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.374421 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.374334    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49a2194a-2e1d-45aa-869d-04cb2d7d0223-sys\") pod \"perf-node-gather-daemonset-vqpft\" (UID: \"49a2194a-2e1d-45aa-869d-04cb2d7d0223\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.474812 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.474781    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49a2194a-2e1d-45aa-869d-04cb2d7d0223-sys\") pod \"perf-node-gather-daemonset-vqpft\" (UID: \"49a2194a-2e1d-45aa-869d-04cb2d7d0223\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.474973 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.474817    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49a2194a-2e1d-45aa-869d-04cb2d7d0223-proc\") pod \"perf-node-gather-daemonset-vqpft\" (UID: \"49a2194a-2e1d-45aa-869d-04cb2d7d0223\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.474973 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.474841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49a2194a-2e1d-45aa-869d-04cb2d7d0223-lib-modules\") pod \"perf-node-gather-daemonset-vqpft\" (UID: \"49a2194a-2e1d-45aa-869d-04cb2d7d0223\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.474973 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.474858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49a2194a-2e1d-45aa-869d-04cb2d7d0223-podres\") pod \"perf-node-gather-daemonset-vqpft\" (UID: \"49a2194a-2e1d-45aa-869d-04cb2d7d0223\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.474973 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.474887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n44x\" (UniqueName: \"kubernetes.io/projected/49a2194a-2e1d-45aa-869d-04cb2d7d0223-kube-api-access-5n44x\") pod \"perf-node-gather-daemonset-vqpft\" (UID: \"49a2194a-2e1d-45aa-869d-04cb2d7d0223\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.474973 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.474916    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49a2194a-2e1d-45aa-869d-04cb2d7d0223-proc\") pod \"perf-node-gather-daemonset-vqpft\" (UID: \"49a2194a-2e1d-45aa-869d-04cb2d7d0223\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.474973 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.474917    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49a2194a-2e1d-45aa-869d-04cb2d7d0223-sys\") pod \"perf-node-gather-daemonset-vqpft\" (UID: \"49a2194a-2e1d-45aa-869d-04cb2d7d0223\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.475182 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.474993    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49a2194a-2e1d-45aa-869d-04cb2d7d0223-lib-modules\") pod \"perf-node-gather-daemonset-vqpft\" (UID: \"49a2194a-2e1d-45aa-869d-04cb2d7d0223\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.475182 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.474993    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49a2194a-2e1d-45aa-869d-04cb2d7d0223-podres\") pod \"perf-node-gather-daemonset-vqpft\" (UID: \"49a2194a-2e1d-45aa-869d-04cb2d7d0223\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.482073 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.482052    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n44x\" (UniqueName: \"kubernetes.io/projected/49a2194a-2e1d-45aa-869d-04cb2d7d0223-kube-api-access-5n44x\") pod \"perf-node-gather-daemonset-vqpft\" (UID: \"49a2194a-2e1d-45aa-869d-04cb2d7d0223\") " pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.598646 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.598567    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:39.867480 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:39.867402    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"]
Sep 09 23:37:39.871183 ip-10-0-133-34 kubenswrapper[2581]: W0909 23:37:39.871151    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod49a2194a_2e1d_45aa_869d_04cb2d7d0223.slice/crio-711689cf5bd20971dab158de7074b80d77fda716921548fc50025ec9dd8daea4 WatchSource:0}: Error finding container 711689cf5bd20971dab158de7074b80d77fda716921548fc50025ec9dd8daea4: Status 404 returned error can't find the container with id 711689cf5bd20971dab158de7074b80d77fda716921548fc50025ec9dd8daea4
Sep 09 23:37:40.772826 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:40.772795    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft" event={"ID":"49a2194a-2e1d-45aa-869d-04cb2d7d0223","Type":"ContainerStarted","Data":"77596107c8703d93e4da9486bfcdf318c7759839bb4d41c3c17050a96d4719d2"}
Sep 09 23:37:40.773215 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:40.772839    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft" event={"ID":"49a2194a-2e1d-45aa-869d-04cb2d7d0223","Type":"ContainerStarted","Data":"711689cf5bd20971dab158de7074b80d77fda716921548fc50025ec9dd8daea4"}
Sep 09 23:37:40.773215 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:40.772890    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:40.788267 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:40.788219    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft" podStartSLOduration=1.788202949 podStartE2EDuration="1.788202949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:37:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:37:40.786695655 +0000 UTC m=+917.525418455" watchObservedRunningTime="2026-09-09 23:37:40.788202949 +0000 UTC m=+917.526925795"
Sep 09 23:37:41.004563 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:41.004538    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qgj56_a075cc78-0534-4aae-a0fa-6bcb7ef674bc/dns/0.log"
Sep 09 23:37:41.021930 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:41.021904    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qgj56_a075cc78-0534-4aae-a0fa-6bcb7ef674bc/kube-rbac-proxy/0.log"
Sep 09 23:37:41.040807 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:41.040752    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2zs45_e8a2522f-05c2-49d1-a218-f2d497019b27/dns-node-resolver/0.log"
Sep 09 23:37:41.626875 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:41.626848    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wzn72_f1fcbbeb-26ac-4451-8d92-c633f16dde4b/node-ca/0.log"
Sep 09 23:37:41.745483 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:41.745461    2581 scope.go:117] "RemoveContainer" containerID="a946ac8046aca0d338cdbf859150093a7fb71595b28b565597e10dea6440b136"
Sep 09 23:37:41.745640 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:37:41.745594    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:37:42.610789 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:42.610757    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fbb956d86-jnfhm_6282a7ea-b903-4e79-90c9-a1c4e4f46cc8/kube-auth-proxy/0.log"
Sep 09 23:37:43.395861 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:43.395831    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-glpf9_dbb2fd75-c34f-4a5e-a9ae-4739e58b655c/serve-healthcheck-canary/0.log"
Sep 09 23:37:43.904210 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:43.904169    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m5ww8_8cd5d867-6be3-4ec9-be93-f1fcd6e01aef/kube-rbac-proxy/0.log"
Sep 09 23:37:43.921136 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:43.921115    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m5ww8_8cd5d867-6be3-4ec9-be93-f1fcd6e01aef/exporter/0.log"
Sep 09 23:37:43.940845 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:43.940822    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m5ww8_8cd5d867-6be3-4ec9-be93-f1fcd6e01aef/extractor/0.log"
Sep 09 23:37:46.044392 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:46.044363    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fnlqp_6dc802f1-1409-4f4b-a11b-b9bd1cc7ee78/manager/0.log"
Sep 09 23:37:46.070788 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:46.070757    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55dfbc648b-ct4sn_f8846e96-6964-41c4-b087-cccfb83cd58e/manager/0.log"
Sep 09 23:37:46.233027 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:46.233000    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fb6f955c9-nzgmw_1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0/manager/0.log"
Sep 09 23:37:46.249649 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:46.249629    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fb6f955c9-nzgmw_1282cfe3-ecf4-4a0d-8adb-1a1ad76306b0/copy-manifests/0.log"
Sep 09 23:37:46.786897 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:46.786870    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vllbr/perf-node-gather-daemonset-vqpft"
Sep 09 23:37:47.417789 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:47.417761    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-b488669bf-hf4tw_05152955-fd48-4ac2-91ff-5c578715cc96/manager/0.log"
Sep 09 23:37:47.443045 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:47.443018    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-g28v9_2a7480d2-bf52-48d7-8f4e-ee4b583bca8f/openshift-lws-operator/0.log"
Sep 09 23:37:47.739445 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:47.739416    2581 scope.go:117] "RemoveContainer" containerID="93930b2be29fc55864ba29813eef4c68727175bed9673637eb6a14818b5a3221"
Sep 09 23:37:47.739712 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:37:47.739662    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-qgb86_llm(571da427-260b-4330-956b-82bbc2f4d919)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-qgb86" podUID="571da427-260b-4330-956b-82bbc2f4d919"
Sep 09 23:37:48.739147 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:48.739110    2581 scope.go:117] "RemoveContainer" containerID="1756f792647b5a845c2ebf58bd959803ef1edaeb73c3493c7b167446e0c65583"
Sep 09 23:37:48.739518 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:37:48.739337    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh_llm(059d817e-b89e-4447-8930-ee8df173cc53)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-lmnzh" podUID="059d817e-b89e-4447-8930-ee8df173cc53"
Sep 09 23:37:49.147954 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:49.147922    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fbb956d86-jnfhm_6282a7ea-b903-4e79-90c9-a1c4e4f46cc8/kube-auth-proxy/0.log"
Sep 09 23:37:50.559765 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:50.559659    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fbb956d86-jnfhm_6282a7ea-b903-4e79-90c9-a1c4e4f46cc8/kube-auth-proxy/0.log"
Sep 09 23:37:54.172014 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:54.171982    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9prfv_b0d988e1-d35b-4ba9-a44d-65cd8a3bc1cc/kube-multus/0.log"
Sep 09 23:37:54.361397 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:54.361365    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jdcm_49ab7649-13c9-46f3-a00d-ac28e2df0c7b/kube-multus-additional-cni-plugins/0.log"
Sep 09 23:37:54.380558 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:54.380534    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jdcm_49ab7649-13c9-46f3-a00d-ac28e2df0c7b/egress-router-binary-copy/0.log"
Sep 09 23:37:54.398352 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:54.398332    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jdcm_49ab7649-13c9-46f3-a00d-ac28e2df0c7b/cni-plugins/0.log"
Sep 09 23:37:54.416636 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:54.416600    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jdcm_49ab7649-13c9-46f3-a00d-ac28e2df0c7b/bond-cni-plugin/0.log"
Sep 09 23:37:54.433878 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:54.433817    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jdcm_49ab7649-13c9-46f3-a00d-ac28e2df0c7b/routeoverride-cni/0.log"
Sep 09 23:37:54.451826 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:54.451798    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jdcm_49ab7649-13c9-46f3-a00d-ac28e2df0c7b/whereabouts-cni-bincopy/0.log"
Sep 09 23:37:54.478504 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:54.478480    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6jdcm_49ab7649-13c9-46f3-a00d-ac28e2df0c7b/whereabouts-cni/0.log"
Sep 09 23:37:54.678425 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:54.678394    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5ldkh_d746b0d0-998c-4264-8725-e909b06c30e2/network-metrics-daemon/0.log"
Sep 09 23:37:54.700455 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:54.700368    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5ldkh_d746b0d0-998c-4264-8725-e909b06c30e2/kube-rbac-proxy/0.log"
Sep 09 23:37:55.532274 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:55.532247    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/ovn-controller/0.log"
Sep 09 23:37:55.553652 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:55.553625    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/ovn-acl-logging/0.log"
Sep 09 23:37:55.553652 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:55.553647    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/ovn-acl-logging/1.log"
Sep 09 23:37:55.569635 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:55.569612    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/kube-rbac-proxy-node/0.log"
Sep 09 23:37:55.589931 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:55.589905    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/kube-rbac-proxy-ovn-metrics/0.log"
Sep 09 23:37:55.612962 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:55.612940    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/northd/0.log"
Sep 09 23:37:55.630781 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:55.630764    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/nbdb/0.log"
Sep 09 23:37:55.654483 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:55.654463    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/sbdb/0.log"
Sep 09 23:37:55.689846 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:55.689824    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5m2q9_f3a022bf-71eb-4784-ad71-be1723163abf/ovnkube-controller/0.log"
Sep 09 23:37:56.739252 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:56.739225    2581 scope.go:117] "RemoveContainer" containerID="a946ac8046aca0d338cdbf859150093a7fb71595b28b565597e10dea6440b136"
Sep 09 23:37:56.739624 ip-10-0-133-34 kubenswrapper[2581]: E0909 23:37:56.739413    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms_llm(c643b476-9118-4757-b380-6ba18823cc24)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b7cms" podUID="c643b476-9118-4757-b380-6ba18823cc24"
Sep 09 23:37:57.093622 ip-10-0-133-34 kubenswrapper[2581]: I0909 23:37:57.093546    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-gwbns_c1771623-e2e6-4795-b247-beed28567e6f/network-check-target-container/0.log"