Jun 03 23:23:59.986635 ip-10-0-129-203 systemd[1]: Starting Kubernetes Kubelet...
Jun 03 23:24:00.371629 ip-10-0-129-203 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 23:24:00.371629 ip-10-0-129-203 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 03 23:24:00.371629 ip-10-0-129-203 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 23:24:00.371629 ip-10-0-129-203 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 03 23:24:00.371629 ip-10-0-129-203 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 23:24:00.374022 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.373928    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 03 23:24:00.377473 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377457    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 23:24:00.377473 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377474    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377478    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377482    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377485    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377488    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377491    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377493    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377496    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377499    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377501    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377504    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377512    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377514    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377517    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377520    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377522    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377527    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377531    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377534    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 23:24:00.377545 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377537    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377540    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377543    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377546    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377549    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377552    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377555    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377558    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377561    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377563    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377566    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377568    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377571    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377573    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377576    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377580    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377584    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377586    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377589    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377592    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 23:24:00.378021 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377594    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377596    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377599    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377602    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377605    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377608    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377611    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377613    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377616    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377619    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377621    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377623    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377626    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377628    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377631    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377634    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377636    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377639    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377642    2561 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377645    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 23:24:00.378522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377647    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377650    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377652    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377655    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377657    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377660    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377662    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377665    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377667    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377670    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377672    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377675    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377678    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377680    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377683    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377685    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377688    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377690    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377693    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377696    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 23:24:00.379022 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377699    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377701    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377704    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377707    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377709    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377712    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377716    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377718    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377721    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377723    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377726    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377728    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377731    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377734    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377736    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377739    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377743    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.377746    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378468    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 23:24:00.379565 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378475    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378478    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378481    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378486    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378490    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378494    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378496    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378500    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378503    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378506    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378508    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378511    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378514    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378517    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378520    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378523    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378526    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378529    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378531    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378535    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 23:24:00.380031 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378538    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378540    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378543    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378546    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378548    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378551    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378553    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378555    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378558    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378561    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378563    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378566    2561 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378568    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378571    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378573    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378576    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378578    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378581    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378584    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378586    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 23:24:00.380550 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378589    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378591    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378594    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378597    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378600    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378602    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378605    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378607    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378610    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378612    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378615    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378618    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378622    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378625    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378628    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378631    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378634    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378636    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378639    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 23:24:00.381053 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378641    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378644    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378646    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378649    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378652    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378655    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378657    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378659    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378662    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378665    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378667    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378670    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378673    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378675    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378677    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378680    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378684    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378686    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378688    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378691    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 23:24:00.381554 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378694    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378696    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378700    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378702    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378706    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378709    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378711    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378714    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378716    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378719    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378721    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378725    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378727    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378730    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378732    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378735    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378738    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.378741    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379142    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 23:24:00.382058 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379147    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379150    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379153    2561 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379156    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379158    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379162    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379165    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379167    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379171    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379176    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379180    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379183    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379186    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379189    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379192    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379194    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379197    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379200    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379202    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379205    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 23:24:00.382540 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379207    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379210    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379212    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379215    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379217    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379220    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379223    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379226    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379230    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379234    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379236    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379239    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379241    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379245    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379247    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379250    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379252    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379255    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379258    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379261    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 23:24:00.383039 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379263    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379279    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379282    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379285    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379287    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379290    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379292    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379295    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379298    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379301    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379303    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379306    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379308    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379311    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379313    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379316    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379318    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379321    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379323    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 23:24:00.383571 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379326    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379328    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379331    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379333    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379337    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379340    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379342    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379345    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379348    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379351    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379353    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379356    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379359    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379361    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379364    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379367    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379369    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379372    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379374    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379377    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 23:24:00.384035 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379379    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379381    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379384    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379386    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379389    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379391    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379394    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379402    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379405    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379408    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379411    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379413    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379416    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379419    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379422    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379425    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379428    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.379432    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379513    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379521    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 03 23:24:00.384579 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379536    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379540    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379544    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379547    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379552    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379557    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379560    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379563    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379567    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379570    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379573    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379577    2561 flags.go:64] FLAG: --cgroup-root=""
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379580    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379583    2561 flags.go:64] FLAG: --client-ca-file=""
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379586    2561 flags.go:64] FLAG: --cloud-provider="external"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379589    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379593    2561 flags.go:64] FLAG: --cluster-domain=""
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379596    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379599    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379603    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379607    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379611    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379614    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 03 23:24:00.385067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379617    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379621    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379624    2561 flags.go:64] FLAG: --contention-profiling="false"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379631    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379634    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379637    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379640    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379644    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379647    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379650    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379653    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379656    2561 flags.go:64] FLAG: --enable-server="true"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379659    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379666    2561 flags.go:64] FLAG: --event-burst="100"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379669    2561 flags.go:64] FLAG: --event-qps="50"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379675    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379678    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379681    2561 flags.go:64] FLAG: --eviction-hard=""
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379685    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379688    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379691    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379694    2561 flags.go:64] FLAG: --eviction-soft=""
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379697    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379700    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379703    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 03 23:24:00.385649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379706    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379708    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379711    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379715    2561 flags.go:64] FLAG: --feature-gates=""
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379719    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379722    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379725    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379729    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379732    2561 flags.go:64] FLAG: --healthz-port="10248"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379735    2561 flags.go:64] FLAG: --help="false"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379739    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379742    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379745    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379748    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379751    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379755    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379758    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379760    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379763    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379766    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379769    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379772    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379775    2561 flags.go:64] FLAG: --kube-reserved=""
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379778    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 03 23:24:00.386426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379781    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379784    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379786    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379789    2561 flags.go:64] FLAG: --lock-file=""
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379792    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379795    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379798    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379803    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379806    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379809    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379812    2561 flags.go:64] FLAG: --logging-format="text"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379819    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379823    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379826    2561 flags.go:64] FLAG: --manifest-url=""
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379828    2561 flags.go:64] FLAG: --manifest-url-header=""
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379833    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379836    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379840    2561 flags.go:64] FLAG: --max-pods="110"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379845    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379848    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379851    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379854    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379857    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379860    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379863    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 03 23:24:00.387034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379871    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379874    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379877    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379880    2561 flags.go:64] FLAG: --pod-cidr=""
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379884    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379890    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379893    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379897    2561 flags.go:64] FLAG: --pods-per-core="0"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379900    2561 flags.go:64] FLAG: --port="10250"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379903    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379906    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0968fae759e01cb0b"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379909    2561 flags.go:64] FLAG: --qos-reserved=""
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379912    2561 flags.go:64] FLAG: --read-only-port="10255"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379915    2561 flags.go:64] FLAG: --register-node="true"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379918    2561 flags.go:64] FLAG: --register-with-taints=""
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379922    2561 flags.go:64] FLAG: --registry-burst="10"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379925    2561 flags.go:64] FLAG: --registry-qps="5"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379927    2561 flags.go:64] FLAG: --reserved-cpus=""
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379932    2561 flags.go:64] FLAG: --reserved-memory=""
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379936    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379939    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379942    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379945    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379947    2561 flags.go:64] FLAG: --runonce="false"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379950    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 03 23:24:00.387690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379953    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379958    2561 flags.go:64] FLAG: --seccomp-default="false"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379960    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379963    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379966    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379970    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379973    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379976    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379979    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379982    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379984    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379987    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379990    2561 flags.go:64] FLAG: --system-cgroups=""
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379993    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.379999    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.380003    2561 flags.go:64] FLAG: --tls-cert-file=""
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.380006    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.380010    2561 flags.go:64] FLAG: --tls-min-version=""
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.380013    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.380016    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.380019    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.380022    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.380024    2561 flags.go:64] FLAG: --v="2"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.380028    2561 flags.go:64] FLAG: --version="false"
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.380033    2561 flags.go:64] FLAG: --vmodule=""
Jun 03 23:24:00.388322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.380038    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.380041    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380154    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380159    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380164    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380167    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380170    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380173    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380177    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380181    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380184    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380187    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380189    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380192    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380195    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380197    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380200    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380203    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380205    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 23:24:00.388943 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380208    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380212    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380215    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380218    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380222    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380225    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380228    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380232    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380234    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380237    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380239    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380242    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380244    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380248    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380250    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380253    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380257    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380260    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380263    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 23:24:00.389522 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380278    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380281    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380285    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380288    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380291    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380294    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380297    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380300    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380302    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380305    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380308    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380310    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380313    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380315    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380318    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380321    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380323    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380326    2561 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380329    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380332    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 23:24:00.389993 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380334    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380337    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380340    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380342    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380345    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380347    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380351    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380353    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380356    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380359    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380362    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380364    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380367    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380370    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380374    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380377    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380380    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380383    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380386    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380389    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 23:24:00.390504 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380391    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380394    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380396    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380399    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380402    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380405    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380408    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380410    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380413    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380416    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380418    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380421    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380424    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380426    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380429    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380431    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380434    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380437    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380440    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380442    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 23:24:00.391136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380445    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 23:24:00.391849 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.380448    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 23:24:00.391849 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.381090    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 03 23:24:00.391849 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.388467    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 03 23:24:00.391849 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.388485    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 03 23:24:00.391849 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.388505    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 03 23:24:00.391849 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.388511    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 03 23:24:00.391849 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388581    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 23:24:00.391849 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388586    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 23:24:00.391849 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388590    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 23:24:00.391849 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388593    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 23:24:00.391849 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388597    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 23:24:00.391849 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388600    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 23:24:00.391849 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388603    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 23:24:00.391849 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388606    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 23:24:00.391849 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388609    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388611    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388614    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388617    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388620    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388622    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388625    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388627    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388631    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388634    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388636    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388639    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388642    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388644    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388647    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388650    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388653    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388655    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388657    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 23:24:00.392252 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388660    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388664    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388668    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388672    2561 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388675    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388678    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388681    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388684    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388688    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388692    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388695    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388698    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388701    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388704    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388706    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388710    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388713    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388715    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388718    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 23:24:00.392748 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388720    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388723    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388725    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388729    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388731    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388734    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388736    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388739    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388741    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388744    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388747    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388750    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388752    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388755    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388757    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388761    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388763    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388766    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388769    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388771    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 23:24:00.393233 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388774    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388777    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388780    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388784    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388787    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388789    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388792    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388795    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388797    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388800    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388802    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388805    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388807    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388810    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388813    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388815    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388824    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388826    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388829    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388832    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 23:24:00.393868 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388834    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 23:24:00.394379 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388836    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 23:24:00.394379 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388839    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 23:24:00.394379 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388841    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 23:24:00.394379 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388844    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 23:24:00.394379 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388846    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 23:24:00.394379 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388849    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 23:24:00.394379 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388853    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 23:24:00.394379 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388855    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 23:24:00.394379 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388858    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 23:24:00.394379 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388861    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 23:24:00.394379 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.388864    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 23:24:00.394379 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.388869    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 03 23:24:00.394379 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389028    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 23:24:00.394379 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389034    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 23:24:00.394379 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389037    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389039    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389042    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389045    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389048    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389051    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389053    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389056    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389059    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389062    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389064    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389067    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389069    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389072    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389080    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389083    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389085    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389088    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389090    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389093    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 23:24:00.394746 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389095    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389098    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389100    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389103    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389105    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389108    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389111    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389113    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389116    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389118    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389121    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389124    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389126    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389129    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389131    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389134    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389136    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389139    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389141    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 23:24:00.395290 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389144    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389146    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389149    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389153    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389156    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389159    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389161    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389164    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389173    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389176    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389179    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389181    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389184    2561 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389187    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389189    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389193    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389197    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389200    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389202    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 23:24:00.395752 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389205    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389208    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389210    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389213    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389216    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389218    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389221    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389223    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389226    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389228    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389231    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389234    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389236    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389238    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389241    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389243    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389246    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389249    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389252    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 23:24:00.396231 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389254    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389258    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389261    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389284    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389290    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389293    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389296    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389298    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389301    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389303    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389306    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389309    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389312    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389314    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389317    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389319    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389322    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389324    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 23:24:00.396709 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:00.389327    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 23:24:00.397140 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.389332    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 03 23:24:00.397140 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.389456    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 03 23:24:00.397140 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.394203    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 03 23:24:00.397140 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.395602    2561 server.go:1019] "Starting client certificate rotation"
Jun 03 23:24:00.397140 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.395699    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 23:24:00.397140 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.395728    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 23:24:00.398493 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.398478    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 23:24:00.404137 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.404119    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 23:24:00.413301 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.413264    2561 log.go:25] "Validated CRI v1 runtime API"
Jun 03 23:24:00.417842 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.417821    2561 log.go:25] "Validated CRI v1 image API"
Jun 03 23:24:00.419331 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.419313    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 03 23:24:00.422878 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.422858    2561 fs.go:135] Filesystem UUIDs: map[1a974c9b-7bc6-4410-b2bc-d626feb6f898:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e3020a43-4982-4bac-a330-6cc8c9700cfe:/dev/nvme0n1p4]
Jun 03 23:24:00.422949 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.422877    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 03 23:24:00.423312 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.423290    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 23:24:00.428586 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.428447    2561 manager.go:216] Machine: {Timestamp:2026-06-03 23:24:00.426513365 +0000 UTC m=+0.325415628 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097832 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bc7b5d4521257713c6083a4936341 SystemUUID:ec2bc7b5-d452-1257-713c-6083a4936341 BootID:0fc2a9f7-27ba-4413-af9f-350319b4e0a1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:34:89:85:71:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:34:89:85:71:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:20:c8:29:d7:95 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 03 23:24:00.428586 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.428566    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 03 23:24:00.428755 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.428721    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 03 23:24:00.432001 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.431957    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 03 23:24:00.432200 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.432005    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-203.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 03 23:24:00.432736 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.432721    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jun 03 23:24:00.432803 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.432743    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jun 03 23:24:00.432803 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.432754    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 23:24:00.432803 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.432774    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 23:24:00.433586 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.433573    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 03 23:24:00.436561 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.436544    2561 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 23:24:00.436720 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.436708    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 03 23:24:00.436783 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.436751    2561 kubelet.go:486] "Attempting to sync node with API server"
Jun 03 23:24:00.436783 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.436766    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 03 23:24:00.436783 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.436782    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 03 23:24:00.436905 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.436801    2561 kubelet.go:398] "Adding apiserver pod source"
Jun 03 23:24:00.436905 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.436815    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 03 23:24:00.437284 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.437253    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 23:24:00.437367 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.437312    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 23:24:00.441098 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.441069    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 03 23:24:00.443161 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.443143    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 03 23:24:00.443240 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.443176    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 03 23:24:00.444726 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.444713    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 03 23:24:00.444763 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.444731    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 03 23:24:00.444763 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.444738    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 03 23:24:00.444763 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.444750    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 03 23:24:00.444763 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.444763    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 03 23:24:00.444878 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.444771    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 03 23:24:00.444878 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.444781    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 03 23:24:00.444878 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.444786    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 03 23:24:00.444878 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.444793    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 03 23:24:00.444878 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.444799    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 03 23:24:00.444878 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.444807    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 03 23:24:00.444878 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.444813    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 03 23:24:00.445470 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.445460    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 03 23:24:00.445470 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.445470    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 03 23:24:00.449131 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.449114    2561 server.go:1268] "Started kubelet"
Jun 03 23:24:00.449222 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.449189    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 03 23:24:00.449874 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.449843    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-203.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 03 23:24:00.450120 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.450058    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 03 23:24:00.450226 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.450143    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 03 23:24:00.450226 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.450180    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 03 23:24:00.450119 ip-10-0-129-203 systemd[1]: Started Kubernetes Kubelet.
Jun 03 23:24:00.450758 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.450200    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-203.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 03 23:24:00.451407 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.451378    2561 server.go:310] "Adding debug handlers to kubelet server"
Jun 03 23:24:00.451470 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.451415    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 03 23:24:00.456088 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.456052    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 03 23:24:00.456088 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.455321    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-203.ec2.internal.18b5b5ba883c19c4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-203.ec2.internal,UID:ip-10-0-129-203.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-203.ec2.internal,},FirstTimestamp:2026-06-03 23:24:00.449083844 +0000 UTC m=+0.347986087,LastTimestamp:2026-06-03 23:24:00.449083844 +0000 UTC m=+0.347986087,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-203.ec2.internal,}"
Jun 03 23:24:00.458432 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.458197    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 03 23:24:00.458533 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.458210    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 03 23:24:00.458590 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.458540    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-203.ec2.internal\" not found"
Jun 03 23:24:00.459169 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.458920    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 03 23:24:00.459169 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.458936    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 03 23:24:00.459169 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.458972    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 03 23:24:00.459169 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.459170    2561 reconstruct.go:97] "Volume reconstruction finished"
Jun 03 23:24:00.459404 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.459178    2561 reconciler.go:29] "Reconciler: start to sync state"
Jun 03 23:24:00.459551 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.459520    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 03 23:24:00.459551 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.459541    2561 factory.go:55] Registering systemd factory
Jun 03 23:24:00.459551 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.459550    2561 factory.go:223] Registration of the systemd container factory successfully
Jun 03 23:24:00.459780 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.459767    2561 factory.go:153] Registering CRI-O factory
Jun 03 23:24:00.459780 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.459782    2561 factory.go:223] Registration of the crio container factory successfully
Jun 03 23:24:00.459892 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.459801    2561 factory.go:103] Registering Raw factory
Jun 03 23:24:00.459892 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.459814    2561 manager.go:1196] Started watching for new ooms in manager
Jun 03 23:24:00.460555 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.460536    2561 manager.go:349] Starting recovery of all containers
Jun 03 23:24:00.461415 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.461394    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 03 23:24:00.461732 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.461644    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-203.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 03 23:24:00.470921 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.470885    2561 manager.go:354] Recovery completed
Jun 03 23:24:00.474841 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.474809    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9z5tc"
Jun 03 23:24:00.476630 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.476616    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 23:24:00.478597 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.478546    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 23:24:00.478597 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.478585    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 23:24:00.478716 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.478602    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasSufficientPID"
Jun 03 23:24:00.479218 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.479199    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 03 23:24:00.479218 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.479213    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 23:24:00.479411 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.479214    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 03 23:24:00.479411 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.479315    2561 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 23:24:00.480504 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.480487    2561 policy_none.go:49] "None policy: Start"
Jun 03 23:24:00.480504 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.480507    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 03 23:24:00.480648 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.480519    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 03 23:24:00.480648 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.480538    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-203.ec2.internal.18b5b5ba89fdf344  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-203.ec2.internal,UID:ip-10-0-129-203.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-203.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-203.ec2.internal,},FirstTimestamp:2026-06-03 23:24:00.478565188 +0000 UTC m=+0.377467445,LastTimestamp:2026-06-03 23:24:00.478565188 +0000 UTC m=+0.377467445,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-203.ec2.internal,}"
Jun 03 23:24:00.481526 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.481513    2561 policy_none.go:47] "Start"
Jun 03 23:24:00.483343 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.483326    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9z5tc"
Jun 03 23:24:00.486547 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.486531    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 23:24:00.486631 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.486563    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 23:24:00.486631 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.486574    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasSufficientPID"
Jun 03 23:24:00.521195 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.514937    2561 manager.go:337] "Starting Device Plugin manager"
Jun 03 23:24:00.521195 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.514973    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 03 23:24:00.521195 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.514984    2561 server.go:87] "Starting device plugin registration server"
Jun 03 23:24:00.521195 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.515303    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 03 23:24:00.521195 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.515317    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 03 23:24:00.521195 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.515408    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 03 23:24:00.521195 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.515498    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 03 23:24:00.521195 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.515507    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 03 23:24:00.521195 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.516093    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 03 23:24:00.521195 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.516136    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-203.ec2.internal\" not found"
Jun 03 23:24:00.521195 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.519997    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 03 23:24:00.521714 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.521363    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 03 23:24:00.521714 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.521394    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 03 23:24:00.521714 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.521414    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 03 23:24:00.521714 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.521445    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 03 23:24:00.523424 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.523403    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 23:24:00.615963 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.615915    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 23:24:00.616923 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.616906    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 23:24:00.617026 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.616935    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 23:24:00.617026 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.616947    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasSufficientPID"
Jun 03 23:24:00.617026 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.616970    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.622135 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.622078    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-203.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal"]
Jun 03 23:24:00.622188 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.622148    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 23:24:00.623028 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.623014    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 23:24:00.623097 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.623046    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 23:24:00.623097 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.623059    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasSufficientPID"
Jun 03 23:24:00.624498 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.624487    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 23:24:00.624612 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.624592    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.624686 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.624630    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 23:24:00.625241 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.625222    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 23:24:00.625347 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.625247    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 23:24:00.625347 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.625253    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 23:24:00.625347 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.625286    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 23:24:00.625347 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.625302    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasSufficientPID"
Jun 03 23:24:00.625347 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.625305    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasSufficientPID"
Jun 03 23:24:00.625514 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.625484    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.625514 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.625506    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-203.ec2.internal\": node \"ip-10-0-129-203.ec2.internal\" not found"
Jun 03 23:24:00.626607 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.626592    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.626673 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.626619    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 23:24:00.627374 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.627356    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 23:24:00.627469 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.627384    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 23:24:00.627469 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.627395    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeHasSufficientPID"
Jun 03 23:24:00.656123 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.656089    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-203.ec2.internal\" not found" node="ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.660512 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.660482    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a93bc6515e10faef9b23786f0c77b15e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-203.ec2.internal\" (UID: \"a93bc6515e10faef9b23786f0c77b15e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.660622 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.660526    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7476c89bb59e907acdd0c6bfd86a930b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal\" (UID: \"7476c89bb59e907acdd0c6bfd86a930b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.660622 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.660554    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7476c89bb59e907acdd0c6bfd86a930b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal\" (UID: \"7476c89bb59e907acdd0c6bfd86a930b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.660622 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.660531    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-203.ec2.internal\" not found" node="ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.667924 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.667899    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-203.ec2.internal\" not found"
Jun 03 23:24:00.761173 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.761141    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a93bc6515e10faef9b23786f0c77b15e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-203.ec2.internal\" (UID: \"a93bc6515e10faef9b23786f0c77b15e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.761293 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.761191    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7476c89bb59e907acdd0c6bfd86a930b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal\" (UID: \"7476c89bb59e907acdd0c6bfd86a930b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.761293 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.761209    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7476c89bb59e907acdd0c6bfd86a930b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal\" (UID: \"7476c89bb59e907acdd0c6bfd86a930b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.761293 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.761235    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7476c89bb59e907acdd0c6bfd86a930b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal\" (UID: \"7476c89bb59e907acdd0c6bfd86a930b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.761293 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.761234    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a93bc6515e10faef9b23786f0c77b15e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-203.ec2.internal\" (UID: \"a93bc6515e10faef9b23786f0c77b15e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.761293 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.761246    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7476c89bb59e907acdd0c6bfd86a930b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal\" (UID: \"7476c89bb59e907acdd0c6bfd86a930b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.769025 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.768996    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-203.ec2.internal\" not found"
Jun 03 23:24:00.870007 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.869969    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-203.ec2.internal\" not found"
Jun 03 23:24:00.959500 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.959476    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.965109 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:00.965086    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal"
Jun 03 23:24:00.970852 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:00.970832    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-203.ec2.internal\" not found"
Jun 03 23:24:01.071443 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:01.071400    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-203.ec2.internal\" not found"
Jun 03 23:24:01.171932 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:01.171898    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-203.ec2.internal\" not found"
Jun 03 23:24:01.272510 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:01.272424    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-203.ec2.internal\" not found"
Jun 03 23:24:01.372972 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:01.372936    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-203.ec2.internal\" not found"
Jun 03 23:24:01.395116 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:01.395085    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 03 23:24:01.395293 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:01.395259    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 03 23:24:01.455525 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:01.455489    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda93bc6515e10faef9b23786f0c77b15e.slice/crio-ca817b5e37cf7e612025ee3a0fc1ce43a620f7f6d64f36978732deee7a80e420 WatchSource:0}: Error finding container ca817b5e37cf7e612025ee3a0fc1ce43a620f7f6d64f36978732deee7a80e420: Status 404 returned error can't find the container with id ca817b5e37cf7e612025ee3a0fc1ce43a620f7f6d64f36978732deee7a80e420
Jun 03 23:24:01.455745 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:01.455726    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7476c89bb59e907acdd0c6bfd86a930b.slice/crio-2495c918b17ac4b424ee242d097cce5ba8ee871988b132bb24b185ffd838f263 WatchSource:0}: Error finding container 2495c918b17ac4b424ee242d097cce5ba8ee871988b132bb24b185ffd838f263: Status 404 returned error can't find the container with id 2495c918b17ac4b424ee242d097cce5ba8ee871988b132bb24b185ffd838f263
Jun 03 23:24:01.461179 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:01.461163    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 23:24:01.473218 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:01.473196    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-203.ec2.internal\" not found"
Jun 03 23:24:01.486357 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:01.486317    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 23:19:00 +0000 UTC" deadline="2028-02-22 10:55:01.564283456 +0000 UTC"
Jun 03 23:24:01.486357 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:01.486350    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15083h31m0.077936461s"
Jun 03 23:24:01.526258 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:01.526147    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-203.ec2.internal" event={"ID":"a93bc6515e10faef9b23786f0c77b15e","Type":"ContainerStarted","Data":"ca817b5e37cf7e612025ee3a0fc1ce43a620f7f6d64f36978732deee7a80e420"}
Jun 03 23:24:01.527255 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:01.527234    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal" event={"ID":"7476c89bb59e907acdd0c6bfd86a930b","Type":"ContainerStarted","Data":"2495c918b17ac4b424ee242d097cce5ba8ee871988b132bb24b185ffd838f263"}
Jun 03 23:24:01.573773 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:01.573747    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-203.ec2.internal\" not found"
Jun 03 23:24:01.674411 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:01.674376    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-203.ec2.internal\" not found"
Jun 03 23:24:01.680617 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:01.680595    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 23:24:01.774781 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:01.774745    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-203.ec2.internal\" not found"
Jun 03 23:24:01.875384 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:01.875298    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-203.ec2.internal\" not found"
Jun 03 23:24:01.937902 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:01.937869    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 23:24:01.959688 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:01.959657    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-203.ec2.internal"
Jun 03 23:24:01.969925 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:01.969893    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 23:24:01.972178 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:01.972159    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal"
Jun 03 23:24:01.983390 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:01.983369    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 23:24:02.044373 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.044337    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 23:24:02.437784 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.437744    2561 apiserver.go:52] "Watching apiserver"
Jun 03 23:24:02.442602 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.442571    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 03 23:24:02.443017 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.442981    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal","openshift-network-operator/iptables-alerter-7z7qr","openshift-ovn-kubernetes/ovnkube-node-7rmhv","kube-system/global-pull-secret-syncer-smlbs","kube-system/konnectivity-agent-2twnm","kube-system/kube-apiserver-proxy-ip-10-0-129-203.ec2.internal","openshift-dns/node-resolver-95bsc","openshift-multus/multus-additional-cni-plugins-xxlch","openshift-multus/multus-hg6q2","openshift-multus/network-metrics-daemon-5t7nh","openshift-network-diagnostics/network-check-target-gxcnq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh","openshift-cluster-node-tuning-operator/tuned-flqk5","openshift-image-registry/node-ca-n89kn"]
Jun 03 23:24:02.444557 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.444536    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:02.444669 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:02.444624    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:02.445842 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.445810    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:02.445951 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:02.445910    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:02.447109 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.447088    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.448587 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.448492    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n89kn"
Jun 03 23:24:02.449559 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.449538    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 03 23:24:02.449796 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.449779    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 03 23:24:02.449873 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.449791    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-js8gq\""
Jun 03 23:24:02.449941 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.449910    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 03 23:24:02.450005 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.449948    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 03 23:24:02.450005 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.449998    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 03 23:24:02.450194 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.450175    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 03 23:24:02.450307 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.450213    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.450642 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.450512    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 03 23:24:02.450740 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.450654    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 03 23:24:02.450740 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.450657    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c7766\""
Jun 03 23:24:02.450740 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.450702    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 03 23:24:02.451389 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.451368    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.452136 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.452111    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 03 23:24:02.452247 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.452175    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 03 23:24:02.452401 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.452351    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 03 23:24:02.453690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.453049    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 03 23:24:02.453690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.453073    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xl7gn\""
Jun 03 23:24:02.453690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.453319    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 03 23:24:02.453690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.453374    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 03 23:24:02.453690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.453398    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 03 23:24:02.453690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.453456    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6xlz7\""
Jun 03 23:24:02.453690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.453538    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 03 23:24:02.453690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.453584    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.454773 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.454755    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.455461 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.455441    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 03 23:24:02.455577 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.455560    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kz25d\""
Jun 03 23:24:02.456222 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.456203    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7z7qr"
Jun 03 23:24:02.456886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.456868    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b22qj\""
Jun 03 23:24:02.456986 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.456899    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 03 23:24:02.457359 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.457055    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 03 23:24:02.457702 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.457684    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-95bsc"
Jun 03 23:24:02.458365 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.458233    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 03 23:24:02.458502 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.458483    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 03 23:24:02.458591 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.458572    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6zqk2\""
Jun 03 23:24:02.458932 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.458688    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 03 23:24:02.459034 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.458946    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 03 23:24:02.459283 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.459254    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2twnm"
Jun 03 23:24:02.464281 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.460676    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 03 23:24:02.464281 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.461309    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 03 23:24:02.464281 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.461340    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5rl5k\""
Jun 03 23:24:02.464281 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.462531    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 03 23:24:02.464281 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.462646    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7zqwp\""
Jun 03 23:24:02.464281 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.462845    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 03 23:24:02.464281 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.463134    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:02.464281 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:02.463218    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:02.469549 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.469523    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-var-lib-openvswitch\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.469667 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.469601    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-etc-openvswitch\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.469819 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.469630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrzwt\" (UniqueName: \"kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt\") pod \"network-check-target-gxcnq\" (UID: \"0085a5e3-8cf5-400a-8679-8d8aa1051e9b\") " pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:02.469882 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.469843    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-device-dir\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.469882 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.469869    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-system-cni-dir\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.469986 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.469904    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-lib-modules\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.470038 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.469975    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gncdl\" (UniqueName: \"kubernetes.io/projected/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-kube-api-access-gncdl\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.470110 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470039    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-run-ovn\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.470110 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470068    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-ovn-node-metrics-cert\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.470300 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470112    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-ovnkube-script-lib\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.470300 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470138    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smtrk\" (UniqueName: \"kubernetes.io/projected/cacad8e3-58d8-475d-bd87-75a469053995-kube-api-access-smtrk\") pod \"iptables-alerter-7z7qr\" (UID: \"cacad8e3-58d8-475d-bd87-75a469053995\") " pod="openshift-network-operator/iptables-alerter-7z7qr"
Jun 03 23:24:02.470300 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470178    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-cni-netd\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.470300 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgblv\" (UniqueName: \"kubernetes.io/projected/c0773ad3-6650-4e53-bb83-ef9be98635d0-kube-api-access-sgblv\") pod \"node-ca-n89kn\" (UID: \"c0773ad3-6650-4e53-bb83-ef9be98635d0\") " pod="openshift-image-registry/node-ca-n89kn"
Jun 03 23:24:02.470300 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470224    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cacad8e3-58d8-475d-bd87-75a469053995-iptables-alerter-script\") pod \"iptables-alerter-7z7qr\" (UID: \"cacad8e3-58d8-475d-bd87-75a469053995\") " pod="openshift-network-operator/iptables-alerter-7z7qr"
Jun 03 23:24:02.470544 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470263    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab54e225-32ec-4324-bdc2-b8c9e495ff3e-konnectivity-ca\") pod \"konnectivity-agent-2twnm\" (UID: \"ab54e225-32ec-4324-bdc2-b8c9e495ff3e\") " pod="kube-system/konnectivity-agent-2twnm"
Jun 03 23:24:02.470544 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470363    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-cnibin\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.470544 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470387    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.470544 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470433    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.470544 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470457    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-multus-cni-dir\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.470544 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470501    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cacad8e3-58d8-475d-bd87-75a469053995-host-slash\") pod \"iptables-alerter-7z7qr\" (UID: \"cacad8e3-58d8-475d-bd87-75a469053995\") " pod="openshift-network-operator/iptables-alerter-7z7qr"
Jun 03 23:24:02.470544 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470527    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-registration-dir\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.470793 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470551    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-cnibin\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.470793 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470591    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-run-k8s-cni-cncf-io\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.470793 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470614    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-var-lib-cni-multus\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.470793 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470646    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-multus-daemon-config\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.470793 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-run-multus-certs\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.470793 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470701    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-sysctl-d\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.470793 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470730    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab54e225-32ec-4324-bdc2-b8c9e495ff3e-agent-certs\") pod \"konnectivity-agent-2twnm\" (UID: \"ab54e225-32ec-4324-bdc2-b8c9e495ff3e\") " pod="kube-system/konnectivity-agent-2twnm"
Jun 03 23:24:02.470793 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470770    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f977\" (UniqueName: \"kubernetes.io/projected/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-kube-api-access-4f977\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.471165 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470793    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-sys-fs\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.471165 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470815    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-system-cni-dir\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.471165 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470851    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-multus-socket-dir-parent\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.471165 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.470911    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-sysctl-conf\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.471386 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471282    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-var-lib-kubelet\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.471386 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471313    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-cni-bin\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.471386 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471339    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.471386 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471365    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-env-overrides\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.471574 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471388    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0773ad3-6650-4e53-bb83-ef9be98635d0-serviceca\") pod \"node-ca-n89kn\" (UID: \"c0773ad3-6650-4e53-bb83-ef9be98635d0\") " pod="openshift-image-registry/node-ca-n89kn"
Jun 03 23:24:02.471574 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-socket-dir\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.471574 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471479    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-etc-kubernetes\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.471574 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471518    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-kubernetes\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.471574 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471561    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-os-release\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.471806 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-sysconfig\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.471806 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471610    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57p4q\" (UniqueName: \"kubernetes.io/projected/a776fd65-5386-4e56-a4da-c5d3bc7870cf-kube-api-access-57p4q\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.471806 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471633    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-os-release\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.471806 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471654    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-tmp\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.471806 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471677    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-run-systemd\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.471806 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfqql\" (UniqueName: \"kubernetes.io/projected/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-kube-api-access-tfqql\") pod \"network-metrics-daemon-5t7nh\" (UID: \"2be4b6b6-ca95-4f1f-afce-1ff311ee9989\") " pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:02.471806 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471723    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-cni-binary-copy\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.471806 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471760    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-multus-conf-dir\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.471806 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471779    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-kubelet\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.472279 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471834    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-log-socket\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.472279 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471852    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-etc-selinux\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.472279 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471866    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.472279 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471890    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7m6c\" (UniqueName: \"kubernetes.io/projected/d5772818-6f15-419b-b75d-7b8787218fcc-kube-api-access-h7m6c\") pod \"node-resolver-95bsc\" (UID: \"d5772818-6f15-419b-b75d-7b8787218fcc\") " pod="openshift-dns/node-resolver-95bsc"
Jun 03 23:24:02.472279 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471931    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-run-netns\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.472279 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.471978    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-run-openvswitch\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.472279 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472017    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-cni-binary-copy\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.472279 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472044    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-var-lib-kubelet\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.472279 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472071    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-hostroot\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.472279 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472096    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-modprobe-d\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.472279 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-ovnkube-config\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.472279 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.472279 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472253    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-run-netns\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472312    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-sys\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472341    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5772818-6f15-419b-b75d-7b8787218fcc-tmp-dir\") pod \"node-resolver-95bsc\" (UID: \"d5772818-6f15-419b-b75d-7b8787218fcc\") " pod="openshift-dns/node-resolver-95bsc"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472364    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-run-ovn-kubernetes\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472387    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkpwx\" (UniqueName: \"kubernetes.io/projected/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-kube-api-access-dkpwx\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-var-lib-cni-bin\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472433    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-host\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472472    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-node-log\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472518    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs\") pod \"network-metrics-daemon-5t7nh\" (UID: \"2be4b6b6-ca95-4f1f-afce-1ff311ee9989\") " pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472551    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-slash\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472572    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0773ad3-6650-4e53-bb83-ef9be98635d0-host\") pod \"node-ca-n89kn\" (UID: \"c0773ad3-6650-4e53-bb83-ef9be98635d0\") " pod="openshift-image-registry/node-ca-n89kn"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472610    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28w24\" (UniqueName: \"kubernetes.io/projected/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-kube-api-access-28w24\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472650    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5772818-6f15-419b-b75d-7b8787218fcc-hosts-file\") pod \"node-resolver-95bsc\" (UID: \"d5772818-6f15-419b-b75d-7b8787218fcc\") " pod="openshift-dns/node-resolver-95bsc"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472694    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-systemd\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472731    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-run\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472761    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-tuned\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472786    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-systemd-units\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.472907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.472862    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 23:24:02.498545 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.498519    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-js66q"
Jun 03 23:24:02.504706 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.504680    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-js66q"
Jun 03 23:24:02.560745 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.560707    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 03 23:24:02.573289 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfqql\" (UniqueName: \"kubernetes.io/projected/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-kube-api-access-tfqql\") pod \"network-metrics-daemon-5t7nh\" (UID: \"2be4b6b6-ca95-4f1f-afce-1ff311ee9989\") " pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:02.573289 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-cni-binary-copy\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.573512 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573307    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-multus-conf-dir\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.573512 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573338    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-kubelet\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.573512 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-log-socket\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.573512 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-etc-selinux\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.573512 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.573512 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573439    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-log-socket\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.573512 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573453    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7m6c\" (UniqueName: \"kubernetes.io/projected/d5772818-6f15-419b-b75d-7b8787218fcc-kube-api-access-h7m6c\") pod \"node-resolver-95bsc\" (UID: \"d5772818-6f15-419b-b75d-7b8787218fcc\") " pod="openshift-dns/node-resolver-95bsc"
Jun 03 23:24:02.573512 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573460    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-kubelet\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.573512 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573478    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-run-netns\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573527    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-etc-selinux\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-run-openvswitch\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573502    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-multus-conf-dir\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573569    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-cni-binary-copy\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573584    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-run-openvswitch\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573617    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-run-netns\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573631    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-var-lib-kubelet\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573659    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-hostroot\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573695    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-modprobe-d\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573697    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-hostroot\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573660    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-var-lib-kubelet\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573711    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-ovnkube-config\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573747    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573778    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-run-netns\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573802    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573809    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-sys\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573839    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5772818-6f15-419b-b75d-7b8787218fcc-tmp-dir\") pod \"node-resolver-95bsc\" (UID: \"d5772818-6f15-419b-b75d-7b8787218fcc\") " pod="openshift-dns/node-resolver-95bsc"
Jun 03 23:24:02.573934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573844    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-modprobe-d\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573851    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-sys\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573879    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-run-netns\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-run-ovn-kubernetes\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkpwx\" (UniqueName: \"kubernetes.io/projected/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-kube-api-access-dkpwx\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573965    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-var-lib-cni-bin\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.573987    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-host\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574007    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-run-ovn-kubernetes\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574033    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-cni-binary-copy\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574137    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-var-lib-cni-bin\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574012    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-node-log\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574158    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-node-log\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574182    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs\") pod \"network-metrics-daemon-5t7nh\" (UID: \"2be4b6b6-ca95-4f1f-afce-1ff311ee9989\") " pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574210    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-host\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-slash\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574251    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0773ad3-6650-4e53-bb83-ef9be98635d0-host\") pod \"node-ca-n89kn\" (UID: \"c0773ad3-6650-4e53-bb83-ef9be98635d0\") " pod="openshift-image-registry/node-ca-n89kn"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574332    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5772818-6f15-419b-b75d-7b8787218fcc-tmp-dir\") pod \"node-resolver-95bsc\" (UID: \"d5772818-6f15-419b-b75d-7b8787218fcc\") " pod="openshift-dns/node-resolver-95bsc"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574353    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-slash\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.574677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574344    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574392    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-cni-binary-copy\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574398    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28w24\" (UniqueName: \"kubernetes.io/projected/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-kube-api-access-28w24\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574404    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-ovnkube-config\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:02.574396    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574419    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0773ad3-6650-4e53-bb83-ef9be98635d0-host\") pod \"node-ca-n89kn\" (UID: \"c0773ad3-6650-4e53-bb83-ef9be98635d0\") " pod="openshift-image-registry/node-ca-n89kn"
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574424    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5772818-6f15-419b-b75d-7b8787218fcc-hosts-file\") pod \"node-resolver-95bsc\" (UID: \"d5772818-6f15-419b-b75d-7b8787218fcc\") " pod="openshift-dns/node-resolver-95bsc"
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:02.574488    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs podName:2be4b6b6-ca95-4f1f-afce-1ff311ee9989 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:03.074471677 +0000 UTC m=+2.973373908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs") pod "network-metrics-daemon-5t7nh" (UID: "2be4b6b6-ca95-4f1f-afce-1ff311ee9989") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-dbus\") pod \"global-pull-secret-syncer-smlbs\" (UID: \"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c\") " pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574567    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-systemd\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574573    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d5772818-6f15-419b-b75d-7b8787218fcc-hosts-file\") pod \"node-resolver-95bsc\" (UID: \"d5772818-6f15-419b-b75d-7b8787218fcc\") " pod="openshift-dns/node-resolver-95bsc"
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574593    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-run\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-tuned\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574651    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-run\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574674    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-systemd\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574703    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-systemd-units\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574720    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-var-lib-openvswitch\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574753    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-systemd-units\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.575428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574765    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-etc-openvswitch\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574784    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-var-lib-openvswitch\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574788    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrzwt\" (UniqueName: \"kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt\") pod \"network-check-target-gxcnq\" (UID: \"0085a5e3-8cf5-400a-8679-8d8aa1051e9b\") " pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574810    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-device-dir\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574833    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-system-cni-dir\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574856    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-etc-openvswitch\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574858    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-lib-modules\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574880    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-device-dir\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574895    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gncdl\" (UniqueName: \"kubernetes.io/projected/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-kube-api-access-gncdl\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-run-ovn\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574955    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574982    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-ovn-node-metrics-cert\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575007    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-lib-modules\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575035    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-run-ovn\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575071    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-ovnkube-script-lib\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575112    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smtrk\" (UniqueName: \"kubernetes.io/projected/cacad8e3-58d8-475d-bd87-75a469053995-kube-api-access-smtrk\") pod \"iptables-alerter-7z7qr\" (UID: \"cacad8e3-58d8-475d-bd87-75a469053995\") " pod="openshift-network-operator/iptables-alerter-7z7qr"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575139    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-cni-netd\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.576156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgblv\" (UniqueName: \"kubernetes.io/projected/c0773ad3-6650-4e53-bb83-ef9be98635d0-kube-api-access-sgblv\") pod \"node-ca-n89kn\" (UID: \"c0773ad3-6650-4e53-bb83-ef9be98635d0\") " pod="openshift-image-registry/node-ca-n89kn"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575220    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cacad8e3-58d8-475d-bd87-75a469053995-iptables-alerter-script\") pod \"iptables-alerter-7z7qr\" (UID: \"cacad8e3-58d8-475d-bd87-75a469053995\") " pod="openshift-network-operator/iptables-alerter-7z7qr"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575246    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab54e225-32ec-4324-bdc2-b8c9e495ff3e-konnectivity-ca\") pod \"konnectivity-agent-2twnm\" (UID: \"ab54e225-32ec-4324-bdc2-b8c9e495ff3e\") " pod="kube-system/konnectivity-agent-2twnm"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575288    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-cnibin\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575316    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575340    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575365    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-multus-cni-dir\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cacad8e3-58d8-475d-bd87-75a469053995-host-slash\") pod \"iptables-alerter-7z7qr\" (UID: \"cacad8e3-58d8-475d-bd87-75a469053995\") " pod="openshift-network-operator/iptables-alerter-7z7qr"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575417    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-registration-dir\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575439    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-cnibin\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575463    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-run-k8s-cni-cncf-io\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575488    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-var-lib-cni-multus\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-multus-daemon-config\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.574896    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-system-cni-dir\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-run-multus-certs\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-sysctl-d\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575586    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.576980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575590    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab54e225-32ec-4324-bdc2-b8c9e495ff3e-agent-certs\") pod \"konnectivity-agent-2twnm\" (UID: \"ab54e225-32ec-4324-bdc2-b8c9e495ff3e\") " pod="kube-system/konnectivity-agent-2twnm"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575657    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-multus-cni-dir\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575701    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cacad8e3-58d8-475d-bd87-75a469053995-host-slash\") pod \"iptables-alerter-7z7qr\" (UID: \"cacad8e3-58d8-475d-bd87-75a469053995\") " pod="openshift-network-operator/iptables-alerter-7z7qr"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575743    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-var-lib-cni-multus\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575832    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-registration-dir\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575891    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-cnibin\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.575935    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-run-k8s-cni-cncf-io\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576009    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-ovnkube-script-lib\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576045    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-sysctl-d\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576058    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f977\" (UniqueName: \"kubernetes.io/projected/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-kube-api-access-4f977\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-sys-fs\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576096    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-host-run-multus-certs\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-system-cni-dir\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576141    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-multus-socket-dir-parent\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576166    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-sysctl-conf\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576189    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-var-lib-kubelet\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576215    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-cni-bin\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.577855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576241    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576286    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-env-overrides\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576313    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0773ad3-6650-4e53-bb83-ef9be98635d0-serviceca\") pod \"node-ca-n89kn\" (UID: \"c0773ad3-6650-4e53-bb83-ef9be98635d0\") " pod="openshift-image-registry/node-ca-n89kn"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576336    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-socket-dir\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576342    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-cnibin\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576362    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-etc-kubernetes\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576385    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-kubernetes\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576394    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-var-lib-kubelet\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-os-release\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576453    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-multus-daemon-config\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576490    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-os-release\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576602    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-socket-dir\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576624    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a776fd65-5386-4e56-a4da-c5d3bc7870cf-sys-fs\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576650    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-etc-kubernetes\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576602    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-cni-netd\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576683    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-system-cni-dir\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576699    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-kubernetes\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576738    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-multus-socket-dir-parent\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.578619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576858    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-sysctl-conf\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576876    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0773ad3-6650-4e53-bb83-ef9be98635d0-serviceca\") pod \"node-ca-n89kn\" (UID: \"c0773ad3-6650-4e53-bb83-ef9be98635d0\") " pod="openshift-image-registry/node-ca-n89kn"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576889    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-kubelet-config\") pod \"global-pull-secret-syncer-smlbs\" (UID: \"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c\") " pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576925    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576926    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cacad8e3-58d8-475d-bd87-75a469053995-iptables-alerter-script\") pod \"iptables-alerter-7z7qr\" (UID: \"cacad8e3-58d8-475d-bd87-75a469053995\") " pod="openshift-network-operator/iptables-alerter-7z7qr"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.576950    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-host-cni-bin\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.577010    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret\") pod \"global-pull-secret-syncer-smlbs\" (UID: \"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c\") " pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.577039    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-sysconfig\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.577081    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57p4q\" (UniqueName: \"kubernetes.io/projected/a776fd65-5386-4e56-a4da-c5d3bc7870cf-kube-api-access-57p4q\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.577106    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-os-release\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.577160    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-sysconfig\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.577195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-tmp\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.577224    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-run-systemd\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.577212    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-os-release\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.577038    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.577261    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-env-overrides\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.577312    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-run-systemd\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.579507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.577518    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab54e225-32ec-4324-bdc2-b8c9e495ff3e-konnectivity-ca\") pod \"konnectivity-agent-2twnm\" (UID: \"ab54e225-32ec-4324-bdc2-b8c9e495ff3e\") " pod="kube-system/konnectivity-agent-2twnm"
Jun 03 23:24:02.580323 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.579327    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-etc-tuned\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.582981 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.582484    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-tmp\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.583134 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.583038    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab54e225-32ec-4324-bdc2-b8c9e495ff3e-agent-certs\") pod \"konnectivity-agent-2twnm\" (UID: \"ab54e225-32ec-4324-bdc2-b8c9e495ff3e\") " pod="kube-system/konnectivity-agent-2twnm"
Jun 03 23:24:02.584641 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:02.583588    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 23:24:02.584641 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:02.583614    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 23:24:02.584641 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:02.583646    2561 projected.go:196] Error preparing data for projected volume kube-api-access-rrzwt for pod openshift-network-diagnostics/network-check-target-gxcnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 23:24:02.584641 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:02.583723    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt podName:0085a5e3-8cf5-400a-8679-8d8aa1051e9b nodeName:}" failed. No retries permitted until 2026-06-03 23:24:03.083692885 +0000 UTC m=+2.982595115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rrzwt" (UniqueName: "kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt") pod "network-check-target-gxcnq" (UID: "0085a5e3-8cf5-400a-8679-8d8aa1051e9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 23:24:02.584641 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.584546    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-ovn-node-metrics-cert\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.587322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.586599    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkpwx\" (UniqueName: \"kubernetes.io/projected/4b2fc57a-fac3-4526-b2ba-8d7c00fb0231-kube-api-access-dkpwx\") pod \"ovnkube-node-7rmhv\" (UID: \"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231\") " pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.587322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.586787    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7m6c\" (UniqueName: \"kubernetes.io/projected/d5772818-6f15-419b-b75d-7b8787218fcc-kube-api-access-h7m6c\") pod \"node-resolver-95bsc\" (UID: \"d5772818-6f15-419b-b75d-7b8787218fcc\") " pod="openshift-dns/node-resolver-95bsc"
Jun 03 23:24:02.587322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.586954    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28w24\" (UniqueName: \"kubernetes.io/projected/bd6f3a91-46a4-4bd5-bbcf-581f27e27417-kube-api-access-28w24\") pod \"multus-hg6q2\" (UID: \"bd6f3a91-46a4-4bd5-bbcf-581f27e27417\") " pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.587322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.587043    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gncdl\" (UniqueName: \"kubernetes.io/projected/3c5b43b1-1dc2-4abf-8d36-5033e3edbb53-kube-api-access-gncdl\") pod \"tuned-flqk5\" (UID: \"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53\") " pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.587322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.587171    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfqql\" (UniqueName: \"kubernetes.io/projected/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-kube-api-access-tfqql\") pod \"network-metrics-daemon-5t7nh\" (UID: \"2be4b6b6-ca95-4f1f-afce-1ff311ee9989\") " pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:02.588975 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.588943    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f977\" (UniqueName: \"kubernetes.io/projected/d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d-kube-api-access-4f977\") pod \"multus-additional-cni-plugins-xxlch\" (UID: \"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d\") " pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.591229 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.591210    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smtrk\" (UniqueName: \"kubernetes.io/projected/cacad8e3-58d8-475d-bd87-75a469053995-kube-api-access-smtrk\") pod \"iptables-alerter-7z7qr\" (UID: \"cacad8e3-58d8-475d-bd87-75a469053995\") " pod="openshift-network-operator/iptables-alerter-7z7qr"
Jun 03 23:24:02.591581 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.591562    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57p4q\" (UniqueName: \"kubernetes.io/projected/a776fd65-5386-4e56-a4da-c5d3bc7870cf-kube-api-access-57p4q\") pod \"aws-ebs-csi-driver-node-tdqhh\" (UID: \"a776fd65-5386-4e56-a4da-c5d3bc7870cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.591624 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.591566    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgblv\" (UniqueName: \"kubernetes.io/projected/c0773ad3-6650-4e53-bb83-ef9be98635d0-kube-api-access-sgblv\") pod \"node-ca-n89kn\" (UID: \"c0773ad3-6650-4e53-bb83-ef9be98635d0\") " pod="openshift-image-registry/node-ca-n89kn"
Jun 03 23:24:02.677897 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.677853    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-kubelet-config\") pod \"global-pull-secret-syncer-smlbs\" (UID: \"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c\") " pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:02.677897 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.677903    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret\") pod \"global-pull-secret-syncer-smlbs\" (UID: \"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c\") " pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:02.678136 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.677958    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-dbus\") pod \"global-pull-secret-syncer-smlbs\" (UID: \"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c\") " pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:02.678136 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.678004    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-kubelet-config\") pod \"global-pull-secret-syncer-smlbs\" (UID: \"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c\") " pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:02.678136 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:02.678062    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 23:24:02.678136 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:02.678127    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret podName:7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c nodeName:}" failed. No retries permitted until 2026-06-03 23:24:03.178111191 +0000 UTC m=+3.077013426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret") pod "global-pull-secret-syncer-smlbs" (UID: "7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c") : object "kube-system"/"original-pull-secret" not registered
Jun 03 23:24:02.678335 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.678158    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-dbus\") pod \"global-pull-secret-syncer-smlbs\" (UID: \"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c\") " pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:02.763508 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.763457    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:02.769153 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.769120    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n89kn"
Jun 03 23:24:02.780122 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.780092    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xxlch"
Jun 03 23:24:02.785144 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.785119    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh"
Jun 03 23:24:02.794014 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.793990    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hg6q2"
Jun 03 23:24:02.801002 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.800969    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-flqk5"
Jun 03 23:24:02.809969 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.809939    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7z7qr"
Jun 03 23:24:02.819173 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.819135    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-95bsc"
Jun 03 23:24:02.825231 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.825201    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2twnm"
Jun 03 23:24:02.826111 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:02.826093    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 23:24:03.082661 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:03.082566    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs\") pod \"network-metrics-daemon-5t7nh\" (UID: \"2be4b6b6-ca95-4f1f-afce-1ff311ee9989\") " pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:03.082802 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:03.082715    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 23:24:03.082802 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:03.082781    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs podName:2be4b6b6-ca95-4f1f-afce-1ff311ee9989 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:04.082766865 +0000 UTC m=+3.981669097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs") pod "network-metrics-daemon-5t7nh" (UID: "2be4b6b6-ca95-4f1f-afce-1ff311ee9989") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 23:24:03.183529 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:03.183497    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrzwt\" (UniqueName: \"kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt\") pod \"network-check-target-gxcnq\" (UID: \"0085a5e3-8cf5-400a-8679-8d8aa1051e9b\") " pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:03.183692 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:03.183547    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret\") pod \"global-pull-secret-syncer-smlbs\" (UID: \"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c\") " pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:03.183692 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:03.183657    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 23:24:03.183805 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:03.183686    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 23:24:03.183805 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:03.183709    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 23:24:03.183805 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:03.183720    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret podName:7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c nodeName:}" failed. No retries permitted until 2026-06-03 23:24:04.183701016 +0000 UTC m=+4.082603250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret") pod "global-pull-secret-syncer-smlbs" (UID: "7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c") : object "kube-system"/"original-pull-secret" not registered
Jun 03 23:24:03.183805 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:03.183723    2561 projected.go:196] Error preparing data for projected volume kube-api-access-rrzwt for pod openshift-network-diagnostics/network-check-target-gxcnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 23:24:03.183805 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:03.183777    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt podName:0085a5e3-8cf5-400a-8679-8d8aa1051e9b nodeName:}" failed. No retries permitted until 2026-06-03 23:24:04.183759981 +0000 UTC m=+4.082662211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rrzwt" (UniqueName: "kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt") pod "network-check-target-gxcnq" (UID: "0085a5e3-8cf5-400a-8679-8d8aa1051e9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 23:24:03.264925 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:03.264690    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b2fc57a_fac3_4526_b2ba_8d7c00fb0231.slice/crio-c9e60936f4811bb8f7881673bfb1996011e21538aafe0daae46a5b34a6424a52 WatchSource:0}: Error finding container c9e60936f4811bb8f7881673bfb1996011e21538aafe0daae46a5b34a6424a52: Status 404 returned error can't find the container with id c9e60936f4811bb8f7881673bfb1996011e21538aafe0daae46a5b34a6424a52
Jun 03 23:24:03.273721 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:03.273605    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd6f3a91_46a4_4bd5_bbcf_581f27e27417.slice/crio-deef98901326c200f1a550d63ededdbcfac34e083f169240267150ee01e8e148 WatchSource:0}: Error finding container deef98901326c200f1a550d63ededdbcfac34e083f169240267150ee01e8e148: Status 404 returned error can't find the container with id deef98901326c200f1a550d63ededdbcfac34e083f169240267150ee01e8e148
Jun 03 23:24:03.277232 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:03.277203    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcacad8e3_58d8_475d_bd87_75a469053995.slice/crio-a7d1c5fd5d2d9b91245833daf093d5d24cf6d6a2e0870b12ce6abc537d96b2ca WatchSource:0}: Error finding container a7d1c5fd5d2d9b91245833daf093d5d24cf6d6a2e0870b12ce6abc537d96b2ca: Status 404 returned error can't find the container with id a7d1c5fd5d2d9b91245833daf093d5d24cf6d6a2e0870b12ce6abc537d96b2ca
Jun 03 23:24:03.278572 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:03.278490    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5772818_6f15_419b_b75d_7b8787218fcc.slice/crio-061a7289585bd9ae8efe57ffac7e859f475fa900d2c8cd7dc1f9e2d4c29e5a3e WatchSource:0}: Error finding container 061a7289585bd9ae8efe57ffac7e859f475fa900d2c8cd7dc1f9e2d4c29e5a3e: Status 404 returned error can't find the container with id 061a7289585bd9ae8efe57ffac7e859f475fa900d2c8cd7dc1f9e2d4c29e5a3e
Jun 03 23:24:03.279379 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:03.279352    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab54e225_32ec_4324_bdc2_b8c9e495ff3e.slice/crio-2653500cc36e3b28de3ad31f33ab138edc414e61c513173f10ba7d7784ce29b9 WatchSource:0}: Error finding container 2653500cc36e3b28de3ad31f33ab138edc414e61c513173f10ba7d7784ce29b9: Status 404 returned error can't find the container with id 2653500cc36e3b28de3ad31f33ab138edc414e61c513173f10ba7d7784ce29b9
Jun 03 23:24:03.280419 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:03.280351    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c5b43b1_1dc2_4abf_8d36_5033e3edbb53.slice/crio-2828a112ba222dd4832ebfa966b5fa271f36e084ab84c0b190dca9e8bde36b36 WatchSource:0}: Error finding container 2828a112ba222dd4832ebfa966b5fa271f36e084ab84c0b190dca9e8bde36b36: Status 404 returned error can't find the container with id 2828a112ba222dd4832ebfa966b5fa271f36e084ab84c0b190dca9e8bde36b36
Jun 03 23:24:03.282156 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:03.282088    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda776fd65_5386_4e56_a4da_c5d3bc7870cf.slice/crio-1c74cc509ced15d57b59f4c80a3332cd3ebc1ade66154be9cadb440dc9eba0f8 WatchSource:0}: Error finding container 1c74cc509ced15d57b59f4c80a3332cd3ebc1ade66154be9cadb440dc9eba0f8: Status 404 returned error can't find the container with id 1c74cc509ced15d57b59f4c80a3332cd3ebc1ade66154be9cadb440dc9eba0f8
Jun 03 23:24:03.284696 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:03.283839    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35da287_2ed2_4ca4_8da9_7e70ff5d6f7d.slice/crio-c4fb804d6524402edf500b96339014e242d74b0140df0f6a39c75ff699bb8c6e WatchSource:0}: Error finding container c4fb804d6524402edf500b96339014e242d74b0140df0f6a39c75ff699bb8c6e: Status 404 returned error can't find the container with id c4fb804d6524402edf500b96339014e242d74b0140df0f6a39c75ff699bb8c6e
Jun 03 23:24:03.507371 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:03.507325    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 23:19:02 +0000 UTC" deadline="2027-11-21 05:49:13.678304473 +0000 UTC"
Jun 03 23:24:03.507371 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:03.507366    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12846h25m10.170941771s"
Jun 03 23:24:03.531554 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:03.531466    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh" event={"ID":"a776fd65-5386-4e56-a4da-c5d3bc7870cf","Type":"ContainerStarted","Data":"1c74cc509ced15d57b59f4c80a3332cd3ebc1ade66154be9cadb440dc9eba0f8"}
Jun 03 23:24:03.533290 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:03.533249    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7z7qr" event={"ID":"cacad8e3-58d8-475d-bd87-75a469053995","Type":"ContainerStarted","Data":"a7d1c5fd5d2d9b91245833daf093d5d24cf6d6a2e0870b12ce6abc537d96b2ca"}
Jun 03 23:24:03.534416 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:03.534389    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hg6q2" event={"ID":"bd6f3a91-46a4-4bd5-bbcf-581f27e27417","Type":"ContainerStarted","Data":"deef98901326c200f1a550d63ededdbcfac34e083f169240267150ee01e8e148"}
Jun 03 23:24:03.539146 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:03.539117    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-203.ec2.internal" event={"ID":"a93bc6515e10faef9b23786f0c77b15e","Type":"ContainerStarted","Data":"3e5b0400dc36898f4d33f3b5f534258b8a91b2b44236429d08f9990520acedf0"}
Jun 03 23:24:03.540215 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:03.540179    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n89kn" event={"ID":"c0773ad3-6650-4e53-bb83-ef9be98635d0","Type":"ContainerStarted","Data":"d06f303190cf652a139d9ba4a970f2162bf052bb05cf743d193b032888c34d87"}
Jun 03 23:24:03.541120 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:03.541100    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-flqk5" event={"ID":"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53","Type":"ContainerStarted","Data":"2828a112ba222dd4832ebfa966b5fa271f36e084ab84c0b190dca9e8bde36b36"}
Jun 03 23:24:03.542011 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:03.541989    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2twnm" event={"ID":"ab54e225-32ec-4324-bdc2-b8c9e495ff3e","Type":"ContainerStarted","Data":"2653500cc36e3b28de3ad31f33ab138edc414e61c513173f10ba7d7784ce29b9"}
Jun 03 23:24:03.542952 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:03.542932    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-95bsc" event={"ID":"d5772818-6f15-419b-b75d-7b8787218fcc","Type":"ContainerStarted","Data":"061a7289585bd9ae8efe57ffac7e859f475fa900d2c8cd7dc1f9e2d4c29e5a3e"}
Jun 03 23:24:03.543926 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:03.543906    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv" event={"ID":"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231","Type":"ContainerStarted","Data":"c9e60936f4811bb8f7881673bfb1996011e21538aafe0daae46a5b34a6424a52"}
Jun 03 23:24:03.546110 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:03.546090    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxlch" event={"ID":"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d","Type":"ContainerStarted","Data":"c4fb804d6524402edf500b96339014e242d74b0140df0f6a39c75ff699bb8c6e"}
Jun 03 23:24:03.566952 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:03.566894    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-203.ec2.internal" podStartSLOduration=2.566878408 podStartE2EDuration="2.566878408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:03.553105345 +0000 UTC m=+3.452007598" watchObservedRunningTime="2026-06-03 23:24:03.566878408 +0000 UTC m=+3.465780661"
Jun 03 23:24:04.090852 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:04.090809    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs\") pod \"network-metrics-daemon-5t7nh\" (UID: \"2be4b6b6-ca95-4f1f-afce-1ff311ee9989\") " pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:04.091054 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:04.091030    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 23:24:04.091124 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:04.091113    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs podName:2be4b6b6-ca95-4f1f-afce-1ff311ee9989 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:06.091090506 +0000 UTC m=+5.989992740 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs") pod "network-metrics-daemon-5t7nh" (UID: "2be4b6b6-ca95-4f1f-afce-1ff311ee9989") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 23:24:04.192772 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:04.191873    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrzwt\" (UniqueName: \"kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt\") pod \"network-check-target-gxcnq\" (UID: \"0085a5e3-8cf5-400a-8679-8d8aa1051e9b\") " pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:04.192772 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:04.191963    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret\") pod \"global-pull-secret-syncer-smlbs\" (UID: \"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c\") " pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:04.192772 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:04.192130    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 23:24:04.192772 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:04.192193    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret podName:7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c nodeName:}" failed. No retries permitted until 2026-06-03 23:24:06.192174833 +0000 UTC m=+6.091077073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret") pod "global-pull-secret-syncer-smlbs" (UID: "7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c") : object "kube-system"/"original-pull-secret" not registered
Jun 03 23:24:04.192772 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:04.192652    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 23:24:04.192772 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:04.192672    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 23:24:04.192772 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:04.192685    2561 projected.go:196] Error preparing data for projected volume kube-api-access-rrzwt for pod openshift-network-diagnostics/network-check-target-gxcnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 23:24:04.192772 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:04.192730    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt podName:0085a5e3-8cf5-400a-8679-8d8aa1051e9b nodeName:}" failed. No retries permitted until 2026-06-03 23:24:06.19271465 +0000 UTC m=+6.091616887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rrzwt" (UniqueName: "kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt") pod "network-check-target-gxcnq" (UID: "0085a5e3-8cf5-400a-8679-8d8aa1051e9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 23:24:04.508199 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:04.508101    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 23:19:02 +0000 UTC" deadline="2027-11-06 21:35:35.831661554 +0000 UTC"
Jun 03 23:24:04.508199 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:04.508165    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12502h11m31.323500871s"
Jun 03 23:24:04.524686 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:04.524030    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:04.524686 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:04.524147    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:04.524686 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:04.524478    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:04.524686 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:04.524547    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:04.524686 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:04.524599    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:04.524686 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:04.524641    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:04.573009 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:04.571870    2561 generic.go:356] "Generic (PLEG): container finished" podID="7476c89bb59e907acdd0c6bfd86a930b" containerID="91e2ef819df5e710c1a4828553e94ccb350079480223132c29b84e4e34b7fd6c" exitCode=0
Jun 03 23:24:04.573009 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:04.572418    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal" event={"ID":"7476c89bb59e907acdd0c6bfd86a930b","Type":"ContainerDied","Data":"91e2ef819df5e710c1a4828553e94ccb350079480223132c29b84e4e34b7fd6c"}
Jun 03 23:24:05.593394 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:05.593355    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal" event={"ID":"7476c89bb59e907acdd0c6bfd86a930b","Type":"ContainerStarted","Data":"0d0b2955172a8364fb07f6068cceecd06b5be7012b4b787d9eff82fb67c37b9d"}
Jun 03 23:24:06.110120 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:06.109451    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs\") pod \"network-metrics-daemon-5t7nh\" (UID: \"2be4b6b6-ca95-4f1f-afce-1ff311ee9989\") " pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:06.110120 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:06.109668    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 23:24:06.110120 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:06.109738    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs podName:2be4b6b6-ca95-4f1f-afce-1ff311ee9989 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:10.109718874 +0000 UTC m=+10.008621122 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs") pod "network-metrics-daemon-5t7nh" (UID: "2be4b6b6-ca95-4f1f-afce-1ff311ee9989") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 23:24:06.210736 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:06.210391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrzwt\" (UniqueName: \"kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt\") pod \"network-check-target-gxcnq\" (UID: \"0085a5e3-8cf5-400a-8679-8d8aa1051e9b\") " pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:06.210736 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:06.210462    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret\") pod \"global-pull-secret-syncer-smlbs\" (UID: \"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c\") " pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:06.210736 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:06.210579    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 23:24:06.210736 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:06.210595    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 23:24:06.210736 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:06.210611    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 23:24:06.210736 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:06.210623    2561 projected.go:196] Error preparing data for projected volume kube-api-access-rrzwt for pod openshift-network-diagnostics/network-check-target-gxcnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 23:24:06.210736 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:06.210638    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret podName:7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c nodeName:}" failed. No retries permitted until 2026-06-03 23:24:10.210620653 +0000 UTC m=+10.109522898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret") pod "global-pull-secret-syncer-smlbs" (UID: "7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c") : object "kube-system"/"original-pull-secret" not registered
Jun 03 23:24:06.210736 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:06.210660    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt podName:0085a5e3-8cf5-400a-8679-8d8aa1051e9b nodeName:}" failed. No retries permitted until 2026-06-03 23:24:10.210649257 +0000 UTC m=+10.109551500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rrzwt" (UniqueName: "kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt") pod "network-check-target-gxcnq" (UID: "0085a5e3-8cf5-400a-8679-8d8aa1051e9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 23:24:06.523865 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:06.523363    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:06.523865 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:06.523492    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:06.523865 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:06.523542    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:06.523865 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:06.523661    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:06.523865 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:06.523715    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:06.523865 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:06.523786    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:08.522582 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:08.522533    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:08.523036 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:08.522532    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:08.523036 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:08.522691    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:08.523036 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:08.522800    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:08.523036 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:08.522862    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:08.523036 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:08.522932    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:10.145966 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:10.145688    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs\") pod \"network-metrics-daemon-5t7nh\" (UID: \"2be4b6b6-ca95-4f1f-afce-1ff311ee9989\") " pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:10.145966 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:10.145879    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 23:24:10.145966 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:10.145948    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs podName:2be4b6b6-ca95-4f1f-afce-1ff311ee9989 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:18.145928801 +0000 UTC m=+18.044831044 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs") pod "network-metrics-daemon-5t7nh" (UID: "2be4b6b6-ca95-4f1f-afce-1ff311ee9989") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 23:24:10.246959 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:10.246385    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrzwt\" (UniqueName: \"kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt\") pod \"network-check-target-gxcnq\" (UID: \"0085a5e3-8cf5-400a-8679-8d8aa1051e9b\") " pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:10.246959 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:10.246455    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret\") pod \"global-pull-secret-syncer-smlbs\" (UID: \"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c\") " pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:10.246959 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:10.246562    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 23:24:10.246959 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:10.246578    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 23:24:10.246959 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:10.246606    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 23:24:10.246959 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:10.246622    2561 projected.go:196] Error preparing data for projected volume kube-api-access-rrzwt for pod openshift-network-diagnostics/network-check-target-gxcnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 23:24:10.246959 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:10.246630    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret podName:7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c nodeName:}" failed. No retries permitted until 2026-06-03 23:24:18.246611691 +0000 UTC m=+18.145513942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret") pod "global-pull-secret-syncer-smlbs" (UID: "7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c") : object "kube-system"/"original-pull-secret" not registered
Jun 03 23:24:10.246959 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:10.246673    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt podName:0085a5e3-8cf5-400a-8679-8d8aa1051e9b nodeName:}" failed. No retries permitted until 2026-06-03 23:24:18.246657617 +0000 UTC m=+18.145559866 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rrzwt" (UniqueName: "kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt") pod "network-check-target-gxcnq" (UID: "0085a5e3-8cf5-400a-8679-8d8aa1051e9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 23:24:10.524200 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:10.524164    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:10.524402 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:10.524330    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:10.526565 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:10.524737    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:10.526565 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:10.524865    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:10.526565 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:10.524916    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:10.526565 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:10.524983    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:12.522674 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:12.522637    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:12.523093 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:12.522637    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:12.523093 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:12.522780    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:12.523093 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:12.522874    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:12.523093 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:12.522639    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:12.523093 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:12.522964    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:14.521985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:14.521948    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:14.522454 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:14.521950    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:14.522454 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:14.522014    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:14.522454 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:14.522110    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:14.522454 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:14.522199    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:14.522454 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:14.522322    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:16.521738 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:16.521706    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:16.522168 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:16.521748    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:16.522168 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:16.521702    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:16.522168 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:16.521841    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:16.522168 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:16.521927    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:16.522168 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:16.521985    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:18.211364 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:18.211331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs\") pod \"network-metrics-daemon-5t7nh\" (UID: \"2be4b6b6-ca95-4f1f-afce-1ff311ee9989\") " pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:18.211784 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:18.211457    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 23:24:18.211784 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:18.211509    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs podName:2be4b6b6-ca95-4f1f-afce-1ff311ee9989 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:34.211493874 +0000 UTC m=+34.110396106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs") pod "network-metrics-daemon-5t7nh" (UID: "2be4b6b6-ca95-4f1f-afce-1ff311ee9989") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 23:24:18.312620 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:18.312593    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrzwt\" (UniqueName: \"kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt\") pod \"network-check-target-gxcnq\" (UID: \"0085a5e3-8cf5-400a-8679-8d8aa1051e9b\") " pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:18.312801 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:18.312650    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret\") pod \"global-pull-secret-syncer-smlbs\" (UID: \"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c\") " pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:18.312801 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:18.312755    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 23:24:18.312801 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:18.312782    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 23:24:18.312938 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:18.312808    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 23:24:18.312938 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:18.312815    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret podName:7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c nodeName:}" failed. No retries permitted until 2026-06-03 23:24:34.312797473 +0000 UTC m=+34.211699706 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret") pod "global-pull-secret-syncer-smlbs" (UID: "7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c") : object "kube-system"/"original-pull-secret" not registered
Jun 03 23:24:18.312938 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:18.312820    2561 projected.go:196] Error preparing data for projected volume kube-api-access-rrzwt for pod openshift-network-diagnostics/network-check-target-gxcnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 23:24:18.312938 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:18.312868    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt podName:0085a5e3-8cf5-400a-8679-8d8aa1051e9b nodeName:}" failed. No retries permitted until 2026-06-03 23:24:34.312852088 +0000 UTC m=+34.211754335 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rrzwt" (UniqueName: "kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt") pod "network-check-target-gxcnq" (UID: "0085a5e3-8cf5-400a-8679-8d8aa1051e9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 23:24:18.525330 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:18.525241    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:18.525481 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:18.525366    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:18.525481 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:18.525377    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:18.525481 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:18.525470    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:18.525645 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:18.525532    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:18.525645 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:18.525621    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:20.522385 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:20.522340    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:20.522934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:20.522432    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:20.522934 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:20.522454    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:20.522934 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:20.522564    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:20.522934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:20.522605    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:20.522934 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:20.522695    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:22.522582 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.522548    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:22.523472 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.522549    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:22.523472 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:22.522672    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:22.523472 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:22.522775    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:22.523472 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.522564    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:22.523472 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:22.522902    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:22.634949 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.634918    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-flqk5" event={"ID":"3c5b43b1-1dc2-4abf-8d36-5033e3edbb53","Type":"ContainerStarted","Data":"3a06a05384c0106f69fe413e4e1d419b168cc81087420644529bd4120e32bcb3"}
Jun 03 23:24:22.636316 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.636288    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2twnm" event={"ID":"ab54e225-32ec-4324-bdc2-b8c9e495ff3e","Type":"ContainerStarted","Data":"c2fdd1fca05cc222d01e0c5fd43fa3a940e187f26d4641c0e5e26eb3fc37f0fd"}
Jun 03 23:24:22.637542 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.637519    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-95bsc" event={"ID":"d5772818-6f15-419b-b75d-7b8787218fcc","Type":"ContainerStarted","Data":"6cceade022b9b69caef5be1c3c367a712fb0dfb62991dd1a3702d0a6661f272e"}
Jun 03 23:24:22.640162 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.640145    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:24:22.640486 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.640466    2561 generic.go:356] "Generic (PLEG): container finished" podID="4b2fc57a-fac3-4526-b2ba-8d7c00fb0231" containerID="f7853cc7a26cb620d65c0b80a32d6c45e807920465b89360958b4a8cd420b4a3" exitCode=1
Jun 03 23:24:22.640600 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.640533    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv" event={"ID":"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231","Type":"ContainerStarted","Data":"eefecd8a8f896c72919874775be7d4601bea0513146eea5477c38d1117d0bb60"}
Jun 03 23:24:22.640600 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.640587    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv" event={"ID":"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231","Type":"ContainerStarted","Data":"626a537971d2ca8e2790b0fe20d39aee88ad0f771154e06cfee822d818b67bee"}
Jun 03 23:24:22.640692 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.640627    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv" event={"ID":"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231","Type":"ContainerStarted","Data":"1172d1743d985986d5102f368840dd05bc577484a0bacf2e6683bd168029bd3d"}
Jun 03 23:24:22.640692 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.640662    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv" event={"ID":"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231","Type":"ContainerStarted","Data":"2fd13da8cc1a624ba3abb0eebc8fc1fffb1f578d2b1831130d07791eced6db76"}
Jun 03 23:24:22.640765 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.640697    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv" event={"ID":"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231","Type":"ContainerDied","Data":"f7853cc7a26cb620d65c0b80a32d6c45e807920465b89360958b4a8cd420b4a3"}
Jun 03 23:24:22.640765 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.640730    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv" event={"ID":"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231","Type":"ContainerStarted","Data":"ad28fdd6217ef8efaa3585b92f39d31cdf641f1e5dc8eb52c0c08ed345591500"}
Jun 03 23:24:22.641982 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.641955    2561 generic.go:356] "Generic (PLEG): container finished" podID="d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d" containerID="01b947b1e03631f7f48814a51a6df7e79f29e4c4d6ed7e880ec2e37ea4fe8847" exitCode=0
Jun 03 23:24:22.642052 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.642015    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxlch" event={"ID":"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d","Type":"ContainerDied","Data":"01b947b1e03631f7f48814a51a6df7e79f29e4c4d6ed7e880ec2e37ea4fe8847"}
Jun 03 23:24:22.643417 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.643400    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh" event={"ID":"a776fd65-5386-4e56-a4da-c5d3bc7870cf","Type":"ContainerStarted","Data":"eac6c61c6549309db3b3d6a2da5130d599e64b249233479333ddfdf85a9459ef"}
Jun 03 23:24:22.644740 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.644722    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hg6q2" event={"ID":"bd6f3a91-46a4-4bd5-bbcf-581f27e27417","Type":"ContainerStarted","Data":"cc21d9203eab93af5d558caf29c55a2fdbf2307118ad49a66880b477f4a1c793"}
Jun 03 23:24:22.646031 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.646011    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n89kn" event={"ID":"c0773ad3-6650-4e53-bb83-ef9be98635d0","Type":"ContainerStarted","Data":"c033e469d2fe5e7ed70bd5abaf04e33b4ae95a75f34195b768ff3e65bc4cdd0c"}
Jun 03 23:24:22.652841 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.652807    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-flqk5" podStartSLOduration=4.425325269 podStartE2EDuration="22.652797463s" totalImagesPullingTime="18.227472194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:22.652189539 +0000 UTC m=+22.551091792" watchObservedRunningTime="2026-06-03 23:24:22.652797463 +0000 UTC m=+22.551699716"
Jun 03 23:24:22.652940 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.652921    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-203.ec2.internal" podStartSLOduration=21.652917512 podStartE2EDuration="21.652917512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:05.609808879 +0000 UTC m=+5.508711133" watchObservedRunningTime="2026-06-03 23:24:22.652917512 +0000 UTC m=+22.551819764"
Jun 03 23:24:22.668279 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.668236    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hg6q2" podStartSLOduration=4.40559578 podStartE2EDuration="22.668223577s" totalImagesPullingTime="18.262627797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:22.668035871 +0000 UTC m=+22.566938124" watchObservedRunningTime="2026-06-03 23:24:22.668223577 +0000 UTC m=+22.567125830"
Jun 03 23:24:22.708707 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.708673    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n89kn" podStartSLOduration=4.509125868 podStartE2EDuration="22.708662012s" totalImagesPullingTime="18.199536144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:22.708549297 +0000 UTC m=+22.607451571" watchObservedRunningTime="2026-06-03 23:24:22.708662012 +0000 UTC m=+22.607564265"
Jun 03 23:24:22.708960 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.708941    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-95bsc" podStartSLOduration=4.480381911 podStartE2EDuration="22.708935277s" totalImagesPullingTime="18.228553366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:22.693685352 +0000 UTC m=+22.592587642" watchObservedRunningTime="2026-06-03 23:24:22.708935277 +0000 UTC m=+22.607837530"
Jun 03 23:24:22.746711 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:22.746663    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2twnm" podStartSLOduration=3.54150282 podStartE2EDuration="21.746648902s" totalImagesPullingTime="18.205146082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:22.746372801 +0000 UTC m=+22.645275067" watchObservedRunningTime="2026-06-03 23:24:22.746648902 +0000 UTC m=+22.645551157"
Jun 03 23:24:23.069658 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:23.069606    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 03 23:24:23.527510 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:23.527189    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T23:24:23.069622967Z","UUID":"186bec5a-b8ac-40f2-9c65-b1e6c396d63f","Handler":null,"Name":"","Endpoint":""}
Jun 03 23:24:23.529042 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:23.529015    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 03 23:24:23.529181 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:23.529063    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 03 23:24:23.650209 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:23.650173    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7z7qr" event={"ID":"cacad8e3-58d8-475d-bd87-75a469053995","Type":"ContainerStarted","Data":"f4f73a95045d31941178b0cc35cb3a361217f37b9476e154a00f1bcb62f12d91"}
Jun 03 23:24:23.652343 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:23.652307    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh" event={"ID":"a776fd65-5386-4e56-a4da-c5d3bc7870cf","Type":"ContainerStarted","Data":"978d50598531f3143ef24fb966e5c52ea1a0dde28f44ae011671fcb18ba4fdd3"}
Jun 03 23:24:23.666784 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:23.666738    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7z7qr" podStartSLOduration=5.458879559 podStartE2EDuration="23.666723414s" totalImagesPullingTime="18.207843855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:23.666559369 +0000 UTC m=+23.565461644" watchObservedRunningTime="2026-06-03 23:24:23.666723414 +0000 UTC m=+23.565625669"
Jun 03 23:24:24.522580 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:24.522414    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:24.522580 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:24.522432    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:24.522580 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:24.522559    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:24.522999 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:24.522609    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:24.522999 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:24.522709    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:24.522999 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:24.522796    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:24.658078 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:24.658004    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:24:24.658704 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:24.658458    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv" event={"ID":"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231","Type":"ContainerStarted","Data":"836bd6e8d27ba1400fa011d127b1a9916d454aa399d76aa37f3937de6c382742"}
Jun 03 23:24:24.660888 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:24.660823    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh" event={"ID":"a776fd65-5386-4e56-a4da-c5d3bc7870cf","Type":"ContainerStarted","Data":"28d3bdfed7f2940de2411d5f96e4030fa38b1b9edac688fa32748ae8d1fc15cb"}
Jun 03 23:24:24.679078 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:24.679028    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdqhh" podStartSLOduration=4.357874372 podStartE2EDuration="24.679012389s" totalImagesPullingTime="20.321138017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:24.678894622 +0000 UTC m=+24.577796876" watchObservedRunningTime="2026-06-03 23:24:24.679012389 +0000 UTC m=+24.577914643"
Jun 03 23:24:25.421348 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:25.421310    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2twnm"
Jun 03 23:24:25.422048 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:25.422020    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2twnm"
Jun 03 23:24:25.663475 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:25.663444    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2twnm"
Jun 03 23:24:25.664155 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:25.663934    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2twnm"
Jun 03 23:24:26.521830 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:26.521790    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:26.521970 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:26.521835    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:26.521970 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:26.521906    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:26.521970 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:26.521790    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:26.522139 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:26.522053    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:26.522139 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:26.522109    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:27.670642 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:27.670449    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:24:27.671249 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:27.670940    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv" event={"ID":"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231","Type":"ContainerStarted","Data":"4d7fd1a33cbca07f622d03ed5ae9661269a085ae259b722d95056880f218c9d1"}
Jun 03 23:24:27.671249 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:27.671192    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:27.671380 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:27.671294    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:27.671418 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:27.671398    2561 scope.go:117] "RemoveContainer" containerID="f7853cc7a26cb620d65c0b80a32d6c45e807920465b89360958b4a8cd420b4a3"
Jun 03 23:24:27.672923 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:27.672890    2561 generic.go:356] "Generic (PLEG): container finished" podID="d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d" containerID="778b44c817035c8fc7cec8e2e750bc5cbc660d52743604a66339f53ee08b9da4" exitCode=0
Jun 03 23:24:27.673151 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:27.672970    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxlch" event={"ID":"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d","Type":"ContainerDied","Data":"778b44c817035c8fc7cec8e2e750bc5cbc660d52743604a66339f53ee08b9da4"}
Jun 03 23:24:27.687630 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:27.687606    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:28.522331 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:28.522295    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:28.522573 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:28.522348    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:28.522573 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:28.522310    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:28.522573 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:28.522435    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:28.522742 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:28.522564    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:28.522742 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:28.522708    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:28.661151 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:28.661127    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gxcnq"]
Jun 03 23:24:28.663768 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:28.663745    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-smlbs"]
Jun 03 23:24:28.667414 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:28.667388    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5t7nh"]
Jun 03 23:24:28.681843 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:28.681819    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:24:28.682458 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:28.682426    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:28.682582 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:28.682558    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:28.683450 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:28.682824    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:28.683450 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:28.682838    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:28.683450 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:28.682846    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv" event={"ID":"4b2fc57a-fac3-4526-b2ba-8d7c00fb0231","Type":"ContainerStarted","Data":"6bc29670247ef224efdf8e0f67758c55d7d53990a324d620a889ff5936441eea"}
Jun 03 23:24:28.683450 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:28.682935    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:28.683450 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:28.683250    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:28.683450 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:28.683374    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:28.703996 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:28.703956    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:24:28.711669 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:28.711620    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv" podStartSLOduration=10.288381002 podStartE2EDuration="28.711604336s" totalImagesPullingTime="18.423223334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:28.711238512 +0000 UTC m=+28.610140766" watchObservedRunningTime="2026-06-03 23:24:28.711604336 +0000 UTC m=+28.610506588"
Jun 03 23:24:29.686936 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:29.686892    2561 generic.go:356] "Generic (PLEG): container finished" podID="d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d" containerID="3409e314402c931888635a8d0b05e17867439a6de318e1dfaf13fef5e042eca5" exitCode=0
Jun 03 23:24:29.687460 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:29.686958    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxlch" event={"ID":"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d","Type":"ContainerDied","Data":"3409e314402c931888635a8d0b05e17867439a6de318e1dfaf13fef5e042eca5"}
Jun 03 23:24:30.522726 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:30.522694    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:30.522923 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:30.522913    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:30.522997 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:30.522947    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:30.523106 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:30.523011    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:30.523106 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:30.523025    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:30.523218 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:30.523170    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:31.694713 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:31.694627    2561 generic.go:356] "Generic (PLEG): container finished" podID="d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d" containerID="0c3a09e1560392163689aae4b327f093498cff9a6eca39fc9d53629c01f880b6" exitCode=0
Jun 03 23:24:31.694713 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:31.694694    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxlch" event={"ID":"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d","Type":"ContainerDied","Data":"0c3a09e1560392163689aae4b327f093498cff9a6eca39fc9d53629c01f880b6"}
Jun 03 23:24:32.521879 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:32.521806    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:32.521879 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:32.521829    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:32.522107 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:32.521953    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smlbs" podUID="7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c"
Jun 03 23:24:32.522107 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:32.522010    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:32.522205 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:32.522157    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:24:32.522390 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:32.522367    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxcnq" podUID="0085a5e3-8cf5-400a-8679-8d8aa1051e9b"
Jun 03 23:24:34.232588 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.232548    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs\") pod \"network-metrics-daemon-5t7nh\" (UID: \"2be4b6b6-ca95-4f1f-afce-1ff311ee9989\") " pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:34.233165 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:34.232728    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 23:24:34.233165 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:34.232810    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs podName:2be4b6b6-ca95-4f1f-afce-1ff311ee9989 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:06.232791202 +0000 UTC m=+66.131693438 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs") pod "network-metrics-daemon-5t7nh" (UID: "2be4b6b6-ca95-4f1f-afce-1ff311ee9989") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 23:24:34.333125 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.333027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrzwt\" (UniqueName: \"kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt\") pod \"network-check-target-gxcnq\" (UID: \"0085a5e3-8cf5-400a-8679-8d8aa1051e9b\") " pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:34.333125 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.333106    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret\") pod \"global-pull-secret-syncer-smlbs\" (UID: \"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c\") " pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:34.333392 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:34.333188    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 23:24:34.333392 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:34.333217    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 23:24:34.333392 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:34.333229    2561 projected.go:196] Error preparing data for projected volume kube-api-access-rrzwt for pod openshift-network-diagnostics/network-check-target-gxcnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 23:24:34.333392 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:34.333242    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 23:24:34.333392 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:34.333319    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt podName:0085a5e3-8cf5-400a-8679-8d8aa1051e9b nodeName:}" failed. No retries permitted until 2026-06-03 23:25:06.333299813 +0000 UTC m=+66.232202049 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rrzwt" (UniqueName: "kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt") pod "network-check-target-gxcnq" (UID: "0085a5e3-8cf5-400a-8679-8d8aa1051e9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 23:24:34.333392 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:34.333340    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret podName:7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c nodeName:}" failed. No retries permitted until 2026-06-03 23:25:06.333330889 +0000 UTC m=+66.232233134 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret") pod "global-pull-secret-syncer-smlbs" (UID: "7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c") : object "kube-system"/"original-pull-secret" not registered
Jun 03 23:24:34.398142 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.398107    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-203.ec2.internal" event="NodeReady"
Jun 03 23:24:34.398314 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.398259    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 03 23:24:34.438195 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.438140    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7957c84c47-rxbwx"]
Jun 03 23:24:34.443626 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.443595    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.445845 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.445818    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 03 23:24:34.445991 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.445827    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4x8v9\""
Jun 03 23:24:34.446081 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.446058    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 03 23:24:34.446432 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.446263    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 03 23:24:34.447336 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.447314    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mqj5m"]
Jun 03 23:24:34.451167 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.451148    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:34.452708 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.452326    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 03 23:24:34.454253 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.454232    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 03 23:24:34.454372 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.454285    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 03 23:24:34.454444 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.454378    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6h75n\""
Jun 03 23:24:34.458325 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.458303    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7957c84c47-rxbwx"]
Jun 03 23:24:34.458975 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.458952    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xrmc4"]
Jun 03 23:24:34.463769 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.463747    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xrmc4"
Jun 03 23:24:34.470081 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.467352    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 03 23:24:34.470081 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.467984    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 03 23:24:34.470081 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.468132    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 03 23:24:34.470081 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.468745    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p5tlk\""
Jun 03 23:24:34.470081 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.469390    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mqj5m"]
Jun 03 23:24:34.473603 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.473579    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xrmc4"]
Jun 03 23:24:34.522129 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.522101    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:24:34.522318 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.522101    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:24:34.522318 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.522227    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:24:34.524600 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.524412    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 03 23:24:34.524600 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.524476    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 23:24:34.524600 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.524537    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 23:24:34.524600 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.524560    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 23:24:34.524908 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.524784    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p9sbx\""
Jun 03 23:24:34.524908 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.524829    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8mqss\""
Jun 03 23:24:34.535700 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.535678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-certificates\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.535952 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.535721    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/415dd3b3-ef9d-49bd-af0b-751c5625e386-ca-trust-extracted\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.535952 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.535744    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/415dd3b3-ef9d-49bd-af0b-751c5625e386-trusted-ca\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.535952 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.535767    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/415dd3b3-ef9d-49bd-af0b-751c5625e386-installation-pull-secrets\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.535952 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.535816    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pnq2\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-kube-api-access-4pnq2\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.535952 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.535866    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.535952 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.535909    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-bound-sa-token\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.536293 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.536002    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/415dd3b3-ef9d-49bd-af0b-751c5625e386-image-registry-private-configuration\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.637294 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.637189    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfhlb\" (UniqueName: \"kubernetes.io/projected/7165ed2f-9fbf-4c4a-89b7-9e46e653cb82-kube-api-access-nfhlb\") pod \"ingress-canary-xrmc4\" (UID: \"7165ed2f-9fbf-4c4a-89b7-9e46e653cb82\") " pod="openshift-ingress-canary/ingress-canary-xrmc4"
Jun 03 23:24:34.637294 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.637236    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/415dd3b3-ef9d-49bd-af0b-751c5625e386-image-registry-private-configuration\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.637294 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.637261    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5khc2\" (UniqueName: \"kubernetes.io/projected/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-kube-api-access-5khc2\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:34.637581 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.637372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-certificates\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.637581 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.637440    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-tmp-dir\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:34.637581 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.637475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-config-volume\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:34.637581 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.637491    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7165ed2f-9fbf-4c4a-89b7-9e46e653cb82-cert\") pod \"ingress-canary-xrmc4\" (UID: \"7165ed2f-9fbf-4c4a-89b7-9e46e653cb82\") " pod="openshift-ingress-canary/ingress-canary-xrmc4"
Jun 03 23:24:34.637581 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.637509    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:34.637838 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.637629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/415dd3b3-ef9d-49bd-af0b-751c5625e386-ca-trust-extracted\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.637838 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.637750    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/415dd3b3-ef9d-49bd-af0b-751c5625e386-trusted-ca\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.637838 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.637776    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/415dd3b3-ef9d-49bd-af0b-751c5625e386-installation-pull-secrets\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.638080 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.638063    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-certificates\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.638493 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.638186    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pnq2\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-kube-api-access-4pnq2\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.638493 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.638232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.638493 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.638259    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-bound-sa-token\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.638493 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.638398    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/415dd3b3-ef9d-49bd-af0b-751c5625e386-ca-trust-extracted\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.638493 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:34.638424    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 23:24:34.638493 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:34.638441    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7957c84c47-rxbwx: secret "image-registry-tls" not found
Jun 03 23:24:34.638493 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:34.638494    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls podName:415dd3b3-ef9d-49bd-af0b-751c5625e386 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:35.13847728 +0000 UTC m=+35.037379533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls") pod "image-registry-7957c84c47-rxbwx" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386") : secret "image-registry-tls" not found
Jun 03 23:24:34.638848 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.638647    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/415dd3b3-ef9d-49bd-af0b-751c5625e386-trusted-ca\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.642099 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.642077    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/415dd3b3-ef9d-49bd-af0b-751c5625e386-installation-pull-secrets\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.642204 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.642184    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/415dd3b3-ef9d-49bd-af0b-751c5625e386-image-registry-private-configuration\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.646363 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.646336    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-bound-sa-token\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.646668 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.646643    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pnq2\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-kube-api-access-4pnq2\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:34.710377 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.710333    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:34.739312 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.739251    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-tmp-dir\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:34.739493 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.739331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-config-volume\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:34.739493 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.739357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7165ed2f-9fbf-4c4a-89b7-9e46e653cb82-cert\") pod \"ingress-canary-xrmc4\" (UID: \"7165ed2f-9fbf-4c4a-89b7-9e46e653cb82\") " pod="openshift-ingress-canary/ingress-canary-xrmc4"
Jun 03 23:24:34.739493 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.739380    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:34.739493 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.739479    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfhlb\" (UniqueName: \"kubernetes.io/projected/7165ed2f-9fbf-4c4a-89b7-9e46e653cb82-kube-api-access-nfhlb\") pod \"ingress-canary-xrmc4\" (UID: \"7165ed2f-9fbf-4c4a-89b7-9e46e653cb82\") " pod="openshift-ingress-canary/ingress-canary-xrmc4"
Jun 03 23:24:34.739703 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.739618    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-tmp-dir\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:34.739703 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:34.739646    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 23:24:34.739703 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.739670    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5khc2\" (UniqueName: \"kubernetes.io/projected/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-kube-api-access-5khc2\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:34.739839 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:34.739705    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls podName:5396ae25-295d-49a4-8b66-3fe3ecefdfe4 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:35.239686335 +0000 UTC m=+35.138588571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls") pod "dns-default-mqj5m" (UID: "5396ae25-295d-49a4-8b66-3fe3ecefdfe4") : secret "dns-default-metrics-tls" not found
Jun 03 23:24:34.739967 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.739944    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-config-volume\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:34.742126 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.742105    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7165ed2f-9fbf-4c4a-89b7-9e46e653cb82-cert\") pod \"ingress-canary-xrmc4\" (UID: \"7165ed2f-9fbf-4c4a-89b7-9e46e653cb82\") " pod="openshift-ingress-canary/ingress-canary-xrmc4"
Jun 03 23:24:34.749563 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.749544    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5khc2\" (UniqueName: \"kubernetes.io/projected/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-kube-api-access-5khc2\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:34.749723 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.749701    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfhlb\" (UniqueName: \"kubernetes.io/projected/7165ed2f-9fbf-4c4a-89b7-9e46e653cb82-kube-api-access-nfhlb\") pod \"ingress-canary-xrmc4\" (UID: \"7165ed2f-9fbf-4c4a-89b7-9e46e653cb82\") " pod="openshift-ingress-canary/ingress-canary-xrmc4"
Jun 03 23:24:34.775842 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.775810    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xrmc4"
Jun 03 23:24:34.805022 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.804765    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:34.914538 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:34.914449    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:35.143471 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:35.143430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:35.143670 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:35.143612    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 23:24:35.143670 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:35.143634    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7957c84c47-rxbwx: secret "image-registry-tls" not found
Jun 03 23:24:35.143786 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:35.143701    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls podName:415dd3b3-ef9d-49bd-af0b-751c5625e386 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:36.143680771 +0000 UTC m=+36.042583022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls") pod "image-registry-7957c84c47-rxbwx" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386") : secret "image-registry-tls" not found
Jun 03 23:24:35.244217 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:35.244180    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:35.244816 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:35.244319    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 23:24:35.244816 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:35.244408    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls podName:5396ae25-295d-49a4-8b66-3fe3ecefdfe4 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:36.244383988 +0000 UTC m=+36.143286219 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls") pod "dns-default-mqj5m" (UID: "5396ae25-295d-49a4-8b66-3fe3ecefdfe4") : secret "dns-default-metrics-tls" not found
Jun 03 23:24:35.498915 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:35.498825    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:35.552949 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:35.552898    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:35.641973 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:35.641942    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xrmc4"]
Jun 03 23:24:35.654316 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:24:35.654263    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7165ed2f_9fbf_4c4a_89b7_9e46e653cb82.slice/crio-724917f5560da9cc5a1e096fde5b4319c12113ce191c4414a8b674f2961377a0 WatchSource:0}: Error finding container 724917f5560da9cc5a1e096fde5b4319c12113ce191c4414a8b674f2961377a0: Status 404 returned error can't find the container with id 724917f5560da9cc5a1e096fde5b4319c12113ce191c4414a8b674f2961377a0
Jun 03 23:24:35.708100 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:35.708035    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxlch" event={"ID":"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d","Type":"ContainerStarted","Data":"2ad916b3269d9e3708e95ed9fa7695a922e2afd44a4a7af5bb07c5eed8f59fdf"}
Jun 03 23:24:35.709231 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:35.709199    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xrmc4" event={"ID":"7165ed2f-9fbf-4c4a-89b7-9e46e653cb82","Type":"ContainerStarted","Data":"724917f5560da9cc5a1e096fde5b4319c12113ce191c4414a8b674f2961377a0"}
Jun 03 23:24:35.896258 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:35.896218    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:35.949853 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:35.949791    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:36.150763 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:36.150686    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:36.150932 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:36.150862    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 23:24:36.150932 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:36.150884    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7957c84c47-rxbwx: secret "image-registry-tls" not found
Jun 03 23:24:36.151038 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:36.150970    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls podName:415dd3b3-ef9d-49bd-af0b-751c5625e386 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:38.150947657 +0000 UTC m=+38.049849914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls") pod "image-registry-7957c84c47-rxbwx" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386") : secret "image-registry-tls" not found
Jun 03 23:24:36.251842 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:36.251806    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:36.252414 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:36.251934    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 23:24:36.252414 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:36.251991    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls podName:5396ae25-295d-49a4-8b66-3fe3ecefdfe4 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:38.251972725 +0000 UTC m=+38.150874957 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls") pod "dns-default-mqj5m" (UID: "5396ae25-295d-49a4-8b66-3fe3ecefdfe4") : secret "dns-default-metrics-tls" not found
Jun 03 23:24:36.714322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:36.714262    2561 generic.go:356] "Generic (PLEG): container finished" podID="d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d" containerID="2ad916b3269d9e3708e95ed9fa7695a922e2afd44a4a7af5bb07c5eed8f59fdf" exitCode=0
Jun 03 23:24:36.714322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:36.714302    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxlch" event={"ID":"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d","Type":"ContainerDied","Data":"2ad916b3269d9e3708e95ed9fa7695a922e2afd44a4a7af5bb07c5eed8f59fdf"}
Jun 03 23:24:37.719599 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:37.719394    2561 generic.go:356] "Generic (PLEG): container finished" podID="d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d" containerID="b9df56d70b6936ec62a1451353ecf88aef051dc01dd0b4da4d2fbbcf9130693e" exitCode=0
Jun 03 23:24:37.720188 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:37.719467    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxlch" event={"ID":"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d","Type":"ContainerDied","Data":"b9df56d70b6936ec62a1451353ecf88aef051dc01dd0b4da4d2fbbcf9130693e"}
Jun 03 23:24:37.721202 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:37.721179    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xrmc4" event={"ID":"7165ed2f-9fbf-4c4a-89b7-9e46e653cb82","Type":"ContainerStarted","Data":"23bc7df11fbea15afe86834b0c80303c49ba179e9161c69a98254073a8c42a83"}
Jun 03 23:24:37.763204 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:37.763119    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xrmc4" podStartSLOduration=1.960316744 podStartE2EDuration="3.763094717s" totalImagesPullingTime="1.802777973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:37.762683173 +0000 UTC m=+37.661585450" watchObservedRunningTime="2026-06-03 23:24:37.763094717 +0000 UTC m=+37.661996970"
Jun 03 23:24:38.167552 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:38.167450    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:38.167714 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:38.167595    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 23:24:38.167714 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:38.167612    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7957c84c47-rxbwx: secret "image-registry-tls" not found
Jun 03 23:24:38.167714 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:38.167674    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls podName:415dd3b3-ef9d-49bd-af0b-751c5625e386 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:42.167656732 +0000 UTC m=+42.066558964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls") pod "image-registry-7957c84c47-rxbwx" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386") : secret "image-registry-tls" not found
Jun 03 23:24:38.268136 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:38.268097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:38.268294 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:38.268254    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 23:24:38.268369 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:38.268357    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls podName:5396ae25-295d-49a4-8b66-3fe3ecefdfe4 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:42.268340099 +0000 UTC m=+42.167242335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls") pod "dns-default-mqj5m" (UID: "5396ae25-295d-49a4-8b66-3fe3ecefdfe4") : secret "dns-default-metrics-tls" not found
Jun 03 23:24:38.475041 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:38.475006    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:38.547996 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:38.547962    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:38.649132 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:38.649099    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:38.726969 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:38.726882    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxlch" event={"ID":"d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d","Type":"ContainerStarted","Data":"a4365d0d74bdc0f2d48fea8a72aedfcc19dd6f6d98706aff0ca18809c8264714"}
Jun 03 23:24:38.750566 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:38.750529    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:38.754173 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:38.754125    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xxlch" podStartSLOduration=10.50059952 podStartE2EDuration="38.754108087s" totalImagesPullingTime="28.253508567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:38.753894729 +0000 UTC m=+38.652796983" watchObservedRunningTime="2026-06-03 23:24:38.754108087 +0000 UTC m=+38.653010342"
Jun 03 23:24:38.849241 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:38.849199    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:38.950040 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:38.950002    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:39.493286 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:39.493242    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:39.594617 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:39.594573    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:39.653648 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:39.653608    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:39.911155 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:39.911070    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:40.011905 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:40.011857    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:42.196064 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:42.196022    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:42.196458 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:42.196164    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 23:24:42.196458 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:42.196184    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7957c84c47-rxbwx: secret "image-registry-tls" not found
Jun 03 23:24:42.196458 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:42.196237    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls podName:415dd3b3-ef9d-49bd-af0b-751c5625e386 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:50.196221968 +0000 UTC m=+50.095124199 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls") pod "image-registry-7957c84c47-rxbwx" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386") : secret "image-registry-tls" not found
Jun 03 23:24:42.296828 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:42.296782    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:42.297031 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:42.296948    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 23:24:42.297031 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:42.297026    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls podName:5396ae25-295d-49a4-8b66-3fe3ecefdfe4 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:50.297005106 +0000 UTC m=+50.195907347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls") pod "dns-default-mqj5m" (UID: "5396ae25-295d-49a4-8b66-3fe3ecefdfe4") : secret "dns-default-metrics-tls" not found
Jun 03 23:24:50.250497 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:50.250461    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:24:50.250963 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:50.250631    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 23:24:50.250963 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:50.250651    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7957c84c47-rxbwx: secret "image-registry-tls" not found
Jun 03 23:24:50.250963 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:50.250739    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls podName:415dd3b3-ef9d-49bd-af0b-751c5625e386 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:06.250723331 +0000 UTC m=+66.149625566 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls") pod "image-registry-7957c84c47-rxbwx" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386") : secret "image-registry-tls" not found
Jun 03 23:24:50.351569 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:50.351513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:24:50.351766 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:50.351679    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 23:24:50.351835 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:24:50.351770    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls podName:5396ae25-295d-49a4-8b66-3fe3ecefdfe4 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:06.351749855 +0000 UTC m=+66.250652085 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls") pod "dns-default-mqj5m" (UID: "5396ae25-295d-49a4-8b66-3fe3ecefdfe4") : secret "dns-default-metrics-tls" not found
Jun 03 23:24:55.460747 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:55.460703    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:55.522587 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:55.522549    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:56.483053 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:56.483017    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:56.541090 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:56.541060    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:57.456382 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:57.456339    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:59.594863 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:59.594821    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:24:59.652451 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:24:59.652414    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:00.655433 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:00.655389    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:00.704905 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:00.704876    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7rmhv"
Jun 03 23:25:00.738206 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:00.738175    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:00.864312 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:00.864259    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:00.967677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:00.967638    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:01.068377 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:01.068342    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:06.273983 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.273929    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:25:06.273983 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.273979    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs\") pod \"network-metrics-daemon-5t7nh\" (UID: \"2be4b6b6-ca95-4f1f-afce-1ff311ee9989\") " pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:25:06.274496 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:25:06.274088    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 23:25:06.274496 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:25:06.274107    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7957c84c47-rxbwx: secret "image-registry-tls" not found
Jun 03 23:25:06.274496 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:25:06.274162    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls podName:415dd3b3-ef9d-49bd-af0b-751c5625e386 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:38.274145394 +0000 UTC m=+98.173047624 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls") pod "image-registry-7957c84c47-rxbwx" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386") : secret "image-registry-tls" not found
Jun 03 23:25:06.276177 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.276160    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 23:25:06.284860 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:25:06.284836    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 23:25:06.284971 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:25:06.284899    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs podName:2be4b6b6-ca95-4f1f-afce-1ff311ee9989 nodeName:}" failed. No retries permitted until 2026-06-03 23:26:10.284881559 +0000 UTC m=+130.183783790 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs") pod "network-metrics-daemon-5t7nh" (UID: "2be4b6b6-ca95-4f1f-afce-1ff311ee9989") : secret "metrics-daemon-secret" not found
Jun 03 23:25:06.374918 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.374876    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret\") pod \"global-pull-secret-syncer-smlbs\" (UID: \"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c\") " pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:25:06.374918 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.374919    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:25:06.375181 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.374977    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrzwt\" (UniqueName: \"kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt\") pod \"network-check-target-gxcnq\" (UID: \"0085a5e3-8cf5-400a-8679-8d8aa1051e9b\") " pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:25:06.375181 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:25:06.375087    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 23:25:06.375181 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:25:06.375162    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls podName:5396ae25-295d-49a4-8b66-3fe3ecefdfe4 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:38.375145321 +0000 UTC m=+98.274047555 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls") pod "dns-default-mqj5m" (UID: "5396ae25-295d-49a4-8b66-3fe3ecefdfe4") : secret "dns-default-metrics-tls" not found
Jun 03 23:25:06.377261 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.377241    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 03 23:25:06.377314 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.377294    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 23:25:06.387739 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.387713    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 23:25:06.389810 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.389788    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c-original-pull-secret\") pod \"global-pull-secret-syncer-smlbs\" (UID: \"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c\") " pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:25:06.398916 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.398883    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrzwt\" (UniqueName: \"kubernetes.io/projected/0085a5e3-8cf5-400a-8679-8d8aa1051e9b-kube-api-access-rrzwt\") pod \"network-check-target-gxcnq\" (UID: \"0085a5e3-8cf5-400a-8679-8d8aa1051e9b\") " pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:25:06.635615 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.635532    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p9sbx\""
Jun 03 23:25:06.641281 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.641247    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smlbs"
Jun 03 23:25:06.643415 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.643392    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:25:06.775434 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.775404    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-smlbs"]
Jun 03 23:25:06.778843 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:25:06.778814    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab889b5_7e4f_4f60_9caf_50b04a6bdc3c.slice/crio-1bdf5bcddc42f4ce774dc65e5b25d3faecfff3ac455be681a4d9a47de4d3cb5a WatchSource:0}: Error finding container 1bdf5bcddc42f4ce774dc65e5b25d3faecfff3ac455be681a4d9a47de4d3cb5a: Status 404 returned error can't find the container with id 1bdf5bcddc42f4ce774dc65e5b25d3faecfff3ac455be681a4d9a47de4d3cb5a
Jun 03 23:25:06.790500 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.790475    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gxcnq"]
Jun 03 23:25:06.792489 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:06.792459    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-smlbs" event={"ID":"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c","Type":"ContainerStarted","Data":"1bdf5bcddc42f4ce774dc65e5b25d3faecfff3ac455be681a4d9a47de4d3cb5a"}
Jun 03 23:25:06.793579 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:25:06.793549    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0085a5e3_8cf5_400a_8679_8d8aa1051e9b.slice/crio-0050b3bc056d4afb69cf84397706bb64147c2f00376d185ec45c4c668934b7c1 WatchSource:0}: Error finding container 0050b3bc056d4afb69cf84397706bb64147c2f00376d185ec45c4c668934b7c1: Status 404 returned error can't find the container with id 0050b3bc056d4afb69cf84397706bb64147c2f00376d185ec45c4c668934b7c1
Jun 03 23:25:07.225415 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:07.225374    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:07.325583 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:07.325546    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:07.796739 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:07.796700    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gxcnq" event={"ID":"0085a5e3-8cf5-400a-8679-8d8aa1051e9b","Type":"ContainerStarted","Data":"0050b3bc056d4afb69cf84397706bb64147c2f00376d185ec45c4c668934b7c1"}
Jun 03 23:25:11.564478 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:11.564382    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:11.624976 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:11.624940    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:11.807913 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:11.807874    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-smlbs" event={"ID":"7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c","Type":"ContainerStarted","Data":"005fb595c56955067901d83fcebf1b77dba4813f1aee89228c1c1dcbc752210e"}
Jun 03 23:25:11.809387 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:11.809358    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gxcnq" event={"ID":"0085a5e3-8cf5-400a-8679-8d8aa1051e9b","Type":"ContainerStarted","Data":"fc8dc5206ad3eec256522b36ceebfffac4089d736782a9ad92759c310167a927"}
Jun 03 23:25:11.809527 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:11.809423    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:25:11.823379 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:11.823246    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-smlbs" podStartSLOduration=66.307232291 podStartE2EDuration="1m10.823230916s" totalImagesPullingTime="4.515998625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:11.822655772 +0000 UTC m=+71.721558040" watchObservedRunningTime="2026-06-03 23:25:11.823230916 +0000 UTC m=+71.722133169"
Jun 03 23:25:11.841049 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:11.840985    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gxcnq" podStartSLOduration=67.342881595 podStartE2EDuration="1m11.840965119s" totalImagesPullingTime="4.498083524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:11.84007698 +0000 UTC m=+71.738979234" watchObservedRunningTime="2026-06-03 23:25:11.840965119 +0000 UTC m=+71.739867373"
Jun 03 23:25:11.842529 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:11.842492    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:11.943048 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:11.943007    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:12.571193 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:12.571133    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:12.671250 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:12.671218    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:15.677263 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:15.677226    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:15.777246 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:15.777216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:16.732138 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:16.732102    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:16.785693 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:16.785662    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:32.545156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:32.545122    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:32.645219 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:32.645182    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:37.630759 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:37.630724    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:37.731685 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:37.731650    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:37.841424 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:37.841379    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:25:38.308329 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:38.308292    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:25:38.308481 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:25:38.308462    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 23:25:38.308542 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:25:38.308488    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7957c84c47-rxbwx: secret "image-registry-tls" not found
Jun 03 23:25:38.308593 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:25:38.308580    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls podName:415dd3b3-ef9d-49bd-af0b-751c5625e386 nodeName:}" failed. No retries permitted until 2026-06-03 23:26:42.308556132 +0000 UTC m=+162.207458383 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls") pod "image-registry-7957c84c47-rxbwx" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386") : secret "image-registry-tls" not found
Jun 03 23:25:38.408647 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:38.408607    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:25:38.408810 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:25:38.408764    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 23:25:38.408854 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:25:38.408840    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls podName:5396ae25-295d-49a4-8b66-3fe3ecefdfe4 nodeName:}" failed. No retries permitted until 2026-06-03 23:26:42.408824854 +0000 UTC m=+162.307727089 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls") pod "dns-default-mqj5m" (UID: "5396ae25-295d-49a4-8b66-3fe3ecefdfe4") : secret "dns-default-metrics-tls" not found
Jun 03 23:25:42.814055 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:25:42.814026    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gxcnq"
Jun 03 23:26:10.330733 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:26:10.330689    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs\") pod \"network-metrics-daemon-5t7nh\" (UID: \"2be4b6b6-ca95-4f1f-afce-1ff311ee9989\") " pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:26:10.331218 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:26:10.330830    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 23:26:10.331218 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:26:10.330895    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs podName:2be4b6b6-ca95-4f1f-afce-1ff311ee9989 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:12.330878273 +0000 UTC m=+252.229780504 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs") pod "network-metrics-daemon-5t7nh" (UID: "2be4b6b6-ca95-4f1f-afce-1ff311ee9989") : secret "metrics-daemon-secret" not found
Jun 03 23:26:37.457034 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:26:37.456993    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx" podUID="415dd3b3-ef9d-49bd-af0b-751c5625e386"
Jun 03 23:26:37.464133 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:26:37.464110    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mqj5m" podUID="5396ae25-295d-49a4-8b66-3fe3ecefdfe4"
Jun 03 23:26:37.546342 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:26:37.546305    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:26:38.010546 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:26:38.010522    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:26:38.010697 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:26:38.010522    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:26:42.348390 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:26:42.348347    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:26:42.348785 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:26:42.348502    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 23:26:42.348785 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:26:42.348521    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7957c84c47-rxbwx: secret "image-registry-tls" not found
Jun 03 23:26:42.348785 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:26:42.348585    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls podName:415dd3b3-ef9d-49bd-af0b-751c5625e386 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:44.348570011 +0000 UTC m=+284.247472241 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls") pod "image-registry-7957c84c47-rxbwx" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386") : secret "image-registry-tls" not found
Jun 03 23:26:42.449224 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:26:42.449193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:26:42.449377 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:26:42.449308    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 23:26:42.449377 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:26:42.449355    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls podName:5396ae25-295d-49a4-8b66-3fe3ecefdfe4 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:44.449341558 +0000 UTC m=+284.348243789 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls") pod "dns-default-mqj5m" (UID: "5396ae25-295d-49a4-8b66-3fe3ecefdfe4") : secret "dns-default-metrics-tls" not found
Jun 03 23:26:50.523282 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:26:50.523189    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:27:31.419198 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:27:31.419160    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:12.353579 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:12.353547    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs\") pod \"network-metrics-daemon-5t7nh\" (UID: \"2be4b6b6-ca95-4f1f-afce-1ff311ee9989\") " pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:28:12.354012 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:12.353651    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 23:28:12.354012 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:12.353700    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs podName:2be4b6b6-ca95-4f1f-afce-1ff311ee9989 nodeName:}" failed. No retries permitted until 2026-06-03 23:30:14.353686255 +0000 UTC m=+374.252588488 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs") pod "network-metrics-daemon-5t7nh" (UID: "2be4b6b6-ca95-4f1f-afce-1ff311ee9989") : secret "metrics-daemon-secret" not found
Jun 03 23:28:14.808216 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.808181    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-xv274"]
Jun 03 23:28:14.809950 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.809935    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274"
Jun 03 23:28:14.812180 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.812152    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jun 03 23:28:14.812335 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.812180    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-brbkb\""
Jun 03 23:28:14.812335 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.812205    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jun 03 23:28:14.812463 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.812448    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94"]
Jun 03 23:28:14.814580 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.814562    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf"]
Jun 03 23:28:14.814694 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.814680    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94"
Jun 03 23:28:14.816300 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.816263    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf"
Jun 03 23:28:14.833111 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.833094    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jun 03 23:28:14.833256 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.833239    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-xv274"]
Jun 03 23:28:14.833873 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.833850    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jun 03 23:28:14.834670 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.834651    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m8qxs\""
Jun 03 23:28:14.834768 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.834680    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jun 03 23:28:14.834768 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.834737    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jun 03 23:28:14.834768 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.834754    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jun 03 23:28:14.834908 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.834738    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jun 03 23:28:14.835716 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.835697    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qrrwn\""
Jun 03 23:28:14.836320 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.836303    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94"]
Jun 03 23:28:14.836548 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.836535    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jun 03 23:28:14.843795 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.843773    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf"]
Jun 03 23:28:14.871543 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.871519    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7de16cf1-50d0-45d3-9910-e6576f3574d8-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf\" (UID: \"7de16cf1-50d0-45d3-9910-e6576f3574d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf"
Jun 03 23:28:14.871648 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.871558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7de16cf1-50d0-45d3-9910-e6576f3574d8-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf\" (UID: \"7de16cf1-50d0-45d3-9910-e6576f3574d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf"
Jun 03 23:28:14.871648 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.871575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-wfk94\" (UID: \"ae2db4ce-1fb5-4132-94a6-2739f1fe059e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94"
Jun 03 23:28:14.871648 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.871595    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xv274\" (UID: \"3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274"
Jun 03 23:28:14.871746 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.871665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zfsp\" (UniqueName: \"kubernetes.io/projected/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-kube-api-access-7zfsp\") pod \"cluster-samples-operator-9f6f677f5-wfk94\" (UID: \"ae2db4ce-1fb5-4132-94a6-2739f1fe059e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94"
Jun 03 23:28:14.871746 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.871707    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b546s\" (UniqueName: \"kubernetes.io/projected/7de16cf1-50d0-45d3-9910-e6576f3574d8-kube-api-access-b546s\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf\" (UID: \"7de16cf1-50d0-45d3-9910-e6576f3574d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf"
Jun 03 23:28:14.871746 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.871730    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-nginx-conf\") pod \"networking-console-plugin-68d6b54856-xv274\" (UID: \"3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274"
Jun 03 23:28:14.917724 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.917690    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn"]
Jun 03 23:28:14.919627 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.919607    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn"
Jun 03 23:28:14.920710 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.920680    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-cv54b"]
Jun 03 23:28:14.922286 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.922245    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jun 03 23:28:14.922591 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.922572    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v7k9f\""
Jun 03 23:28:14.922707 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.922683    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jun 03 23:28:14.922899 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.922870    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jun 03 23:28:14.923154 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.923134    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jun 03 23:28:14.923309 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.923291    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-cv54b"
Jun 03 23:28:14.928207 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.928187    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-v9b5x\""
Jun 03 23:28:14.929960 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.929943    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn"]
Jun 03 23:28:14.931886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.931864    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-cv54b"]
Jun 03 23:28:14.960558 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.960521    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:14.972693 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.972668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7de16cf1-50d0-45d3-9910-e6576f3574d8-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf\" (UID: \"7de16cf1-50d0-45d3-9910-e6576f3574d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf"
Jun 03 23:28:14.972835 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.972703    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa-config\") pod \"service-ca-operator-5bc4cf794b-frrsn\" (UID: \"1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn"
Jun 03 23:28:14.972835 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.972736    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7de16cf1-50d0-45d3-9910-e6576f3574d8-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf\" (UID: \"7de16cf1-50d0-45d3-9910-e6576f3574d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf"
Jun 03 23:28:14.972835 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.972752    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-wfk94\" (UID: \"ae2db4ce-1fb5-4132-94a6-2739f1fe059e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94"
Jun 03 23:28:14.972835 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.972773    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84s78\" (UniqueName: \"kubernetes.io/projected/b46ca08f-f7f5-4865-b179-a990d387638e-kube-api-access-84s78\") pod \"network-check-source-dbd9cf844-cv54b\" (UID: \"b46ca08f-f7f5-4865-b179-a990d387638e\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-cv54b"
Jun 03 23:28:14.972835 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.972801    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xv274\" (UID: \"3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274"
Jun 03 23:28:14.972835 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.972821    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zfsp\" (UniqueName: \"kubernetes.io/projected/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-kube-api-access-7zfsp\") pod \"cluster-samples-operator-9f6f677f5-wfk94\" (UID: \"ae2db4ce-1fb5-4132-94a6-2739f1fe059e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94"
Jun 03 23:28:14.972835 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.972836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa-serving-cert\") pod \"service-ca-operator-5bc4cf794b-frrsn\" (UID: \"1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn"
Jun 03 23:28:14.973178 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:14.972835    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 23:28:14.973178 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.972880    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5g69\" (UniqueName: \"kubernetes.io/projected/1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa-kube-api-access-x5g69\") pod \"service-ca-operator-5bc4cf794b-frrsn\" (UID: \"1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn"
Jun 03 23:28:14.973178 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:14.972902    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls podName:ae2db4ce-1fb5-4132-94a6-2739f1fe059e nodeName:}" failed. No retries permitted until 2026-06-03 23:28:15.472890089 +0000 UTC m=+255.371792320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-wfk94" (UID: "ae2db4ce-1fb5-4132-94a6-2739f1fe059e") : secret "samples-operator-tls" not found
Jun 03 23:28:14.973178 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.972943    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b546s\" (UniqueName: \"kubernetes.io/projected/7de16cf1-50d0-45d3-9910-e6576f3574d8-kube-api-access-b546s\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf\" (UID: \"7de16cf1-50d0-45d3-9910-e6576f3574d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf"
Jun 03 23:28:14.973178 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.972977    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-nginx-conf\") pod \"networking-console-plugin-68d6b54856-xv274\" (UID: \"3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274"
Jun 03 23:28:14.973178 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:14.972976    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 23:28:14.973178 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:14.973042    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert podName:3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:15.473034975 +0000 UTC m=+255.371937206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-xv274" (UID: "3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1") : secret "networking-console-plugin-cert" not found
Jun 03 23:28:14.973526 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.973392    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7de16cf1-50d0-45d3-9910-e6576f3574d8-config\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf\" (UID: \"7de16cf1-50d0-45d3-9910-e6576f3574d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf"
Jun 03 23:28:14.973583 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.973565    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-nginx-conf\") pod \"networking-console-plugin-68d6b54856-xv274\" (UID: \"3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274"
Jun 03 23:28:14.975058 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.975037    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7de16cf1-50d0-45d3-9910-e6576f3574d8-serving-cert\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf\" (UID: \"7de16cf1-50d0-45d3-9910-e6576f3574d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf"
Jun 03 23:28:14.980931 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.980905    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b546s\" (UniqueName: \"kubernetes.io/projected/7de16cf1-50d0-45d3-9910-e6576f3574d8-kube-api-access-b546s\") pod \"kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf\" (UID: \"7de16cf1-50d0-45d3-9910-e6576f3574d8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf"
Jun 03 23:28:14.981069 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:14.981051    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zfsp\" (UniqueName: \"kubernetes.io/projected/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-kube-api-access-7zfsp\") pod \"cluster-samples-operator-9f6f677f5-wfk94\" (UID: \"ae2db4ce-1fb5-4132-94a6-2739f1fe059e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94"
Jun 03 23:28:15.006709 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.006674    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-69684796bc-vrf65"]
Jun 03 23:28:15.009212 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.009193    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.011530 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.011510    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jun 03 23:28:15.011633 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.011532    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 03 23:28:15.011633 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.011532    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 03 23:28:15.011789 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.011771    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jun 03 23:28:15.011835 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.011807    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dp5kg\""
Jun 03 23:28:15.017738 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.017718    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jun 03 23:28:15.020159 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.020102    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-vrf65"]
Jun 03 23:28:15.073383 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.073261    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa-config\") pod \"service-ca-operator-5bc4cf794b-frrsn\" (UID: \"1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn"
Jun 03 23:28:15.073383 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.073330    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6b70489-bf56-47d9-b873-eaa3aa386f4c-serving-cert\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.073383 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.073369    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e6b70489-bf56-47d9-b873-eaa3aa386f4c-snapshots\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.073637 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.073391    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6b70489-bf56-47d9-b873-eaa3aa386f4c-trusted-ca-bundle\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.073637 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.073409    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsbhh\" (UniqueName: \"kubernetes.io/projected/e6b70489-bf56-47d9-b873-eaa3aa386f4c-kube-api-access-vsbhh\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.073637 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.073501    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa-serving-cert\") pod \"service-ca-operator-5bc4cf794b-frrsn\" (UID: \"1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn"
Jun 03 23:28:15.073637 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.073525    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b70489-bf56-47d9-b873-eaa3aa386f4c-tmp\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.073637 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.073585    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84s78\" (UniqueName: \"kubernetes.io/projected/b46ca08f-f7f5-4865-b179-a990d387638e-kube-api-access-84s78\") pod \"network-check-source-dbd9cf844-cv54b\" (UID: \"b46ca08f-f7f5-4865-b179-a990d387638e\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-cv54b"
Jun 03 23:28:15.073637 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.073624    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5g69\" (UniqueName: \"kubernetes.io/projected/1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa-kube-api-access-x5g69\") pod \"service-ca-operator-5bc4cf794b-frrsn\" (UID: \"1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn"
Jun 03 23:28:15.073924 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.073665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6b70489-bf56-47d9-b873-eaa3aa386f4c-service-ca-bundle\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.074007 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.073980    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa-config\") pod \"service-ca-operator-5bc4cf794b-frrsn\" (UID: \"1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn"
Jun 03 23:28:15.074167 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.074107    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:15.075836 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.075816    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa-serving-cert\") pod \"service-ca-operator-5bc4cf794b-frrsn\" (UID: \"1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn"
Jun 03 23:28:15.081217 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.081194    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5g69\" (UniqueName: \"kubernetes.io/projected/1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa-kube-api-access-x5g69\") pod \"service-ca-operator-5bc4cf794b-frrsn\" (UID: \"1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn"
Jun 03 23:28:15.081969 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.081951    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84s78\" (UniqueName: \"kubernetes.io/projected/b46ca08f-f7f5-4865-b179-a990d387638e-kube-api-access-84s78\") pod \"network-check-source-dbd9cf844-cv54b\" (UID: \"b46ca08f-f7f5-4865-b179-a990d387638e\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-cv54b"
Jun 03 23:28:15.131160 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.131138    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf"
Jun 03 23:28:15.173970 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.173938    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e6b70489-bf56-47d9-b873-eaa3aa386f4c-snapshots\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.173970 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.173976    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6b70489-bf56-47d9-b873-eaa3aa386f4c-trusted-ca-bundle\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.174205 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.174002    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsbhh\" (UniqueName: \"kubernetes.io/projected/e6b70489-bf56-47d9-b873-eaa3aa386f4c-kube-api-access-vsbhh\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.174205 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.174038    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b70489-bf56-47d9-b873-eaa3aa386f4c-tmp\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.174205 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.174135    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6b70489-bf56-47d9-b873-eaa3aa386f4c-service-ca-bundle\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.174205 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.174173    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6b70489-bf56-47d9-b873-eaa3aa386f4c-serving-cert\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.174773 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.174743    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e6b70489-bf56-47d9-b873-eaa3aa386f4c-snapshots\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.174931 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.174852    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6b70489-bf56-47d9-b873-eaa3aa386f4c-service-ca-bundle\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.175041 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.175008    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6b70489-bf56-47d9-b873-eaa3aa386f4c-trusted-ca-bundle\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.175041 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.175023    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:15.175210 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.175144    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b70489-bf56-47d9-b873-eaa3aa386f4c-tmp\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.177708 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.177569    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6b70489-bf56-47d9-b873-eaa3aa386f4c-serving-cert\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.182498 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.182434    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsbhh\" (UniqueName: \"kubernetes.io/projected/e6b70489-bf56-47d9-b873-eaa3aa386f4c-kube-api-access-vsbhh\") pod \"insights-operator-69684796bc-vrf65\" (UID: \"e6b70489-bf56-47d9-b873-eaa3aa386f4c\") " pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.233634 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.233607    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn"
Jun 03 23:28:15.239323 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.239302    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-cv54b"
Jun 03 23:28:15.252882 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.252853    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf"]
Jun 03 23:28:15.255256 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:28:15.255228    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de16cf1_50d0_45d3_9910_e6576f3574d8.slice/crio-04b1df94aab187282a60b63942a48b47d7a29f0223e82ac5dd30a40d177a399b WatchSource:0}: Error finding container 04b1df94aab187282a60b63942a48b47d7a29f0223e82ac5dd30a40d177a399b: Status 404 returned error can't find the container with id 04b1df94aab187282a60b63942a48b47d7a29f0223e82ac5dd30a40d177a399b
Jun 03 23:28:15.320625 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.320601    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-69684796bc-vrf65"
Jun 03 23:28:15.360504 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.360205    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn"]
Jun 03 23:28:15.363241 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:28:15.363210    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b69a0f4_6bd9_4e01_8a45_9e3f1752cafa.slice/crio-7dcfc1c93145d28b97b2f4230bc62a9e307bfb8b4939fbbf4cf0974b79ed48e8 WatchSource:0}: Error finding container 7dcfc1c93145d28b97b2f4230bc62a9e307bfb8b4939fbbf4cf0974b79ed48e8: Status 404 returned error can't find the container with id 7dcfc1c93145d28b97b2f4230bc62a9e307bfb8b4939fbbf4cf0974b79ed48e8
Jun 03 23:28:15.380632 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.380605    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-cv54b"]
Jun 03 23:28:15.383608 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:28:15.383584    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46ca08f_f7f5_4865_b179_a990d387638e.slice/crio-75ea854787a3ef050929a1f656d7c8d2942fd8319c8a8266f87158620ad5965d WatchSource:0}: Error finding container 75ea854787a3ef050929a1f656d7c8d2942fd8319c8a8266f87158620ad5965d: Status 404 returned error can't find the container with id 75ea854787a3ef050929a1f656d7c8d2942fd8319c8a8266f87158620ad5965d
Jun 03 23:28:15.447622 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.447598    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-69684796bc-vrf65"]
Jun 03 23:28:15.449920 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:28:15.449893    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b70489_bf56_47d9_b873_eaa3aa386f4c.slice/crio-2fba93375b17fcbc042bb6d97aef7ec348afabd5fb8007205bb4f4a96382d32e WatchSource:0}: Error finding container 2fba93375b17fcbc042bb6d97aef7ec348afabd5fb8007205bb4f4a96382d32e: Status 404 returned error can't find the container with id 2fba93375b17fcbc042bb6d97aef7ec348afabd5fb8007205bb4f4a96382d32e
Jun 03 23:28:15.477149 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.477119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xv274\" (UID: \"3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274"
Jun 03 23:28:15.477285 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:15.477205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-wfk94\" (UID: \"ae2db4ce-1fb5-4132-94a6-2739f1fe059e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94"
Jun 03 23:28:15.477285 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:15.477259    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 23:28:15.477359 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:15.477337    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert podName:3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:16.477319478 +0000 UTC m=+256.376221711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-xv274" (UID: "3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1") : secret "networking-console-plugin-cert" not found
Jun 03 23:28:15.477359 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:15.477340    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 23:28:15.477428 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:15.477391    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls podName:ae2db4ce-1fb5-4132-94a6-2739f1fe059e nodeName:}" failed. No retries permitted until 2026-06-03 23:28:16.477375135 +0000 UTC m=+256.376277390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-wfk94" (UID: "ae2db4ce-1fb5-4132-94a6-2739f1fe059e") : secret "samples-operator-tls" not found
Jun 03 23:28:16.247692 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:16.247603    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn" event={"ID":"1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa","Type":"ContainerStarted","Data":"7dcfc1c93145d28b97b2f4230bc62a9e307bfb8b4939fbbf4cf0974b79ed48e8"}
Jun 03 23:28:16.249690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:16.249665    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-vrf65" event={"ID":"e6b70489-bf56-47d9-b873-eaa3aa386f4c","Type":"ContainerStarted","Data":"2fba93375b17fcbc042bb6d97aef7ec348afabd5fb8007205bb4f4a96382d32e"}
Jun 03 23:28:16.251682 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:16.251653    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-cv54b" event={"ID":"b46ca08f-f7f5-4865-b179-a990d387638e","Type":"ContainerStarted","Data":"5662b83beea996eea2e9af72311fd788ee966fc349146d55dea0e703ce041189"}
Jun 03 23:28:16.251793 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:16.251696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-cv54b" event={"ID":"b46ca08f-f7f5-4865-b179-a990d387638e","Type":"ContainerStarted","Data":"75ea854787a3ef050929a1f656d7c8d2942fd8319c8a8266f87158620ad5965d"}
Jun 03 23:28:16.253392 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:16.253367    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf" event={"ID":"7de16cf1-50d0-45d3-9910-e6576f3574d8","Type":"ContainerStarted","Data":"04b1df94aab187282a60b63942a48b47d7a29f0223e82ac5dd30a40d177a399b"}
Jun 03 23:28:16.269407 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:16.268700    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-cv54b" podStartSLOduration=2.268680925 podStartE2EDuration="2.268680925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:16.267810933 +0000 UTC m=+256.166713179" watchObservedRunningTime="2026-06-03 23:28:16.268680925 +0000 UTC m=+256.167583180"
Jun 03 23:28:16.486599 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:16.486537    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-wfk94\" (UID: \"ae2db4ce-1fb5-4132-94a6-2739f1fe059e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94"
Jun 03 23:28:16.486780 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:16.486676    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xv274\" (UID: \"3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274"
Jun 03 23:28:16.486855 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:16.486837    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 23:28:16.486912 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:16.486897    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert podName:3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:18.486878964 +0000 UTC m=+258.385781200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-xv274" (UID: "3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1") : secret "networking-console-plugin-cert" not found
Jun 03 23:28:16.487322 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:16.487304    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 23:28:16.487432 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:16.487351    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls podName:ae2db4ce-1fb5-4132-94a6-2739f1fe059e nodeName:}" failed. No retries permitted until 2026-06-03 23:28:18.487337477 +0000 UTC m=+258.386239715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-wfk94" (UID: "ae2db4ce-1fb5-4132-94a6-2739f1fe059e") : secret "samples-operator-tls" not found
Jun 03 23:28:17.065500 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:17.065464    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:17.123803 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:17.123767    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:18.504755 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:18.504721    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xv274\" (UID: \"3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274"
Jun 03 23:28:18.505248 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:18.504783    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-wfk94\" (UID: \"ae2db4ce-1fb5-4132-94a6-2739f1fe059e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94"
Jun 03 23:28:18.505248 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:18.504918    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 23:28:18.505248 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:18.505001    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert podName:3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:22.504979523 +0000 UTC m=+262.403881761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-xv274" (UID: "3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1") : secret "networking-console-plugin-cert" not found
Jun 03 23:28:18.505248 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:18.504931    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 23:28:18.505248 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:18.505063    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls podName:ae2db4ce-1fb5-4132-94a6-2739f1fe059e nodeName:}" failed. No retries permitted until 2026-06-03 23:28:22.505046727 +0000 UTC m=+262.403948961 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-wfk94" (UID: "ae2db4ce-1fb5-4132-94a6-2739f1fe059e") : secret "samples-operator-tls" not found
Jun 03 23:28:19.267153 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:19.267095    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn" event={"ID":"1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa","Type":"ContainerStarted","Data":"5dfc32819440ebf956279d1ee2b645c7d393d05b842ac2a6b6bf481d8f206629"}
Jun 03 23:28:19.268716 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:19.268684    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-vrf65" event={"ID":"e6b70489-bf56-47d9-b873-eaa3aa386f4c","Type":"ContainerStarted","Data":"e3e0a92f860245134c9aa585ead345e869c5a44449f428b3488b020e53482aba"}
Jun 03 23:28:19.270208 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:19.270182    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf" event={"ID":"7de16cf1-50d0-45d3-9910-e6576f3574d8","Type":"ContainerStarted","Data":"e4bc55bd11cf37a231884400f9360c8dba84a226af2b21d24c790990349297ef"}
Jun 03 23:28:19.283564 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:19.283510    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn" podStartSLOduration=2.346691442 podStartE2EDuration="5.283491611s" totalImagesPullingTime="2.936800169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:19.282184537 +0000 UTC m=+259.181086791" watchObservedRunningTime="2026-06-03 23:28:19.283491611 +0000 UTC m=+259.182393865"
Jun 03 23:28:19.297544 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:19.297490    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf" podStartSLOduration=2.2586423509999998 podStartE2EDuration="5.297471196s" totalImagesPullingTime="3.038828845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:19.296217041 +0000 UTC m=+259.195119295" watchObservedRunningTime="2026-06-03 23:28:19.297471196 +0000 UTC m=+259.196373450"
Jun 03 23:28:19.314991 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:19.314948    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-69684796bc-vrf65" podStartSLOduration=2.4596902099999998 podStartE2EDuration="5.314932527s" totalImagesPullingTime="2.855242317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:19.313727537 +0000 UTC m=+259.212629795" watchObservedRunningTime="2026-06-03 23:28:19.314932527 +0000 UTC m=+259.213834778"
Jun 03 23:28:19.829528 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:19.829490    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:19.886907 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:19.886877    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:19.960865 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:19.960798    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:20.025399 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.025331    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:20.100875 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.100795    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:20.114114 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.114085    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-77ljk"]
Jun 03 23:28:20.116169 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.116140    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-77ljk"
Jun 03 23:28:20.118428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.118408    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jun 03 23:28:20.118811 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.118791    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hds4t\""
Jun 03 23:28:20.118889 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.118838    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jun 03 23:28:20.127883 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.127857    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-77ljk"]
Jun 03 23:28:20.192753 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.192728    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:20.217919 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.217892    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d284n\" (UniqueName: \"kubernetes.io/projected/551b45fe-b4cb-4813-92bf-2d0f653ea6b5-kube-api-access-d284n\") pod \"migrator-955ffdf5f-77ljk\" (UID: \"551b45fe-b4cb-4813-92bf-2d0f653ea6b5\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-77ljk"
Jun 03 23:28:20.257229 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.257201    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:20.318750 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.318709    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d284n\" (UniqueName: \"kubernetes.io/projected/551b45fe-b4cb-4813-92bf-2d0f653ea6b5-kube-api-access-d284n\") pod \"migrator-955ffdf5f-77ljk\" (UID: \"551b45fe-b4cb-4813-92bf-2d0f653ea6b5\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-77ljk"
Jun 03 23:28:20.326438 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.326416    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d284n\" (UniqueName: \"kubernetes.io/projected/551b45fe-b4cb-4813-92bf-2d0f653ea6b5-kube-api-access-d284n\") pod \"migrator-955ffdf5f-77ljk\" (UID: \"551b45fe-b4cb-4813-92bf-2d0f653ea6b5\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-77ljk"
Jun 03 23:28:20.407470 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.407381    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:20.424561 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.424537    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-77ljk"
Jun 03 23:28:20.477321 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.477294    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:20.543461 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.543435    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-77ljk"]
Jun 03 23:28:20.547675 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:28:20.547639    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551b45fe_b4cb_4813_92bf_2d0f653ea6b5.slice/crio-3193e561f110e57f977ff9b1e63cff2bd586afb8468e1ca07cefd36f8e1df7d3 WatchSource:0}: Error finding container 3193e561f110e57f977ff9b1e63cff2bd586afb8468e1ca07cefd36f8e1df7d3: Status 404 returned error can't find the container with id 3193e561f110e57f977ff9b1e63cff2bd586afb8468e1ca07cefd36f8e1df7d3
Jun 03 23:28:20.681245 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.681153    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:20.778694 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:20.778654    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:21.279289 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:21.279246    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-77ljk" event={"ID":"551b45fe-b4cb-4813-92bf-2d0f653ea6b5","Type":"ContainerStarted","Data":"3193e561f110e57f977ff9b1e63cff2bd586afb8468e1ca07cefd36f8e1df7d3"}
Jun 03 23:28:21.546828 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:21.546756    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-95bsc_d5772818-6f15-419b-b75d-7b8787218fcc/dns-node-resolver/0.log"
Jun 03 23:28:22.286152 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:22.286121    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-77ljk" event={"ID":"551b45fe-b4cb-4813-92bf-2d0f653ea6b5","Type":"ContainerStarted","Data":"ce17c7c87bdbe3c563ed3bd26a576f0c594942e06d5f942aadc979601c417cde"}
Jun 03 23:28:22.286531 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:22.286177    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-77ljk" event={"ID":"551b45fe-b4cb-4813-92bf-2d0f653ea6b5","Type":"ContainerStarted","Data":"032f71fa0034422f8c521259500d4425af2befba2b15bd7952cbe17873ce1af2"}
Jun 03 23:28:22.300879 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:22.300828    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-77ljk" podStartSLOduration=1.119809016 podStartE2EDuration="2.300813201s" totalImagesPullingTime="1.181004185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:22.300419083 +0000 UTC m=+262.199321327" watchObservedRunningTime="2026-06-03 23:28:22.300813201 +0000 UTC m=+262.199715473"
Jun 03 23:28:22.304573 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:22.304527    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:22.381514 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:22.381484    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:22.483383 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:22.483357    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:22.536417 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:22.536350    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xv274\" (UID: \"3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274"
Jun 03 23:28:22.536417 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:22.536400    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-wfk94\" (UID: \"ae2db4ce-1fb5-4132-94a6-2739f1fe059e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94"
Jun 03 23:28:22.536549 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:22.536498    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 23:28:22.536585 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:22.536552    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert podName:3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:30.53653877 +0000 UTC m=+270.435441005 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-xv274" (UID: "3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1") : secret "networking-console-plugin-cert" not found
Jun 03 23:28:22.536623 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:22.536498    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 03 23:28:22.536655 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:22.536624    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls podName:ae2db4ce-1fb5-4132-94a6-2739f1fe059e nodeName:}" failed. No retries permitted until 2026-06-03 23:28:30.536613166 +0000 UTC m=+270.435515407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-wfk94" (UID: "ae2db4ce-1fb5-4132-94a6-2739f1fe059e") : secret "samples-operator-tls" not found
Jun 03 23:28:22.946906 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:22.946828    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n89kn_c0773ad3-6650-4e53-bb83-ef9be98635d0/node-ca/0.log"
Jun 03 23:28:23.275156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:23.275121    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:23.748131 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:23.748106    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xrmc4_7165ed2f-9fbf-4c4a-89b7-9e46e653cb82/serve-healthcheck-canary/0.log"
Jun 03 23:28:25.825174 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:25.825142    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:25.978760 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:25.978729    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:26.080202 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:26.080106    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:26.180366 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:26.180337    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:26.327751 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:26.327716    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:26.532760 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:26.532731    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:26.633996 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:26.633967    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:27.524840 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:27.524786    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:27.926896 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:27.926815    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:28.125454 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:28.125423    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:28.317067 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:28.317038    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:28.722370 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:28.722338    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:29.320896 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:29.320863    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:29.647028 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:29.646950    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:29.747939 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:29.747909    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:29.848622 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:29.848582    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:30.120040 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:30.120005    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:30.536578 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:30.536547    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:30.601459 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:30.601427    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xv274\" (UID: \"3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274"
Jun 03 23:28:30.601630 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:30.601491    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-wfk94\" (UID: \"ae2db4ce-1fb5-4132-94a6-2739f1fe059e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94"
Jun 03 23:28:30.601630 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:30.601578    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 23:28:30.601710 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:30.601638    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert podName:3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:46.601623697 +0000 UTC m=+286.500525930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-xv274" (UID: "3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1") : secret "networking-console-plugin-cert" not found
Jun 03 23:28:30.603803 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:30.603780    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2db4ce-1fb5-4132-94a6-2739f1fe059e-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-wfk94\" (UID: \"ae2db4ce-1fb5-4132-94a6-2739f1fe059e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94"
Jun 03 23:28:30.719434 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:30.719399    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:30.726245 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:30.726225    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94"
Jun 03 23:28:30.847370 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:30.847336    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94"]
Jun 03 23:28:31.316413 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:31.316380    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94" event={"ID":"ae2db4ce-1fb5-4132-94a6-2739f1fe059e","Type":"ContainerStarted","Data":"c0be473f48d63993812860740469607d8aa8d5dcc99621575adff3b18e583d91"}
Jun 03 23:28:31.320300 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:31.320278    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:31.719016 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:31.718981    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:32.124908 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:32.124816    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:32.319789 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:32.319754    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:32.421776 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:32.421707    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:32.829880 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:32.829850    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:32.930821 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:32.930794    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:33.324427 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:33.324396    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94" event={"ID":"ae2db4ce-1fb5-4132-94a6-2739f1fe059e","Type":"ContainerStarted","Data":"3c4e9633146b13bef8ba071dcdab03febe73c41a319a6405f64c78f0c3955be2"}
Jun 03 23:28:33.324781 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:33.324447    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94" event={"ID":"ae2db4ce-1fb5-4132-94a6-2739f1fe059e","Type":"ContainerStarted","Data":"935dad7352d790a59a9140f51fac9da1816838c4dd2ca0835cbc0dd0b0397057"}
Jun 03 23:28:33.343644 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:33.343598    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-wfk94" podStartSLOduration=17.774614069 podStartE2EDuration="19.343584418s" totalImagesPullingTime="1.568970349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:33.34262875 +0000 UTC m=+273.241531003" watchObservedRunningTime="2026-06-03 23:28:33.343584418 +0000 UTC m=+273.242486670"
Jun 03 23:28:33.345228 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:33.345186    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:33.729243 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:33.729199    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:34.118576 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:34.118469    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:34.322485 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:34.322453    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:34.724506 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:34.724477    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:35.020632 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:35.020545    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:35.331324 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:35.331249    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:35.933383 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:35.933349    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:36.120468 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:36.120436    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:36.322930 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:36.322900    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:36.533364 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:36.533334    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:38.782068 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:38.782038    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:38.836058 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:38.836029    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:41.011548 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:41.011490    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx" podUID="415dd3b3-ef9d-49bd-af0b-751c5625e386"
Jun 03 23:28:41.011548 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:41.011507    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mqj5m" podUID="5396ae25-295d-49a4-8b66-3fe3ecefdfe4"
Jun 03 23:28:41.349008 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:41.348933    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:28:41.349137 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:41.348933    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:28:44.411344 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:44.411297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:28:44.413614 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:44.413586    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls\") pod \"image-registry-7957c84c47-rxbwx\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") " pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:28:44.511958 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:44.511928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:28:44.514107 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:44.514089    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5396ae25-295d-49a4-8b66-3fe3ecefdfe4-metrics-tls\") pod \"dns-default-mqj5m\" (UID: \"5396ae25-295d-49a4-8b66-3fe3ecefdfe4\") " pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:28:44.652126 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:44.652097    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4x8v9\""
Jun 03 23:28:44.652126 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:44.652109    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6h75n\""
Jun 03 23:28:44.660047 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:44.660028    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:28:44.660145 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:44.660056    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:28:44.815757 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:44.815729    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mqj5m"]
Jun 03 23:28:44.818645 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:28:44.818619    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5396ae25_295d_49a4_8b66_3fe3ecefdfe4.slice/crio-8bd0a65d13e169ae256d731ceb58421151dac5985fcaa4ed63d3c98ac159f2e7 WatchSource:0}: Error finding container 8bd0a65d13e169ae256d731ceb58421151dac5985fcaa4ed63d3c98ac159f2e7: Status 404 returned error can't find the container with id 8bd0a65d13e169ae256d731ceb58421151dac5985fcaa4ed63d3c98ac159f2e7
Jun 03 23:28:44.850438 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:44.850416    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7957c84c47-rxbwx"]
Jun 03 23:28:44.853549 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:28:44.853524    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415dd3b3_ef9d_49bd_af0b_751c5625e386.slice/crio-8d6fe365ded12e07517a20c8fbdfe7658dec2bb985a55424947c5f2bea6ee076 WatchSource:0}: Error finding container 8d6fe365ded12e07517a20c8fbdfe7658dec2bb985a55424947c5f2bea6ee076: Status 404 returned error can't find the container with id 8d6fe365ded12e07517a20c8fbdfe7658dec2bb985a55424947c5f2bea6ee076
Jun 03 23:28:44.997700 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:44.997668    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gz8cg"]
Jun 03 23:28:44.999841 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:44.999822    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.002006 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.001946    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h745f\""
Jun 03 23:28:45.002148 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.002128    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 03 23:28:45.002345 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.002333    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 03 23:28:45.037534 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.037505    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gz8cg"]
Jun 03 23:28:45.117570 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.117533    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de20ac2f-afb8-4e3e-b153-ab95f1d499d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gz8cg\" (UID: \"de20ac2f-afb8-4e3e-b153-ab95f1d499d6\") " pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.117720 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.117635    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j54xr\" (UniqueName: \"kubernetes.io/projected/de20ac2f-afb8-4e3e-b153-ab95f1d499d6-kube-api-access-j54xr\") pod \"insights-runtime-extractor-gz8cg\" (UID: \"de20ac2f-afb8-4e3e-b153-ab95f1d499d6\") " pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.117720 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.117695    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/de20ac2f-afb8-4e3e-b153-ab95f1d499d6-crio-socket\") pod \"insights-runtime-extractor-gz8cg\" (UID: \"de20ac2f-afb8-4e3e-b153-ab95f1d499d6\") " pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.117720 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.117713    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de20ac2f-afb8-4e3e-b153-ab95f1d499d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gz8cg\" (UID: \"de20ac2f-afb8-4e3e-b153-ab95f1d499d6\") " pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.117813 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.117740    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/de20ac2f-afb8-4e3e-b153-ab95f1d499d6-data-volume\") pod \"insights-runtime-extractor-gz8cg\" (UID: \"de20ac2f-afb8-4e3e-b153-ab95f1d499d6\") " pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.166129 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.166098    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:45.219084 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.219055    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/de20ac2f-afb8-4e3e-b153-ab95f1d499d6-data-volume\") pod \"insights-runtime-extractor-gz8cg\" (UID: \"de20ac2f-afb8-4e3e-b153-ab95f1d499d6\") " pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.219222 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.219107    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de20ac2f-afb8-4e3e-b153-ab95f1d499d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gz8cg\" (UID: \"de20ac2f-afb8-4e3e-b153-ab95f1d499d6\") " pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.219222 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.219141    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j54xr\" (UniqueName: \"kubernetes.io/projected/de20ac2f-afb8-4e3e-b153-ab95f1d499d6-kube-api-access-j54xr\") pod \"insights-runtime-extractor-gz8cg\" (UID: \"de20ac2f-afb8-4e3e-b153-ab95f1d499d6\") " pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.219222 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.219174    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/de20ac2f-afb8-4e3e-b153-ab95f1d499d6-crio-socket\") pod \"insights-runtime-extractor-gz8cg\" (UID: \"de20ac2f-afb8-4e3e-b153-ab95f1d499d6\") " pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.219222 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.219197    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de20ac2f-afb8-4e3e-b153-ab95f1d499d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gz8cg\" (UID: \"de20ac2f-afb8-4e3e-b153-ab95f1d499d6\") " pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.219441 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.219327    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/de20ac2f-afb8-4e3e-b153-ab95f1d499d6-crio-socket\") pod \"insights-runtime-extractor-gz8cg\" (UID: \"de20ac2f-afb8-4e3e-b153-ab95f1d499d6\") " pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.219492 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.219456    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/de20ac2f-afb8-4e3e-b153-ab95f1d499d6-data-volume\") pod \"insights-runtime-extractor-gz8cg\" (UID: \"de20ac2f-afb8-4e3e-b153-ab95f1d499d6\") " pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.219834 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.219810    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de20ac2f-afb8-4e3e-b153-ab95f1d499d6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gz8cg\" (UID: \"de20ac2f-afb8-4e3e-b153-ab95f1d499d6\") " pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.221403 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.221387    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de20ac2f-afb8-4e3e-b153-ab95f1d499d6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gz8cg\" (UID: \"de20ac2f-afb8-4e3e-b153-ab95f1d499d6\") " pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.227421 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.227391    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j54xr\" (UniqueName: \"kubernetes.io/projected/de20ac2f-afb8-4e3e-b153-ab95f1d499d6-kube-api-access-j54xr\") pod \"insights-runtime-extractor-gz8cg\" (UID: \"de20ac2f-afb8-4e3e-b153-ab95f1d499d6\") " pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.270014 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.269929    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:45.308818 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.308794    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gz8cg"
Jun 03 23:28:45.366361 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.365432    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx" event={"ID":"415dd3b3-ef9d-49bd-af0b-751c5625e386","Type":"ContainerStarted","Data":"fc53f09e89c3ca5919807c68abf7a104efbc1afd7377ebca1a2dd03f8004090f"}
Jun 03 23:28:45.366361 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.365526    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx" event={"ID":"415dd3b3-ef9d-49bd-af0b-751c5625e386","Type":"ContainerStarted","Data":"8d6fe365ded12e07517a20c8fbdfe7658dec2bb985a55424947c5f2bea6ee076"}
Jun 03 23:28:45.366361 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.366311    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:28:45.369840 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.369812    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mqj5m" event={"ID":"5396ae25-295d-49a4-8b66-3fe3ecefdfe4","Type":"ContainerStarted","Data":"8bd0a65d13e169ae256d731ceb58421151dac5985fcaa4ed63d3c98ac159f2e7"}
Jun 03 23:28:45.396320 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.396251    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx" podStartSLOduration=285.396231144 podStartE2EDuration="4m45.396231144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:24:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:45.395070849 +0000 UTC m=+285.293973102" watchObservedRunningTime="2026-06-03 23:28:45.396231144 +0000 UTC m=+285.295133398"
Jun 03 23:28:45.462367 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:45.462219    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gz8cg"]
Jun 03 23:28:45.464968 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:28:45.464936    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde20ac2f_afb8_4e3e_b153_ab95f1d499d6.slice/crio-975b7541e93a530723b0fc41df576b2942e431e61034b8a53fe41cb87a17d688 WatchSource:0}: Error finding container 975b7541e93a530723b0fc41df576b2942e431e61034b8a53fe41cb87a17d688: Status 404 returned error can't find the container with id 975b7541e93a530723b0fc41df576b2942e431e61034b8a53fe41cb87a17d688
Jun 03 23:28:46.375598 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:46.375556    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gz8cg" event={"ID":"de20ac2f-afb8-4e3e-b153-ab95f1d499d6","Type":"ContainerStarted","Data":"1ee23b146cf82a2f6bde9a53db80bf174f79c7b84e601f2a4e27a8337fd442cb"}
Jun 03 23:28:46.375804 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:46.375634    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gz8cg" event={"ID":"de20ac2f-afb8-4e3e-b153-ab95f1d499d6","Type":"ContainerStarted","Data":"2e1f90dca297bbb3ea25923b84275a46114adce98ebb73ffe47618ab3e50bf29"}
Jun 03 23:28:46.375804 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:46.375663    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gz8cg" event={"ID":"de20ac2f-afb8-4e3e-b153-ab95f1d499d6","Type":"ContainerStarted","Data":"975b7541e93a530723b0fc41df576b2942e431e61034b8a53fe41cb87a17d688"}
Jun 03 23:28:46.630748 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:46.630713    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xv274\" (UID: \"3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274"
Jun 03 23:28:46.633678 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:46.633654    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-xv274\" (UID: \"3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274"
Jun 03 23:28:46.920673 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:46.920641    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274"
Jun 03 23:28:47.062923 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:47.062888    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-xv274"]
Jun 03 23:28:47.066162 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:28:47.066114    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ccfd2d2_e09b_43e0_921b_e5c2341b1ff1.slice/crio-6d01bcaba93f3b5e85a602b11d0b185c4fb98753118a7d36cf88cf87c6ab4065 WatchSource:0}: Error finding container 6d01bcaba93f3b5e85a602b11d0b185c4fb98753118a7d36cf88cf87c6ab4065: Status 404 returned error can't find the container with id 6d01bcaba93f3b5e85a602b11d0b185c4fb98753118a7d36cf88cf87c6ab4065
Jun 03 23:28:47.162499 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:47.162464    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:47.262400 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:47.262366    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:47.381111 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:47.381071    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274" event={"ID":"3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1","Type":"ContainerStarted","Data":"6d01bcaba93f3b5e85a602b11d0b185c4fb98753118a7d36cf88cf87c6ab4065"}
Jun 03 23:28:47.382989 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:47.382960    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mqj5m" event={"ID":"5396ae25-295d-49a4-8b66-3fe3ecefdfe4","Type":"ContainerStarted","Data":"eeefb96ede278f97ddb01689a70d5254af18d5edb97d3e9ffe67dbb9f979e541"}
Jun 03 23:28:47.383134 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:47.383014    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mqj5m" event={"ID":"5396ae25-295d-49a4-8b66-3fe3ecefdfe4","Type":"ContainerStarted","Data":"479d0fc532c2d05f1f4e709a7a13d36616cbe7d198b7d5683bd40394fbd9d121"}
Jun 03 23:28:47.402252 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:47.402215    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mqj5m" podStartSLOduration=251.463387022 podStartE2EDuration="4m13.402198605s" totalImagesPullingTime="1.938811583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:24:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:47.401216314 +0000 UTC m=+287.300118568" watchObservedRunningTime="2026-06-03 23:28:47.402198605 +0000 UTC m=+287.301100857"
Jun 03 23:28:48.391565 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:48.391529    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gz8cg" event={"ID":"de20ac2f-afb8-4e3e-b153-ab95f1d499d6","Type":"ContainerStarted","Data":"642d77ef6f68115530f6cf9afed37f5ca7247eca7bfa656a3d3c79d0413833cb"}
Jun 03 23:28:48.391995 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:48.391825    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:28:48.411538 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:48.411497    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gz8cg" podStartSLOduration=1.749975591 podStartE2EDuration="4.411480582s" totalImagesPullingTime="2.661504991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:28:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:48.409572679 +0000 UTC m=+288.308474953" watchObservedRunningTime="2026-06-03 23:28:48.411480582 +0000 UTC m=+288.310382836"
Jun 03 23:28:49.396474 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:49.396420    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274" event={"ID":"3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1","Type":"ContainerStarted","Data":"2ff4c60c763850f3f04fd9817424ea0937991fa607d21ca53ea1f0d7f97ec7b1"}
Jun 03 23:28:49.502210 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:49.502176    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:49.603663 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:49.603575    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:49.704769 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:49.704722    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-68d6b54856-xv274" podStartSLOduration=33.448720643 podStartE2EDuration="35.704705012s" totalImagesPullingTime="2.255984369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:49.411434688 +0000 UTC m=+289.310336941" watchObservedRunningTime="2026-06-03 23:28:49.704705012 +0000 UTC m=+289.603607279"
Jun 03 23:28:49.704937 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:49.704855    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gmtv4"]
Jun 03 23:28:49.706950 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:49.706934    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gmtv4"
Jun 03 23:28:49.717113 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:49.717097    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jun 03 23:28:49.717862 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:49.717847    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9tmg5\""
Jun 03 23:28:49.737396 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:49.737378    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gmtv4"]
Jun 03 23:28:49.740355 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:49.740323    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:49.857569 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:49.857515    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b124d11b-082b-4413-8f9d-5226285a39d2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gmtv4\" (UID: \"b124d11b-082b-4413-8f9d-5226285a39d2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gmtv4"
Jun 03 23:28:49.958126 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:49.958100    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b124d11b-082b-4413-8f9d-5226285a39d2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gmtv4\" (UID: \"b124d11b-082b-4413-8f9d-5226285a39d2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gmtv4"
Jun 03 23:28:49.958227 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:49.958213    2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jun 03 23:28:49.958295 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:49.958261    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b124d11b-082b-4413-8f9d-5226285a39d2-tls-certificates podName:b124d11b-082b-4413-8f9d-5226285a39d2 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:50.458248272 +0000 UTC m=+290.357150506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/b124d11b-082b-4413-8f9d-5226285a39d2-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-gmtv4" (UID: "b124d11b-082b-4413-8f9d-5226285a39d2") : secret "prometheus-operator-admission-webhook-tls" not found
Jun 03 23:28:50.461622 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:50.461581    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b124d11b-082b-4413-8f9d-5226285a39d2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gmtv4\" (UID: \"b124d11b-082b-4413-8f9d-5226285a39d2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gmtv4"
Jun 03 23:28:50.461981 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:50.461704    2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jun 03 23:28:50.461981 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:50.461755    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b124d11b-082b-4413-8f9d-5226285a39d2-tls-certificates podName:b124d11b-082b-4413-8f9d-5226285a39d2 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:51.461740947 +0000 UTC m=+291.360643179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/b124d11b-082b-4413-8f9d-5226285a39d2-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-gmtv4" (UID: "b124d11b-082b-4413-8f9d-5226285a39d2") : secret "prometheus-operator-admission-webhook-tls" not found
Jun 03 23:28:50.683364 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:50.683332    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:51.216845 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:51.216814    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:51.282568 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:51.282531    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:51.469189 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:51.469127    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b124d11b-082b-4413-8f9d-5226285a39d2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gmtv4\" (UID: \"b124d11b-082b-4413-8f9d-5226285a39d2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gmtv4"
Jun 03 23:28:51.471471 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:51.471450    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b124d11b-082b-4413-8f9d-5226285a39d2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-gmtv4\" (UID: \"b124d11b-082b-4413-8f9d-5226285a39d2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gmtv4"
Jun 03 23:28:51.515453 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:51.515417    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gmtv4"
Jun 03 23:28:51.639607 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:51.639581    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gmtv4"]
Jun 03 23:28:51.642364 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:28:51.642333    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb124d11b_082b_4413_8f9d_5226285a39d2.slice/crio-cb2b120b6662516991adae6d794e8473a052173d1b1740d03b44ff58dc506cea WatchSource:0}: Error finding container cb2b120b6662516991adae6d794e8473a052173d1b1740d03b44ff58dc506cea: Status 404 returned error can't find the container with id cb2b120b6662516991adae6d794e8473a052173d1b1740d03b44ff58dc506cea
Jun 03 23:28:52.408385 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:52.408350    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gmtv4" event={"ID":"b124d11b-082b-4413-8f9d-5226285a39d2","Type":"ContainerStarted","Data":"cb2b120b6662516991adae6d794e8473a052173d1b1740d03b44ff58dc506cea"}
Jun 03 23:28:53.412843 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:53.412805    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gmtv4" event={"ID":"b124d11b-082b-4413-8f9d-5226285a39d2","Type":"ContainerStarted","Data":"d940bd4b56173e9e0f2ba186eea66908ef47f7b1c789a9807e2de64f0603ca66"}
Jun 03 23:28:53.413213 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:53.412984    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gmtv4"
Jun 03 23:28:53.417754 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:53.417734    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gmtv4"
Jun 03 23:28:53.429513 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:53.429473    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-gmtv4" podStartSLOduration=3.392973645 podStartE2EDuration="4.429460349s" totalImagesPullingTime="1.036486704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:53.428861987 +0000 UTC m=+293.327764265" watchObservedRunningTime="2026-06-03 23:28:53.429460349 +0000 UTC m=+293.328362600"
Jun 03 23:28:53.523566 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:28:53.523532    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5t7nh" podUID="2be4b6b6-ca95-4f1f-afce-1ff311ee9989"
Jun 03 23:28:53.707048 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:53.706968    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:53.795812 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:53.795784    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:53.983108 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:53.983084    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:55.810393 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:55.810359    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:57.861610 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:57.861577    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:58.091677 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.091641    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:58.119895 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.119819    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"]
Jun 03 23:28:58.123148 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.123132    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"
Jun 03 23:28:58.125873 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.125787    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pmn62\""
Jun 03 23:28:58.125873 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.125812    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jun 03 23:28:58.125873 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.125833    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jun 03 23:28:58.125873 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.125838    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 03 23:28:58.126137 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.125917    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 03 23:28:58.126137 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.125931    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 03 23:28:58.126482 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.126465    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-79ctc"]
Jun 03 23:28:58.129390 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.129372    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.132447 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.131867    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 03 23:28:58.132447 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.132025    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 03 23:28:58.132447 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.132216    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 03 23:28:58.132891 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.132873    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5kp99\""
Jun 03 23:28:58.138122 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.138101    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"]
Jun 03 23:28:58.139394 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.139375    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"]
Jun 03 23:28:58.142781 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.142762    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.145160 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.145141    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jun 03 23:28:58.145260 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.145210    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jun 03 23:28:58.145260 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.145254    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jun 03 23:28:58.145398 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.145307    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tdlwt\""
Jun 03 23:28:58.154616 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.154597    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"]
Jun 03 23:28:58.177647 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.177623    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:58.217958 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.217931    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/120fa87d-2b5d-434c-af7c-63394b120b54-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-6xxxp\" (UID: \"120fa87d-2b5d-434c-af7c-63394b120b54\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"
Jun 03 23:28:58.218079 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.217974    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/719ba6b8-8607-4094-9323-fe570d677c7e-root\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.218079 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.217996    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/719ba6b8-8607-4094-9323-fe570d677c7e-node-exporter-wtmp\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.218079 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.218067    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/719ba6b8-8607-4094-9323-fe570d677c7e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.218193 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.218085    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/719ba6b8-8607-4094-9323-fe570d677c7e-node-exporter-accelerators-collector-config\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.218193 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.218100    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz4kq\" (UniqueName: \"kubernetes.io/projected/719ba6b8-8607-4094-9323-fe570d677c7e-kube-api-access-sz4kq\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.218193 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.218130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/719ba6b8-8607-4094-9323-fe570d677c7e-sys\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.218193 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.218165    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v777f\" (UniqueName: \"kubernetes.io/projected/120fa87d-2b5d-434c-af7c-63394b120b54-kube-api-access-v777f\") pod \"openshift-state-metrics-65f78d5c66-6xxxp\" (UID: \"120fa87d-2b5d-434c-af7c-63394b120b54\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"
Jun 03 23:28:58.218193 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.218183    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/719ba6b8-8607-4094-9323-fe570d677c7e-node-exporter-textfile\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.218410 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.218200    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/719ba6b8-8607-4094-9323-fe570d677c7e-metrics-client-ca\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.218410 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.218234    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/120fa87d-2b5d-434c-af7c-63394b120b54-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-6xxxp\" (UID: \"120fa87d-2b5d-434c-af7c-63394b120b54\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"
Jun 03 23:28:58.218410 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.218259    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/719ba6b8-8607-4094-9323-fe570d677c7e-node-exporter-tls\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.218410 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.218322    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/120fa87d-2b5d-434c-af7c-63394b120b54-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-6xxxp\" (UID: \"120fa87d-2b5d-434c-af7c-63394b120b54\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"
Jun 03 23:28:58.257620 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.257571    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:58.319372 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319343    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/43f297f3-5920-4ee3-b54b-ecfaaee92f83-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.319484 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319386    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/719ba6b8-8607-4094-9323-fe570d677c7e-root\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.319484 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43f297f3-5920-4ee3-b54b-ecfaaee92f83-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.319484 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319428    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/719ba6b8-8607-4094-9323-fe570d677c7e-node-exporter-wtmp\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.319484 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319452    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/719ba6b8-8607-4094-9323-fe570d677c7e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.319484 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319456    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/719ba6b8-8607-4094-9323-fe570d677c7e-root\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.319484 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319468    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/719ba6b8-8607-4094-9323-fe570d677c7e-node-exporter-accelerators-collector-config\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.319484 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319483    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz4kq\" (UniqueName: \"kubernetes.io/projected/719ba6b8-8607-4094-9323-fe570d677c7e-kube-api-access-sz4kq\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.319791 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319499    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/43f297f3-5920-4ee3-b54b-ecfaaee92f83-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.319791 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319520    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/719ba6b8-8607-4094-9323-fe570d677c7e-sys\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.319791 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319553    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v777f\" (UniqueName: \"kubernetes.io/projected/120fa87d-2b5d-434c-af7c-63394b120b54-kube-api-access-v777f\") pod \"openshift-state-metrics-65f78d5c66-6xxxp\" (UID: \"120fa87d-2b5d-434c-af7c-63394b120b54\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"
Jun 03 23:28:58.319791 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319560    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/719ba6b8-8607-4094-9323-fe570d677c7e-node-exporter-wtmp\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.319791 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319589    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/719ba6b8-8607-4094-9323-fe570d677c7e-sys\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.319791 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/719ba6b8-8607-4094-9323-fe570d677c7e-node-exporter-textfile\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.319791 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319635    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/719ba6b8-8607-4094-9323-fe570d677c7e-metrics-client-ca\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.319791 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319658    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/43f297f3-5920-4ee3-b54b-ecfaaee92f83-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.319791 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319685    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43f297f3-5920-4ee3-b54b-ecfaaee92f83-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.319791 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319727    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/120fa87d-2b5d-434c-af7c-63394b120b54-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-6xxxp\" (UID: \"120fa87d-2b5d-434c-af7c-63394b120b54\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"
Jun 03 23:28:58.319791 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319751    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkj4w\" (UniqueName: \"kubernetes.io/projected/43f297f3-5920-4ee3-b54b-ecfaaee92f83-kube-api-access-vkj4w\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.320344 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319806    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/719ba6b8-8607-4094-9323-fe570d677c7e-node-exporter-tls\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.320344 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/120fa87d-2b5d-434c-af7c-63394b120b54-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-6xxxp\" (UID: \"120fa87d-2b5d-434c-af7c-63394b120b54\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"
Jun 03 23:28:58.320344 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319892    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/120fa87d-2b5d-434c-af7c-63394b120b54-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-6xxxp\" (UID: \"120fa87d-2b5d-434c-af7c-63394b120b54\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"
Jun 03 23:28:58.320344 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.319912    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/719ba6b8-8607-4094-9323-fe570d677c7e-node-exporter-textfile\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.320344 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.320218    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/719ba6b8-8607-4094-9323-fe570d677c7e-node-exporter-accelerators-collector-config\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.320344 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.320298    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/719ba6b8-8607-4094-9323-fe570d677c7e-metrics-client-ca\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.320646 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.320624    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/120fa87d-2b5d-434c-af7c-63394b120b54-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-6xxxp\" (UID: \"120fa87d-2b5d-434c-af7c-63394b120b54\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"
Jun 03 23:28:58.322032 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.322012    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/719ba6b8-8607-4094-9323-fe570d677c7e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.322282 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.322250    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/120fa87d-2b5d-434c-af7c-63394b120b54-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-6xxxp\" (UID: \"120fa87d-2b5d-434c-af7c-63394b120b54\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"
Jun 03 23:28:58.322531 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.322511    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/120fa87d-2b5d-434c-af7c-63394b120b54-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-6xxxp\" (UID: \"120fa87d-2b5d-434c-af7c-63394b120b54\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"
Jun 03 23:28:58.322592 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.322540    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/719ba6b8-8607-4094-9323-fe570d677c7e-node-exporter-tls\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.327981 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.327958    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v777f\" (UniqueName: \"kubernetes.io/projected/120fa87d-2b5d-434c-af7c-63394b120b54-kube-api-access-v777f\") pod \"openshift-state-metrics-65f78d5c66-6xxxp\" (UID: \"120fa87d-2b5d-434c-af7c-63394b120b54\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"
Jun 03 23:28:58.330758 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.330734    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz4kq\" (UniqueName: \"kubernetes.io/projected/719ba6b8-8607-4094-9323-fe570d677c7e-kube-api-access-sz4kq\") pod \"node-exporter-79ctc\" (UID: \"719ba6b8-8607-4094-9323-fe570d677c7e\") " pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.361960 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.361935    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:58.398889 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.398817    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mqj5m"
Jun 03 23:28:58.420302 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.420258    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/43f297f3-5920-4ee3-b54b-ecfaaee92f83-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.420432 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.420315    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/43f297f3-5920-4ee3-b54b-ecfaaee92f83-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.420432 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.420336    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43f297f3-5920-4ee3-b54b-ecfaaee92f83-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.420432 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.420370    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkj4w\" (UniqueName: \"kubernetes.io/projected/43f297f3-5920-4ee3-b54b-ecfaaee92f83-kube-api-access-vkj4w\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.420432 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.420406    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/43f297f3-5920-4ee3-b54b-ecfaaee92f83-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.420632 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.420448    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43f297f3-5920-4ee3-b54b-ecfaaee92f83-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.420717 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.420694    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/43f297f3-5920-4ee3-b54b-ecfaaee92f83-volume-directive-shadow\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.421069 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.421045    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/43f297f3-5920-4ee3-b54b-ecfaaee92f83-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.421163 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.421081    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43f297f3-5920-4ee3-b54b-ecfaaee92f83-metrics-client-ca\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.422915 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.422894    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/43f297f3-5920-4ee3-b54b-ecfaaee92f83-kube-state-metrics-tls\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.422981 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.422895    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43f297f3-5920-4ee3-b54b-ecfaaee92f83-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.432672 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.432650    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkj4w\" (UniqueName: \"kubernetes.io/projected/43f297f3-5920-4ee3-b54b-ecfaaee92f83-kube-api-access-vkj4w\") pod \"kube-state-metrics-79fb7d47d4-rlbs8\" (UID: \"43f297f3-5920-4ee3-b54b-ecfaaee92f83\") " pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.433359 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.433342    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"
Jun 03 23:28:58.441448 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.441431    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-79ctc"
Jun 03 23:28:58.451232 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.451211    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"
Jun 03 23:28:58.452121 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:28:58.452095    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719ba6b8_8607_4094_9323_fe570d677c7e.slice/crio-31f4ff61afa4e2e568f97d7141d0b1df4dd4e74c2c331c47c454f1e607f32dd8 WatchSource:0}: Error finding container 31f4ff61afa4e2e568f97d7141d0b1df4dd4e74c2c331c47c454f1e607f32dd8: Status 404 returned error can't find the container with id 31f4ff61afa4e2e568f97d7141d0b1df4dd4e74c2c331c47c454f1e607f32dd8
Jun 03 23:28:58.578424 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.578394    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:58.578881 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.578840    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp"]
Jun 03 23:28:58.581064 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:28:58.581038    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120fa87d_2b5d_434c_af7c_63394b120b54.slice/crio-0864977955fad6996ecd9fd64a575e8483caeea068504eb07bf96f52b2980bbf WatchSource:0}: Error finding container 0864977955fad6996ecd9fd64a575e8483caeea068504eb07bf96f52b2980bbf: Status 404 returned error can't find the container with id 0864977955fad6996ecd9fd64a575e8483caeea068504eb07bf96f52b2980bbf
Jun 03 23:28:58.594041 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:58.594018    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8"]
Jun 03 23:28:58.596091 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:28:58.596030    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f297f3_5920_4ee3_b54b_ecfaaee92f83.slice/crio-7d84feb7fc25092cad2aac8fb8e0bb51f756bd928988e01e18741b61f4ccb646 WatchSource:0}: Error finding container 7d84feb7fc25092cad2aac8fb8e0bb51f756bd928988e01e18741b61f4ccb646: Status 404 returned error can't find the container with id 7d84feb7fc25092cad2aac8fb8e0bb51f756bd928988e01e18741b61f4ccb646
Jun 03 23:28:59.061834 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.061800    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:59.159692 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.159614    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:59.211646 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.209641    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 23:28:59.213888 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.213863    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.216324 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.216299    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 03 23:28:59.216449 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.216335    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 03 23:28:59.216588 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.216562    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 03 23:28:59.216768 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.216751    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nd864\""
Jun 03 23:28:59.216839 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.216767    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 03 23:28:59.216997 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.216981    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 03 23:28:59.217047 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.216999    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 03 23:28:59.217327 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.217188    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 03 23:28:59.217327 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.217201    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 03 23:28:59.217327 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.217246    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 03 23:28:59.232806 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.232781    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 23:28:59.239449 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.239381    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:59.330219 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.330136    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.330219 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.330189    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-web-config\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.330219 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.330217    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c14ed454-99e1-4ba3-9903-e06e3647feef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.330520 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.330287    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kp78\" (UniqueName: \"kubernetes.io/projected/c14ed454-99e1-4ba3-9903-e06e3647feef-kube-api-access-5kp78\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.330520 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.330315    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c14ed454-99e1-4ba3-9903-e06e3647feef-config-out\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.330520 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.330421    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.330520 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.330502    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-config-volume\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.330738 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.330540    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.330738 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.330603    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c14ed454-99e1-4ba3-9903-e06e3647feef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.330738 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.330632    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c14ed454-99e1-4ba3-9903-e06e3647feef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.330738 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.330661    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.330738 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.330719    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.330940 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.330785    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c14ed454-99e1-4ba3-9903-e06e3647feef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.361238 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.361206    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:28:59.431234 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.431184    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kp78\" (UniqueName: \"kubernetes.io/projected/c14ed454-99e1-4ba3-9903-e06e3647feef-kube-api-access-5kp78\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.431234 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.431236    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c14ed454-99e1-4ba3-9903-e06e3647feef-config-out\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.431464 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.431300    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.431464 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.431344    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-config-volume\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.431464 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.431372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.431464 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.431408    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c14ed454-99e1-4ba3-9903-e06e3647feef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.431464 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.431438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c14ed454-99e1-4ba3-9903-e06e3647feef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.431703 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.431471    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.432985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.432219    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.432985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.432301    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c14ed454-99e1-4ba3-9903-e06e3647feef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.432985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.432335    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.432985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.432381    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-web-config\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.432985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.432408    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c14ed454-99e1-4ba3-9903-e06e3647feef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.432985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.432706    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c14ed454-99e1-4ba3-9903-e06e3647feef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.432985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.432929    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c14ed454-99e1-4ba3-9903-e06e3647feef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.435345 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.433836    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c14ed454-99e1-4ba3-9903-e06e3647feef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.436503 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.436476    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.437047 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.437005    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c14ed454-99e1-4ba3-9903-e06e3647feef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.438337 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.438304    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.438681 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.438653    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c14ed454-99e1-4ba3-9903-e06e3647feef-config-out\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.439202 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.439068    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8" event={"ID":"43f297f3-5920-4ee3-b54b-ecfaaee92f83","Type":"ContainerStarted","Data":"7d84feb7fc25092cad2aac8fb8e0bb51f756bd928988e01e18741b61f4ccb646"}
Jun 03 23:28:59.439202 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.439139    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-config-volume\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.439573 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.439554    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.439648 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.439559    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.439991 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.439938    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.440773 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.440746    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79ctc" event={"ID":"719ba6b8-8607-4094-9323-fe570d677c7e","Type":"ContainerStarted","Data":"31f4ff61afa4e2e568f97d7141d0b1df4dd4e74c2c331c47c454f1e607f32dd8"}
Jun 03 23:28:59.441608 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.441566    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-web-config\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.443327 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.443170    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp" event={"ID":"120fa87d-2b5d-434c-af7c-63394b120b54","Type":"ContainerStarted","Data":"4da0b40505eb13a2584bceae22602758dc5c567ec3f7842dffd636fe055331cf"}
Jun 03 23:28:59.443327 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.443236    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp" event={"ID":"120fa87d-2b5d-434c-af7c-63394b120b54","Type":"ContainerStarted","Data":"b6bfb94103a68963b3bd2173addc264130b5b79420196ab385b52bbb5372f0d5"}
Jun 03 23:28:59.443327 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.443292    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp" event={"ID":"120fa87d-2b5d-434c-af7c-63394b120b54","Type":"ContainerStarted","Data":"0864977955fad6996ecd9fd64a575e8483caeea068504eb07bf96f52b2980bbf"}
Jun 03 23:28:59.445240 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.445198    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kp78\" (UniqueName: \"kubernetes.io/projected/c14ed454-99e1-4ba3-9903-e06e3647feef-kube-api-access-5kp78\") pod \"alertmanager-main-0\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:28:59.527477 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:28:59.527439    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:29:00.147823 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.146879    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 23:29:00.171786 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:29:00.171747    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc14ed454_99e1_4ba3_9903_e06e3647feef.slice/crio-bb5ff44f99dc85102c68405f14e3e3119e92bfb57cbe90d0821d5b78b560ec86 WatchSource:0}: Error finding container bb5ff44f99dc85102c68405f14e3e3119e92bfb57cbe90d0821d5b78b560ec86: Status 404 returned error can't find the container with id bb5ff44f99dc85102c68405f14e3e3119e92bfb57cbe90d0821d5b78b560ec86
Jun 03 23:29:00.231680 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.231608    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"]
Jun 03 23:29:00.235157 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.235137    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.238052 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.238028    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 03 23:29:00.238750 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.238630    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 03 23:29:00.238750 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.238713    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-96t9154gs9r8b\""
Jun 03 23:29:00.238920 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.238841    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 03 23:29:00.239134 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.239009    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 03 23:29:00.239134 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.239059    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ssshj\""
Jun 03 23:29:00.239134 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.239063    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 03 23:29:00.270716 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.270689    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"]
Jun 03 23:29:00.343397 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.343368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.343560 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.343400    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.343560 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.343435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-thanos-querier-tls\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.343560 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.343454    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8e72b98-3ff9-449b-83a4-7e477779a080-metrics-client-ca\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.343560 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.343477    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.343560 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.343530    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnqlt\" (UniqueName: \"kubernetes.io/projected/c8e72b98-3ff9-449b-83a4-7e477779a080-kube-api-access-pnqlt\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.343732 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.343559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.343732 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.343625    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-grpc-tls\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.444199 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.444162    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.444385 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.444207    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnqlt\" (UniqueName: \"kubernetes.io/projected/c8e72b98-3ff9-449b-83a4-7e477779a080-kube-api-access-pnqlt\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.444385 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.444241    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.444385 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.444335    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-grpc-tls\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.444385 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.444363    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.444606 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.444389    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.444606 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.444434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-thanos-querier-tls\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.444606 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.444461    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8e72b98-3ff9-449b-83a4-7e477779a080-metrics-client-ca\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.445149 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.445128    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8e72b98-3ff9-449b-83a4-7e477779a080-metrics-client-ca\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.446404 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.446388    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 03 23:29:00.446404 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.446400    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 03 23:29:00.446552 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.446388    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-96t9154gs9r8b\""
Jun 03 23:29:00.446640 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.446619    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 03 23:29:00.446754 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.446680    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 03 23:29:00.446754 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.446708    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 03 23:29:00.449797 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.449775    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp" event={"ID":"120fa87d-2b5d-434c-af7c-63394b120b54","Type":"ContainerStarted","Data":"977c6317fef60a88a0296e3f9cc673811e28f5f998b05d22b02581edc0437fdb"}
Jun 03 23:29:00.451408 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.451386    2561 generic.go:356] "Generic (PLEG): container finished" podID="719ba6b8-8607-4094-9323-fe570d677c7e" containerID="bdb57c2ed5bb6ebed895c9a17f9eaba69d286c600f2088892457a33449f76ebc" exitCode=0
Jun 03 23:29:00.451497 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.451475    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79ctc" event={"ID":"719ba6b8-8607-4094-9323-fe570d677c7e","Type":"ContainerDied","Data":"bdb57c2ed5bb6ebed895c9a17f9eaba69d286c600f2088892457a33449f76ebc"}
Jun 03 23:29:00.453922 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.453888    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8" event={"ID":"43f297f3-5920-4ee3-b54b-ecfaaee92f83","Type":"ContainerStarted","Data":"9111ff8bee59fa0b2d7981fad5ecf8d2ac1640b12c46924e48b4a93d705bfb00"}
Jun 03 23:29:00.454001 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.453946    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8" event={"ID":"43f297f3-5920-4ee3-b54b-ecfaaee92f83","Type":"ContainerStarted","Data":"0de8b8e5791011676446ab298732fd3fe2baa7ed380511c4eb9bc1ad819238cd"}
Jun 03 23:29:00.454001 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.453975    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8" event={"ID":"43f297f3-5920-4ee3-b54b-ecfaaee92f83","Type":"ContainerStarted","Data":"e7f505bf5ffa62e97e3f041060d6a0c7fc247019533309fa703dd1d3e0de79cb"}
Jun 03 23:29:00.454144 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.454067    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnqlt\" (UniqueName: \"kubernetes.io/projected/c8e72b98-3ff9-449b-83a4-7e477779a080-kube-api-access-pnqlt\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.455876 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.455694    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14ed454-99e1-4ba3-9903-e06e3647feef","Type":"ContainerStarted","Data":"bb5ff44f99dc85102c68405f14e3e3119e92bfb57cbe90d0821d5b78b560ec86"}
Jun 03 23:29:00.456987 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.456957    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.457111 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.457091    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.457645 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.457621    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-thanos-querier-tls\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.457893 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.457866    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.458064 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.458045    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-grpc-tls\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.458745 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.458724    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8e72b98-3ff9-449b-83a4-7e477779a080-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c768cc9d9-zg4bw\" (UID: \"c8e72b98-3ff9-449b-83a4-7e477779a080\") " pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.469342 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.469244    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-6xxxp" podStartSLOduration=1.176172596 podStartE2EDuration="2.469229714s" totalImagesPullingTime="1.293057118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:00.468009053 +0000 UTC m=+300.366911306" watchObservedRunningTime="2026-06-03 23:29:00.469229714 +0000 UTC m=+300.368131968"
Jun 03 23:29:00.510192 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.510044    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-79fb7d47d4-rlbs8" podStartSLOduration=1.125266308 podStartE2EDuration="2.510023009s" totalImagesPullingTime="1.384756701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:00.508204531 +0000 UTC m=+300.407106784" watchObservedRunningTime="2026-06-03 23:29:00.510023009 +0000 UTC m=+300.408925279"
Jun 03 23:29:00.517315 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.517295    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:29:00.521077 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.521061    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:29:00.522702 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.522682    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jun 03 23:29:00.548112 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.548095    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ssshj\""
Jun 03 23:29:00.555982 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.555955    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:00.701317 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:00.701292    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"]
Jun 03 23:29:00.703409 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:29:00.703386    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8e72b98_3ff9_449b_83a4_7e477779a080.slice/crio-8a689e1f25f81fdbe48d5ad9245e6d9acd0b9d529a24d184420bc3ea77165169 WatchSource:0}: Error finding container 8a689e1f25f81fdbe48d5ad9245e6d9acd0b9d529a24d184420bc3ea77165169: Status 404 returned error can't find the container with id 8a689e1f25f81fdbe48d5ad9245e6d9acd0b9d529a24d184420bc3ea77165169
Jun 03 23:29:01.121464 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:01.121429    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:01.187133 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:01.187098    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:01.284598 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:01.284573    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:01.385629 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:01.385569    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:01.462573 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:01.462542    2561 generic.go:356] "Generic (PLEG): container finished" podID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerID="f15368448ee73b62593a081a1bab61b787ca9a4bbd6f29f95c6185dcfbc539ad" exitCode=0
Jun 03 23:29:01.462720 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:01.462640    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14ed454-99e1-4ba3-9903-e06e3647feef","Type":"ContainerDied","Data":"f15368448ee73b62593a081a1bab61b787ca9a4bbd6f29f95c6185dcfbc539ad"}
Jun 03 23:29:01.464247 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:01.464227    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 23:29:01.465405 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:01.465381    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79ctc" event={"ID":"719ba6b8-8607-4094-9323-fe570d677c7e","Type":"ContainerStarted","Data":"639f22a40e591083a27c4fc49ff9639132a73f138618c9eef62bdce2b34026c6"}
Jun 03 23:29:01.465510 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:01.465433    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79ctc" event={"ID":"719ba6b8-8607-4094-9323-fe570d677c7e","Type":"ContainerStarted","Data":"9e055cb56bf03bce946da5e8e0aabd1936735d400538cd7e7f8711be6fce45f1"}
Jun 03 23:29:01.467416 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:01.467390    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw" event={"ID":"c8e72b98-3ff9-449b-83a4-7e477779a080","Type":"ContainerStarted","Data":"8a689e1f25f81fdbe48d5ad9245e6d9acd0b9d529a24d184420bc3ea77165169"}
Jun 03 23:29:01.536518 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:01.536424    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-79ctc" podStartSLOduration=2.510669434 podStartE2EDuration="3.536408199s" totalImagesPullingTime="934.64014ms" totalInitContainerRuntime="91.098625ms" isStatefulPod=true podCreationTimestamp="2026-06-03 23:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:01.536083161 +0000 UTC m=+301.434985428" watchObservedRunningTime="2026-06-03 23:29:01.536408199 +0000 UTC m=+301.435310452"
Jun 03 23:29:02.883628 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:02.883583    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:03.480114 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:03.480041    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw" event={"ID":"c8e72b98-3ff9-449b-83a4-7e477779a080","Type":"ContainerStarted","Data":"626efc9740b7d7091835e13d7f97f7c76525757901f8198588970742ac49efcf"}
Jun 03 23:29:03.480229 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:03.480149    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw" event={"ID":"c8e72b98-3ff9-449b-83a4-7e477779a080","Type":"ContainerStarted","Data":"28f6fa8dd85272866ce6e12c286cc111a4930fbba633d5309371b9a5cd3f51b9"}
Jun 03 23:29:03.480528 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:03.480503    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw" event={"ID":"c8e72b98-3ff9-449b-83a4-7e477779a080","Type":"ContainerStarted","Data":"1c7dcf7cd6c65a6b0d7f530c6e4602613866697bac40a61e5fb175dca0b0b23b"}
Jun 03 23:29:03.483240 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:03.483217    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14ed454-99e1-4ba3-9903-e06e3647feef","Type":"ContainerStarted","Data":"66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba"}
Jun 03 23:29:03.483345 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:03.483291    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14ed454-99e1-4ba3-9903-e06e3647feef","Type":"ContainerStarted","Data":"1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91"}
Jun 03 23:29:03.483345 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:03.483336    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14ed454-99e1-4ba3-9903-e06e3647feef","Type":"ContainerStarted","Data":"13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f"}
Jun 03 23:29:03.893175 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:03.893089    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:04.435115 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.435090    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:04.445791 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.445767    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 23:29:04.451322 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.451301    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.453853 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.453831    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jun 03 23:29:04.453974 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.453874    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p2cwl\""
Jun 03 23:29:04.454044 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.453982    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 03 23:29:04.454044 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.454006    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 03 23:29:04.454144 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.454117    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 03 23:29:04.454198 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.454184    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2rolk9cfgqkiu\""
Jun 03 23:29:04.454198 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.454191    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 03 23:29:04.454306 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.454194    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 03 23:29:04.454717 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.454701    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 03 23:29:04.455359 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.455343    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 03 23:29:04.455416 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.455349    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 03 23:29:04.455915 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.455899    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jun 03 23:29:04.455986 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.455964    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 03 23:29:04.456045 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.456024    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 03 23:29:04.456735 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.456709    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 03 23:29:04.457842 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.457825    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 03 23:29:04.460912 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.460892    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 03 23:29:04.468541 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.468521    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 23:29:04.485173 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485136    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485173 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485436 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485199    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-web-config\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485436 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485228    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485436 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485261    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485436 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485339    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485436 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485363    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485436 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485391    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485436 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485414    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485436 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485442    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485865 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485539    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsv8c\" (UniqueName: \"kubernetes.io/projected/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-kube-api-access-tsv8c\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485865 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485578    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-config-out\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485865 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485606    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485865 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485634    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-config\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485865 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485709    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485865 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485735    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485865 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485766    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.485865 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.486261 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485884    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.486261 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.485927    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.496049 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.496025    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14ed454-99e1-4ba3-9903-e06e3647feef","Type":"ContainerStarted","Data":"dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68"}
Jun 03 23:29:04.496144 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.496110    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14ed454-99e1-4ba3-9903-e06e3647feef","Type":"ContainerStarted","Data":"92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00"}
Jun 03 23:29:04.586633 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.586594    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-web-config\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.586633 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.586638    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.586774 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.586662    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.586774 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.586691    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.586774 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.586717    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.586774 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.586743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.586964 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.586793    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.586964 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.586836    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.586964 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.586876    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsv8c\" (UniqueName: \"kubernetes.io/projected/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-kube-api-access-tsv8c\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.586964 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.586898    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-config-out\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.586964 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.586922    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.587223 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.586967    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-config\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.587223 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.587030    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.587223 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.587056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.587223 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.587087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.587223 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.587119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.587223 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.587153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.587223 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.587198    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.587576 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.587239    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.587576 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.587284    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.587576 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.587378    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.587576 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.587541    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.587764 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.587634    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.589164 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.588249    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.589164 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.588256    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.589741 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.589647    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.589741 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.589693    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.590213 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.590156    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-web-config\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.590926 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.590882    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.591024 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.590968    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.591415 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.591373    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.591831 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.591806    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.592458 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.592409    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.592458 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.592447    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-config-out\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.593104 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.593079    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.593517 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.593488    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.593674 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.593657    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.593818 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.593800    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.593961 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.593936    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-config\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.599374 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.599354    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsv8c\" (UniqueName: \"kubernetes.io/projected/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-kube-api-access-tsv8c\") pod \"prometheus-k8s-0\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.664858 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.664825    2561 patch_prober.go:28] interesting pod/image-registry-7957c84c47-rxbwx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 03 23:29:04.665064 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.664876    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx" podUID="415dd3b3-ef9d-49bd-af0b-751c5625e386" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 23:29:04.789724 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.789687    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:04.931756 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:04.931734    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 23:29:04.933704 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:29:04.933676    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod055bbb9b_e2e3_4dd3_976b_f0af5d7a06cc.slice/crio-14aca0a0bbf23ce153899b98c17fba170a285a8535debf77db16e66936a5a786 WatchSource:0}: Error finding container 14aca0a0bbf23ce153899b98c17fba170a285a8535debf77db16e66936a5a786: Status 404 returned error can't find the container with id 14aca0a0bbf23ce153899b98c17fba170a285a8535debf77db16e66936a5a786
Jun 03 23:29:05.502795 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:05.502758    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw" event={"ID":"c8e72b98-3ff9-449b-83a4-7e477779a080","Type":"ContainerStarted","Data":"4db628b6879efd06fdda3bafe6a4e696b31758eee030d2014d56419fef5d9991"}
Jun 03 23:29:05.502981 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:05.502841    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw" event={"ID":"c8e72b98-3ff9-449b-83a4-7e477779a080","Type":"ContainerStarted","Data":"55c81fb4bd164bc3f6e125cb52323550f7256ed37d2c9a40e10d22de55dc144a"}
Jun 03 23:29:05.502981 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:05.502886    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw" event={"ID":"c8e72b98-3ff9-449b-83a4-7e477779a080","Type":"ContainerStarted","Data":"8f16a6435e96a5da0e8a122b0821f44d6d802b125eec0f8d319f9b59b6e23cf3"}
Jun 03 23:29:05.503080 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:05.503017    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:05.505873 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:05.505846    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14ed454-99e1-4ba3-9903-e06e3647feef","Type":"ContainerStarted","Data":"1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a"}
Jun 03 23:29:05.507441 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:05.507418    2561 generic.go:356] "Generic (PLEG): container finished" podID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerID="0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6" exitCode=0
Jun 03 23:29:05.507558 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:05.507478    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc","Type":"ContainerDied","Data":"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6"}
Jun 03 23:29:05.507558 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:05.507530    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc","Type":"ContainerStarted","Data":"14aca0a0bbf23ce153899b98c17fba170a285a8535debf77db16e66936a5a786"}
Jun 03 23:29:05.521966 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:05.521939    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:29:05.530984 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:05.530937    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw" podStartSLOduration=2.028422944 podStartE2EDuration="5.530918941s" totalImagesPullingTime="3.502495997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:05.52999348 +0000 UTC m=+305.428895732" watchObservedRunningTime="2026-06-03 23:29:05.530918941 +0000 UTC m=+305.429821197"
Jun 03 23:29:05.563845 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:05.563799    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.823167948 podStartE2EDuration="6.563787154s" totalImagesPullingTime="3.72594685s" totalInitContainerRuntime="14.672356ms" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:05.56162537 +0000 UTC m=+305.460527623" watchObservedRunningTime="2026-06-03 23:29:05.563787154 +0000 UTC m=+305.462689407"
Jun 03 23:29:07.093152 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:07.093117    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7957c84c47-rxbwx"]
Jun 03 23:29:07.098155 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:07.098123    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:29:07.181912 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:07.181881    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:07.244237 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:07.244208    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:07.334472 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:07.334444    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:07.435545 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:07.435469    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:07.534454 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:07.534411    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:07.600423 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:07.600393    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:09.530590 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:09.530563    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc","Type":"ContainerStarted","Data":"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3"}
Jun 03 23:29:09.530933 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:09.530654    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc","Type":"ContainerStarted","Data":"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45"}
Jun 03 23:29:09.530933 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:09.530702    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc","Type":"ContainerStarted","Data":"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0"}
Jun 03 23:29:09.530933 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:09.530744    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc","Type":"ContainerStarted","Data":"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a"}
Jun 03 23:29:10.543061 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:10.543024    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc","Type":"ContainerStarted","Data":"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13"}
Jun 03 23:29:10.543442 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:10.543129    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc","Type":"ContainerStarted","Data":"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6"}
Jun 03 23:29:10.576109 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:10.576045    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.85147084 podStartE2EDuration="6.576006013s" totalImagesPullingTime="3.705455736s" totalInitContainerRuntime="19.079437ms" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:10.575099726 +0000 UTC m=+310.474002033" watchObservedRunningTime="2026-06-03 23:29:10.576006013 +0000 UTC m=+310.474908267"
Jun 03 23:29:11.519666 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:11.519639    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-c768cc9d9-zg4bw"
Jun 03 23:29:11.995573 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:11.995539    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:12.090323 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:12.090260    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:12.146016 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:12.145984    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:12.311671 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:12.311579    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:12.512182 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:12.512150    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:12.612122 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:12.612046    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:13.294704 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:13.294676    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:13.393966 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:13.393936    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:13.493255 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:13.493224    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:13.701074 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:13.700992    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:13.798116 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:13.798088    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:14.072812 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:14.072783    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:14.790457 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:14.790422    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:29:15.883515 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:15.883484    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:15.942660 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:15.942631    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:19.164123 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:19.164090    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:19.253126 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:19.253091    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:23.788870 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:23.788837    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:23.846587 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:23.846561    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:24.601172 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:24.601098    2561 generic.go:356] "Generic (PLEG): container finished" podID="e6b70489-bf56-47d9-b873-eaa3aa386f4c" containerID="e3e0a92f860245134c9aa585ead345e869c5a44449f428b3488b020e53482aba" exitCode=0
Jun 03 23:29:24.601172 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:24.601145    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-vrf65" event={"ID":"e6b70489-bf56-47d9-b873-eaa3aa386f4c","Type":"ContainerDied","Data":"e3e0a92f860245134c9aa585ead345e869c5a44449f428b3488b020e53482aba"}
Jun 03 23:29:24.601488 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:24.601474    2561 scope.go:117] "RemoveContainer" containerID="e3e0a92f860245134c9aa585ead345e869c5a44449f428b3488b020e53482aba"
Jun 03 23:29:24.967431 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:24.967392    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:25.068828 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:25.068788    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:25.609555 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:25.609526    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-69684796bc-vrf65" event={"ID":"e6b70489-bf56-47d9-b873-eaa3aa386f4c","Type":"ContainerStarted","Data":"6805ad46dec9c17cac87f2e8f3accab3e7bf86286ce0ffdbb5b3d50e03bed6b6"}
Jun 03 23:29:26.025787 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:26.025741    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mqj5m_5396ae25-295d-49a4-8b66-3fe3ecefdfe4/dns/0.log"
Jun 03 23:29:26.227984 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:26.227959    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mqj5m_5396ae25-295d-49a4-8b66-3fe3ecefdfe4/kube-rbac-proxy/0.log"
Jun 03 23:29:26.425488 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:26.425404    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-95bsc_d5772818-6f15-419b-b75d-7b8787218fcc/dns-node-resolver/0.log"
Jun 03 23:29:27.488761 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:27.488724    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:27.547557 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:27.547531    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:27.625543 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:27.625520    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xrmc4_7165ed2f-9fbf-4c4a-89b7-9e46e653cb82/serve-healthcheck-canary/0.log"
Jun 03 23:29:30.284366 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:30.284337    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:30.336739 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:30.336704    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:32.116314 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.116254    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx" podUID="415dd3b3-ef9d-49bd-af0b-751c5625e386" containerName="registry" containerID="cri-o://fc53f09e89c3ca5919807c68abf7a104efbc1afd7377ebca1a2dd03f8004090f" gracePeriod=30
Jun 03 23:29:32.369737 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.369680    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:29:32.436122 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.436095    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-certificates\") pod \"415dd3b3-ef9d-49bd-af0b-751c5625e386\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") "
Jun 03 23:29:32.436254 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.436149    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls\") pod \"415dd3b3-ef9d-49bd-af0b-751c5625e386\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") "
Jun 03 23:29:32.436254 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.436187    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/415dd3b3-ef9d-49bd-af0b-751c5625e386-ca-trust-extracted\") pod \"415dd3b3-ef9d-49bd-af0b-751c5625e386\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") "
Jun 03 23:29:32.436254 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.436239    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/415dd3b3-ef9d-49bd-af0b-751c5625e386-installation-pull-secrets\") pod \"415dd3b3-ef9d-49bd-af0b-751c5625e386\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") "
Jun 03 23:29:32.436422 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.436303    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/415dd3b3-ef9d-49bd-af0b-751c5625e386-trusted-ca\") pod \"415dd3b3-ef9d-49bd-af0b-751c5625e386\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") "
Jun 03 23:29:32.436422 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.436344    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/415dd3b3-ef9d-49bd-af0b-751c5625e386-image-registry-private-configuration\") pod \"415dd3b3-ef9d-49bd-af0b-751c5625e386\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") "
Jun 03 23:29:32.436422 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.436405    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pnq2\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-kube-api-access-4pnq2\") pod \"415dd3b3-ef9d-49bd-af0b-751c5625e386\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") "
Jun 03 23:29:32.436580 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.436432    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-bound-sa-token\") pod \"415dd3b3-ef9d-49bd-af0b-751c5625e386\" (UID: \"415dd3b3-ef9d-49bd-af0b-751c5625e386\") "
Jun 03 23:29:32.436786 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.436717    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/415dd3b3-ef9d-49bd-af0b-751c5625e386-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "415dd3b3-ef9d-49bd-af0b-751c5625e386" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 23:29:32.436909 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.436856    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "415dd3b3-ef9d-49bd-af0b-751c5625e386" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 23:29:32.438898 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.438870    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/415dd3b3-ef9d-49bd-af0b-751c5625e386-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "415dd3b3-ef9d-49bd-af0b-751c5625e386" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:29:32.438982 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.438917    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "415dd3b3-ef9d-49bd-af0b-751c5625e386" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 23:29:32.439042 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.438994    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-kube-api-access-4pnq2" (OuterVolumeSpecName: "kube-api-access-4pnq2") pod "415dd3b3-ef9d-49bd-af0b-751c5625e386" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386"). InnerVolumeSpecName "kube-api-access-4pnq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 23:29:32.439042 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.439003    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/415dd3b3-ef9d-49bd-af0b-751c5625e386-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "415dd3b3-ef9d-49bd-af0b-751c5625e386" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:29:32.439042 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.439001    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "415dd3b3-ef9d-49bd-af0b-751c5625e386" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 23:29:32.444867 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.444844    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/415dd3b3-ef9d-49bd-af0b-751c5625e386-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "415dd3b3-ef9d-49bd-af0b-751c5625e386" (UID: "415dd3b3-ef9d-49bd-af0b-751c5625e386"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 23:29:32.537933 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.537913    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/415dd3b3-ef9d-49bd-af0b-751c5625e386-installation-pull-secrets\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:29:32.537933 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.537934    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/415dd3b3-ef9d-49bd-af0b-751c5625e386-trusted-ca\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:29:32.538052 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.537943    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/415dd3b3-ef9d-49bd-af0b-751c5625e386-image-registry-private-configuration\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:29:32.538052 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.537953    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pnq2\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-kube-api-access-4pnq2\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:29:32.538052 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.537962    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-bound-sa-token\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:29:32.538052 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.537969    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-certificates\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:29:32.538052 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.537977    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/415dd3b3-ef9d-49bd-af0b-751c5625e386-registry-tls\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:29:32.538052 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.537986    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/415dd3b3-ef9d-49bd-af0b-751c5625e386-ca-trust-extracted\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:29:32.638428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.638367    2561 generic.go:356] "Generic (PLEG): container finished" podID="415dd3b3-ef9d-49bd-af0b-751c5625e386" containerID="fc53f09e89c3ca5919807c68abf7a104efbc1afd7377ebca1a2dd03f8004090f" exitCode=0
Jun 03 23:29:32.638428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.638407    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx"
Jun 03 23:29:32.638541 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.638450    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx" event={"ID":"415dd3b3-ef9d-49bd-af0b-751c5625e386","Type":"ContainerDied","Data":"fc53f09e89c3ca5919807c68abf7a104efbc1afd7377ebca1a2dd03f8004090f"}
Jun 03 23:29:32.638541 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.638499    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7957c84c47-rxbwx" event={"ID":"415dd3b3-ef9d-49bd-af0b-751c5625e386","Type":"ContainerDied","Data":"8d6fe365ded12e07517a20c8fbdfe7658dec2bb985a55424947c5f2bea6ee076"}
Jun 03 23:29:32.638541 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.638524    2561 scope.go:117] "RemoveContainer" containerID="fc53f09e89c3ca5919807c68abf7a104efbc1afd7377ebca1a2dd03f8004090f"
Jun 03 23:29:32.646711 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.646691    2561 scope.go:117] "RemoveContainer" containerID="fc53f09e89c3ca5919807c68abf7a104efbc1afd7377ebca1a2dd03f8004090f"
Jun 03 23:29:32.646979 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:29:32.646955    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc53f09e89c3ca5919807c68abf7a104efbc1afd7377ebca1a2dd03f8004090f\": container with ID starting with fc53f09e89c3ca5919807c68abf7a104efbc1afd7377ebca1a2dd03f8004090f not found: ID does not exist" containerID="fc53f09e89c3ca5919807c68abf7a104efbc1afd7377ebca1a2dd03f8004090f"
Jun 03 23:29:32.647030 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.646989    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc53f09e89c3ca5919807c68abf7a104efbc1afd7377ebca1a2dd03f8004090f"} err="failed to get container status \"fc53f09e89c3ca5919807c68abf7a104efbc1afd7377ebca1a2dd03f8004090f\": rpc error: code = NotFound desc = could not find container \"fc53f09e89c3ca5919807c68abf7a104efbc1afd7377ebca1a2dd03f8004090f\": container with ID starting with fc53f09e89c3ca5919807c68abf7a104efbc1afd7377ebca1a2dd03f8004090f not found: ID does not exist"
Jun 03 23:29:32.653264 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.653242    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7957c84c47-rxbwx"]
Jun 03 23:29:32.659089 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:32.659067    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7957c84c47-rxbwx"]
Jun 03 23:29:34.527586 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:34.527553    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="415dd3b3-ef9d-49bd-af0b-751c5625e386" path="/var/lib/kubelet/pods/415dd3b3-ef9d-49bd-af0b-751c5625e386/volumes"
Jun 03 23:29:34.653081 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:34.653045    2561 generic.go:356] "Generic (PLEG): container finished" podID="1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa" containerID="5dfc32819440ebf956279d1ee2b645c7d393d05b842ac2a6b6bf481d8f206629" exitCode=0
Jun 03 23:29:34.653217 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:34.653117    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn" event={"ID":"1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa","Type":"ContainerDied","Data":"5dfc32819440ebf956279d1ee2b645c7d393d05b842ac2a6b6bf481d8f206629"}
Jun 03 23:29:34.653448 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:34.653433    2561 scope.go:117] "RemoveContainer" containerID="5dfc32819440ebf956279d1ee2b645c7d393d05b842ac2a6b6bf481d8f206629"
Jun 03 23:29:35.660392 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:35.660357    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-frrsn" event={"ID":"1b69a0f4-6bd9-4e01-8a45-9e3f1752cafa","Type":"ContainerStarted","Data":"a43365978391d67f0357a9d7605af308ba7866ed96683a201657b35305f9c6a0"}
Jun 03 23:29:35.711197 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:35.711168    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:35.807424 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:35.807390    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:38.286716 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:38.286687    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:38.356536 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:38.356423    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:38.785358 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:38.785326    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:38.852863 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:38.852832    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:39.521474 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:39.521425    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:39.623284 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:39.623230    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:39.684396 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:39.684352    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:45.838632 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:45.838575    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:45.938748 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:45.938719    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:45.994467 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:45.994440    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:49.720145 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:49.720114    2561 generic.go:356] "Generic (PLEG): container finished" podID="7de16cf1-50d0-45d3-9910-e6576f3574d8" containerID="e4bc55bd11cf37a231884400f9360c8dba84a226af2b21d24c790990349297ef" exitCode=0
Jun 03 23:29:49.720565 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:49.720195    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf" event={"ID":"7de16cf1-50d0-45d3-9910-e6576f3574d8","Type":"ContainerDied","Data":"e4bc55bd11cf37a231884400f9360c8dba84a226af2b21d24c790990349297ef"}
Jun 03 23:29:49.720565 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:49.720511    2561 scope.go:117] "RemoveContainer" containerID="e4bc55bd11cf37a231884400f9360c8dba84a226af2b21d24c790990349297ef"
Jun 03 23:29:50.725437 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:50.725408    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf" event={"ID":"7de16cf1-50d0-45d3-9910-e6576f3574d8","Type":"ContainerStarted","Data":"402fb12452968a276d113486e9a3aefe9aa509f3957e75943d6b59942ecfd265"}
Jun 03 23:29:52.539948 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:52.539914    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:52.640711 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:52.640685    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:53.798580 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:53.798542    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:29:53.862571 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:29:53.862544    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:30:04.789844 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:04.789809    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:04.809575 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:04.809552    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:05.801305 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:05.801262    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:14.394363 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:14.394315    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs\") pod \"network-metrics-daemon-5t7nh\" (UID: \"2be4b6b6-ca95-4f1f-afce-1ff311ee9989\") " pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:30:14.396608 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:14.396580    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2be4b6b6-ca95-4f1f-afce-1ff311ee9989-metrics-certs\") pod \"network-metrics-daemon-5t7nh\" (UID: \"2be4b6b6-ca95-4f1f-afce-1ff311ee9989\") " pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:30:14.524809 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:14.524788    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8mqss\""
Jun 03 23:30:14.533516 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:14.533496    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5t7nh"
Jun 03 23:30:14.660634 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:14.660604    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5t7nh"]
Jun 03 23:30:14.662914 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:30:14.662880    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2be4b6b6_ca95_4f1f_afce_1ff311ee9989.slice/crio-9b526df6ee75a165bc086fabcbe4cc733d025221508ca3593e4f0337caf5a5f8 WatchSource:0}: Error finding container 9b526df6ee75a165bc086fabcbe4cc733d025221508ca3593e4f0337caf5a5f8: Status 404 returned error can't find the container with id 9b526df6ee75a165bc086fabcbe4cc733d025221508ca3593e4f0337caf5a5f8
Jun 03 23:30:14.820985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:14.820952    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5t7nh" event={"ID":"2be4b6b6-ca95-4f1f-afce-1ff311ee9989","Type":"ContainerStarted","Data":"9b526df6ee75a165bc086fabcbe4cc733d025221508ca3593e4f0337caf5a5f8"}
Jun 03 23:30:15.827049 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:15.827018    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5t7nh" event={"ID":"2be4b6b6-ca95-4f1f-afce-1ff311ee9989","Type":"ContainerStarted","Data":"035b95edd4a51813976ca67e6ce8266bfc4385c51589be15330fb556272bd9cb"}
Jun 03 23:30:15.827441 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:15.827068    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5t7nh" event={"ID":"2be4b6b6-ca95-4f1f-afce-1ff311ee9989","Type":"ContainerStarted","Data":"55f8c19fc0ac37218a58b98e5552e065169b1bc511d2fa3754247d948d246c90"}
Jun 03 23:30:15.946970 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:15.946937    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:30:16.008225 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:16.008190    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:30:17.426214 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:17.426179    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:30:17.745638 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:17.745606    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:30:18.500286 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:18.500211    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5t7nh" podStartSLOduration=377.707170391 podStartE2EDuration="6m18.500194025s" totalImagesPullingTime="793.023634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:30:15.843844193 +0000 UTC m=+375.742746458" watchObservedRunningTime="2026-06-03 23:30:18.500194025 +0000 UTC m=+378.399096275"
Jun 03 23:30:18.500630 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:18.500586    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 23:30:18.500854 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:18.500832    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="alertmanager" containerID="cri-o://13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f" gracePeriod=120
Jun 03 23:30:18.500934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:18.500899    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="kube-rbac-proxy-metric" containerID="cri-o://dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68" gracePeriod=120
Jun 03 23:30:18.500934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:18.500911    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="kube-rbac-proxy-web" containerID="cri-o://66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba" gracePeriod=120
Jun 03 23:30:18.501112 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:18.500959    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="prom-label-proxy" containerID="cri-o://1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a" gracePeriod=120
Jun 03 23:30:18.501112 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:18.500993    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="kube-rbac-proxy" containerID="cri-o://92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00" gracePeriod=120
Jun 03 23:30:18.501112 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:18.500989    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="config-reloader" containerID="cri-o://1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91" gracePeriod=120
Jun 03 23:30:18.842175 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:18.842095    2561 generic.go:356] "Generic (PLEG): container finished" podID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerID="1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a" exitCode=0
Jun 03 23:30:18.842175 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:18.842118    2561 generic.go:356] "Generic (PLEG): container finished" podID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerID="92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00" exitCode=0
Jun 03 23:30:18.842175 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:18.842125    2561 generic.go:356] "Generic (PLEG): container finished" podID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerID="1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91" exitCode=0
Jun 03 23:30:18.842175 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:18.842130    2561 generic.go:356] "Generic (PLEG): container finished" podID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerID="13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f" exitCode=0
Jun 03 23:30:18.842175 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:18.842151    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14ed454-99e1-4ba3-9903-e06e3647feef","Type":"ContainerDied","Data":"1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a"}
Jun 03 23:30:18.842444 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:18.842199    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14ed454-99e1-4ba3-9903-e06e3647feef","Type":"ContainerDied","Data":"92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00"}
Jun 03 23:30:18.842444 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:18.842225    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14ed454-99e1-4ba3-9903-e06e3647feef","Type":"ContainerDied","Data":"1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91"}
Jun 03 23:30:18.842444 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:18.842248    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14ed454-99e1-4ba3-9903-e06e3647feef","Type":"ContainerDied","Data":"13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f"}
Jun 03 23:30:19.755621 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.755597    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:19.841550 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.841467    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy-web\") pod \"c14ed454-99e1-4ba3-9903-e06e3647feef\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") "
Jun 03 23:30:19.841550 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.841527    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c14ed454-99e1-4ba3-9903-e06e3647feef-alertmanager-trusted-ca-bundle\") pod \"c14ed454-99e1-4ba3-9903-e06e3647feef\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") "
Jun 03 23:30:19.841763 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.841555    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kp78\" (UniqueName: \"kubernetes.io/projected/c14ed454-99e1-4ba3-9903-e06e3647feef-kube-api-access-5kp78\") pod \"c14ed454-99e1-4ba3-9903-e06e3647feef\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") "
Jun 03 23:30:19.841763 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.841588    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-config-volume\") pod \"c14ed454-99e1-4ba3-9903-e06e3647feef\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") "
Jun 03 23:30:19.841763 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.841626    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c14ed454-99e1-4ba3-9903-e06e3647feef-metrics-client-ca\") pod \"c14ed454-99e1-4ba3-9903-e06e3647feef\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") "
Jun 03 23:30:19.841763 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.841651    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c14ed454-99e1-4ba3-9903-e06e3647feef-alertmanager-main-db\") pod \"c14ed454-99e1-4ba3-9903-e06e3647feef\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") "
Jun 03 23:30:19.841763 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.841695    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-web-config\") pod \"c14ed454-99e1-4ba3-9903-e06e3647feef\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") "
Jun 03 23:30:19.841763 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.841721    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c14ed454-99e1-4ba3-9903-e06e3647feef\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") "
Jun 03 23:30:19.841763 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.841747    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c14ed454-99e1-4ba3-9903-e06e3647feef-config-out\") pod \"c14ed454-99e1-4ba3-9903-e06e3647feef\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") "
Jun 03 23:30:19.842089 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.841770    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-main-tls\") pod \"c14ed454-99e1-4ba3-9903-e06e3647feef\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") "
Jun 03 23:30:19.842089 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.841805    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-cluster-tls-config\") pod \"c14ed454-99e1-4ba3-9903-e06e3647feef\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") "
Jun 03 23:30:19.842089 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.841844    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c14ed454-99e1-4ba3-9903-e06e3647feef-tls-assets\") pod \"c14ed454-99e1-4ba3-9903-e06e3647feef\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") "
Jun 03 23:30:19.842089 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.841875    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy\") pod \"c14ed454-99e1-4ba3-9903-e06e3647feef\" (UID: \"c14ed454-99e1-4ba3-9903-e06e3647feef\") "
Jun 03 23:30:19.842089 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.841956    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c14ed454-99e1-4ba3-9903-e06e3647feef-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c14ed454-99e1-4ba3-9903-e06e3647feef" (UID: "c14ed454-99e1-4ba3-9903-e06e3647feef"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 23:30:19.842089 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.842053    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c14ed454-99e1-4ba3-9903-e06e3647feef-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c14ed454-99e1-4ba3-9903-e06e3647feef" (UID: "c14ed454-99e1-4ba3-9903-e06e3647feef"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 23:30:19.842444 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.842219    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c14ed454-99e1-4ba3-9903-e06e3647feef-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c14ed454-99e1-4ba3-9903-e06e3647feef" (UID: "c14ed454-99e1-4ba3-9903-e06e3647feef"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 23:30:19.842444 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.842293    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c14ed454-99e1-4ba3-9903-e06e3647feef-metrics-client-ca\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:19.842444 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.842316    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c14ed454-99e1-4ba3-9903-e06e3647feef-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:19.844412 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.844383    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-config-volume" (OuterVolumeSpecName: "config-volume") pod "c14ed454-99e1-4ba3-9903-e06e3647feef" (UID: "c14ed454-99e1-4ba3-9903-e06e3647feef"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:30:19.844810 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.844696    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c14ed454-99e1-4ba3-9903-e06e3647feef" (UID: "c14ed454-99e1-4ba3-9903-e06e3647feef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:30:19.844810 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.844747    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14ed454-99e1-4ba3-9903-e06e3647feef-kube-api-access-5kp78" (OuterVolumeSpecName: "kube-api-access-5kp78") pod "c14ed454-99e1-4ba3-9903-e06e3647feef" (UID: "c14ed454-99e1-4ba3-9903-e06e3647feef"). InnerVolumeSpecName "kube-api-access-5kp78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 23:30:19.844810 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.844775    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c14ed454-99e1-4ba3-9903-e06e3647feef" (UID: "c14ed454-99e1-4ba3-9903-e06e3647feef"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:30:19.845195 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.845165    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c14ed454-99e1-4ba3-9903-e06e3647feef-config-out" (OuterVolumeSpecName: "config-out") pod "c14ed454-99e1-4ba3-9903-e06e3647feef" (UID: "c14ed454-99e1-4ba3-9903-e06e3647feef"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 23:30:19.845394 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.845365    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c14ed454-99e1-4ba3-9903-e06e3647feef" (UID: "c14ed454-99e1-4ba3-9903-e06e3647feef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:30:19.846778 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.846754    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14ed454-99e1-4ba3-9903-e06e3647feef-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c14ed454-99e1-4ba3-9903-e06e3647feef" (UID: "c14ed454-99e1-4ba3-9903-e06e3647feef"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 23:30:19.846870 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.846779    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c14ed454-99e1-4ba3-9903-e06e3647feef" (UID: "c14ed454-99e1-4ba3-9903-e06e3647feef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:30:19.849571 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.849551    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c14ed454-99e1-4ba3-9903-e06e3647feef" (UID: "c14ed454-99e1-4ba3-9903-e06e3647feef"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:30:19.853071 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.853044    2561 generic.go:356] "Generic (PLEG): container finished" podID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerID="dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68" exitCode=0
Jun 03 23:30:19.853169 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.853071    2561 generic.go:356] "Generic (PLEG): container finished" podID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerID="66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba" exitCode=0
Jun 03 23:30:19.853169 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.853104    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14ed454-99e1-4ba3-9903-e06e3647feef","Type":"ContainerDied","Data":"dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68"}
Jun 03 23:30:19.853307 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.853179    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14ed454-99e1-4ba3-9903-e06e3647feef","Type":"ContainerDied","Data":"66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba"}
Jun 03 23:30:19.853307 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.853223    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c14ed454-99e1-4ba3-9903-e06e3647feef","Type":"ContainerDied","Data":"bb5ff44f99dc85102c68405f14e3e3119e92bfb57cbe90d0821d5b78b560ec86"}
Jun 03 23:30:19.853307 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.853291    2561 scope.go:117] "RemoveContainer" containerID="1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a"
Jun 03 23:30:19.853478 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.853387    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:19.857825 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.857801    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-web-config" (OuterVolumeSpecName: "web-config") pod "c14ed454-99e1-4ba3-9903-e06e3647feef" (UID: "c14ed454-99e1-4ba3-9903-e06e3647feef"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:30:19.861070 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.861054    2561 scope.go:117] "RemoveContainer" containerID="dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68"
Jun 03 23:30:19.867661 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.867644    2561 scope.go:117] "RemoveContainer" containerID="92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00"
Jun 03 23:30:19.874261 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.874237    2561 scope.go:117] "RemoveContainer" containerID="66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba"
Jun 03 23:30:19.880821 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.880802    2561 scope.go:117] "RemoveContainer" containerID="1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91"
Jun 03 23:30:19.887540 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.887521    2561 scope.go:117] "RemoveContainer" containerID="13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f"
Jun 03 23:30:19.894166 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.894150    2561 scope.go:117] "RemoveContainer" containerID="f15368448ee73b62593a081a1bab61b787ca9a4bbd6f29f95c6185dcfbc539ad"
Jun 03 23:30:19.900742 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.900727    2561 scope.go:117] "RemoveContainer" containerID="1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a"
Jun 03 23:30:19.900985 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:30:19.900967    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a\": container with ID starting with 1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a not found: ID does not exist" containerID="1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a"
Jun 03 23:30:19.901029 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.900994    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a"} err="failed to get container status \"1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a\": rpc error: code = NotFound desc = could not find container \"1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a\": container with ID starting with 1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a not found: ID does not exist"
Jun 03 23:30:19.901029 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.901010    2561 scope.go:117] "RemoveContainer" containerID="dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68"
Jun 03 23:30:19.901245 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:30:19.901227    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68\": container with ID starting with dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68 not found: ID does not exist" containerID="dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68"
Jun 03 23:30:19.901395 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.901251    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68"} err="failed to get container status \"dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68\": rpc error: code = NotFound desc = could not find container \"dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68\": container with ID starting with dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68 not found: ID does not exist"
Jun 03 23:30:19.901395 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.901320    2561 scope.go:117] "RemoveContainer" containerID="92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00"
Jun 03 23:30:19.901584 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:30:19.901567    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00\": container with ID starting with 92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00 not found: ID does not exist" containerID="92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00"
Jun 03 23:30:19.901629 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.901588    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00"} err="failed to get container status \"92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00\": rpc error: code = NotFound desc = could not find container \"92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00\": container with ID starting with 92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00 not found: ID does not exist"
Jun 03 23:30:19.901629 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.901603    2561 scope.go:117] "RemoveContainer" containerID="66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba"
Jun 03 23:30:19.901840 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:30:19.901825    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba\": container with ID starting with 66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba not found: ID does not exist" containerID="66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba"
Jun 03 23:30:19.901876 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.901847    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba"} err="failed to get container status \"66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba\": rpc error: code = NotFound desc = could not find container \"66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba\": container with ID starting with 66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba not found: ID does not exist"
Jun 03 23:30:19.901876 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.901867    2561 scope.go:117] "RemoveContainer" containerID="1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91"
Jun 03 23:30:19.902075 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:30:19.902060    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91\": container with ID starting with 1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91 not found: ID does not exist" containerID="1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91"
Jun 03 23:30:19.902110 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.902079    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91"} err="failed to get container status \"1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91\": rpc error: code = NotFound desc = could not find container \"1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91\": container with ID starting with 1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91 not found: ID does not exist"
Jun 03 23:30:19.902110 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.902091    2561 scope.go:117] "RemoveContainer" containerID="13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f"
Jun 03 23:30:19.902329 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:30:19.902305    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f\": container with ID starting with 13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f not found: ID does not exist" containerID="13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f"
Jun 03 23:30:19.902413 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.902333    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f"} err="failed to get container status \"13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f\": rpc error: code = NotFound desc = could not find container \"13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f\": container with ID starting with 13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f not found: ID does not exist"
Jun 03 23:30:19.902413 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.902348    2561 scope.go:117] "RemoveContainer" containerID="f15368448ee73b62593a081a1bab61b787ca9a4bbd6f29f95c6185dcfbc539ad"
Jun 03 23:30:19.902580 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:30:19.902564    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f15368448ee73b62593a081a1bab61b787ca9a4bbd6f29f95c6185dcfbc539ad\": container with ID starting with f15368448ee73b62593a081a1bab61b787ca9a4bbd6f29f95c6185dcfbc539ad not found: ID does not exist" containerID="f15368448ee73b62593a081a1bab61b787ca9a4bbd6f29f95c6185dcfbc539ad"
Jun 03 23:30:19.902665 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.902580    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f15368448ee73b62593a081a1bab61b787ca9a4bbd6f29f95c6185dcfbc539ad"} err="failed to get container status \"f15368448ee73b62593a081a1bab61b787ca9a4bbd6f29f95c6185dcfbc539ad\": rpc error: code = NotFound desc = could not find container \"f15368448ee73b62593a081a1bab61b787ca9a4bbd6f29f95c6185dcfbc539ad\": container with ID starting with f15368448ee73b62593a081a1bab61b787ca9a4bbd6f29f95c6185dcfbc539ad not found: ID does not exist"
Jun 03 23:30:19.902665 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.902591    2561 scope.go:117] "RemoveContainer" containerID="1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a"
Jun 03 23:30:19.902799 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.902774    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a"} err="failed to get container status \"1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a\": rpc error: code = NotFound desc = could not find container \"1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a\": container with ID starting with 1ea7db9ec68c9fbb3d6cfc5cb783a161217b534e2538c7f6e58904bed9605c6a not found: ID does not exist"
Jun 03 23:30:19.902799 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.902787    2561 scope.go:117] "RemoveContainer" containerID="dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68"
Jun 03 23:30:19.902987 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.902970    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68"} err="failed to get container status \"dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68\": rpc error: code = NotFound desc = could not find container \"dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68\": container with ID starting with dfd55e964932c3c9dca9414e74c1325f743649537546b345601e8869c013fc68 not found: ID does not exist"
Jun 03 23:30:19.903029 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.902988    2561 scope.go:117] "RemoveContainer" containerID="92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00"
Jun 03 23:30:19.903180 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.903164    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00"} err="failed to get container status \"92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00\": rpc error: code = NotFound desc = could not find container \"92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00\": container with ID starting with 92e2af2d9962063675351716d2cafc40febe4d343f911bc872330ed511283a00 not found: ID does not exist"
Jun 03 23:30:19.903230 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.903179    2561 scope.go:117] "RemoveContainer" containerID="66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba"
Jun 03 23:30:19.903419 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.903401    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba"} err="failed to get container status \"66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba\": rpc error: code = NotFound desc = could not find container \"66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba\": container with ID starting with 66180e0753c3f2298c1173e87060e08d68d7ac9ebf1fd48b0b768923f757f5ba not found: ID does not exist"
Jun 03 23:30:19.903480 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.903419    2561 scope.go:117] "RemoveContainer" containerID="1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91"
Jun 03 23:30:19.903643 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.903626    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91"} err="failed to get container status \"1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91\": rpc error: code = NotFound desc = could not find container \"1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91\": container with ID starting with 1e885b0625a81e8a79942079efd8d6689ffdfe8845263a1c4d1db4f596192d91 not found: ID does not exist"
Jun 03 23:30:19.903684 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.903644    2561 scope.go:117] "RemoveContainer" containerID="13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f"
Jun 03 23:30:19.903849 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.903829    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f"} err="failed to get container status \"13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f\": rpc error: code = NotFound desc = could not find container \"13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f\": container with ID starting with 13262b79159de2a481c2b78d029a23d9a2c4f173eed78180a0509630032c960f not found: ID does not exist"
Jun 03 23:30:19.903849 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.903848    2561 scope.go:117] "RemoveContainer" containerID="f15368448ee73b62593a081a1bab61b787ca9a4bbd6f29f95c6185dcfbc539ad"
Jun 03 23:30:19.904030 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.904015    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f15368448ee73b62593a081a1bab61b787ca9a4bbd6f29f95c6185dcfbc539ad"} err="failed to get container status \"f15368448ee73b62593a081a1bab61b787ca9a4bbd6f29f95c6185dcfbc539ad\": rpc error: code = NotFound desc = could not find container \"f15368448ee73b62593a081a1bab61b787ca9a4bbd6f29f95c6185dcfbc539ad\": container with ID starting with f15368448ee73b62593a081a1bab61b787ca9a4bbd6f29f95c6185dcfbc539ad not found: ID does not exist"
Jun 03 23:30:19.943594 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.943573    2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-cluster-tls-config\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:19.943594 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.943593    2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c14ed454-99e1-4ba3-9903-e06e3647feef-tls-assets\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:19.943719 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.943603    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:19.943719 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.943612    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:19.943719 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.943621    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kp78\" (UniqueName: \"kubernetes.io/projected/c14ed454-99e1-4ba3-9903-e06e3647feef-kube-api-access-5kp78\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:19.943719 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.943629    2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-config-volume\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:19.943719 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.943637    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c14ed454-99e1-4ba3-9903-e06e3647feef-alertmanager-main-db\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:19.943719 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.943645    2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-web-config\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:19.943719 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.943653    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:19.943719 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.943661    2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c14ed454-99e1-4ba3-9903-e06e3647feef-config-out\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:19.943719 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:19.943669    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c14ed454-99e1-4ba3-9903-e06e3647feef-secret-alertmanager-main-tls\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:20.178045 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.178018    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 23:30:20.182429 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.182405    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 23:30:20.209632 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.209606    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 23:30:20.209932 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.209920    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="kube-rbac-proxy-metric"
Jun 03 23:30:20.209969 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.209934    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="kube-rbac-proxy-metric"
Jun 03 23:30:20.209969 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.209944    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="prom-label-proxy"
Jun 03 23:30:20.209969 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.209950    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="prom-label-proxy"
Jun 03 23:30:20.209969 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.209958    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="init-config-reloader"
Jun 03 23:30:20.209969 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.209964    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="init-config-reloader"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.209975    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="kube-rbac-proxy"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.209980    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="kube-rbac-proxy"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.209988    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="415dd3b3-ef9d-49bd-af0b-751c5625e386" containerName="registry"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.209993    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="415dd3b3-ef9d-49bd-af0b-751c5625e386" containerName="registry"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.210002    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="alertmanager"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.210007    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="alertmanager"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.210014    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="config-reloader"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.210018    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="config-reloader"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.210029    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="kube-rbac-proxy-web"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.210034    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="kube-rbac-proxy-web"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.210078    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="kube-rbac-proxy"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.210085    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="alertmanager"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.210093    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="415dd3b3-ef9d-49bd-af0b-751c5625e386" containerName="registry"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.210099    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="prom-label-proxy"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.210105    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="kube-rbac-proxy-web"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.210110    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="kube-rbac-proxy-metric"
Jun 03 23:30:20.210130 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.210116    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" containerName="config-reloader"
Jun 03 23:30:20.215312 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.215294    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.217832 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.217812    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 03 23:30:20.217832 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.217836    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 03 23:30:20.218001 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.217877    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 03 23:30:20.218001 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.217925    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 03 23:30:20.218001 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.217941    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nd864\""
Jun 03 23:30:20.218158 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.217813    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 03 23:30:20.218158 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.218108    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 03 23:30:20.218158 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.218125    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 03 23:30:20.218367 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.218350    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 03 23:30:20.223082 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.223065    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 03 23:30:20.228959 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.228939    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 23:30:20.345840 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.345812    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-web-config\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.345951 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.345844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.345951 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.345869    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.345951 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.345929    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.346103 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.346012    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.346103 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.346050    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbn49\" (UniqueName: \"kubernetes.io/projected/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-kube-api-access-rbn49\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.346103 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.346072    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.346237 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.346124    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.346237 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.346144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.346237 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.346214    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.346420 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.346243    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.346420 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.346325    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-config-out\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.346420 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.346357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.446862 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.446806    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.446862 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.446833    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.446862 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.446851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.447057 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.446875    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbn49\" (UniqueName: \"kubernetes.io/projected/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-kube-api-access-rbn49\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.447057 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.446988    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.447057 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.447032    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.447214 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.447059    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.447214 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.447103    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.447214 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.447129    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.447214 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.447166    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-config-out\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.447214 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.447195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.447501 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.447240    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.447501 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.447297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-web-config\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.447501 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.447325    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.448009 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.447986    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.448178 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.448148    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.450028 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.449906    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.450028 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.449985    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.450028 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.449985    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.450197 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.450026    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.450197 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.450142    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.450309 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.450197    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-config-out\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.450664 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.450641    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.450827 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.450808    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.451863 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.451844    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-web-config\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.455997 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.455979    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbn49\" (UniqueName: \"kubernetes.io/projected/0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e-kube-api-access-rbn49\") pod \"alertmanager-main-0\" (UID: \"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.524935 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.524914    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 23:30:20.527982 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.527962    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c14ed454-99e1-4ba3-9903-e06e3647feef" path="/var/lib/kubelet/pods/c14ed454-99e1-4ba3-9903-e06e3647feef/volumes"
Jun 03 23:30:20.686801 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.686780    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 23:30:20.688886 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:30:20.688856    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec6bb77_ab9d_45b3_8aaf_4b866f8c136e.slice/crio-7ffad136a0f929ebdf992a6fb2b71eded5257c19eff1fc0f6858f1f5f1713e6c WatchSource:0}: Error finding container 7ffad136a0f929ebdf992a6fb2b71eded5257c19eff1fc0f6858f1f5f1713e6c: Status 404 returned error can't find the container with id 7ffad136a0f929ebdf992a6fb2b71eded5257c19eff1fc0f6858f1f5f1713e6c
Jun 03 23:30:20.858894 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.858863    2561 generic.go:356] "Generic (PLEG): container finished" podID="0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e" containerID="b21e829a2a26cd49a1e6ee2ee5caae0ed9381029bdffaeb3d3d9953292d69db4" exitCode=0
Jun 03 23:30:20.859300 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.858949    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e","Type":"ContainerDied","Data":"b21e829a2a26cd49a1e6ee2ee5caae0ed9381029bdffaeb3d3d9953292d69db4"}
Jun 03 23:30:20.859300 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:20.859023    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e","Type":"ContainerStarted","Data":"7ffad136a0f929ebdf992a6fb2b71eded5257c19eff1fc0f6858f1f5f1713e6c"}
Jun 03 23:30:21.868191 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:21.868144    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e","Type":"ContainerStarted","Data":"78b7bc47431db54a27fce75533e2b855e0009177f64b80f5e4f64899326ae6d7"}
Jun 03 23:30:21.868709 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:21.868233    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e","Type":"ContainerStarted","Data":"aaf648e2b3d8190ed7f4de6e7d8eb4fc9c6a6dca22bc5287c5ed5fc64413622c"}
Jun 03 23:30:21.868709 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:21.868305    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e","Type":"ContainerStarted","Data":"2846b972199bfb31258c5e75aab90c14ffdd37981a4a93bf6b8932a8f1105e85"}
Jun 03 23:30:21.868709 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:21.868350    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e","Type":"ContainerStarted","Data":"5dd5ef41d10d3dbea90341311cad6ba2a71502cd5a800c5baba3abd1a3d230ef"}
Jun 03 23:30:21.868709 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:21.868393    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e","Type":"ContainerStarted","Data":"423be1dae742e784eb21e490201e270a7aa924b6cc62d81fcca3e3ad9f01e052"}
Jun 03 23:30:21.868709 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:21.868429    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e","Type":"ContainerStarted","Data":"d562f6baf669a946563efff74ad81bf0d62e029d43adfe24526140a425edc478"}
Jun 03 23:30:21.897773 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:21.897717    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.882684841 podStartE2EDuration="1.897699687s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.014846ms" isStatefulPod=false podCreationTimestamp="2026-06-03 23:30:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:30:21.895369949 +0000 UTC m=+381.794272184" watchObservedRunningTime="2026-06-03 23:30:21.897699687 +0000 UTC m=+381.796601961"
Jun 03 23:30:22.538557 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.538523    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"]
Jun 03 23:30:22.542133 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.542109    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.544442 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.544420    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xfhd9\""
Jun 03 23:30:22.544527 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.544449    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jun 03 23:30:22.544620 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.544606    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jun 03 23:30:22.544926 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.544910    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jun 03 23:30:22.544989 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.544913    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jun 03 23:30:22.545198 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.545183    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jun 03 23:30:22.549826 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.549804    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jun 03 23:30:22.558694 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.558668    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"]
Jun 03 23:30:22.666102 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.666070    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/129432be-4ef1-4e85-b007-87da70db0c26-secret-telemeter-client\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.666288 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.666119    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/129432be-4ef1-4e85-b007-87da70db0c26-metrics-client-ca\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.666288 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.666138    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/129432be-4ef1-4e85-b007-87da70db0c26-telemeter-trusted-ca-bundle\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.666288 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.666203    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65mpj\" (UniqueName: \"kubernetes.io/projected/129432be-4ef1-4e85-b007-87da70db0c26-kube-api-access-65mpj\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.666288 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.666255    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/129432be-4ef1-4e85-b007-87da70db0c26-telemeter-client-tls\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.666431 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.666331    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/129432be-4ef1-4e85-b007-87da70db0c26-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.666431 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.666381    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/129432be-4ef1-4e85-b007-87da70db0c26-serving-certs-ca-bundle\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.666431 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.666398    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/129432be-4ef1-4e85-b007-87da70db0c26-federate-client-tls\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.767430 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.767394    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/129432be-4ef1-4e85-b007-87da70db0c26-metrics-client-ca\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.767430 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.767432    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/129432be-4ef1-4e85-b007-87da70db0c26-telemeter-trusted-ca-bundle\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.767705 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.767480    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65mpj\" (UniqueName: \"kubernetes.io/projected/129432be-4ef1-4e85-b007-87da70db0c26-kube-api-access-65mpj\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.767705 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.767524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/129432be-4ef1-4e85-b007-87da70db0c26-telemeter-client-tls\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.767705 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.767563    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/129432be-4ef1-4e85-b007-87da70db0c26-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.767705 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.767623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/129432be-4ef1-4e85-b007-87da70db0c26-serving-certs-ca-bundle\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.767705 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.767647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/129432be-4ef1-4e85-b007-87da70db0c26-federate-client-tls\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.767705 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.767690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/129432be-4ef1-4e85-b007-87da70db0c26-secret-telemeter-client\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.768370 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.768341    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/129432be-4ef1-4e85-b007-87da70db0c26-metrics-client-ca\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.768483 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.768442    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/129432be-4ef1-4e85-b007-87da70db0c26-serving-certs-ca-bundle\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.768483 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.768441    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/129432be-4ef1-4e85-b007-87da70db0c26-telemeter-trusted-ca-bundle\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.770129 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.770085    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/129432be-4ef1-4e85-b007-87da70db0c26-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.770282 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.770244    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/129432be-4ef1-4e85-b007-87da70db0c26-telemeter-client-tls\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.770492 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.770473    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/129432be-4ef1-4e85-b007-87da70db0c26-secret-telemeter-client\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.770551 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.770479    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/129432be-4ef1-4e85-b007-87da70db0c26-federate-client-tls\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.775207 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.775182    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65mpj\" (UniqueName: \"kubernetes.io/projected/129432be-4ef1-4e85-b007-87da70db0c26-kube-api-access-65mpj\") pod \"telemeter-client-794dbddbc5-ngnt5\" (UID: \"129432be-4ef1-4e85-b007-87da70db0c26\") " pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.852015 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.851921    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"
Jun 03 23:30:22.852148 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.852046    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 23:30:22.852625 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.852410    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="kube-rbac-proxy-thanos" containerID="cri-o://49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13" gracePeriod=600
Jun 03 23:30:22.852625 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.852407    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="prometheus" containerID="cri-o://ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a" gracePeriod=600
Jun 03 23:30:22.852625 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.852443    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="config-reloader" containerID="cri-o://b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0" gracePeriod=600
Jun 03 23:30:22.852625 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.852490    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="kube-rbac-proxy-web" containerID="cri-o://dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3" gracePeriod=600
Jun 03 23:30:22.852625 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.852541    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="kube-rbac-proxy" containerID="cri-o://84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6" gracePeriod=600
Jun 03 23:30:22.852625 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:22.852436    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="thanos-sidecar" containerID="cri-o://eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45" gracePeriod=600
Jun 03 23:30:23.001474 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.001448    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-794dbddbc5-ngnt5"]
Jun 03 23:30:23.003145 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:30:23.003111    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod129432be_4ef1_4e85_b007_87da70db0c26.slice/crio-dac5be42a9a46dbf50b9762c6ac78fa1887f5e0e966e8847e6cdb0935d179e11 WatchSource:0}: Error finding container dac5be42a9a46dbf50b9762c6ac78fa1887f5e0e966e8847e6cdb0935d179e11: Status 404 returned error can't find the container with id dac5be42a9a46dbf50b9762c6ac78fa1887f5e0e966e8847e6cdb0935d179e11
Jun 03 23:30:23.102247 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.102185    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:23.171394 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.171368    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-0\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.171557 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.171421    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-2\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.171557 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.171439    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-kubelet-serving-ca-bundle\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.171557 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.171461    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-grpc-tls\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.171557 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.171482    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-web-config\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.171557 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.171503    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsv8c\" (UniqueName: \"kubernetes.io/projected/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-kube-api-access-tsv8c\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.171557 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.171521    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.171557 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.171560    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-serving-certs-ca-bundle\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.171934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.171896    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 23:30:23.171995 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.171930    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 23:30:23.171995 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.171980    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.172092 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.172016    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-config-out\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.172092 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.172049    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-metrics-client-certs\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.172092 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.172084    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-db\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.172244 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.172111    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-trusted-ca-bundle\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.172244 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.172135    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-config\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.172244 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.172160    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-1\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.172244 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.172210    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-metrics-client-ca\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.172244 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.172234    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-tls-assets\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.172525 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.172304    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-kube-rbac-proxy\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.172525 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.172344    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-thanos-prometheus-http-client-file\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.172525 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.172397    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-tls\") pod \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\" (UID: \"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc\") "
Jun 03 23:30:23.174558 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.172691    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.174558 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.172703    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 23:30:23.174558 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.172721    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.174558 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.173115    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 23:30:23.174558 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.173200    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 23:30:23.174558 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.173372    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 23:30:23.175839 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.175581    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 23:30:23.175839 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.175688    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 23:30:23.175839 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.175759    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:30:23.175839 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.175814    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:30:23.176184 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.176153    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:30:23.176602 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.176548    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:30:23.176602 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.176577    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-config" (OuterVolumeSpecName: "config") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:30:23.176756 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.176695    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:30:23.177024 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.177000    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-config-out" (OuterVolumeSpecName: "config-out") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 23:30:23.177248 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.177228    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:30:23.177876 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.177850    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:30:23.178109 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.178079    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-kube-api-access-tsv8c" (OuterVolumeSpecName: "kube-api-access-tsv8c") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "kube-api-access-tsv8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 23:30:23.178575 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.178551    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 23:30:23.186474 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.186453    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-web-config" (OuterVolumeSpecName: "web-config") pod "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" (UID: "055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 23:30:23.273679 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273647    2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273679 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273674    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273679 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273685    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273694    2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-grpc-tls\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273703    2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-web-config\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273712    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsv8c\" (UniqueName: \"kubernetes.io/projected/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-kube-api-access-tsv8c\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273721    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273730    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273738    2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273747    2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-config-out\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273755    2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-metrics-client-certs\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273762    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-db\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273771    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273779    2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-config\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273788    2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273796    2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-configmap-metrics-client-ca\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273806    2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-tls-assets\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.273886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.273815    2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc-secret-kube-rbac-proxy\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:30:23.884518 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.884481    2561 generic.go:356] "Generic (PLEG): container finished" podID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerID="49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13" exitCode=0
Jun 03 23:30:23.884518 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.884513    2561 generic.go:356] "Generic (PLEG): container finished" podID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerID="84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6" exitCode=0
Jun 03 23:30:23.884518 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.884525    2561 generic.go:356] "Generic (PLEG): container finished" podID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerID="dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3" exitCode=0
Jun 03 23:30:23.884810 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.884534    2561 generic.go:356] "Generic (PLEG): container finished" podID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerID="eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45" exitCode=0
Jun 03 23:30:23.884810 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.884544    2561 generic.go:356] "Generic (PLEG): container finished" podID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerID="b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0" exitCode=0
Jun 03 23:30:23.884810 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.884552    2561 generic.go:356] "Generic (PLEG): container finished" podID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerID="ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a" exitCode=0
Jun 03 23:30:23.884810 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.884578    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:23.884810 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.884604    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc","Type":"ContainerDied","Data":"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13"}
Jun 03 23:30:23.884810 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.884683    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc","Type":"ContainerDied","Data":"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6"}
Jun 03 23:30:23.884810 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.884722    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc","Type":"ContainerDied","Data":"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3"}
Jun 03 23:30:23.884810 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.884754    2561 scope.go:117] "RemoveContainer" containerID="49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13"
Jun 03 23:30:23.884810 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.884760    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc","Type":"ContainerDied","Data":"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45"}
Jun 03 23:30:23.884810 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.884797    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc","Type":"ContainerDied","Data":"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0"}
Jun 03 23:30:23.885223 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.884830    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc","Type":"ContainerDied","Data":"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a"}
Jun 03 23:30:23.885223 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.884855    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc","Type":"ContainerDied","Data":"14aca0a0bbf23ce153899b98c17fba170a285a8535debf77db16e66936a5a786"}
Jun 03 23:30:23.886704 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.886680    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5" event={"ID":"129432be-4ef1-4e85-b007-87da70db0c26","Type":"ContainerStarted","Data":"dac5be42a9a46dbf50b9762c6ac78fa1887f5e0e966e8847e6cdb0935d179e11"}
Jun 03 23:30:23.894106 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.894086    2561 scope.go:117] "RemoveContainer" containerID="84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6"
Jun 03 23:30:23.903006 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.902988    2561 scope.go:117] "RemoveContainer" containerID="dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3"
Jun 03 23:30:23.911737 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.911404    2561 scope.go:117] "RemoveContainer" containerID="eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45"
Jun 03 23:30:23.912950 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.912926    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 23:30:23.916727 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.916707    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 23:30:23.919881 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.919854    2561 scope.go:117] "RemoveContainer" containerID="b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0"
Jun 03 23:30:23.928059 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.928040    2561 scope.go:117] "RemoveContainer" containerID="ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a"
Jun 03 23:30:23.937332 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.937314    2561 scope.go:117] "RemoveContainer" containerID="0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6"
Jun 03 23:30:23.944426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.944398    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 23:30:23.944884 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.944862    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="kube-rbac-proxy-web"
Jun 03 23:30:23.944884 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.944881    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="kube-rbac-proxy-web"
Jun 03 23:30:23.944973 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.944893    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="kube-rbac-proxy"
Jun 03 23:30:23.944973 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.944903    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="kube-rbac-proxy"
Jun 03 23:30:23.944973 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.944913    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="config-reloader"
Jun 03 23:30:23.944973 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.944923    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="config-reloader"
Jun 03 23:30:23.944973 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.944945    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="prometheus"
Jun 03 23:30:23.944973 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.944953    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="prometheus"
Jun 03 23:30:23.944973 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.944962    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="thanos-sidecar"
Jun 03 23:30:23.944973 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.944970    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="thanos-sidecar"
Jun 03 23:30:23.945242 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.944985    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="kube-rbac-proxy-thanos"
Jun 03 23:30:23.945242 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.944994    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="kube-rbac-proxy-thanos"
Jun 03 23:30:23.945242 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.945011    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="init-config-reloader"
Jun 03 23:30:23.945242 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.945019    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="init-config-reloader"
Jun 03 23:30:23.945242 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.945102    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="thanos-sidecar"
Jun 03 23:30:23.945242 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.945113    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="kube-rbac-proxy-web"
Jun 03 23:30:23.945242 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.945124    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="config-reloader"
Jun 03 23:30:23.945242 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.945137    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="prometheus"
Jun 03 23:30:23.945242 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.945145    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="kube-rbac-proxy"
Jun 03 23:30:23.945242 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.945155    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" containerName="kube-rbac-proxy-thanos"
Jun 03 23:30:23.945682 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.945503    2561 scope.go:117] "RemoveContainer" containerID="49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13"
Jun 03 23:30:23.945951 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:30:23.945925    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13\": container with ID starting with 49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13 not found: ID does not exist" containerID="49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13"
Jun 03 23:30:23.946047 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.945962    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13"} err="failed to get container status \"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13\": rpc error: code = NotFound desc = could not find container \"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13\": container with ID starting with 49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13 not found: ID does not exist"
Jun 03 23:30:23.946047 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.945986    2561 scope.go:117] "RemoveContainer" containerID="84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6"
Jun 03 23:30:23.946304 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:30:23.946280    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6\": container with ID starting with 84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6 not found: ID does not exist" containerID="84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6"
Jun 03 23:30:23.946357 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.946310    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6"} err="failed to get container status \"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6\": rpc error: code = NotFound desc = could not find container \"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6\": container with ID starting with 84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6 not found: ID does not exist"
Jun 03 23:30:23.946357 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.946328    2561 scope.go:117] "RemoveContainer" containerID="dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3"
Jun 03 23:30:23.946656 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:30:23.946625    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3\": container with ID starting with dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3 not found: ID does not exist" containerID="dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3"
Jun 03 23:30:23.946749 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.946661    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3"} err="failed to get container status \"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3\": rpc error: code = NotFound desc = could not find container \"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3\": container with ID starting with dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3 not found: ID does not exist"
Jun 03 23:30:23.946749 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.946682    2561 scope.go:117] "RemoveContainer" containerID="eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45"
Jun 03 23:30:23.946933 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:30:23.946910    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45\": container with ID starting with eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45 not found: ID does not exist" containerID="eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45"
Jun 03 23:30:23.947020 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.946941    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45"} err="failed to get container status \"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45\": rpc error: code = NotFound desc = could not find container \"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45\": container with ID starting with eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45 not found: ID does not exist"
Jun 03 23:30:23.947020 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.946961    2561 scope.go:117] "RemoveContainer" containerID="b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0"
Jun 03 23:30:23.947280 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:30:23.947248    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0\": container with ID starting with b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0 not found: ID does not exist" containerID="b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0"
Jun 03 23:30:23.947345 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.947283    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0"} err="failed to get container status \"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0\": rpc error: code = NotFound desc = could not find container \"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0\": container with ID starting with b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0 not found: ID does not exist"
Jun 03 23:30:23.947345 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.947305    2561 scope.go:117] "RemoveContainer" containerID="ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a"
Jun 03 23:30:23.947587 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:30:23.947566    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a\": container with ID starting with ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a not found: ID does not exist" containerID="ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a"
Jun 03 23:30:23.947673 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.947592    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a"} err="failed to get container status \"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a\": rpc error: code = NotFound desc = could not find container \"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a\": container with ID starting with ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a not found: ID does not exist"
Jun 03 23:30:23.947673 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.947611    2561 scope.go:117] "RemoveContainer" containerID="0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6"
Jun 03 23:30:23.947859 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:30:23.947836    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6\": container with ID starting with 0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6 not found: ID does not exist" containerID="0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6"
Jun 03 23:30:23.947920 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.947867    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6"} err="failed to get container status \"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6\": rpc error: code = NotFound desc = could not find container \"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6\": container with ID starting with 0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6 not found: ID does not exist"
Jun 03 23:30:23.947920 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.947888    2561 scope.go:117] "RemoveContainer" containerID="49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13"
Jun 03 23:30:23.948132 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.948114    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13"} err="failed to get container status \"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13\": rpc error: code = NotFound desc = could not find container \"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13\": container with ID starting with 49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13 not found: ID does not exist"
Jun 03 23:30:23.948203 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.948133    2561 scope.go:117] "RemoveContainer" containerID="84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6"
Jun 03 23:30:23.948443 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.948419    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6"} err="failed to get container status \"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6\": rpc error: code = NotFound desc = could not find container \"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6\": container with ID starting with 84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6 not found: ID does not exist"
Jun 03 23:30:23.948513 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.948444    2561 scope.go:117] "RemoveContainer" containerID="dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3"
Jun 03 23:30:23.948703 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.948684    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3"} err="failed to get container status \"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3\": rpc error: code = NotFound desc = could not find container \"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3\": container with ID starting with dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3 not found: ID does not exist"
Jun 03 23:30:23.948766 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.948703    2561 scope.go:117] "RemoveContainer" containerID="eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45"
Jun 03 23:30:23.948918 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.948897    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45"} err="failed to get container status \"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45\": rpc error: code = NotFound desc = could not find container \"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45\": container with ID starting with eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45 not found: ID does not exist"
Jun 03 23:30:23.948976 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.948919    2561 scope.go:117] "RemoveContainer" containerID="b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0"
Jun 03 23:30:23.949137 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.949121    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0"} err="failed to get container status \"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0\": rpc error: code = NotFound desc = could not find container \"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0\": container with ID starting with b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0 not found: ID does not exist"
Jun 03 23:30:23.949200 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.949137    2561 scope.go:117] "RemoveContainer" containerID="ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a"
Jun 03 23:30:23.949403 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.949381    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a"} err="failed to get container status \"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a\": rpc error: code = NotFound desc = could not find container \"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a\": container with ID starting with ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a not found: ID does not exist"
Jun 03 23:30:23.949487 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.949406    2561 scope.go:117] "RemoveContainer" containerID="0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6"
Jun 03 23:30:23.949707 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.949664    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6"} err="failed to get container status \"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6\": rpc error: code = NotFound desc = could not find container \"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6\": container with ID starting with 0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6 not found: ID does not exist"
Jun 03 23:30:23.949707 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.949687    2561 scope.go:117] "RemoveContainer" containerID="49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13"
Jun 03 23:30:23.949940 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.949895    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13"} err="failed to get container status \"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13\": rpc error: code = NotFound desc = could not find container \"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13\": container with ID starting with 49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13 not found: ID does not exist"
Jun 03 23:30:23.949940 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.949933    2561 scope.go:117] "RemoveContainer" containerID="84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6"
Jun 03 23:30:23.950172 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.950149    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6"} err="failed to get container status \"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6\": rpc error: code = NotFound desc = could not find container \"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6\": container with ID starting with 84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6 not found: ID does not exist"
Jun 03 23:30:23.950215 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.950174    2561 scope.go:117] "RemoveContainer" containerID="dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3"
Jun 03 23:30:23.950401 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.950384    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3"} err="failed to get container status \"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3\": rpc error: code = NotFound desc = could not find container \"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3\": container with ID starting with dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3 not found: ID does not exist"
Jun 03 23:30:23.950461 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.950400    2561 scope.go:117] "RemoveContainer" containerID="eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45"
Jun 03 23:30:23.950657 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.950637    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45"} err="failed to get container status \"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45\": rpc error: code = NotFound desc = could not find container \"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45\": container with ID starting with eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45 not found: ID does not exist"
Jun 03 23:30:23.950734 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.950658    2561 scope.go:117] "RemoveContainer" containerID="b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0"
Jun 03 23:30:23.950968 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.950949    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0"} err="failed to get container status \"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0\": rpc error: code = NotFound desc = could not find container \"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0\": container with ID starting with b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0 not found: ID does not exist"
Jun 03 23:30:23.951026 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.950969    2561 scope.go:117] "RemoveContainer" containerID="ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a"
Jun 03 23:30:23.951206 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.951180    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a"} err="failed to get container status \"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a\": rpc error: code = NotFound desc = could not find container \"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a\": container with ID starting with ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a not found: ID does not exist"
Jun 03 23:30:23.951290 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.951207    2561 scope.go:117] "RemoveContainer" containerID="0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6"
Jun 03 23:30:23.951456 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.951429    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6"} err="failed to get container status \"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6\": rpc error: code = NotFound desc = could not find container \"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6\": container with ID starting with 0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6 not found: ID does not exist"
Jun 03 23:30:23.951456 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.951456    2561 scope.go:117] "RemoveContainer" containerID="49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13"
Jun 03 23:30:23.951601 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.951502    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:23.952255 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.952232    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13"} err="failed to get container status \"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13\": rpc error: code = NotFound desc = could not find container \"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13\": container with ID starting with 49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13 not found: ID does not exist"
Jun 03 23:30:23.952377 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.952255    2561 scope.go:117] "RemoveContainer" containerID="84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6"
Jun 03 23:30:23.952569 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.952539    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6"} err="failed to get container status \"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6\": rpc error: code = NotFound desc = could not find container \"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6\": container with ID starting with 84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6 not found: ID does not exist"
Jun 03 23:30:23.952639 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.952571    2561 scope.go:117] "RemoveContainer" containerID="dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3"
Jun 03 23:30:23.952855 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.952827    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3"} err="failed to get container status \"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3\": rpc error: code = NotFound desc = could not find container \"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3\": container with ID starting with dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3 not found: ID does not exist"
Jun 03 23:30:23.952922 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.952856    2561 scope.go:117] "RemoveContainer" containerID="eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45"
Jun 03 23:30:23.953158 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.953109    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45"} err="failed to get container status \"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45\": rpc error: code = NotFound desc = could not find container \"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45\": container with ID starting with eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45 not found: ID does not exist"
Jun 03 23:30:23.953221 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.953161    2561 scope.go:117] "RemoveContainer" containerID="b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0"
Jun 03 23:30:23.953536 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.953513    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0"} err="failed to get container status \"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0\": rpc error: code = NotFound desc = could not find container \"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0\": container with ID starting with b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0 not found: ID does not exist"
Jun 03 23:30:23.953627 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.953538    2561 scope.go:117] "RemoveContainer" containerID="ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a"
Jun 03 23:30:23.953887 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.953865    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a"} err="failed to get container status \"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a\": rpc error: code = NotFound desc = could not find container \"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a\": container with ID starting with ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a not found: ID does not exist"
Jun 03 23:30:23.953965 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.953890    2561 scope.go:117] "RemoveContainer" containerID="0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6"
Jun 03 23:30:23.954551 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.954065    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 03 23:30:23.954551 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.954157    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 03 23:30:23.954551 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.954197    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6"} err="failed to get container status \"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6\": rpc error: code = NotFound desc = could not find container \"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6\": container with ID starting with 0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6 not found: ID does not exist"
Jun 03 23:30:23.954551 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.954221    2561 scope.go:117] "RemoveContainer" containerID="49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13"
Jun 03 23:30:23.954551 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.954368    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 03 23:30:23.954551 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.954373    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jun 03 23:30:23.954551 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.954383    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 03 23:30:23.954551 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.954402    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 03 23:30:23.954551 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.954422    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p2cwl\""
Jun 03 23:30:23.954551 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.954374    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 03 23:30:23.954551 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.954533    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 03 23:30:23.955291 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.954877    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jun 03 23:30:23.955291 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.954898    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 03 23:30:23.955291 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.955239    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13"} err="failed to get container status \"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13\": rpc error: code = NotFound desc = could not find container \"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13\": container with ID starting with 49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13 not found: ID does not exist"
Jun 03 23:30:23.955291 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.955262    2561 scope.go:117] "RemoveContainer" containerID="84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6"
Jun 03 23:30:23.955727 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.955430    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 03 23:30:23.955727 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.955439    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 03 23:30:23.955727 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.955581    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 03 23:30:23.955727 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.955685    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2rolk9cfgqkiu\""
Jun 03 23:30:23.956001 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.955730    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6"} err="failed to get container status \"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6\": rpc error: code = NotFound desc = could not find container \"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6\": container with ID starting with 84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6 not found: ID does not exist"
Jun 03 23:30:23.956001 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.955753    2561 scope.go:117] "RemoveContainer" containerID="dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3"
Jun 03 23:30:23.956253 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.956139    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3"} err="failed to get container status \"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3\": rpc error: code = NotFound desc = could not find container \"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3\": container with ID starting with dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3 not found: ID does not exist"
Jun 03 23:30:23.956253 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.956165    2561 scope.go:117] "RemoveContainer" containerID="eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45"
Jun 03 23:30:23.956826 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.956490    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45"} err="failed to get container status \"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45\": rpc error: code = NotFound desc = could not find container \"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45\": container with ID starting with eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45 not found: ID does not exist"
Jun 03 23:30:23.956826 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.956512    2561 scope.go:117] "RemoveContainer" containerID="b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0"
Jun 03 23:30:23.957032 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.956866    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0"} err="failed to get container status \"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0\": rpc error: code = NotFound desc = could not find container \"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0\": container with ID starting with b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0 not found: ID does not exist"
Jun 03 23:30:23.957032 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.956885    2561 scope.go:117] "RemoveContainer" containerID="ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a"
Jun 03 23:30:23.957185 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.957164    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a"} err="failed to get container status \"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a\": rpc error: code = NotFound desc = could not find container \"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a\": container with ID starting with ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a not found: ID does not exist"
Jun 03 23:30:23.957185 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.957181    2561 scope.go:117] "RemoveContainer" containerID="0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6"
Jun 03 23:30:23.957486 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.957460    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6"} err="failed to get container status \"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6\": rpc error: code = NotFound desc = could not find container \"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6\": container with ID starting with 0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6 not found: ID does not exist"
Jun 03 23:30:23.957486 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.957487    2561 scope.go:117] "RemoveContainer" containerID="49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13"
Jun 03 23:30:23.957836 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.957807    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13"} err="failed to get container status \"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13\": rpc error: code = NotFound desc = could not find container \"49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13\": container with ID starting with 49387e361f5c531bc949a6f3644a826a66f23a0b6e169a86a06746d9de74bf13 not found: ID does not exist"
Jun 03 23:30:23.957836 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.957837    2561 scope.go:117] "RemoveContainer" containerID="84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6"
Jun 03 23:30:23.958109 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.958083    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6"} err="failed to get container status \"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6\": rpc error: code = NotFound desc = could not find container \"84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6\": container with ID starting with 84fb6e8a91cae53ab09a7fa0bf9c0082f6c412a6962aa74919775a5c0d8526b6 not found: ID does not exist"
Jun 03 23:30:23.958203 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.958111    2561 scope.go:117] "RemoveContainer" containerID="dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3"
Jun 03 23:30:23.958430 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.958405    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3"} err="failed to get container status \"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3\": rpc error: code = NotFound desc = could not find container \"dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3\": container with ID starting with dd8462299669f958047ecb51b0a9088d9a1863145716ca9d0e9189b945ee02b3 not found: ID does not exist"
Jun 03 23:30:23.958430 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.958429    2561 scope.go:117] "RemoveContainer" containerID="eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45"
Jun 03 23:30:23.959150 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.959125    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45"} err="failed to get container status \"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45\": rpc error: code = NotFound desc = could not find container \"eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45\": container with ID starting with eb6f9f3cbb7bf629870408bd1f8799bf4b92ccaae3bf0c6a5c6cd411efea0d45 not found: ID does not exist"
Jun 03 23:30:23.959259 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.959155    2561 scope.go:117] "RemoveContainer" containerID="b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0"
Jun 03 23:30:23.965597 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.963808    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 03 23:30:23.967366 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.967332    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0"} err="failed to get container status \"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0\": rpc error: code = NotFound desc = could not find container \"b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0\": container with ID starting with b3327e3e4853e67d6f95db220c94c8886269ab51bd9472b338002fa7aa5838c0 not found: ID does not exist"
Jun 03 23:30:23.967366 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.967361    2561 scope.go:117] "RemoveContainer" containerID="ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a"
Jun 03 23:30:23.967849 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.967827    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 23:30:23.967965 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.967825    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a"} err="failed to get container status \"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a\": rpc error: code = NotFound desc = could not find container \"ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a\": container with ID starting with ee34c861c24b4157e505883be9b01e27dc5d823b57fdfedbbd3b7c7c9279fe0a not found: ID does not exist"
Jun 03 23:30:23.968025 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.967969    2561 scope.go:117] "RemoveContainer" containerID="0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6"
Jun 03 23:30:23.968292 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.968250    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6"} err="failed to get container status \"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6\": rpc error: code = NotFound desc = could not find container \"0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6\": container with ID starting with 0abfb0f688047e529707e0c47b5cc49777b194d040dc4ce9a83dce2fb1f54ba6 not found: ID does not exist"
Jun 03 23:30:23.971164 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:23.971138    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 03 23:30:24.081552 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081465    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.081552 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081501    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/105b4dd0-d309-4bd6-8c88-c5a178a18046-config-out\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.081552 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081523    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.081552 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081542    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-config\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.081985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081607    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.081985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081649    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.081985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081667    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-web-config\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.081985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081737    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.081985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081774    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.081985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081791    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.081985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081813    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.081985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081831    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.081985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081867    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/105b4dd0-d309-4bd6-8c88-c5a178a18046-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.081985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081894    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.081985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081913    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjfv6\" (UniqueName: \"kubernetes.io/projected/105b4dd0-d309-4bd6-8c88-c5a178a18046-kube-api-access-hjfv6\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.081985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081959    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.081985 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081977    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.082385 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.081998    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.082385 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.082021    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.082385 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.082040    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/105b4dd0-d309-4bd6-8c88-c5a178a18046-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.182863 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.182814    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.182863 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.182867    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183072 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.182898    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/105b4dd0-d309-4bd6-8c88-c5a178a18046-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183072 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.182936    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183072 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.182964    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/105b4dd0-d309-4bd6-8c88-c5a178a18046-config-out\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183072 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.182998    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183072 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.183027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-config\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183072 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.183062    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183420 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.183393    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183476 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.183435    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-web-config\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183531 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.183475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183531 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.183511    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183622 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.183538    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183622 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.183576    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183622 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.183603    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183775 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.183633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/105b4dd0-d309-4bd6-8c88-c5a178a18046-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183775 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.183663    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183775 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.183687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjfv6\" (UniqueName: \"kubernetes.io/projected/105b4dd0-d309-4bd6-8c88-c5a178a18046-kube-api-access-hjfv6\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183775 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.183732    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.183775 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.183758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.184805 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.184507    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/105b4dd0-d309-4bd6-8c88-c5a178a18046-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.184805 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.184588    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.188595 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.185383    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.188595 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.186092    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.188595 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.186091    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.188595 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.186303    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.188595 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.186322    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-config\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.188595 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.186631    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.188595 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.186952    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.188595 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.187029    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.188595 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.187456    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.188595 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.187456    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.188595 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.188167    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/105b4dd0-d309-4bd6-8c88-c5a178a18046-config-out\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.189189 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.189131    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/105b4dd0-d309-4bd6-8c88-c5a178a18046-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.189385 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.189361    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/105b4dd0-d309-4bd6-8c88-c5a178a18046-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.190163 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.190143    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-web-config\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.190726 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.190698    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.191430 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.191401    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.191629 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.191606    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/105b4dd0-d309-4bd6-8c88-c5a178a18046-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.195779 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.195756    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjfv6\" (UniqueName: \"kubernetes.io/projected/105b4dd0-d309-4bd6-8c88-c5a178a18046-kube-api-access-hjfv6\") pod \"prometheus-k8s-0\" (UID: \"105b4dd0-d309-4bd6-8c88-c5a178a18046\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.270820 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.270790    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:24.422612 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.422577    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 23:30:24.425739 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:30:24.425709    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod105b4dd0_d309_4bd6_8c88_c5a178a18046.slice/crio-baeeb9e15c5f3c14d381437a3eebb6c0caee48a008ea12f654a5847e4feec3f1 WatchSource:0}: Error finding container baeeb9e15c5f3c14d381437a3eebb6c0caee48a008ea12f654a5847e4feec3f1: Status 404 returned error can't find the container with id baeeb9e15c5f3c14d381437a3eebb6c0caee48a008ea12f654a5847e4feec3f1
Jun 03 23:30:24.528073 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.528045    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc" path="/var/lib/kubelet/pods/055bbb9b-e2e3-4dd3-976b-f0af5d7a06cc/volumes"
Jun 03 23:30:24.897719 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.897681    2561 generic.go:356] "Generic (PLEG): container finished" podID="105b4dd0-d309-4bd6-8c88-c5a178a18046" containerID="a99ae18a69040dd2108aa30451f628f36dcb90c830eca10e01c25e81a183422b" exitCode=0
Jun 03 23:30:24.897892 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.897781    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"105b4dd0-d309-4bd6-8c88-c5a178a18046","Type":"ContainerDied","Data":"a99ae18a69040dd2108aa30451f628f36dcb90c830eca10e01c25e81a183422b"}
Jun 03 23:30:24.897892 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:24.897866    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"105b4dd0-d309-4bd6-8c88-c5a178a18046","Type":"ContainerStarted","Data":"baeeb9e15c5f3c14d381437a3eebb6c0caee48a008ea12f654a5847e4feec3f1"}
Jun 03 23:30:25.906280 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:25.906240    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5" event={"ID":"129432be-4ef1-4e85-b007-87da70db0c26","Type":"ContainerStarted","Data":"4527f70b4ed46bf85747534091a0366efd0bb5fd6e635e83f3a17796b3a78e24"}
Jun 03 23:30:25.906680 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:25.906316    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5" event={"ID":"129432be-4ef1-4e85-b007-87da70db0c26","Type":"ContainerStarted","Data":"5ad0686cf96277aa26e74400d0934463d062bd231857f574ceee0ba53e986269"}
Jun 03 23:30:25.906680 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:25.906336    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5" event={"ID":"129432be-4ef1-4e85-b007-87da70db0c26","Type":"ContainerStarted","Data":"800f0f4161feb3fccc3bced0545bb4cd79836ed64cd93906ccf2af37bb0d89de"}
Jun 03 23:30:25.909560 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:25.909534    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"105b4dd0-d309-4bd6-8c88-c5a178a18046","Type":"ContainerStarted","Data":"c02a2174c1ce5e012b6442a4ef25e8142c07be1579fc959b9934909da22f04e1"}
Jun 03 23:30:25.909669 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:25.909587    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"105b4dd0-d309-4bd6-8c88-c5a178a18046","Type":"ContainerStarted","Data":"58ea94999c134b71ae9e1a9cdced986d701b39443432df52630426531e66389d"}
Jun 03 23:30:25.909669 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:25.909613    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"105b4dd0-d309-4bd6-8c88-c5a178a18046","Type":"ContainerStarted","Data":"ba37ac649e75751df86c0a8c080c70051a8999da653f0179694950aedcac696c"}
Jun 03 23:30:25.909669 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:25.909636    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"105b4dd0-d309-4bd6-8c88-c5a178a18046","Type":"ContainerStarted","Data":"bbfbdb8051dfe623ae27aa903bc5f0befbcb3670d4f79d0fae2610b186ac1c69"}
Jun 03 23:30:25.909669 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:25.909660    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"105b4dd0-d309-4bd6-8c88-c5a178a18046","Type":"ContainerStarted","Data":"bebd0769adf11c318dcfa97c047594f9c8bb700f9818387fb2daaf39c7010062"}
Jun 03 23:30:25.909802 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:25.909685    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"105b4dd0-d309-4bd6-8c88-c5a178a18046","Type":"ContainerStarted","Data":"1c4d904d2f861ff17d282eb4258a8d0515d7c976a62a0f85c45a1eb07661296f"}
Jun 03 23:30:25.930872 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:25.930715    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-794dbddbc5-ngnt5" podStartSLOduration=1.9192199699999999 podStartE2EDuration="3.930695315s" totalImagesPullingTime="2.011475345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:30:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:30:25.928958195 +0000 UTC m=+385.827860450" watchObservedRunningTime="2026-06-03 23:30:25.930695315 +0000 UTC m=+385.829597572"
Jun 03 23:30:25.957460 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:25.957415    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.935550741 podStartE2EDuration="2.957399763s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.849022ms" isStatefulPod=false podCreationTimestamp="2026-06-03 23:30:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:30:25.955469337 +0000 UTC m=+385.854371612" watchObservedRunningTime="2026-06-03 23:30:25.957399763 +0000 UTC m=+385.856302038"
Jun 03 23:30:26.743249 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:26.743216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:30:26.827579 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:26.827552    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:30:26.927234 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:26.927203    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:30:27.467573 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:27.467546    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:30:27.538585 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:27.538560    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:30:29.271162 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:29.271125    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:30:37.706290 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:37.706246    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:30:37.764208 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:37.764185    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:30:37.817445 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:37.817416    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:30:50.821434 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:50.821402    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:30:55.199535 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:55.199502    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:30:55.254945 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:30:55.254914    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:31:17.340406 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:31:17.340367    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:31:24.271085 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:31:24.270985    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:31:24.286664 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:31:24.286640    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:31:25.196153 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:31:25.196129    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 23:31:32.683448 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:31:32.683409    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:31:32.743182 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:31:32.743147    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:31:44.511461 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:31:44.511425    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:31:44.612043 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:31:44.612007    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:31:47.530640 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:31:47.530605    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:31:47.583578 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:31:47.583544    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:31:53.794729 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:31:53.794699    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:31:53.895969 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:31:53.895940    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:31:54.203003 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:31:54.202908    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:31:58.003066 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:31:58.003019    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:31:58.058949 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:31:58.058916    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:31:58.117185 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:31:58.117152    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:32:32.298483 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:32:32.298447    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:32:32.395721 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:32:32.395690    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:32:53.925016 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:32:53.924939    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:32:54.922043 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:32:54.922009    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:32:57.534941 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:32:57.534909    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:32:57.594724 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:32:57.594687    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:32:59.351404 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:32:59.351372    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:32:59.528068 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:32:59.528034    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:02.803019 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:02.802980    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:03.210195 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:03.210153    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:04.741368 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:04.741331    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:04.846781 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:04.846748    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:08.127650 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:08.127616    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:08.230672 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:08.230638    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:10.016371 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:10.016342    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:21.281983 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:21.281949    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:21.541875 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:21.541777    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:22.586220 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:22.586186    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztz7j"]
Jun 03 23:33:22.589185 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:22.589169    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztz7j"
Jun 03 23:33:22.594310 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:22.594290    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 03 23:33:22.594310 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:22.594299    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 03 23:33:22.594756 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:22.594740    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-ccpdg\""
Jun 03 23:33:22.600660 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:22.600638    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztz7j"]
Jun 03 23:33:22.646402 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:22.646358    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5b6372c-f0a9-4aeb-987c-7d199c7cb8a6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ztz7j\" (UID: \"a5b6372c-f0a9-4aeb-987c-7d199c7cb8a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztz7j"
Jun 03 23:33:22.646622 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:22.646596    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8sl8\" (UniqueName: \"kubernetes.io/projected/a5b6372c-f0a9-4aeb-987c-7d199c7cb8a6-kube-api-access-h8sl8\") pod \"openshift-lws-operator-fd8ccff4c-ztz7j\" (UID: \"a5b6372c-f0a9-4aeb-987c-7d199c7cb8a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztz7j"
Jun 03 23:33:22.747875 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:22.747840    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5b6372c-f0a9-4aeb-987c-7d199c7cb8a6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ztz7j\" (UID: \"a5b6372c-f0a9-4aeb-987c-7d199c7cb8a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztz7j"
Jun 03 23:33:22.748064 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:22.747891    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8sl8\" (UniqueName: \"kubernetes.io/projected/a5b6372c-f0a9-4aeb-987c-7d199c7cb8a6-kube-api-access-h8sl8\") pod \"openshift-lws-operator-fd8ccff4c-ztz7j\" (UID: \"a5b6372c-f0a9-4aeb-987c-7d199c7cb8a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztz7j"
Jun 03 23:33:22.748238 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:22.748219    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5b6372c-f0a9-4aeb-987c-7d199c7cb8a6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ztz7j\" (UID: \"a5b6372c-f0a9-4aeb-987c-7d199c7cb8a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztz7j"
Jun 03 23:33:22.756558 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:22.756526    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8sl8\" (UniqueName: \"kubernetes.io/projected/a5b6372c-f0a9-4aeb-987c-7d199c7cb8a6-kube-api-access-h8sl8\") pod \"openshift-lws-operator-fd8ccff4c-ztz7j\" (UID: \"a5b6372c-f0a9-4aeb-987c-7d199c7cb8a6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztz7j"
Jun 03 23:33:22.914585 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:22.914502    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztz7j"
Jun 03 23:33:23.050496 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:23.050472    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztz7j"]
Jun 03 23:33:23.053371 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:33:23.053342    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5b6372c_f0a9_4aeb_987c_7d199c7cb8a6.slice/crio-8aa7bb10c55d57bd246c39aac03412a250deda59fd47a273f37489cf6a4820fa WatchSource:0}: Error finding container 8aa7bb10c55d57bd246c39aac03412a250deda59fd47a273f37489cf6a4820fa: Status 404 returned error can't find the container with id 8aa7bb10c55d57bd246c39aac03412a250deda59fd47a273f37489cf6a4820fa
Jun 03 23:33:23.684992 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:23.684959    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztz7j" event={"ID":"a5b6372c-f0a9-4aeb-987c-7d199c7cb8a6","Type":"ContainerStarted","Data":"8aa7bb10c55d57bd246c39aac03412a250deda59fd47a273f37489cf6a4820fa"}
Jun 03 23:33:26.699776 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:26.699742    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztz7j" event={"ID":"a5b6372c-f0a9-4aeb-987c-7d199c7cb8a6","Type":"ContainerStarted","Data":"d5d2b937311e127da9309b487c2218cc08c096a46a51830d00ee8abbe4899599"}
Jun 03 23:33:26.728419 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:26.728363    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztz7j" podStartSLOduration=2.022677167 podStartE2EDuration="4.728345657s" totalImagesPullingTime="2.70566849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:33:26.726812081 +0000 UTC m=+566.625714335" watchObservedRunningTime="2026-06-03 23:33:26.728345657 +0000 UTC m=+566.627247913"
Jun 03 23:33:27.438526 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:27.438484    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:27.543347 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:27.543318    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:29.492782 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:29.492748    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:40.938401 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:40.938363    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:41.038221 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:41.038190    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:41.543128 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:41.543093    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:41.743763 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:41.743737    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:41.843312 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:41.843260    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:41.913980 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:41.913875    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"]
Jun 03 23:33:41.920605 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:41.920587    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:41.927372 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:41.927096    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 03 23:33:41.927372 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:41.927108    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 03 23:33:41.927372 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:41.927307    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 03 23:33:41.927569 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:41.927446    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 03 23:33:41.927619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:41.927601    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4jsbw\""
Jun 03 23:33:41.937214 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:41.937194    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"]
Jun 03 23:33:42.018853 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.018780    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/51cd6649-53ef-4b46-85d9-a7cdcaba7517-manifests\") pod \"opendatahub-operator-controller-manager-f87df8b57-ksd6x\" (UID: \"51cd6649-53ef-4b46-85d9-a7cdcaba7517\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:42.018853 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.018814    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/51cd6649-53ef-4b46-85d9-a7cdcaba7517-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f87df8b57-ksd6x\" (UID: \"51cd6649-53ef-4b46-85d9-a7cdcaba7517\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:42.019229 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.018890    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zppmh\" (UniqueName: \"kubernetes.io/projected/51cd6649-53ef-4b46-85d9-a7cdcaba7517-kube-api-access-zppmh\") pod \"opendatahub-operator-controller-manager-f87df8b57-ksd6x\" (UID: \"51cd6649-53ef-4b46-85d9-a7cdcaba7517\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:42.019229 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.018938    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51cd6649-53ef-4b46-85d9-a7cdcaba7517-tmp\") pod \"opendatahub-operator-controller-manager-f87df8b57-ksd6x\" (UID: \"51cd6649-53ef-4b46-85d9-a7cdcaba7517\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:42.019229 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.018985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51cd6649-53ef-4b46-85d9-a7cdcaba7517-webhook-cert\") pod \"opendatahub-operator-controller-manager-f87df8b57-ksd6x\" (UID: \"51cd6649-53ef-4b46-85d9-a7cdcaba7517\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:42.086434 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.086410    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:42.120458 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.120428    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51cd6649-53ef-4b46-85d9-a7cdcaba7517-webhook-cert\") pod \"opendatahub-operator-controller-manager-f87df8b57-ksd6x\" (UID: \"51cd6649-53ef-4b46-85d9-a7cdcaba7517\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:42.120639 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.120503    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/51cd6649-53ef-4b46-85d9-a7cdcaba7517-manifests\") pod \"opendatahub-operator-controller-manager-f87df8b57-ksd6x\" (UID: \"51cd6649-53ef-4b46-85d9-a7cdcaba7517\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:42.120639 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.120537    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/51cd6649-53ef-4b46-85d9-a7cdcaba7517-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f87df8b57-ksd6x\" (UID: \"51cd6649-53ef-4b46-85d9-a7cdcaba7517\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:42.120639 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.120593    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zppmh\" (UniqueName: \"kubernetes.io/projected/51cd6649-53ef-4b46-85d9-a7cdcaba7517-kube-api-access-zppmh\") pod \"opendatahub-operator-controller-manager-f87df8b57-ksd6x\" (UID: \"51cd6649-53ef-4b46-85d9-a7cdcaba7517\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:42.120639 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.120629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51cd6649-53ef-4b46-85d9-a7cdcaba7517-tmp\") pod \"opendatahub-operator-controller-manager-f87df8b57-ksd6x\" (UID: \"51cd6649-53ef-4b46-85d9-a7cdcaba7517\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:42.121128 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.121102    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/51cd6649-53ef-4b46-85d9-a7cdcaba7517-manifests\") pod \"opendatahub-operator-controller-manager-f87df8b57-ksd6x\" (UID: \"51cd6649-53ef-4b46-85d9-a7cdcaba7517\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:42.123679 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.123478    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51cd6649-53ef-4b46-85d9-a7cdcaba7517-tmp\") pod \"opendatahub-operator-controller-manager-f87df8b57-ksd6x\" (UID: \"51cd6649-53ef-4b46-85d9-a7cdcaba7517\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:42.124425 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.124403    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/51cd6649-53ef-4b46-85d9-a7cdcaba7517-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f87df8b57-ksd6x\" (UID: \"51cd6649-53ef-4b46-85d9-a7cdcaba7517\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:42.124573 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.124422    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51cd6649-53ef-4b46-85d9-a7cdcaba7517-webhook-cert\") pod \"opendatahub-operator-controller-manager-f87df8b57-ksd6x\" (UID: \"51cd6649-53ef-4b46-85d9-a7cdcaba7517\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:42.131824 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.131778    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zppmh\" (UniqueName: \"kubernetes.io/projected/51cd6649-53ef-4b46-85d9-a7cdcaba7517-kube-api-access-zppmh\") pod \"opendatahub-operator-controller-manager-f87df8b57-ksd6x\" (UID: \"51cd6649-53ef-4b46-85d9-a7cdcaba7517\") " pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:42.194105 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.194069    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:42.231001 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.230972    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:42.288134 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.288074    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:42.371212 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.371189    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"]
Jun 03 23:33:42.373555 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:33:42.373524    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51cd6649_53ef_4b46_85d9_a7cdcaba7517.slice/crio-eb12924a6454ba81775b9b3259a6bc32082101fe6c12d15966f342bc49c1ff87 WatchSource:0}: Error finding container eb12924a6454ba81775b9b3259a6bc32082101fe6c12d15966f342bc49c1ff87: Status 404 returned error can't find the container with id eb12924a6454ba81775b9b3259a6bc32082101fe6c12d15966f342bc49c1ff87
Jun 03 23:33:42.373706 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.373688    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:42.443093 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.443074    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:42.545397 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.545344    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:42.644136 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.644110    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:42.771914 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:42.771888    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x" event={"ID":"51cd6649-53ef-4b46-85d9-a7cdcaba7517","Type":"ContainerStarted","Data":"eb12924a6454ba81775b9b3259a6bc32082101fe6c12d15966f342bc49c1ff87"}
Jun 03 23:33:45.795791 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:45.795756    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x" event={"ID":"51cd6649-53ef-4b46-85d9-a7cdcaba7517","Type":"ContainerStarted","Data":"8a3106bd58fa7536b6e29ea1b6a3b57e260f573e29f8c2a033228bfbe0f15686"}
Jun 03 23:33:46.801478 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:46.801441    2561 generic.go:356] "Generic (PLEG): container finished" podID="51cd6649-53ef-4b46-85d9-a7cdcaba7517" containerID="8a3106bd58fa7536b6e29ea1b6a3b57e260f573e29f8c2a033228bfbe0f15686" exitCode=0
Jun 03 23:33:46.801872 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:46.801503    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x" event={"ID":"51cd6649-53ef-4b46-85d9-a7cdcaba7517","Type":"ContainerDied","Data":"8a3106bd58fa7536b6e29ea1b6a3b57e260f573e29f8c2a033228bfbe0f15686"}
Jun 03 23:33:47.808490 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:47.808450    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x" event={"ID":"51cd6649-53ef-4b46-85d9-a7cdcaba7517","Type":"ContainerStarted","Data":"ce6979362f954b779d0a98e4c76a5cadae4223aff4bda15d6be5053b937a345b"}
Jun 03 23:33:47.808874 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:47.808573    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:33:47.816048 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:47.816020    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:47.831287 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:47.831221    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x" podStartSLOduration=2.87391662 podStartE2EDuration="6.831207264s" totalImagesPullingTime="3.04447661s" totalInitContainerRuntime="912.814034ms" isStatefulPod=false podCreationTimestamp="2026-06-03 23:33:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:33:47.829809871 +0000 UTC m=+587.728712136" watchObservedRunningTime="2026-06-03 23:33:47.831207264 +0000 UTC m=+587.730109621"
Jun 03 23:33:47.912377 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:47.912348    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:33:58.815176 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:33:58.815137    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f87df8b57-ksd6x"
Jun 03 23:34:00.554510 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:00.554396    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:34:00.565506 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:00.554520    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:34:00.726313 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:00.726285    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:00.877404 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:00.877324    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:01.503480 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:01.503443    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:01.613134 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:01.613104    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:01.708200 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:01.708163    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:02.126224 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:02.126195    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:02.300934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:02.300897    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:02.682138 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:02.682107    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:02.796660 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:02.796622    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:02.872071 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:02.872043    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:03.134315 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:03.134247    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:12.128747 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.128699    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:12.269974 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.269940    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"]
Jun 03 23:34:12.272816 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.272794    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"
Jun 03 23:34:12.275583 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.275553    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jun 03 23:34:12.276555 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.276538    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jun 03 23:34:12.277771 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.277753    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-khfml\""
Jun 03 23:34:12.278527 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.278505    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jun 03 23:34:12.292197 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.292173    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"]
Jun 03 23:34:12.399573 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.399476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42c61bc2-9682-4dc7-ac2a-b682c802d49b-cert\") pod \"lws-controller-manager-6845fb6b5-dfh7l\" (UID: \"42c61bc2-9682-4dc7-ac2a-b682c802d49b\") " pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"
Jun 03 23:34:12.399746 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.399613    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/42c61bc2-9682-4dc7-ac2a-b682c802d49b-metrics-cert\") pod \"lws-controller-manager-6845fb6b5-dfh7l\" (UID: \"42c61bc2-9682-4dc7-ac2a-b682c802d49b\") " pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"
Jun 03 23:34:12.399746 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.399642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/42c61bc2-9682-4dc7-ac2a-b682c802d49b-manager-config\") pod \"lws-controller-manager-6845fb6b5-dfh7l\" (UID: \"42c61bc2-9682-4dc7-ac2a-b682c802d49b\") " pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"
Jun 03 23:34:12.399746 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.399674    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqv5f\" (UniqueName: \"kubernetes.io/projected/42c61bc2-9682-4dc7-ac2a-b682c802d49b-kube-api-access-rqv5f\") pod \"lws-controller-manager-6845fb6b5-dfh7l\" (UID: \"42c61bc2-9682-4dc7-ac2a-b682c802d49b\") " pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"
Jun 03 23:34:12.500514 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.500483    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/42c61bc2-9682-4dc7-ac2a-b682c802d49b-metrics-cert\") pod \"lws-controller-manager-6845fb6b5-dfh7l\" (UID: \"42c61bc2-9682-4dc7-ac2a-b682c802d49b\") " pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"
Jun 03 23:34:12.500514 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.500513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/42c61bc2-9682-4dc7-ac2a-b682c802d49b-manager-config\") pod \"lws-controller-manager-6845fb6b5-dfh7l\" (UID: \"42c61bc2-9682-4dc7-ac2a-b682c802d49b\") " pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"
Jun 03 23:34:12.500721 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.500535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqv5f\" (UniqueName: \"kubernetes.io/projected/42c61bc2-9682-4dc7-ac2a-b682c802d49b-kube-api-access-rqv5f\") pod \"lws-controller-manager-6845fb6b5-dfh7l\" (UID: \"42c61bc2-9682-4dc7-ac2a-b682c802d49b\") " pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"
Jun 03 23:34:12.500721 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.500582    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42c61bc2-9682-4dc7-ac2a-b682c802d49b-cert\") pod \"lws-controller-manager-6845fb6b5-dfh7l\" (UID: \"42c61bc2-9682-4dc7-ac2a-b682c802d49b\") " pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"
Jun 03 23:34:12.501319 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.501261    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/42c61bc2-9682-4dc7-ac2a-b682c802d49b-manager-config\") pod \"lws-controller-manager-6845fb6b5-dfh7l\" (UID: \"42c61bc2-9682-4dc7-ac2a-b682c802d49b\") " pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"
Jun 03 23:34:12.503082 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.503059    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/42c61bc2-9682-4dc7-ac2a-b682c802d49b-metrics-cert\") pod \"lws-controller-manager-6845fb6b5-dfh7l\" (UID: \"42c61bc2-9682-4dc7-ac2a-b682c802d49b\") " pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"
Jun 03 23:34:12.503200 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.503124    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42c61bc2-9682-4dc7-ac2a-b682c802d49b-cert\") pod \"lws-controller-manager-6845fb6b5-dfh7l\" (UID: \"42c61bc2-9682-4dc7-ac2a-b682c802d49b\") " pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"
Jun 03 23:34:12.516905 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.516877    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqv5f\" (UniqueName: \"kubernetes.io/projected/42c61bc2-9682-4dc7-ac2a-b682c802d49b-kube-api-access-rqv5f\") pod \"lws-controller-manager-6845fb6b5-dfh7l\" (UID: \"42c61bc2-9682-4dc7-ac2a-b682c802d49b\") " pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"
Jun 03 23:34:12.584011 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.583983    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"
Jun 03 23:34:12.723691 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.723659    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"]
Jun 03 23:34:12.726956 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:34:12.726928    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42c61bc2_9682_4dc7_ac2a_b682c802d49b.slice/crio-43e66fb6f82d09b850a4a38e09baa8e29a3228010c0ac6ba25e0cfd2af5365b5 WatchSource:0}: Error finding container 43e66fb6f82d09b850a4a38e09baa8e29a3228010c0ac6ba25e0cfd2af5365b5: Status 404 returned error can't find the container with id 43e66fb6f82d09b850a4a38e09baa8e29a3228010c0ac6ba25e0cfd2af5365b5
Jun 03 23:34:12.728919 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.728903    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 23:34:12.921868 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:12.921782    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l" event={"ID":"42c61bc2-9682-4dc7-ac2a-b682c802d49b","Type":"ContainerStarted","Data":"43e66fb6f82d09b850a4a38e09baa8e29a3228010c0ac6ba25e0cfd2af5365b5"}
Jun 03 23:34:13.301243 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:13.301213    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:13.474187 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:13.474139    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:13.617553 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:13.617416    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:13.716443 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:13.716410    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:13.960828 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:13.960792    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:14.937072 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:14.937033    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l" event={"ID":"42c61bc2-9682-4dc7-ac2a-b682c802d49b","Type":"ContainerStarted","Data":"a342ecfc5569d6c4bb4051e6d0494335d21d66a009e97f31106082f8b122d114"}
Jun 03 23:34:14.937538 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:14.937181    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"
Jun 03 23:34:14.955050 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:14.954999    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l" podStartSLOduration=1.474606898 podStartE2EDuration="2.954986435s" totalImagesPullingTime="1.480379537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:14.953058197 +0000 UTC m=+614.851960450" watchObservedRunningTime="2026-06-03 23:34:14.954986435 +0000 UTC m=+614.853888687"
Jun 03 23:34:15.899541 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:15.899508    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:16.007537 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:16.007506    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:18.054280 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:18.054232    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:18.279119 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:18.279089    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:18.629199 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:18.629164    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:18.733867 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:18.733835    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:18.977801 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:18.977769    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:19.114843 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:19.114813    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:20.591961 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:20.591871    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7c7b778c9c-w6lkl"]
Jun 03 23:34:20.598794 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:20.598770    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7c7b778c9c-w6lkl"
Jun 03 23:34:20.604834 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:20.604812    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 03 23:34:20.605024 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:20.605008    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-cx9pv\""
Jun 03 23:34:20.627389 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:20.627363    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7c7b778c9c-w6lkl"]
Jun 03 23:34:20.675022 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:20.674993    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:20.695253 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:20.695220    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42wvb\" (UniqueName: \"kubernetes.io/projected/22750ee4-dcdf-406e-9cf4-e016caf003f2-kube-api-access-42wvb\") pod \"dashboard-redirect-7c7b778c9c-w6lkl\" (UID: \"22750ee4-dcdf-406e-9cf4-e016caf003f2\") " pod="opendatahub/dashboard-redirect-7c7b778c9c-w6lkl"
Jun 03 23:34:20.695398 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:20.695382    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/22750ee4-dcdf-406e-9cf4-e016caf003f2-redirect-config\") pod \"dashboard-redirect-7c7b778c9c-w6lkl\" (UID: \"22750ee4-dcdf-406e-9cf4-e016caf003f2\") " pod="opendatahub/dashboard-redirect-7c7b778c9c-w6lkl"
Jun 03 23:34:20.796579 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:20.796552    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/22750ee4-dcdf-406e-9cf4-e016caf003f2-redirect-config\") pod \"dashboard-redirect-7c7b778c9c-w6lkl\" (UID: \"22750ee4-dcdf-406e-9cf4-e016caf003f2\") " pod="opendatahub/dashboard-redirect-7c7b778c9c-w6lkl"
Jun 03 23:34:20.796713 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:20.796584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42wvb\" (UniqueName: \"kubernetes.io/projected/22750ee4-dcdf-406e-9cf4-e016caf003f2-kube-api-access-42wvb\") pod \"dashboard-redirect-7c7b778c9c-w6lkl\" (UID: \"22750ee4-dcdf-406e-9cf4-e016caf003f2\") " pod="opendatahub/dashboard-redirect-7c7b778c9c-w6lkl"
Jun 03 23:34:20.797202 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:20.797183    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/22750ee4-dcdf-406e-9cf4-e016caf003f2-redirect-config\") pod \"dashboard-redirect-7c7b778c9c-w6lkl\" (UID: \"22750ee4-dcdf-406e-9cf4-e016caf003f2\") " pod="opendatahub/dashboard-redirect-7c7b778c9c-w6lkl"
Jun 03 23:34:20.811148 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:20.811123    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42wvb\" (UniqueName: \"kubernetes.io/projected/22750ee4-dcdf-406e-9cf4-e016caf003f2-kube-api-access-42wvb\") pod \"dashboard-redirect-7c7b778c9c-w6lkl\" (UID: \"22750ee4-dcdf-406e-9cf4-e016caf003f2\") " pod="opendatahub/dashboard-redirect-7c7b778c9c-w6lkl"
Jun 03 23:34:20.909352 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:20.909288    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7c7b778c9c-w6lkl"
Jun 03 23:34:21.045682 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:21.045657    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7c7b778c9c-w6lkl"]
Jun 03 23:34:21.047955 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:34:21.047921    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22750ee4_dcdf_406e_9cf4_e016caf003f2.slice/crio-db3ff05c272fde833d58b788456599812f464401227752149c07c8e133c989fe WatchSource:0}: Error finding container db3ff05c272fde833d58b788456599812f464401227752149c07c8e133c989fe: Status 404 returned error can't find the container with id db3ff05c272fde833d58b788456599812f464401227752149c07c8e133c989fe
Jun 03 23:34:21.972934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:21.972892    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7c7b778c9c-w6lkl" event={"ID":"22750ee4-dcdf-406e-9cf4-e016caf003f2","Type":"ContainerStarted","Data":"db3ff05c272fde833d58b788456599812f464401227752149c07c8e133c989fe"}
Jun 03 23:34:25.943286 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:25.943242    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6845fb6b5-dfh7l"
Jun 03 23:34:27.001817 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:27.001782    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7c7b778c9c-w6lkl" event={"ID":"22750ee4-dcdf-406e-9cf4-e016caf003f2","Type":"ContainerStarted","Data":"617a97f847b5c4e216c0aa58f4533891315cac0b0cc4a4ddb8b451db6211e314"}
Jun 03 23:34:27.018831 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:27.018779    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7c7b778c9c-w6lkl" podStartSLOduration=2.065146349 podStartE2EDuration="7.018760987s" totalImagesPullingTime="4.953614638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:27.018091859 +0000 UTC m=+626.916994111" watchObservedRunningTime="2026-06-03 23:34:27.018760987 +0000 UTC m=+626.917663241"
Jun 03 23:34:28.986316 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:28.986281    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:29.083989 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:29.083956    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:33.925264 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:33.925229    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:34.026656 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:34.026624    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:34.541420 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:34.541388    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:38.102451 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.102418    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:38.209521 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.209489    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:38.414230 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.414157    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"]
Jun 03 23:34:38.418718 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.418703    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.422472 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.422449    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-k5tjh\""
Jun 03 23:34:38.422861 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.422848    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 03 23:34:38.423150 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.423133    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 03 23:34:38.423241 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.423210    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 03 23:34:38.436521 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.436498    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"]
Jun 03 23:34:38.468232 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.468203    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:38.558168 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.558140    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d57b94-6fc5-467a-b7a2-86f8628f3387-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.558292 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.558170    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38d57b94-6fc5-467a-b7a2-86f8628f3387-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.558292 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.558201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp28q\" (UniqueName: \"kubernetes.io/projected/38d57b94-6fc5-467a-b7a2-86f8628f3387-kube-api-access-tp28q\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.558292 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.558283    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d57b94-6fc5-467a-b7a2-86f8628f3387-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.558425 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.558343    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38d57b94-6fc5-467a-b7a2-86f8628f3387-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.558425 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.558379    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38d57b94-6fc5-467a-b7a2-86f8628f3387-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.558501 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.558433    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d57b94-6fc5-467a-b7a2-86f8628f3387-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.558501 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.558485    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38d57b94-6fc5-467a-b7a2-86f8628f3387-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.558576 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.558524    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38d57b94-6fc5-467a-b7a2-86f8628f3387-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.659619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.659592    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d57b94-6fc5-467a-b7a2-86f8628f3387-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.659619 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.659620    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38d57b94-6fc5-467a-b7a2-86f8628f3387-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.659789 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.659646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp28q\" (UniqueName: \"kubernetes.io/projected/38d57b94-6fc5-467a-b7a2-86f8628f3387-kube-api-access-tp28q\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.659789 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.659667    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d57b94-6fc5-467a-b7a2-86f8628f3387-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.659789 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.659706    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38d57b94-6fc5-467a-b7a2-86f8628f3387-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.659789 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.659725    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38d57b94-6fc5-467a-b7a2-86f8628f3387-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.659789 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.659746    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d57b94-6fc5-467a-b7a2-86f8628f3387-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.660007 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.659798    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38d57b94-6fc5-467a-b7a2-86f8628f3387-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.660007 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.659829    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38d57b94-6fc5-467a-b7a2-86f8628f3387-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.660134 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.660106    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d57b94-6fc5-467a-b7a2-86f8628f3387-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.660253 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.660156    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38d57b94-6fc5-467a-b7a2-86f8628f3387-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.660253 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.660180    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38d57b94-6fc5-467a-b7a2-86f8628f3387-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.660401 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.660326    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38d57b94-6fc5-467a-b7a2-86f8628f3387-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.660575 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.660554    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38d57b94-6fc5-467a-b7a2-86f8628f3387-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.661920 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.661899    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38d57b94-6fc5-467a-b7a2-86f8628f3387-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.662386 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.662363    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38d57b94-6fc5-467a-b7a2-86f8628f3387-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.674094 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.674044    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp28q\" (UniqueName: \"kubernetes.io/projected/38d57b94-6fc5-467a-b7a2-86f8628f3387-kube-api-access-tp28q\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.674439 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.674420    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38d57b94-6fc5-467a-b7a2-86f8628f3387-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795n6skq\" (UID: \"38d57b94-6fc5-467a-b7a2-86f8628f3387\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.708188 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.708152    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:38.729313 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.729288    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:38.904000 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:38.903972    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"]
Jun 03 23:34:38.912758 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:34:38.912720    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d57b94_6fc5_467a_b7a2_86f8628f3387.slice/crio-b77119b19222ad446561d717a3bf776f5f18234fcf71c692172671576afea6b6 WatchSource:0}: Error finding container b77119b19222ad446561d717a3bf776f5f18234fcf71c692172671576afea6b6: Status 404 returned error can't find the container with id b77119b19222ad446561d717a3bf776f5f18234fcf71c692172671576afea6b6
Jun 03 23:34:39.054457 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:39.054429    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:39.058496 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:39.058473    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq" event={"ID":"38d57b94-6fc5-467a-b7a2-86f8628f3387","Type":"ContainerStarted","Data":"b77119b19222ad446561d717a3bf776f5f18234fcf71c692172671576afea6b6"}
Jun 03 23:34:39.767166 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:39.767128    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:34:44.243787 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:44.243748    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 23:34:44.244069 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:44.243822    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 23:34:44.244069 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:44.243850    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 23:34:45.088620 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:45.088582    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq" event={"ID":"38d57b94-6fc5-467a-b7a2-86f8628f3387","Type":"ContainerStarted","Data":"217ab717de4f2df7493d395c513998270e5b04cdf7cb3048138252c723e3877d"}
Jun 03 23:34:45.111867 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:45.111819    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq" podStartSLOduration=1.782947404 podStartE2EDuration="7.111804896s" totalImagesPullingTime="5.328857492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:45.109334251 +0000 UTC m=+645.008236505" watchObservedRunningTime="2026-06-03 23:34:45.111804896 +0000 UTC m=+645.010707148"
Jun 03 23:34:45.730119 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:45.730092    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:45.734564 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:45.734541    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:46.093555 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:46.093475    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:34:46.094490 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:34:46.094469    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795n6skq"
Jun 03 23:35:02.324580 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:02.324544    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:02.422690 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:02.422649    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:02.453544 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:02.453508    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qfs6g"]
Jun 03 23:35:02.471236 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:02.471210    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qfs6g"]
Jun 03 23:35:02.471425 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:02.471327    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qfs6g"
Jun 03 23:35:02.473828 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:02.473809    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jv9ft\""
Jun 03 23:35:02.474350 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:02.474333    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 03 23:35:02.474746 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:02.474727    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 03 23:35:02.522207 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:02.522164    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:02.568058 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:02.568035    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4lv8\" (UniqueName: \"kubernetes.io/projected/a5e76e94-9ea8-4887-8c85-091a6ad91f09-kube-api-access-c4lv8\") pod \"kuadrant-operator-catalog-qfs6g\" (UID: \"a5e76e94-9ea8-4887-8c85-091a6ad91f09\") " pod="kuadrant-system/kuadrant-operator-catalog-qfs6g"
Jun 03 23:35:02.669135 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:02.669066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4lv8\" (UniqueName: \"kubernetes.io/projected/a5e76e94-9ea8-4887-8c85-091a6ad91f09-kube-api-access-c4lv8\") pod \"kuadrant-operator-catalog-qfs6g\" (UID: \"a5e76e94-9ea8-4887-8c85-091a6ad91f09\") " pod="kuadrant-system/kuadrant-operator-catalog-qfs6g"
Jun 03 23:35:02.677387 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:02.677363    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4lv8\" (UniqueName: \"kubernetes.io/projected/a5e76e94-9ea8-4887-8c85-091a6ad91f09-kube-api-access-c4lv8\") pod \"kuadrant-operator-catalog-qfs6g\" (UID: \"a5e76e94-9ea8-4887-8c85-091a6ad91f09\") " pod="kuadrant-system/kuadrant-operator-catalog-qfs6g"
Jun 03 23:35:02.782814 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:02.782789    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qfs6g"
Jun 03 23:35:02.815300 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:02.815263    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qfs6g"]
Jun 03 23:35:02.909460 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:02.909437    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qfs6g"]
Jun 03 23:35:02.911136 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:35:02.911113    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e76e94_9ea8_4887_8c85_091a6ad91f09.slice/crio-0440d5f70c3fdfa472920d8de444a726b9208f0086a42d492a80d5239a1379fe WatchSource:0}: Error finding container 0440d5f70c3fdfa472920d8de444a726b9208f0086a42d492a80d5239a1379fe: Status 404 returned error can't find the container with id 0440d5f70c3fdfa472920d8de444a726b9208f0086a42d492a80d5239a1379fe
Jun 03 23:35:03.043444 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:03.043413    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tp276"]
Jun 03 23:35:03.046517 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:03.046498    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tp276"
Jun 03 23:35:03.056890 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:03.056869    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tp276"]
Jun 03 23:35:03.173557 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:03.173526    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjfp2\" (UniqueName: \"kubernetes.io/projected/afe31876-7cab-4faf-b423-e715dcf61b47-kube-api-access-kjfp2\") pod \"kuadrant-operator-catalog-tp276\" (UID: \"afe31876-7cab-4faf-b423-e715dcf61b47\") " pod="kuadrant-system/kuadrant-operator-catalog-tp276"
Jun 03 23:35:03.174328 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:03.174299    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qfs6g" event={"ID":"a5e76e94-9ea8-4887-8c85-091a6ad91f09","Type":"ContainerStarted","Data":"0440d5f70c3fdfa472920d8de444a726b9208f0086a42d492a80d5239a1379fe"}
Jun 03 23:35:03.274747 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:03.274715    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjfp2\" (UniqueName: \"kubernetes.io/projected/afe31876-7cab-4faf-b423-e715dcf61b47-kube-api-access-kjfp2\") pod \"kuadrant-operator-catalog-tp276\" (UID: \"afe31876-7cab-4faf-b423-e715dcf61b47\") " pod="kuadrant-system/kuadrant-operator-catalog-tp276"
Jun 03 23:35:03.283216 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:03.283185    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjfp2\" (UniqueName: \"kubernetes.io/projected/afe31876-7cab-4faf-b423-e715dcf61b47-kube-api-access-kjfp2\") pod \"kuadrant-operator-catalog-tp276\" (UID: \"afe31876-7cab-4faf-b423-e715dcf61b47\") " pod="kuadrant-system/kuadrant-operator-catalog-tp276"
Jun 03 23:35:03.356392 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:03.356324    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tp276"
Jun 03 23:35:03.497227 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:03.497185    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tp276"]
Jun 03 23:35:03.534727 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:35:03.534690    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe31876_7cab_4faf_b423_e715dcf61b47.slice/crio-598a78ce7f4f73407b1812529855e8172140335a6021c72123e40d3749b45220 WatchSource:0}: Error finding container 598a78ce7f4f73407b1812529855e8172140335a6021c72123e40d3749b45220: Status 404 returned error can't find the container with id 598a78ce7f4f73407b1812529855e8172140335a6021c72123e40d3749b45220
Jun 03 23:35:04.182305 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:04.182242    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tp276" event={"ID":"afe31876-7cab-4faf-b423-e715dcf61b47","Type":"ContainerStarted","Data":"598a78ce7f4f73407b1812529855e8172140335a6021c72123e40d3749b45220"}
Jun 03 23:35:05.188641 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:05.188552    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tp276" event={"ID":"afe31876-7cab-4faf-b423-e715dcf61b47","Type":"ContainerStarted","Data":"827b8959a956c95cb55c25f4a20ceed9a5c37b184abbf02be9a785dcfc904d11"}
Jun 03 23:35:05.190042 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:05.190017    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qfs6g" event={"ID":"a5e76e94-9ea8-4887-8c85-091a6ad91f09","Type":"ContainerStarted","Data":"d6a57e6bdd5d9d6e7c6c6a0f31096f65b405fb3bc422c6cb6ddc88992d818773"}
Jun 03 23:35:05.190168 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:05.190091    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-qfs6g" podUID="a5e76e94-9ea8-4887-8c85-091a6ad91f09" containerName="registry-server" containerID="cri-o://d6a57e6bdd5d9d6e7c6c6a0f31096f65b405fb3bc422c6cb6ddc88992d818773" gracePeriod=2
Jun 03 23:35:05.212383 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:05.212341    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tp276" podStartSLOduration=0.903807881 podStartE2EDuration="2.21232755s" totalImagesPullingTime="1.308519669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:35:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:35:05.211582097 +0000 UTC m=+665.110484352" watchObservedRunningTime="2026-06-03 23:35:05.21232755 +0000 UTC m=+665.111229836"
Jun 03 23:35:05.234840 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:05.234801    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qfs6g" podStartSLOduration=1.303458643 podStartE2EDuration="3.234785193s" totalImagesPullingTime="1.93132655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:35:05.234652569 +0000 UTC m=+665.133554824" watchObservedRunningTime="2026-06-03 23:35:05.234785193 +0000 UTC m=+665.133687446"
Jun 03 23:35:05.430225 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:05.430198    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qfs6g"
Jun 03 23:35:05.597184 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:05.597155    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4lv8\" (UniqueName: \"kubernetes.io/projected/a5e76e94-9ea8-4887-8c85-091a6ad91f09-kube-api-access-c4lv8\") pod \"a5e76e94-9ea8-4887-8c85-091a6ad91f09\" (UID: \"a5e76e94-9ea8-4887-8c85-091a6ad91f09\") "
Jun 03 23:35:05.599246 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:05.599218    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e76e94-9ea8-4887-8c85-091a6ad91f09-kube-api-access-c4lv8" (OuterVolumeSpecName: "kube-api-access-c4lv8") pod "a5e76e94-9ea8-4887-8c85-091a6ad91f09" (UID: "a5e76e94-9ea8-4887-8c85-091a6ad91f09"). InnerVolumeSpecName "kube-api-access-c4lv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 23:35:05.698068 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:05.698046    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4lv8\" (UniqueName: \"kubernetes.io/projected/a5e76e94-9ea8-4887-8c85-091a6ad91f09-kube-api-access-c4lv8\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:35:06.196142 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:06.196053    2561 generic.go:356] "Generic (PLEG): container finished" podID="a5e76e94-9ea8-4887-8c85-091a6ad91f09" containerID="d6a57e6bdd5d9d6e7c6c6a0f31096f65b405fb3bc422c6cb6ddc88992d818773" exitCode=0
Jun 03 23:35:06.196142 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:06.196113    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qfs6g"
Jun 03 23:35:06.196647 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:06.196142    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qfs6g" event={"ID":"a5e76e94-9ea8-4887-8c85-091a6ad91f09","Type":"ContainerDied","Data":"d6a57e6bdd5d9d6e7c6c6a0f31096f65b405fb3bc422c6cb6ddc88992d818773"}
Jun 03 23:35:06.196647 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:06.196244    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qfs6g" event={"ID":"a5e76e94-9ea8-4887-8c85-091a6ad91f09","Type":"ContainerDied","Data":"0440d5f70c3fdfa472920d8de444a726b9208f0086a42d492a80d5239a1379fe"}
Jun 03 23:35:06.196647 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:06.196283    2561 scope.go:117] "RemoveContainer" containerID="d6a57e6bdd5d9d6e7c6c6a0f31096f65b405fb3bc422c6cb6ddc88992d818773"
Jun 03 23:35:06.205678 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:06.205661    2561 scope.go:117] "RemoveContainer" containerID="d6a57e6bdd5d9d6e7c6c6a0f31096f65b405fb3bc422c6cb6ddc88992d818773"
Jun 03 23:35:06.205928 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:35:06.205910    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6a57e6bdd5d9d6e7c6c6a0f31096f65b405fb3bc422c6cb6ddc88992d818773\": container with ID starting with d6a57e6bdd5d9d6e7c6c6a0f31096f65b405fb3bc422c6cb6ddc88992d818773 not found: ID does not exist" containerID="d6a57e6bdd5d9d6e7c6c6a0f31096f65b405fb3bc422c6cb6ddc88992d818773"
Jun 03 23:35:06.206000 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:06.205935    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6a57e6bdd5d9d6e7c6c6a0f31096f65b405fb3bc422c6cb6ddc88992d818773"} err="failed to get container status \"d6a57e6bdd5d9d6e7c6c6a0f31096f65b405fb3bc422c6cb6ddc88992d818773\": rpc error: code = NotFound desc = could not find container \"d6a57e6bdd5d9d6e7c6c6a0f31096f65b405fb3bc422c6cb6ddc88992d818773\": container with ID starting with d6a57e6bdd5d9d6e7c6c6a0f31096f65b405fb3bc422c6cb6ddc88992d818773 not found: ID does not exist"
Jun 03 23:35:06.218488 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:06.218458    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qfs6g"]
Jun 03 23:35:06.224027 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:06.223997    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qfs6g"]
Jun 03 23:35:06.528212 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:06.528179    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5e76e94-9ea8-4887-8c85-091a6ad91f09" path="/var/lib/kubelet/pods/a5e76e94-9ea8-4887-8c85-091a6ad91f09/volumes"
Jun 03 23:35:12.673481 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:12.673449    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:12.761571 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:12.761543    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:13.356852 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:13.356818    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-tp276"
Jun 03 23:35:13.357054 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:13.356882    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-tp276"
Jun 03 23:35:13.380414 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:13.380390    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-tp276"
Jun 03 23:35:14.254917 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:14.254882    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-tp276"
Jun 03 23:35:20.030610 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:20.030577    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:20.130262 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:20.130237    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:25.669146 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:25.669109    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:25.856510 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:25.856473    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:26.999622 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:26.999588    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:28.076611 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:28.076575    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vlnbl"]
Jun 03 23:35:28.077018 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:28.077004    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e76e94-9ea8-4887-8c85-091a6ad91f09" containerName="registry-server"
Jun 03 23:35:28.077063 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:28.077020    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e76e94-9ea8-4887-8c85-091a6ad91f09" containerName="registry-server"
Jun 03 23:35:28.077098 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:28.077083    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5e76e94-9ea8-4887-8c85-091a6ad91f09" containerName="registry-server"
Jun 03 23:35:28.080420 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:28.080402    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlnbl"
Jun 03 23:35:28.085456 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:28.085429    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-s6gn6\""
Jun 03 23:35:28.110393 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:28.110356    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vlnbl"]
Jun 03 23:35:28.201898 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:28.201856    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw5p9\" (UniqueName: \"kubernetes.io/projected/4c8e44f8-381a-4579-b642-f7496123a754-kube-api-access-tw5p9\") pod \"authorino-operator-75cc8d5cb7-vlnbl\" (UID: \"4c8e44f8-381a-4579-b642-f7496123a754\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlnbl"
Jun 03 23:35:28.303415 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:28.303375    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw5p9\" (UniqueName: \"kubernetes.io/projected/4c8e44f8-381a-4579-b642-f7496123a754-kube-api-access-tw5p9\") pod \"authorino-operator-75cc8d5cb7-vlnbl\" (UID: \"4c8e44f8-381a-4579-b642-f7496123a754\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlnbl"
Jun 03 23:35:28.313255 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:28.313220    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw5p9\" (UniqueName: \"kubernetes.io/projected/4c8e44f8-381a-4579-b642-f7496123a754-kube-api-access-tw5p9\") pod \"authorino-operator-75cc8d5cb7-vlnbl\" (UID: \"4c8e44f8-381a-4579-b642-f7496123a754\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlnbl"
Jun 03 23:35:28.391299 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:28.391177    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlnbl"
Jun 03 23:35:28.531542 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:28.531516    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vlnbl"]
Jun 03 23:35:28.534323 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:35:28.534292    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c8e44f8_381a_4579_b642_f7496123a754.slice/crio-f9eea118d55cff783f1364870bc087ee007997e6de7866b4e6b0553e9a43bcec WatchSource:0}: Error finding container f9eea118d55cff783f1364870bc087ee007997e6de7866b4e6b0553e9a43bcec: Status 404 returned error can't find the container with id f9eea118d55cff783f1364870bc087ee007997e6de7866b4e6b0553e9a43bcec
Jun 03 23:35:29.112582 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:29.112510    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:29.317758 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:29.317720    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlnbl" event={"ID":"4c8e44f8-381a-4579-b642-f7496123a754","Type":"ContainerStarted","Data":"f9eea118d55cff783f1364870bc087ee007997e6de7866b4e6b0553e9a43bcec"}
Jun 03 23:35:31.331432 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:31.331394    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlnbl" event={"ID":"4c8e44f8-381a-4579-b642-f7496123a754","Type":"ContainerStarted","Data":"2eb29b9fea60cb67a559def6ff21c4e8005aad36871585eccdc43c77c8c5ccb3"}
Jun 03 23:35:31.331805 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:31.331526    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlnbl"
Jun 03 23:35:31.356794 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:31.356743    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlnbl" podStartSLOduration=1.298515158 podStartE2EDuration="3.35672603s" totalImagesPullingTime="2.058210872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:35:31.356251246 +0000 UTC m=+691.255153498" watchObservedRunningTime="2026-06-03 23:35:31.35672603 +0000 UTC m=+691.255628282"
Jun 03 23:35:31.748838 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:31.748801    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"]
Jun 03 23:35:31.752500 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:31.752481    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"
Jun 03 23:35:31.755771 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:31.755749    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mbtfj\""
Jun 03 23:35:31.772029 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:31.771999    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"]
Jun 03 23:35:31.837046 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:31.837006    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48fq6\" (UniqueName: \"kubernetes.io/projected/c2e932da-60f9-4cf1-9656-5af8369fd69c-kube-api-access-48fq6\") pod \"limitador-operator-controller-manager-859d7b78bd-9pzm8\" (UID: \"c2e932da-60f9-4cf1-9656-5af8369fd69c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"
Jun 03 23:35:31.937681 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:31.937642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48fq6\" (UniqueName: \"kubernetes.io/projected/c2e932da-60f9-4cf1-9656-5af8369fd69c-kube-api-access-48fq6\") pod \"limitador-operator-controller-manager-859d7b78bd-9pzm8\" (UID: \"c2e932da-60f9-4cf1-9656-5af8369fd69c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"
Jun 03 23:35:31.949935 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:31.949897    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48fq6\" (UniqueName: \"kubernetes.io/projected/c2e932da-60f9-4cf1-9656-5af8369fd69c-kube-api-access-48fq6\") pod \"limitador-operator-controller-manager-859d7b78bd-9pzm8\" (UID: \"c2e932da-60f9-4cf1-9656-5af8369fd69c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"
Jun 03 23:35:32.063560 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:32.063459    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"
Jun 03 23:35:32.210770 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:32.210705    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"]
Jun 03 23:35:32.213111 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:35:32.213077    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e932da_60f9_4cf1_9656_5af8369fd69c.slice/crio-fe9807a5c59fcb0be46af7f394ec67289a0aa01c1e645717461d0b7d45286f59 WatchSource:0}: Error finding container fe9807a5c59fcb0be46af7f394ec67289a0aa01c1e645717461d0b7d45286f59: Status 404 returned error can't find the container with id fe9807a5c59fcb0be46af7f394ec67289a0aa01c1e645717461d0b7d45286f59
Jun 03 23:35:32.339045 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:32.338955    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8" event={"ID":"c2e932da-60f9-4cf1-9656-5af8369fd69c","Type":"ContainerStarted","Data":"fe9807a5c59fcb0be46af7f394ec67289a0aa01c1e645717461d0b7d45286f59"}
Jun 03 23:35:32.918693 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:32.918661    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:34.352534 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:34.352500    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8" event={"ID":"c2e932da-60f9-4cf1-9656-5af8369fd69c","Type":"ContainerStarted","Data":"fbe263c0ebd3d40ca8f9cf05a0194d2ef0cfbf45b41da4f565e37417126dde9f"}
Jun 03 23:35:34.352961 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:34.352561    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"
Jun 03 23:35:34.374877 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:34.374817    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8" podStartSLOduration=2.140317047 podStartE2EDuration="3.374801276s" totalImagesPullingTime="1.234484229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:35:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:35:34.372215475 +0000 UTC m=+694.271117724" watchObservedRunningTime="2026-06-03 23:35:34.374801276 +0000 UTC m=+694.273703612"
Jun 03 23:35:34.972248 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:34.972213    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:35.291082 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:35.290993    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:35.391839 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:35.391801    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:35.929247 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:35.929217    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:36.464778 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:36.464729    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:37.940969 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:37.940932    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:41.121694 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:41.121652    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:41.222219 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:41.222186    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:41.329287 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:41.329243    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:42.341399 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:42.341363    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlnbl"
Jun 03 23:35:45.114432 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:45.114394    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:45.262158 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:45.262122    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:45.360099 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:45.360072    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"
Jun 03 23:35:45.965450 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:45.965418    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:46.068658 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:46.068625    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:46.170817 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:46.170782    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:46.262589 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:46.262502    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:47.617365 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.617327    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8"]
Jun 03 23:35:47.624244 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.624218    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:47.625412 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.625398    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8"
Jun 03 23:35:47.627511 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.627487    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jun 03 23:35:47.627511 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.627506    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kzwvk\""
Jun 03 23:35:47.627704 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.627487    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jun 03 23:35:47.629553 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.629527    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8"]
Jun 03 23:35:47.776827 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.776792    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:47.798101 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.798066    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c05b70e2-12d6-44d6-8693-7ea13eabda6f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-wpdd8\" (UID: \"c05b70e2-12d6-44d6-8693-7ea13eabda6f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8"
Jun 03 23:35:47.798243 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.798203    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtmnb\" (UniqueName: \"kubernetes.io/projected/c05b70e2-12d6-44d6-8693-7ea13eabda6f-kube-api-access-dtmnb\") pod \"kuadrant-console-plugin-66b5774985-wpdd8\" (UID: \"c05b70e2-12d6-44d6-8693-7ea13eabda6f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8"
Jun 03 23:35:47.798355 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.798335    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c05b70e2-12d6-44d6-8693-7ea13eabda6f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wpdd8\" (UID: \"c05b70e2-12d6-44d6-8693-7ea13eabda6f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8"
Jun 03 23:35:47.899460 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.899344    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtmnb\" (UniqueName: \"kubernetes.io/projected/c05b70e2-12d6-44d6-8693-7ea13eabda6f-kube-api-access-dtmnb\") pod \"kuadrant-console-plugin-66b5774985-wpdd8\" (UID: \"c05b70e2-12d6-44d6-8693-7ea13eabda6f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8"
Jun 03 23:35:47.899460 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.899425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c05b70e2-12d6-44d6-8693-7ea13eabda6f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wpdd8\" (UID: \"c05b70e2-12d6-44d6-8693-7ea13eabda6f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8"
Jun 03 23:35:47.899460 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.899454    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c05b70e2-12d6-44d6-8693-7ea13eabda6f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-wpdd8\" (UID: \"c05b70e2-12d6-44d6-8693-7ea13eabda6f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8"
Jun 03 23:35:47.900152 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.900121    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c05b70e2-12d6-44d6-8693-7ea13eabda6f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-wpdd8\" (UID: \"c05b70e2-12d6-44d6-8693-7ea13eabda6f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8"
Jun 03 23:35:47.901809 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.901789    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c05b70e2-12d6-44d6-8693-7ea13eabda6f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wpdd8\" (UID: \"c05b70e2-12d6-44d6-8693-7ea13eabda6f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8"
Jun 03 23:35:47.915657 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.915630    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtmnb\" (UniqueName: \"kubernetes.io/projected/c05b70e2-12d6-44d6-8693-7ea13eabda6f-kube-api-access-dtmnb\") pod \"kuadrant-console-plugin-66b5774985-wpdd8\" (UID: \"c05b70e2-12d6-44d6-8693-7ea13eabda6f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8"
Jun 03 23:35:47.936538 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:47.936501    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8"
Jun 03 23:35:48.078443 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:48.078421    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8"]
Jun 03 23:35:48.080734 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:35:48.080698    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc05b70e2_12d6_44d6_8693_7ea13eabda6f.slice/crio-9f88c960935759be97a7d56e5c43d39bdd52ce65e7308be095ae447b0f65e530 WatchSource:0}: Error finding container 9f88c960935759be97a7d56e5c43d39bdd52ce65e7308be095ae447b0f65e530: Status 404 returned error can't find the container with id 9f88c960935759be97a7d56e5c43d39bdd52ce65e7308be095ae447b0f65e530
Jun 03 23:35:48.115561 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:48.115523    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:48.186997 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:48.186911    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:48.426449 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:48.426402    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8" event={"ID":"c05b70e2-12d6-44d6-8693-7ea13eabda6f","Type":"ContainerStarted","Data":"9f88c960935759be97a7d56e5c43d39bdd52ce65e7308be095ae447b0f65e530"}
Jun 03 23:35:52.497418 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:52.497321    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:52.596951 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:52.596896    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:35:56.904316 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:56.904281    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"]
Jun 03 23:35:56.920256 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:56.920213    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"
Jun 03 23:35:56.923036 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:56.922981    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2ss54\""
Jun 03 23:35:56.925247 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:56.925171    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"]
Jun 03 23:35:56.984588 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:56.984554    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cd0c05e-c8ca-4896-9ab6-1ef13229a258-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hrnv5\" (UID: \"1cd0c05e-c8ca-4896-9ab6-1ef13229a258\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"
Jun 03 23:35:56.984780 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:56.984617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bxnq\" (UniqueName: \"kubernetes.io/projected/1cd0c05e-c8ca-4896-9ab6-1ef13229a258-kube-api-access-9bxnq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hrnv5\" (UID: \"1cd0c05e-c8ca-4896-9ab6-1ef13229a258\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"
Jun 03 23:35:57.085744 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.085609    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cd0c05e-c8ca-4896-9ab6-1ef13229a258-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hrnv5\" (UID: \"1cd0c05e-c8ca-4896-9ab6-1ef13229a258\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"
Jun 03 23:35:57.085744 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.085695    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bxnq\" (UniqueName: \"kubernetes.io/projected/1cd0c05e-c8ca-4896-9ab6-1ef13229a258-kube-api-access-9bxnq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hrnv5\" (UID: \"1cd0c05e-c8ca-4896-9ab6-1ef13229a258\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"
Jun 03 23:35:57.086196 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.086156    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cd0c05e-c8ca-4896-9ab6-1ef13229a258-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hrnv5\" (UID: \"1cd0c05e-c8ca-4896-9ab6-1ef13229a258\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"
Jun 03 23:35:57.094996 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.094961    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bxnq\" (UniqueName: \"kubernetes.io/projected/1cd0c05e-c8ca-4896-9ab6-1ef13229a258-kube-api-access-9bxnq\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-hrnv5\" (UID: \"1cd0c05e-c8ca-4896-9ab6-1ef13229a258\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"
Jun 03 23:35:57.237638 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.237600    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"
Jun 03 23:35:57.514750 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.514654    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"]
Jun 03 23:35:57.523806 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.523778    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"]
Jun 03 23:35:57.560573 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.560540    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"]
Jun 03 23:35:57.560823 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.560788    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8" podUID="c2e932da-60f9-4cf1-9656-5af8369fd69c" containerName="manager" containerID="cri-o://fbe263c0ebd3d40ca8f9cf05a0194d2ef0cfbf45b41da4f565e37417126dde9f" gracePeriod=2
Jun 03 23:35:57.577584 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.577554    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"]
Jun 03 23:35:57.588573 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:35:57.588517    2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"c2e932da-60f9-4cf1-9656-5af8369fd69c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-9pzm8\": pods \"limitador-operator-controller-manager-859d7b78bd-9pzm8\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"
Jun 03 23:35:57.606391 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.606357    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wtzgc"]
Jun 03 23:35:57.607003 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.606968    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2e932da-60f9-4cf1-9656-5af8369fd69c" containerName="manager"
Jun 03 23:35:57.607003 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.606990    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2e932da-60f9-4cf1-9656-5af8369fd69c" containerName="manager"
Jun 03 23:35:57.607221 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.607094    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2e932da-60f9-4cf1-9656-5af8369fd69c" containerName="manager"
Jun 03 23:35:57.611958 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.611936    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wtzgc"
Jun 03 23:35:57.614472 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:35:57.614436    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9pzm8\" is forbidden: User \"system:node:ip-10-0-129-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-203.ec2.internal' and this object" podUID="c2e932da-60f9-4cf1-9656-5af8369fd69c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"
Jun 03 23:35:57.627707 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.627391    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wtzgc"]
Jun 03 23:35:57.692264 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.692223    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znzwh\" (UniqueName: \"kubernetes.io/projected/e45df8e2-6e1a-4998-a4a8-e08adb06ee3c-kube-api-access-znzwh\") pod \"limitador-operator-controller-manager-859d7b78bd-wtzgc\" (UID: \"e45df8e2-6e1a-4998-a4a8-e08adb06ee3c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wtzgc"
Jun 03 23:35:57.793750 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.793657    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znzwh\" (UniqueName: \"kubernetes.io/projected/e45df8e2-6e1a-4998-a4a8-e08adb06ee3c-kube-api-access-znzwh\") pod \"limitador-operator-controller-manager-859d7b78bd-wtzgc\" (UID: \"e45df8e2-6e1a-4998-a4a8-e08adb06ee3c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wtzgc"
Jun 03 23:35:57.804587 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.804546    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znzwh\" (UniqueName: \"kubernetes.io/projected/e45df8e2-6e1a-4998-a4a8-e08adb06ee3c-kube-api-access-znzwh\") pod \"limitador-operator-controller-manager-859d7b78bd-wtzgc\" (UID: \"e45df8e2-6e1a-4998-a4a8-e08adb06ee3c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wtzgc"
Jun 03 23:35:57.946074 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:57.946026    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wtzgc"
Jun 03 23:35:59.581761 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:35:59.581721    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:00.350118 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:00.350082    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:00.449100 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:00.449052    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:00.755214 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:00.755175    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:00.853246 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:00.853216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:03.345969 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:03.345922    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:03.446645 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:03.446589    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:06.391731 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:06.391652    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:06.492214 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:06.492173    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:10.096127 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.096098    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"
Jun 03 23:36:10.098439 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:36:10.098407    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9pzm8\" is forbidden: User \"system:node:ip-10-0-129-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-203.ec2.internal' and this object" podUID="c2e932da-60f9-4cf1-9656-5af8369fd69c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"
Jun 03 23:36:10.125518 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.125493    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wtzgc"]
Jun 03 23:36:10.126768 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:36:10.126740    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode45df8e2_6e1a_4998_a4a8_e08adb06ee3c.slice/crio-00d76f9916df1d722ef8890541bfa8aac0373515d3a06aacdb51b24433b334f4 WatchSource:0}: Error finding container 00d76f9916df1d722ef8890541bfa8aac0373515d3a06aacdb51b24433b334f4: Status 404 returned error can't find the container with id 00d76f9916df1d722ef8890541bfa8aac0373515d3a06aacdb51b24433b334f4
Jun 03 23:36:10.224916 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.224882    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48fq6\" (UniqueName: \"kubernetes.io/projected/c2e932da-60f9-4cf1-9656-5af8369fd69c-kube-api-access-48fq6\") pod \"c2e932da-60f9-4cf1-9656-5af8369fd69c\" (UID: \"c2e932da-60f9-4cf1-9656-5af8369fd69c\") "
Jun 03 23:36:10.226963 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.226941    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2e932da-60f9-4cf1-9656-5af8369fd69c-kube-api-access-48fq6" (OuterVolumeSpecName: "kube-api-access-48fq6") pod "c2e932da-60f9-4cf1-9656-5af8369fd69c" (UID: "c2e932da-60f9-4cf1-9656-5af8369fd69c"). InnerVolumeSpecName "kube-api-access-48fq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 23:36:10.326804 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.326763    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48fq6\" (UniqueName: \"kubernetes.io/projected/c2e932da-60f9-4cf1-9656-5af8369fd69c-kube-api-access-48fq6\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:36:10.527134 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:36:10.527037    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9pzm8\" is forbidden: User \"system:node:ip-10-0-129-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-203.ec2.internal' and this object" podUID="c2e932da-60f9-4cf1-9656-5af8369fd69c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"
Jun 03 23:36:10.528818 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.528796    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2e932da-60f9-4cf1-9656-5af8369fd69c" path="/var/lib/kubelet/pods/c2e932da-60f9-4cf1-9656-5af8369fd69c/volumes"
Jun 03 23:36:10.566334 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.566285    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8" event={"ID":"c05b70e2-12d6-44d6-8693-7ea13eabda6f","Type":"ContainerStarted","Data":"d20f964bd0462d35ca7b5b3a051ff581b3c9145d84d64fbb21a4806adcbd23cf"}
Jun 03 23:36:10.567873 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.567847    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wtzgc" event={"ID":"e45df8e2-6e1a-4998-a4a8-e08adb06ee3c","Type":"ContainerStarted","Data":"6b0529fbd7ca395b83858ab616442b7dd7c51f9032bfd82d15c780ba060a247c"}
Jun 03 23:36:10.568033 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.567947    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wtzgc" event={"ID":"e45df8e2-6e1a-4998-a4a8-e08adb06ee3c","Type":"ContainerStarted","Data":"00d76f9916df1d722ef8890541bfa8aac0373515d3a06aacdb51b24433b334f4"}
Jun 03 23:36:10.568033 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.567983    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wtzgc"
Jun 03 23:36:10.569054 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.569030    2561 generic.go:356] "Generic (PLEG): container finished" podID="c2e932da-60f9-4cf1-9656-5af8369fd69c" containerID="fbe263c0ebd3d40ca8f9cf05a0194d2ef0cfbf45b41da4f565e37417126dde9f" exitCode=0
Jun 03 23:36:10.569156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.569079    2561 scope.go:117] "RemoveContainer" containerID="fbe263c0ebd3d40ca8f9cf05a0194d2ef0cfbf45b41da4f565e37417126dde9f"
Jun 03 23:36:10.569156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.569082    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"
Jun 03 23:36:10.577778 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.577755    2561 scope.go:117] "RemoveContainer" containerID="fbe263c0ebd3d40ca8f9cf05a0194d2ef0cfbf45b41da4f565e37417126dde9f"
Jun 03 23:36:10.578015 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:36:10.577995    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbe263c0ebd3d40ca8f9cf05a0194d2ef0cfbf45b41da4f565e37417126dde9f\": container with ID starting with fbe263c0ebd3d40ca8f9cf05a0194d2ef0cfbf45b41da4f565e37417126dde9f not found: ID does not exist" containerID="fbe263c0ebd3d40ca8f9cf05a0194d2ef0cfbf45b41da4f565e37417126dde9f"
Jun 03 23:36:10.578076 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.578030    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbe263c0ebd3d40ca8f9cf05a0194d2ef0cfbf45b41da4f565e37417126dde9f"} err="failed to get container status \"fbe263c0ebd3d40ca8f9cf05a0194d2ef0cfbf45b41da4f565e37417126dde9f\": rpc error: code = NotFound desc = could not find container \"fbe263c0ebd3d40ca8f9cf05a0194d2ef0cfbf45b41da4f565e37417126dde9f\": container with ID starting with fbe263c0ebd3d40ca8f9cf05a0194d2ef0cfbf45b41da4f565e37417126dde9f not found: ID does not exist"
Jun 03 23:36:10.600779 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.600727    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wpdd8" podStartSLOduration=1.6689091729999999 podStartE2EDuration="23.600709476s" totalImagesPullingTime="21.931800303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:36:10.598824311 +0000 UTC m=+730.497726582" watchObservedRunningTime="2026-06-03 23:36:10.600709476 +0000 UTC m=+730.499611730"
Jun 03 23:36:10.609520 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:36:10.609482    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9pzm8\" is forbidden: User \"system:node:ip-10-0-129-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-203.ec2.internal' and this object" podUID="c2e932da-60f9-4cf1-9656-5af8369fd69c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9pzm8"
Jun 03 23:36:10.648715 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.648664    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wtzgc" podStartSLOduration=13.64864858 podStartE2EDuration="13.64864858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:35:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:36:10.645631751 +0000 UTC m=+730.544533997" watchObservedRunningTime="2026-06-03 23:36:10.64864858 +0000 UTC m=+730.547550832"
Jun 03 23:36:10.955918 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:10.955889    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:11.048767 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:11.048732    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:11.983427 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:11.983386    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:12.084483 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:12.084451    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:12.510730 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:36:12.510685    2561 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-hrnv5_kuadrant-system_1cd0c05e-c8ca-4896-9ab6-1ef13229a258_0(44f713aa8645a26683cfd717b6fa5cbdd330c3f7673a3978621f0dafa8b61dac): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-hrnv5 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jun 03 23:36:12.510806 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:36:12.510750    2561 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-hrnv5_kuadrant-system_1cd0c05e-c8ca-4896-9ab6-1ef13229a258_0(44f713aa8645a26683cfd717b6fa5cbdd330c3f7673a3978621f0dafa8b61dac): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-hrnv5 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"
Jun 03 23:36:12.581251 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:12.581218    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"
Jun 03 23:36:12.583225 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:36:12.583199    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hrnv5\" is forbidden: User \"system:node:ip-10-0-129-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-203.ec2.internal' and this object" podUID="1cd0c05e-c8ca-4896-9ab6-1ef13229a258" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"
Jun 03 23:36:12.588385 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:12.588364    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"
Jun 03 23:36:12.590110 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:36:12.590081    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hrnv5\" is forbidden: User \"system:node:ip-10-0-129-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-203.ec2.internal' and this object" podUID="1cd0c05e-c8ca-4896-9ab6-1ef13229a258" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"
Jun 03 23:36:12.649162 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:12.649128    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cd0c05e-c8ca-4896-9ab6-1ef13229a258-extensions-socket-volume\") pod \"1cd0c05e-c8ca-4896-9ab6-1ef13229a258\" (UID: \"1cd0c05e-c8ca-4896-9ab6-1ef13229a258\") "
Jun 03 23:36:12.649408 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:12.649188    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bxnq\" (UniqueName: \"kubernetes.io/projected/1cd0c05e-c8ca-4896-9ab6-1ef13229a258-kube-api-access-9bxnq\") pod \"1cd0c05e-c8ca-4896-9ab6-1ef13229a258\" (UID: \"1cd0c05e-c8ca-4896-9ab6-1ef13229a258\") "
Jun 03 23:36:12.649408 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:12.649397    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cd0c05e-c8ca-4896-9ab6-1ef13229a258-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1cd0c05e-c8ca-4896-9ab6-1ef13229a258" (UID: "1cd0c05e-c8ca-4896-9ab6-1ef13229a258"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 23:36:12.649493 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:12.649484    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cd0c05e-c8ca-4896-9ab6-1ef13229a258-extensions-socket-volume\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:36:12.651507 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:12.651358    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cd0c05e-c8ca-4896-9ab6-1ef13229a258-kube-api-access-9bxnq" (OuterVolumeSpecName: "kube-api-access-9bxnq") pod "1cd0c05e-c8ca-4896-9ab6-1ef13229a258" (UID: "1cd0c05e-c8ca-4896-9ab6-1ef13229a258"). InnerVolumeSpecName "kube-api-access-9bxnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 23:36:12.750462 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:12.750367    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bxnq\" (UniqueName: \"kubernetes.io/projected/1cd0c05e-c8ca-4896-9ab6-1ef13229a258-kube-api-access-9bxnq\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 03 23:36:13.586010 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:13.585982    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"
Jun 03 23:36:13.588065 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:36:13.588037    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hrnv5\" is forbidden: User \"system:node:ip-10-0-129-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-203.ec2.internal' and this object" podUID="1cd0c05e-c8ca-4896-9ab6-1ef13229a258" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"
Jun 03 23:36:13.593485 ip-10-0-129-203 kubenswrapper[2561]: E0603 23:36:13.593456    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-hrnv5\" is forbidden: User \"system:node:ip-10-0-129-203.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-203.ec2.internal' and this object" podUID="1cd0c05e-c8ca-4896-9ab6-1ef13229a258" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-hrnv5"
Jun 03 23:36:14.528847 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:14.528810    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cd0c05e-c8ca-4896-9ab6-1ef13229a258" path="/var/lib/kubelet/pods/1cd0c05e-c8ca-4896-9ab6-1ef13229a258/volumes"
Jun 03 23:36:21.578673 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:21.578642    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wtzgc"
Jun 03 23:36:26.322576 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.322538    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"]
Jun 03 23:36:26.337375 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.337344    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.346875 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.346575    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-qsdxw\""
Jun 03 23:36:26.351594 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.351561    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"]
Jun 03 23:36:26.365775 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.365739    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:26.468997 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.468962    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:26.483343 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.483256    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5037a6c-d404-4612-b511-7174fa6b8049-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.483502 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.483365    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5037a6c-d404-4612-b511-7174fa6b8049-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.483502 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.483390    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5037a6c-d404-4612-b511-7174fa6b8049-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.483502 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.483409    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njtw6\" (UniqueName: \"kubernetes.io/projected/f5037a6c-d404-4612-b511-7174fa6b8049-kube-api-access-njtw6\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.483502 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.483437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5037a6c-d404-4612-b511-7174fa6b8049-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.483644 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.483526    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5037a6c-d404-4612-b511-7174fa6b8049-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.483644 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.483579    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5037a6c-d404-4612-b511-7174fa6b8049-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.483644 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.483616    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5037a6c-d404-4612-b511-7174fa6b8049-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.483739 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.483650    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5037a6c-d404-4612-b511-7174fa6b8049-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.584615 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.584505    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5037a6c-d404-4612-b511-7174fa6b8049-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.584615 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.584556    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5037a6c-d404-4612-b511-7174fa6b8049-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.584894 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.584675    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5037a6c-d404-4612-b511-7174fa6b8049-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.584894 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.584714    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njtw6\" (UniqueName: \"kubernetes.io/projected/f5037a6c-d404-4612-b511-7174fa6b8049-kube-api-access-njtw6\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.584894 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.584757    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5037a6c-d404-4612-b511-7174fa6b8049-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.584894 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.584803    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5037a6c-d404-4612-b511-7174fa6b8049-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.584894 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.584863    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5037a6c-d404-4612-b511-7174fa6b8049-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.585175 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.584912    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5037a6c-d404-4612-b511-7174fa6b8049-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.585175 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.584965    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5037a6c-d404-4612-b511-7174fa6b8049-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.585361 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.585316    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5037a6c-d404-4612-b511-7174fa6b8049-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.585423 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.585372    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5037a6c-d404-4612-b511-7174fa6b8049-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.585524 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.585472    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5037a6c-d404-4612-b511-7174fa6b8049-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.585524 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.584976    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5037a6c-d404-4612-b511-7174fa6b8049-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.585830 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.585802    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5037a6c-d404-4612-b511-7174fa6b8049-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.587201 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.587172    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5037a6c-d404-4612-b511-7174fa6b8049-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.587428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.587412    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5037a6c-d404-4612-b511-7174fa6b8049-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.595979 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.595953    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njtw6\" (UniqueName: \"kubernetes.io/projected/f5037a6c-d404-4612-b511-7174fa6b8049-kube-api-access-njtw6\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.596336 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.596311    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5037a6c-d404-4612-b511-7174fa6b8049-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-969c5\" (UID: \"f5037a6c-d404-4612-b511-7174fa6b8049\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.657645 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.657607    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:26.825596 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.825565    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"]
Jun 03 23:36:26.828259 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:36:26.828229    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5037a6c_d404_4612_b511_7174fa6b8049.slice/crio-ec3dfe659a0da8fb6f5a4bc54105a44faf3146fb9a67e976cd42e428b8e6ad51 WatchSource:0}: Error finding container ec3dfe659a0da8fb6f5a4bc54105a44faf3146fb9a67e976cd42e428b8e6ad51: Status 404 returned error can't find the container with id ec3dfe659a0da8fb6f5a4bc54105a44faf3146fb9a67e976cd42e428b8e6ad51
Jun 03 23:36:26.830644 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.830608    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 23:36:26.830771 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.830695    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 23:36:26.830771 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:26.830744    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 23:36:27.661600 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:27.661562    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5" event={"ID":"f5037a6c-d404-4612-b511-7174fa6b8049","Type":"ContainerStarted","Data":"1ffcbe7183ee1133f97d4752821a4194dc8ed8ec5dc566cc1051b2f1ee482485"}
Jun 03 23:36:27.662018 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:27.661621    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5" event={"ID":"f5037a6c-d404-4612-b511-7174fa6b8049","Type":"ContainerStarted","Data":"ec3dfe659a0da8fb6f5a4bc54105a44faf3146fb9a67e976cd42e428b8e6ad51"}
Jun 03 23:36:27.682584 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:27.682535    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5" podStartSLOduration=1.68251688 podStartE2EDuration="1.68251688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:36:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:36:27.681315672 +0000 UTC m=+747.580217927" watchObservedRunningTime="2026-06-03 23:36:27.68251688 +0000 UTC m=+747.581419132"
Jun 03 23:36:28.658259 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:28.658216    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:28.663571 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:28.663547    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:28.667029 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:28.667005    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:28.667904 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:28.667887    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:36:30.075761 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:30.075732    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:40.993367 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:40.993325    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:41.095349 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:41.095315    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:41.157391 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:41.157356    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:41.426381 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:41.426345    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:36:41.460476 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:41.460443    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:36:41.460476 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:41.460483    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:36:41.460679 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:41.460568    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qmttl"
Jun 03 23:36:41.462565 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:41.462539    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jun 03 23:36:41.529038 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:41.529000    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkg5c\" (UniqueName: \"kubernetes.io/projected/9a9dc818-275c-4a9d-a107-4061aba7bcef-kube-api-access-vkg5c\") pod \"limitador-limitador-54d6d988d5-qmttl\" (UID: \"9a9dc818-275c-4a9d-a107-4061aba7bcef\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qmttl"
Jun 03 23:36:41.529235 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:41.529068    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a9dc818-275c-4a9d-a107-4061aba7bcef-config-file\") pod \"limitador-limitador-54d6d988d5-qmttl\" (UID: \"9a9dc818-275c-4a9d-a107-4061aba7bcef\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qmttl"
Jun 03 23:36:41.630208 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:41.630164    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a9dc818-275c-4a9d-a107-4061aba7bcef-config-file\") pod \"limitador-limitador-54d6d988d5-qmttl\" (UID: \"9a9dc818-275c-4a9d-a107-4061aba7bcef\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qmttl"
Jun 03 23:36:41.630416 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:41.630295    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkg5c\" (UniqueName: \"kubernetes.io/projected/9a9dc818-275c-4a9d-a107-4061aba7bcef-kube-api-access-vkg5c\") pod \"limitador-limitador-54d6d988d5-qmttl\" (UID: \"9a9dc818-275c-4a9d-a107-4061aba7bcef\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qmttl"
Jun 03 23:36:41.630885 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:41.630866    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a9dc818-275c-4a9d-a107-4061aba7bcef-config-file\") pod \"limitador-limitador-54d6d988d5-qmttl\" (UID: \"9a9dc818-275c-4a9d-a107-4061aba7bcef\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qmttl"
Jun 03 23:36:41.638527 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:41.638491    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkg5c\" (UniqueName: \"kubernetes.io/projected/9a9dc818-275c-4a9d-a107-4061aba7bcef-kube-api-access-vkg5c\") pod \"limitador-limitador-54d6d988d5-qmttl\" (UID: \"9a9dc818-275c-4a9d-a107-4061aba7bcef\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qmttl"
Jun 03 23:36:41.772755 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:41.772711    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qmttl"
Jun 03 23:36:41.903521 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:41.903491    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:41.919735 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:41.919699    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:36:41.923533 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:36:41.923501    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9dc818_275c_4a9d_a107_4061aba7bcef.slice/crio-ac521c219d186648456972ffdf1c13680443fc0b37baf55141b7783ea9f11c90 WatchSource:0}: Error finding container ac521c219d186648456972ffdf1c13680443fc0b37baf55141b7783ea9f11c90: Status 404 returned error can't find the container with id ac521c219d186648456972ffdf1c13680443fc0b37baf55141b7783ea9f11c90
Jun 03 23:36:42.003751 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:42.003720    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:36:42.743252 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:42.743204    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qmttl" event={"ID":"9a9dc818-275c-4a9d-a107-4061aba7bcef","Type":"ContainerStarted","Data":"ac521c219d186648456972ffdf1c13680443fc0b37baf55141b7783ea9f11c90"}
Jun 03 23:36:44.755119 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:44.755081    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qmttl" event={"ID":"9a9dc818-275c-4a9d-a107-4061aba7bcef","Type":"ContainerStarted","Data":"972d0a85ebde00480b2427991a9cd2aca1753b9875c5c20117829f7e818f953a"}
Jun 03 23:36:44.755562 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:44.755221    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qmttl"
Jun 03 23:36:44.774177 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:44.774125    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-qmttl" podStartSLOduration=1.306170586 podStartE2EDuration="3.774109963s" totalImagesPullingTime="2.467939377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:36:44.772430834 +0000 UTC m=+764.671333088" watchObservedRunningTime="2026-06-03 23:36:44.774109963 +0000 UTC m=+764.673012215"
Jun 03 23:36:55.761548 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:36:55.761516    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qmttl"
Jun 03 23:37:01.948225 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:37:01.948186    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:37:11.616282 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:37:11.616246    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:37:11.714452 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:37:11.714422    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:37:11.864217 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:37:11.864183    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:37:31.261924 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:37:31.261838    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:37:31.362170 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:37:31.362133    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:37:35.176711 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:37:35.176681    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:37:35.278249 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:37:35.278216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:38:05.667606 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:05.667564    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:38:05.844530 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:05.844492    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:38:14.860630 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:14.860595    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:38:14.962687 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:14.962648    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:38:45.925311 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:45.925261    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:38:46.314054 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:46.314021    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:38:46.418057 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:46.418022    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:38:46.497289 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:46.497224    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:38:46.802984 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:46.802951    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:38:48.650080 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:48.650046    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:38:54.463856 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:54.463826    2561 generic.go:356] "Generic (PLEG): container finished" podID="f5037a6c-d404-4612-b511-7174fa6b8049" containerID="1ffcbe7183ee1133f97d4752821a4194dc8ed8ec5dc566cc1051b2f1ee482485" exitCode=0
Jun 03 23:38:54.464319 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:54.463879    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5" event={"ID":"f5037a6c-d404-4612-b511-7174fa6b8049","Type":"ContainerDied","Data":"1ffcbe7183ee1133f97d4752821a4194dc8ed8ec5dc566cc1051b2f1ee482485"}
Jun 03 23:38:54.464319 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:54.464208    2561 scope.go:117] "RemoveContainer" containerID="1ffcbe7183ee1133f97d4752821a4194dc8ed8ec5dc566cc1051b2f1ee482485"
Jun 03 23:38:54.465199 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:54.465170    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 23:38:54.465287 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:54.465255    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 23:38:54.465335 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:54.465300    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 23:38:55.470317 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:55.470261    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5" event={"ID":"f5037a6c-d404-4612-b511-7174fa6b8049","Type":"ContainerStarted","Data":"a8dbc25ca28b4e44b783359344ea874b27088eb1a2e028999df5c0afce0f9d38"}
Jun 03 23:38:55.658010 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:55.657976    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:38:55.658936 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:55.658911    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-969c5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jun 03 23:38:55.659109 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:55.658957    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5" podUID="f5037a6c-d404-4612-b511-7174fa6b8049" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jun 03 23:38:56.658498 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:56.658461    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-969c5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jun 03 23:38:56.658853 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:56.658520    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5" podUID="f5037a6c-d404-4612-b511-7174fa6b8049" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jun 03 23:38:57.658246 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:57.658212    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-969c5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jun 03 23:38:57.658436 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:57.658307    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5" podUID="f5037a6c-d404-4612-b511-7174fa6b8049" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jun 03 23:38:58.658828 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:58.658795    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-969c5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jun 03 23:38:58.659229 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:58.658844    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5" podUID="f5037a6c-d404-4612-b511-7174fa6b8049" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jun 03 23:38:58.667914 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:58.667895    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:38:59.662125 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:59.662095    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:38:59.663173 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:38:59.663146    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-969c5"
Jun 03 23:39:00.589317 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:00.589292    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:39:00.589655 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:00.589631    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:39:35.352898 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:35.352866    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:39:36.470646 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:36.470611    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:39:39.258886 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:39.258853    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:39:39.678926 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:39.678844    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:39:49.689860 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.689824    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"]
Jun 03 23:39:49.693838 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.693815    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.696071 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.696048    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wwhdp\""
Jun 03 23:39:49.696180 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.696085    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 03 23:39:49.696500 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.696481    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 03 23:39:49.696500 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.696498    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jun 03 23:39:49.700729 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.700703    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da702d52-6456-4538-b6bc-4ecc5c267d53-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.700849 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.700749    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da702d52-6456-4538-b6bc-4ecc5c267d53-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.700849 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.700783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da702d52-6456-4538-b6bc-4ecc5c267d53-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.700849 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.700816    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da702d52-6456-4538-b6bc-4ecc5c267d53-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.701029 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.700931    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crkj8\" (UniqueName: \"kubernetes.io/projected/da702d52-6456-4538-b6bc-4ecc5c267d53-kube-api-access-crkj8\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.701029 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.701015    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da702d52-6456-4538-b6bc-4ecc5c267d53-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.703043 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.703022    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"]
Jun 03 23:39:49.715352 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.715323    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:39:49.802016 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.801987    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da702d52-6456-4538-b6bc-4ecc5c267d53-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.802153 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.802036    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da702d52-6456-4538-b6bc-4ecc5c267d53-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.802153 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.802070    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da702d52-6456-4538-b6bc-4ecc5c267d53-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.802153 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.802100    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da702d52-6456-4538-b6bc-4ecc5c267d53-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.802153 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.802132    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da702d52-6456-4538-b6bc-4ecc5c267d53-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.802396 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.802188    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crkj8\" (UniqueName: \"kubernetes.io/projected/da702d52-6456-4538-b6bc-4ecc5c267d53-kube-api-access-crkj8\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.802453 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.802391    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da702d52-6456-4538-b6bc-4ecc5c267d53-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.802508 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.802460    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da702d52-6456-4538-b6bc-4ecc5c267d53-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.802508 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.802480    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/da702d52-6456-4538-b6bc-4ecc5c267d53-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.804327 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.804310    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da702d52-6456-4538-b6bc-4ecc5c267d53-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.804709 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.804689    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da702d52-6456-4538-b6bc-4ecc5c267d53-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:49.809301 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:49.809261    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crkj8\" (UniqueName: \"kubernetes.io/projected/da702d52-6456-4538-b6bc-4ecc5c267d53-kube-api-access-crkj8\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-t79gc\" (UID: \"da702d52-6456-4538-b6bc-4ecc5c267d53\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:50.004757 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:50.004721    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:39:50.141534 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:50.141501    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"]
Jun 03 23:39:50.143251 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:39:50.143207    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda702d52_6456_4538_b6bc_4ecc5c267d53.slice/crio-4a5730b1d6d9bf02dcf60bdf64c459d08e28f56901221b06d8d651973ef8df05 WatchSource:0}: Error finding container 4a5730b1d6d9bf02dcf60bdf64c459d08e28f56901221b06d8d651973ef8df05: Status 404 returned error can't find the container with id 4a5730b1d6d9bf02dcf60bdf64c459d08e28f56901221b06d8d651973ef8df05
Jun 03 23:39:50.147465 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:50.147445    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 23:39:50.189252 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:50.189228    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:39:50.746080 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:50.746043    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc" event={"ID":"da702d52-6456-4538-b6bc-4ecc5c267d53","Type":"ContainerStarted","Data":"4a5730b1d6d9bf02dcf60bdf64c459d08e28f56901221b06d8d651973ef8df05"}
Jun 03 23:39:53.775771 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:53.775690    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc" event={"ID":"da702d52-6456-4538-b6bc-4ecc5c267d53","Type":"ContainerStarted","Data":"fac93c361830a42c09278b4618987b70ba264c22844510294e4a13500281a0ba"}
Jun 03 23:39:55.787118 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:55.787088    2561 generic.go:356] "Generic (PLEG): container finished" podID="da702d52-6456-4538-b6bc-4ecc5c267d53" containerID="fac93c361830a42c09278b4618987b70ba264c22844510294e4a13500281a0ba" exitCode=0
Jun 03 23:39:55.787522 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:55.787131    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc" event={"ID":"da702d52-6456-4538-b6bc-4ecc5c267d53","Type":"ContainerDied","Data":"fac93c361830a42c09278b4618987b70ba264c22844510294e4a13500281a0ba"}
Jun 03 23:39:57.670943 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.670910    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"]
Jun 03 23:39:57.674924 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.674901    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.677055 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.677035    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jun 03 23:39:57.685299 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.685254    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"]
Jun 03 23:39:57.774465 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.774433    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.774616 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.774479    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.774616 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.774509    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.774616 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.774546    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.774616 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.774566    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqbfq\" (UniqueName: \"kubernetes.io/projected/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-kube-api-access-cqbfq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.774777 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.774642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.785816 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.785787    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:39:57.798426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.798397    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc" event={"ID":"da702d52-6456-4538-b6bc-4ecc5c267d53","Type":"ContainerStarted","Data":"679c99dde37afaca90afe85b06e8118bbb146726a25f6ba13cba03c083b47387"}
Jun 03 23:39:57.820031 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.819986    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc" podStartSLOduration=3.227879174 podStartE2EDuration="8.819971673s" totalImagesPullingTime="4.355981044s" totalInitContainerRuntime="1.236111455s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:39:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:39:57.818327262 +0000 UTC m=+957.717229525" watchObservedRunningTime="2026-06-03 23:39:57.819971673 +0000 UTC m=+957.718873925"
Jun 03 23:39:57.875427 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.875401    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.875536 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.875437    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqbfq\" (UniqueName: \"kubernetes.io/projected/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-kube-api-access-cqbfq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.875536 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.875520    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.875654 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.875583    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.875711 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.875647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.875711 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.875702    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.875837 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.875806    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.875894 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.875871    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.876041 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.876017    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.877874 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.877854    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.878146 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.878128    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.884015 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.883989    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqbfq\" (UniqueName: \"kubernetes.io/projected/eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51-kube-api-access-cqbfq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z\" (UID: \"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:57.987649 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:57.987605    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:39:58.146643 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:58.146607    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"]
Jun 03 23:39:58.153547 ip-10-0-129-203 kubenswrapper[2561]: W0603 23:39:58.153518    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff8ebf6_50ab_4a16_8ef7_ca6fca81ec51.slice/crio-941b49da0623a8beb13690642b2997baceced87bf1b99ae176b6354dfec5d79d WatchSource:0}: Error finding container 941b49da0623a8beb13690642b2997baceced87bf1b99ae176b6354dfec5d79d: Status 404 returned error can't find the container with id 941b49da0623a8beb13690642b2997baceced87bf1b99ae176b6354dfec5d79d
Jun 03 23:39:58.676801 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:58.676770    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:39:58.805046 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:58.805010    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z" event={"ID":"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51","Type":"ContainerStarted","Data":"601f004fbbda4be1379419c65993fc4d3a315fbf4cdf657f236d259acaca6828"}
Jun 03 23:39:58.805198 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:58.805069    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z" event={"ID":"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51","Type":"ContainerStarted","Data":"941b49da0623a8beb13690642b2997baceced87bf1b99ae176b6354dfec5d79d"}
Jun 03 23:39:59.814178 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:59.814142    2561 generic.go:356] "Generic (PLEG): container finished" podID="eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51" containerID="601f004fbbda4be1379419c65993fc4d3a315fbf4cdf657f236d259acaca6828" exitCode=0
Jun 03 23:39:59.814579 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:39:59.814228    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z" event={"ID":"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51","Type":"ContainerDied","Data":"601f004fbbda4be1379419c65993fc4d3a315fbf4cdf657f236d259acaca6828"}
Jun 03 23:40:00.005170 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:00.005137    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:40:00.005361 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:00.005222    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:40:00.018209 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:00.018184    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:40:00.821114 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:00.821076    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z" event={"ID":"eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51","Type":"ContainerStarted","Data":"3dad835a220fbd28179eebcf52c2b879caaa16a18e0b2c0c61be6cbf62c28838"}
Jun 03 23:40:00.832326 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:00.832301    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-t79gc"
Jun 03 23:40:00.841709 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:00.841649    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z" podStartSLOduration=2.461307494 podStartE2EDuration="3.841636238s" totalImagesPullingTime="217.969506ms" totalInitContainerRuntime="1.162359238s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:39:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:40:00.840697941 +0000 UTC m=+960.739600196" watchObservedRunningTime="2026-06-03 23:40:00.841636238 +0000 UTC m=+960.740538491"
Jun 03 23:40:01.790426 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:01.790389    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:40:03.480066 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:03.480031    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:40:07.988656 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:07.988622    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:40:07.989124 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:07.988689    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:40:08.000912 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:08.000883    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:40:08.884723 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:08.884696    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z"
Jun 03 23:40:18.370402 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:18.370366    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:40:19.884502 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:19.884470    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:40:27.309147 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:27.309113    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:40:29.560068 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:29.560039    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:40:30.082533 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:40:30.082500    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:41:38.582533 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:41:38.582495    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:41:38.645707 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:41:38.645681    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:41:39.765166 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:41:39.765129    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:41:39.962179 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:41:39.962150    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:41:51.703310 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:41:51.703216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:41:59.196109 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:41:59.196081    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:42:09.954858 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:42:09.954818    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:42:19.479770 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:42:19.479736    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:42:30.182255 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:42:30.182224    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:42:39.079997 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:42:39.079959    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:42:48.983553 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:42:48.983518    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:42:58.582076 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:42:58.582039    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:43:31.084699 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:43:31.084618    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:43:37.279145 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:43:37.279102    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:43:46.437624 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:43:46.437587    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:43:46.535968 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:43:46.535924    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:43:54.759805 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:43:54.759764    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:44:00.628736 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:44:00.628709    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:44:00.630082 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:44:00.630065    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:44:00.690168 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:44:00.690136    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:44:00.767787 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:44:00.767760    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:44:11.184035 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:44:11.184005    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:44:27.198192 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:44:27.198161    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:44:32.870371 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:44:32.870337    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:44:32.963710 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:44:32.963677    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:44:56.700609 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:44:56.700520    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:02.566660 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:02.566626    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:02.670586 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:02.670537    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:02.767119 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:02.767074    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:02.934903 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:02.934796    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:03.034379 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:03.034350    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:04.382351 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:04.382312    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:45:19.454392 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:19.454353    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:19.575853 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:19.575823    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:19.687388 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:19.687339    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:21.675055 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:21.675025    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:45:25.918562 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:25.918517    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:26.019086 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:26.019051    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:34.055209 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:34.055157    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:34.156291 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:34.156240    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:34.255548 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:34.255515    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:34.357417 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:34.357331    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:36.988856 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:36.988821    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:45:50.815107 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:50.815064    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:50.980976 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:50.980926    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:51.094428 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:51.094340    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:53.185190 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:53.185156    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:45:56.831453 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:56.831413    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:45:56.936349 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:45:56.936314    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:46:47.185421 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:46:47.185335    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:46:56.583625 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:46:56.583592    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:47:13.608699 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:47:13.608665    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:47:20.382256 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:47:20.382208    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:47:38.979123 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:47:38.979083    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:47:47.575786 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:47:47.575744    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:48:18.719350 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:48:18.719249    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:48:27.283369 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:48:27.283334    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:48:36.685979 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:48:36.685939    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:48:44.894829 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:48:44.894792    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:48:52.782202 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:48:52.782163    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:49:00.665123 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:49:00.665094    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:49:00.667571 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:49:00.666293    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:49:10.390258 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:49:10.390225    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:49:23.691512 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:49:23.691435    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:50:11.281794 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:50:11.281760    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:50:19.703875 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:50:19.703834    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:50:25.582077 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:50:25.582042    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:50:34.488046 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:50:34.488005    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:50:43.077605 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:50:43.077567    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:50:49.678575 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:50:49.678539    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:51:00.685140 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:51:00.685110    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:51:02.918979 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:51:02.918949    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:51:09.589688 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:51:09.589653    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:51:18.398984 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:51:18.398950    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:51:25.295484 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:51:25.295447    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:51:35.380630 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:51:35.380586    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:51:42.577361 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:51:42.577320    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:51:49.783156 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:51:49.783112    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:51:50.162338 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:51:50.162200    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:51:50.260692 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:51:50.260650    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:51:56.183716 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:51:56.183682    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:52:02.387959 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:52:02.387921    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:52:09.083444 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:52:09.083399    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:52:19.181380 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:52:19.181340    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:52:27.986286 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:52:27.986181    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:52:37.477380 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:52:37.477344    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:52:43.481456 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:52:43.481419    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:52:51.285987 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:52:51.285950    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:52:58.149430 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:52:58.149394    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:52:58.249814 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:52:58.249782    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:54:00.703934 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:54:00.703834    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:54:00.710912 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:54:00.707000    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:54:55.190437 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:54:55.190398    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:55:01.984577 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:55:01.984541    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:55:26.674359 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:55:26.674257    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:55:36.598443 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:55:36.598402    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:55:45.579224 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:55:45.579172    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:55:55.176342 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:55:55.176310    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:56:05.578300 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:56:05.578254    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:56:15.274781 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:56:15.274746    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:56:24.416329 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:56:24.416290    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:56:33.381888 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:56:33.381857    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:56:43.687429 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:56:43.687387    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:56:53.380625 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:56:53.380554    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:57:02.782657 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:57:02.782617    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:57:38.776734 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:57:38.776703    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:58:22.378145 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:58:22.378061    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:58:28.375999 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:58:28.375958    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:58:39.079349 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:58:39.079314    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:58:46.580085 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:58:46.580047    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:58:54.889346 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:58:54.889306    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:59:00.740131 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:59:00.740099    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:59:00.744602 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:59:00.744581    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 03 23:59:08.076999 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:59:08.076964    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:59:17.092406 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:59:17.092360    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:59:28.485444 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:59:28.485402    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:59:35.182497 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:59:35.182463    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:59:43.684170 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:59:43.684126    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 03 23:59:48.489576 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:59:48.489541    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 03 23:59:51.985779 ip-10-0-129-203 kubenswrapper[2561]: I0603 23:59:51.985692    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:00:00.176688 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:00.176647    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29675520-wgzxm"]
Jun 04 00:00:00.180781 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:00.180754    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29675520-wgzxm"
Jun 04 00:00:00.187778 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:00.187744    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-t4m64\""
Jun 04 00:00:00.189092 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:00.189073    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\""
Jun 04 00:00:00.214671 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:00.214641    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29675520-wgzxm"]
Jun 04 00:00:00.268084 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:00.268045    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7czp\" (UniqueName: \"kubernetes.io/projected/96d8bd5c-e3b8-4544-a1e3-92319df06283-kube-api-access-w7czp\") pod \"image-pruner-29675520-wgzxm\" (UID: \"96d8bd5c-e3b8-4544-a1e3-92319df06283\") " pod="openshift-image-registry/image-pruner-29675520-wgzxm"
Jun 04 00:00:00.268265 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:00.268102    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/96d8bd5c-e3b8-4544-a1e3-92319df06283-serviceca\") pod \"image-pruner-29675520-wgzxm\" (UID: \"96d8bd5c-e3b8-4544-a1e3-92319df06283\") " pod="openshift-image-registry/image-pruner-29675520-wgzxm"
Jun 04 00:00:00.368837 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:00.368794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7czp\" (UniqueName: \"kubernetes.io/projected/96d8bd5c-e3b8-4544-a1e3-92319df06283-kube-api-access-w7czp\") pod \"image-pruner-29675520-wgzxm\" (UID: \"96d8bd5c-e3b8-4544-a1e3-92319df06283\") " pod="openshift-image-registry/image-pruner-29675520-wgzxm"
Jun 04 00:00:00.368837 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:00.368848    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/96d8bd5c-e3b8-4544-a1e3-92319df06283-serviceca\") pod \"image-pruner-29675520-wgzxm\" (UID: \"96d8bd5c-e3b8-4544-a1e3-92319df06283\") " pod="openshift-image-registry/image-pruner-29675520-wgzxm"
Jun 04 00:00:00.369590 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:00.369569    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/96d8bd5c-e3b8-4544-a1e3-92319df06283-serviceca\") pod \"image-pruner-29675520-wgzxm\" (UID: \"96d8bd5c-e3b8-4544-a1e3-92319df06283\") " pod="openshift-image-registry/image-pruner-29675520-wgzxm"
Jun 04 00:00:00.377250 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:00.377221    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7czp\" (UniqueName: \"kubernetes.io/projected/96d8bd5c-e3b8-4544-a1e3-92319df06283-kube-api-access-w7czp\") pod \"image-pruner-29675520-wgzxm\" (UID: \"96d8bd5c-e3b8-4544-a1e3-92319df06283\") " pod="openshift-image-registry/image-pruner-29675520-wgzxm"
Jun 04 00:00:00.520544 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:00.520517    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-t4m64\""
Jun 04 00:00:00.528104 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:00.528071    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29675520-wgzxm"
Jun 04 00:00:00.672887 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:00.672824    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29675520-wgzxm"]
Jun 04 00:00:00.675450 ip-10-0-129-203 kubenswrapper[2561]: W0604 00:00:00.675420    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d8bd5c_e3b8_4544_a1e3_92319df06283.slice/crio-dc18dab7c5112c6f1ddbc082149d40385a03278f0c68bf3f392d239c1220f5f7 WatchSource:0}: Error finding container dc18dab7c5112c6f1ddbc082149d40385a03278f0c68bf3f392d239c1220f5f7: Status 404 returned error can't find the container with id dc18dab7c5112c6f1ddbc082149d40385a03278f0c68bf3f392d239c1220f5f7
Jun 04 00:00:01.192492 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:01.192454    2561 generic.go:356] "Generic (PLEG): container finished" podID="96d8bd5c-e3b8-4544-a1e3-92319df06283" containerID="2fc9ca740f0e0d9c2287da7fe9d0368843eb0dca95fb3b8d1dca6f0b4ec54b3d" exitCode=0
Jun 04 00:00:01.192867 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:01.192543    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29675520-wgzxm" event={"ID":"96d8bd5c-e3b8-4544-a1e3-92319df06283","Type":"ContainerDied","Data":"2fc9ca740f0e0d9c2287da7fe9d0368843eb0dca95fb3b8d1dca6f0b4ec54b3d"}
Jun 04 00:00:01.192867 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:01.192595    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29675520-wgzxm" event={"ID":"96d8bd5c-e3b8-4544-a1e3-92319df06283","Type":"ContainerStarted","Data":"dc18dab7c5112c6f1ddbc082149d40385a03278f0c68bf3f392d239c1220f5f7"}
Jun 04 00:00:02.344810 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:02.344785    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29675520-wgzxm"
Jun 04 00:00:02.491924 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:02.491888    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7czp\" (UniqueName: \"kubernetes.io/projected/96d8bd5c-e3b8-4544-a1e3-92319df06283-kube-api-access-w7czp\") pod \"96d8bd5c-e3b8-4544-a1e3-92319df06283\" (UID: \"96d8bd5c-e3b8-4544-a1e3-92319df06283\") "
Jun 04 00:00:02.492135 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:02.491964    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/96d8bd5c-e3b8-4544-a1e3-92319df06283-serviceca\") pod \"96d8bd5c-e3b8-4544-a1e3-92319df06283\" (UID: \"96d8bd5c-e3b8-4544-a1e3-92319df06283\") "
Jun 04 00:00:02.492402 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:02.492380    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96d8bd5c-e3b8-4544-a1e3-92319df06283-serviceca" (OuterVolumeSpecName: "serviceca") pod "96d8bd5c-e3b8-4544-a1e3-92319df06283" (UID: "96d8bd5c-e3b8-4544-a1e3-92319df06283"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 04 00:00:02.494234 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:02.494196    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96d8bd5c-e3b8-4544-a1e3-92319df06283-kube-api-access-w7czp" (OuterVolumeSpecName: "kube-api-access-w7czp") pod "96d8bd5c-e3b8-4544-a1e3-92319df06283" (UID: "96d8bd5c-e3b8-4544-a1e3-92319df06283"). InnerVolumeSpecName "kube-api-access-w7czp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 04 00:00:02.593783 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:02.593750    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7czp\" (UniqueName: \"kubernetes.io/projected/96d8bd5c-e3b8-4544-a1e3-92319df06283-kube-api-access-w7czp\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:00:02.593783 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:02.593778    2561 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/96d8bd5c-e3b8-4544-a1e3-92319df06283-serviceca\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:00:03.204434 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:03.204405    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29675520-wgzxm"
Jun 04 00:00:03.204434 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:03.204416    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29675520-wgzxm" event={"ID":"96d8bd5c-e3b8-4544-a1e3-92319df06283","Type":"ContainerDied","Data":"dc18dab7c5112c6f1ddbc082149d40385a03278f0c68bf3f392d239c1220f5f7"}
Jun 04 00:00:03.204647 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:03.204466    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc18dab7c5112c6f1ddbc082149d40385a03278f0c68bf3f392d239c1220f5f7"
Jun 04 00:00:04.975608 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:04.975574    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:00:23.783888 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:23.783845    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:00:29.988615 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:29.988580    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:00:40.482034 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:40.482002    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:00:49.277126 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:00:49.277090    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:01:05.280297 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:01:05.280226    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:01:13.989760 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:01:13.989721    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:01:22.774781 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:01:22.774701    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:01:31.775425 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:01:31.775384    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:01:40.786006 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:01:40.785970    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:01:47.878928 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:01:47.878890    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:01:58.485888 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:01:58.485851    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:02:11.517384 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:02:11.517338    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:02:20.385319 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:02:20.385263    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:02:29.029203 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:02:29.029139    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:02:33.800689 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:02:33.800642    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:02:38.965651 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:02:38.965613    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:02:42.681710 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:02:42.681676    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:02:53.584209 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:02:53.584132    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:03:00.483453 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:03:00.483421    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:03:15.877180 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:03:15.877145    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:03:31.278815 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:03:31.278775    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:03:40.579911 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:03:40.579872    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:03:47.171531 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:03:47.171494    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:03:49.977163 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:03:49.977127    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:03:56.854184 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:03:56.854141    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:00.477187 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:00.477152    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:04:00.775299 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:00.775120    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 04 00:04:00.781308 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:00.781262    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7rmhv_4b2fc57a-fac3-4526-b2ba-8d7c00fb0231/ovn-acl-logging/0.log"
Jun 04 00:04:21.120110 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:21.120013    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:23.939358 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:23.939318    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:04:34.197102 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:34.197065    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:36.020670 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.020632    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:36.074576 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.074540    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"]
Jun 04 00:04:36.075060 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.075031    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d8bd5c-e3b8-4544-a1e3-92319df06283" containerName="image-pruner"
Jun 04 00:04:36.075060 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.075054    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d8bd5c-e3b8-4544-a1e3-92319df06283" containerName="image-pruner"
Jun 04 00:04:36.075239 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.075146    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="96d8bd5c-e3b8-4544-a1e3-92319df06283" containerName="image-pruner"
Jun 04 00:04:36.078040 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.078018    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.080513 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.080493    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2e75cefc-openshift-default-dockercfg-26c8x\""
Jun 04 00:04:36.108289 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.108240    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"]
Jun 04 00:04:36.114413 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.114381    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:36.175412 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.175375    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js48g\" (UniqueName: \"kubernetes.io/projected/7f15ac2a-78ee-454e-9f39-6a01ca91e022-kube-api-access-js48g\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.175615 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.175422    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-workload-certs\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.175615 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.175446    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-data\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.175615 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.175515    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-workload-socket\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.175798 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.175623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istiod-ca-cert\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.175798 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.175690    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-podinfo\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.175798 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.175728    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-token\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.175798 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.175792    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-credential-socket\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.175976 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.175821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-envoy\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.181141 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.181117    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:36.276918 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.276823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istiod-ca-cert\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.276918 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.276877    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-podinfo\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.277156 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.276989    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-token\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.277156 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.277045    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-credential-socket\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.277156 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.277066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-envoy\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.277156 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.277121    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js48g\" (UniqueName: \"kubernetes.io/projected/7f15ac2a-78ee-454e-9f39-6a01ca91e022-kube-api-access-js48g\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.277437 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.277178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-workload-certs\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.277437 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.277212    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-data\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.277437 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.277256    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-workload-socket\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.277611 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.277510    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-credential-socket\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.277667 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.277640    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-workload-certs\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.277724 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.277677    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-workload-socket\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.277779 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.277764    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-data\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.277843 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.277798    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istiod-ca-cert\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.279439 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.279417    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-envoy\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.279606 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.279591    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-podinfo\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.284597 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.284572    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-token\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.284985 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.284965    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js48g\" (UniqueName: \"kubernetes.io/projected/7f15ac2a-78ee-454e-9f39-6a01ca91e022-kube-api-access-js48g\") pod \"e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") " pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.382126 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.382088    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qmttl"]
Jun 04 00:04:36.390680 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.390653    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:36.530152 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.530089    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"]
Jun 04 00:04:36.533144 ip-10-0-129-203 kubenswrapper[2561]: W0604 00:04:36.533112    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f15ac2a_78ee_454e_9f39_6a01ca91e022.slice/crio-bf8741524e98cc4d1fe688a9e5578decc50e19626616e23f12d66db50e20ea61 WatchSource:0}: Error finding container bf8741524e98cc4d1fe688a9e5578decc50e19626616e23f12d66db50e20ea61: Status 404 returned error can't find the container with id bf8741524e98cc4d1fe688a9e5578decc50e19626616e23f12d66db50e20ea61
Jun 04 00:04:36.534898 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.534867    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 04 00:04:36.535002 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.534949    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 04 00:04:36.535002 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.534993    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 04 00:04:36.667559 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.667524    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78" event={"ID":"7f15ac2a-78ee-454e-9f39-6a01ca91e022","Type":"ContainerStarted","Data":"412006c0c68a1f09064660aa3ecd23518d962ff9ea1fb2cc1b5c39c5c3db6069"}
Jun 04 00:04:36.667768 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.667591    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78" event={"ID":"7f15ac2a-78ee-454e-9f39-6a01ca91e022","Type":"ContainerStarted","Data":"bf8741524e98cc4d1fe688a9e5578decc50e19626616e23f12d66db50e20ea61"}
Jun 04 00:04:36.689603 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:36.689545    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78" podStartSLOduration=0.689525063 podStartE2EDuration="689.525063ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 00:04:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 00:04:36.688396322 +0000 UTC m=+2436.587317647" watchObservedRunningTime="2026-06-04 00:04:36.689525063 +0000 UTC m=+2436.588427319"
Jun 04 00:04:37.391083 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:37.391049    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:37.395913 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:37.395891    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:37.673732 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:37.673647    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:37.674595 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:37.674574    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:39.548967 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:39.548925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:42.102381 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:42.102347    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"]
Jun 04 00:04:42.102865 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:42.102519    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78" podUID="7f15ac2a-78ee-454e-9f39-6a01ca91e022" containerName="istio-proxy" containerID="cri-o://412006c0c68a1f09064660aa3ecd23518d962ff9ea1fb2cc1b5c39c5c3db6069" gracePeriod=30
Jun 04 00:04:42.129136 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:42.129107    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:42.187791 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:42.187758    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:42.476532 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:42.476500    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:43.663946 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:43.663907    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:47.376165 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.376092    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:47.490683 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.490647    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-workload-socket\") pod \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") "
Jun 04 00:04:47.490981 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.490712    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-credential-socket\") pod \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") "
Jun 04 00:04:47.490981 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.490768    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-data\") pod \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") "
Jun 04 00:04:47.490981 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.490797    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istiod-ca-cert\") pod \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") "
Jun 04 00:04:47.490981 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.490830    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-workload-certs\") pod \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") "
Jun 04 00:04:47.490981 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.490870    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-podinfo\") pod \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") "
Jun 04 00:04:47.490981 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.490948    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f15ac2a-78ee-454e-9f39-6a01ca91e022" (UID: "7f15ac2a-78ee-454e-9f39-6a01ca91e022"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 04 00:04:47.491361 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.491019    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-envoy\") pod \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") "
Jun 04 00:04:47.491361 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.491048    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f15ac2a-78ee-454e-9f39-6a01ca91e022" (UID: "7f15ac2a-78ee-454e-9f39-6a01ca91e022"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 04 00:04:47.491361 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.491071    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-token\") pod \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") "
Jun 04 00:04:47.491361 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.491148    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js48g\" (UniqueName: \"kubernetes.io/projected/7f15ac2a-78ee-454e-9f39-6a01ca91e022-kube-api-access-js48g\") pod \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\" (UID: \"7f15ac2a-78ee-454e-9f39-6a01ca91e022\") "
Jun 04 00:04:47.491361 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.491208    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f15ac2a-78ee-454e-9f39-6a01ca91e022" (UID: "7f15ac2a-78ee-454e-9f39-6a01ca91e022"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 04 00:04:47.491361 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.491309    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f15ac2a-78ee-454e-9f39-6a01ca91e022" (UID: "7f15ac2a-78ee-454e-9f39-6a01ca91e022"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 04 00:04:47.491665 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.491481    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f15ac2a-78ee-454e-9f39-6a01ca91e022" (UID: "7f15ac2a-78ee-454e-9f39-6a01ca91e022"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 04 00:04:47.491665 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.491617    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-workload-socket\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:04:47.491665 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.491637    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-credential-socket\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:04:47.491665 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.491651    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-data\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:04:47.491665 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.491665    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istiod-ca-cert\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:04:47.491868 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.491677    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-workload-certs\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:04:47.493578 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.493545    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f15ac2a-78ee-454e-9f39-6a01ca91e022" (UID: "7f15ac2a-78ee-454e-9f39-6a01ca91e022"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 04 00:04:47.493578 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.493567    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f15ac2a-78ee-454e-9f39-6a01ca91e022" (UID: "7f15ac2a-78ee-454e-9f39-6a01ca91e022"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 04 00:04:47.493750 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.493619    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f15ac2a-78ee-454e-9f39-6a01ca91e022-kube-api-access-js48g" (OuterVolumeSpecName: "kube-api-access-js48g") pod "7f15ac2a-78ee-454e-9f39-6a01ca91e022" (UID: "7f15ac2a-78ee-454e-9f39-6a01ca91e022"). InnerVolumeSpecName "kube-api-access-js48g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 04 00:04:47.493750 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.493645    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f15ac2a-78ee-454e-9f39-6a01ca91e022" (UID: "7f15ac2a-78ee-454e-9f39-6a01ca91e022"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jun 04 00:04:47.592195 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.592144    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-podinfo\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:04:47.592195 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.592172    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-envoy\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:04:47.592195 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.592182    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f15ac2a-78ee-454e-9f39-6a01ca91e022-istio-token\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:04:47.592195 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.592190    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js48g\" (UniqueName: \"kubernetes.io/projected/7f15ac2a-78ee-454e-9f39-6a01ca91e022-kube-api-access-js48g\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:04:47.729773 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.729737    2561 generic.go:356] "Generic (PLEG): container finished" podID="7f15ac2a-78ee-454e-9f39-6a01ca91e022" containerID="412006c0c68a1f09064660aa3ecd23518d962ff9ea1fb2cc1b5c39c5c3db6069" exitCode=0
Jun 04 00:04:47.729773 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.729778    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78" event={"ID":"7f15ac2a-78ee-454e-9f39-6a01ca91e022","Type":"ContainerDied","Data":"412006c0c68a1f09064660aa3ecd23518d962ff9ea1fb2cc1b5c39c5c3db6069"}
Jun 04 00:04:47.729986 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.729823    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78" event={"ID":"7f15ac2a-78ee-454e-9f39-6a01ca91e022","Type":"ContainerDied","Data":"bf8741524e98cc4d1fe688a9e5578decc50e19626616e23f12d66db50e20ea61"}
Jun 04 00:04:47.729986 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.729847    2561 scope.go:117] "RemoveContainer" containerID="412006c0c68a1f09064660aa3ecd23518d962ff9ea1fb2cc1b5c39c5c3db6069"
Jun 04 00:04:47.729986 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.729781    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"
Jun 04 00:04:47.740019 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.739996    2561 scope.go:117] "RemoveContainer" containerID="412006c0c68a1f09064660aa3ecd23518d962ff9ea1fb2cc1b5c39c5c3db6069"
Jun 04 00:04:47.740349 ip-10-0-129-203 kubenswrapper[2561]: E0604 00:04:47.740326    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"412006c0c68a1f09064660aa3ecd23518d962ff9ea1fb2cc1b5c39c5c3db6069\": container with ID starting with 412006c0c68a1f09064660aa3ecd23518d962ff9ea1fb2cc1b5c39c5c3db6069 not found: ID does not exist" containerID="412006c0c68a1f09064660aa3ecd23518d962ff9ea1fb2cc1b5c39c5c3db6069"
Jun 04 00:04:47.740435 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.740362    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412006c0c68a1f09064660aa3ecd23518d962ff9ea1fb2cc1b5c39c5c3db6069"} err="failed to get container status \"412006c0c68a1f09064660aa3ecd23518d962ff9ea1fb2cc1b5c39c5c3db6069\": rpc error: code = NotFound desc = could not find container \"412006c0c68a1f09064660aa3ecd23518d962ff9ea1fb2cc1b5c39c5c3db6069\": container with ID starting with 412006c0c68a1f09064660aa3ecd23518d962ff9ea1fb2cc1b5c39c5c3db6069 not found: ID does not exist"
Jun 04 00:04:47.752116 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.752081    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"]
Jun 04 00:04:47.759648 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:47.759617    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2e75cefc-openshift-default-76d5c7b874-8tg78"]
Jun 04 00:04:48.439486 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.439456    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:48.501744 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.501709    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:48.528599 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.528569    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f15ac2a-78ee-454e-9f39-6a01ca91e022" path="/var/lib/kubelet/pods/7f15ac2a-78ee-454e-9f39-6a01ca91e022/volumes"
Jun 04 00:04:48.740298 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.740243    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:48.801176 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.801120    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"]
Jun 04 00:04:48.802032 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.802005    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f15ac2a-78ee-454e-9f39-6a01ca91e022" containerName="istio-proxy"
Jun 04 00:04:48.802194 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.802173    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f15ac2a-78ee-454e-9f39-6a01ca91e022" containerName="istio-proxy"
Jun 04 00:04:48.802336 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.802323    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f15ac2a-78ee-454e-9f39-6a01ca91e022" containerName="istio-proxy"
Jun 04 00:04:48.807539 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.807513    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:48.810123 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.810102    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2d67fd09-openshift-default-dockercfg-8v86w\""
Jun 04 00:04:48.820664 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.820637    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"]
Jun 04 00:04:48.846435 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.846406    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:48.903868 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.903833    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad430434-e37c-4eb6-9c35-53554563e393-istiod-ca-cert\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:48.904056 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.903881    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad430434-e37c-4eb6-9c35-53554563e393-istio-podinfo\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:48.904056 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.903904    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-istio-envoy\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:48.904056 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.903961    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-workload-socket\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:48.904056 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.903993    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-credential-socket\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:48.904056 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.904027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-istio-data\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:48.904314 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.904112    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c98bw\" (UniqueName: \"kubernetes.io/projected/ad430434-e37c-4eb6-9c35-53554563e393-kube-api-access-c98bw\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:48.904314 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.904201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-workload-certs\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:48.904314 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.904230    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad430434-e37c-4eb6-9c35-53554563e393-istio-token\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:48.947130 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:48.947089    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:49.005667 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.005591    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-istio-envoy\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.005667 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.005627    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-workload-socket\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.005667 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.005644    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-credential-socket\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.005926 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.005669    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-istio-data\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.005926 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.005702    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c98bw\" (UniqueName: \"kubernetes.io/projected/ad430434-e37c-4eb6-9c35-53554563e393-kube-api-access-c98bw\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.005926 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.005744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-workload-certs\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.005926 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.005760    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad430434-e37c-4eb6-9c35-53554563e393-istio-token\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.005926 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.005806    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad430434-e37c-4eb6-9c35-53554563e393-istiod-ca-cert\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.005926 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.005856    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad430434-e37c-4eb6-9c35-53554563e393-istio-podinfo\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.006239 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.006096    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-workload-socket\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.006239 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.006114    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-credential-socket\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.006239 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.006226    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-workload-certs\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.006519 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.006495    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-istio-data\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.006672 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.006651    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad430434-e37c-4eb6-9c35-53554563e393-istiod-ca-cert\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.008055 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.008027    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-istio-envoy\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.008201 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.008184    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad430434-e37c-4eb6-9c35-53554563e393-istio-podinfo\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.015790 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.015765    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad430434-e37c-4eb6-9c35-53554563e393-istio-token\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.015904 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.015886    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c98bw\" (UniqueName: \"kubernetes.io/projected/ad430434-e37c-4eb6-9c35-53554563e393-kube-api-access-c98bw\") pod \"e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") " pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.119651 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.119619    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:49.296195 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.296171    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"]
Jun 04 00:04:49.298888 ip-10-0-129-203 kubenswrapper[2561]: W0604 00:04:49.298864    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad430434_e37c_4eb6_9c35_53554563e393.slice/crio-9c8336603b35427d685c21ed2dda7d590cb4d22c78d05c8bb5c48d6320c1a9fe WatchSource:0}: Error finding container 9c8336603b35427d685c21ed2dda7d590cb4d22c78d05c8bb5c48d6320c1a9fe: Status 404 returned error can't find the container with id 9c8336603b35427d685c21ed2dda7d590cb4d22c78d05c8bb5c48d6320c1a9fe
Jun 04 00:04:49.300958 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.300915    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 04 00:04:49.301051 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.301006    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 04 00:04:49.301095 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.301050    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 04 00:04:49.745262 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.745233    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72" event={"ID":"ad430434-e37c-4eb6-9c35-53554563e393","Type":"ContainerStarted","Data":"cdd3519e936163b07a5e689039b1b2d904cce1a188e031f69197e2012cfb999e"}
Jun 04 00:04:49.745716 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.745306    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72" event={"ID":"ad430434-e37c-4eb6-9c35-53554563e393","Type":"ContainerStarted","Data":"9c8336603b35427d685c21ed2dda7d590cb4d22c78d05c8bb5c48d6320c1a9fe"}
Jun 04 00:04:49.766569 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:49.766523    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72" podStartSLOduration=1.7665073489999998 podStartE2EDuration="1.766507349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 00:04:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 00:04:49.765126247 +0000 UTC m=+2449.664028499" watchObservedRunningTime="2026-06-04 00:04:49.766507349 +0000 UTC m=+2449.665409602"
Jun 04 00:04:50.120485 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:50.120398    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:50.125447 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:50.125422    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:50.750608 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:50.750575    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:50.751682 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:50.751661    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:04:52.309919 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:52.309882    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:54.844577 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:54.844542    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"]
Jun 04 00:04:54.845001 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:54.844765    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72" podUID="ad430434-e37c-4eb6-9c35-53554563e393" containerName="istio-proxy" containerID="cri-o://cdd3519e936163b07a5e689039b1b2d904cce1a188e031f69197e2012cfb999e" gracePeriod=30
Jun 04 00:04:54.874122 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:54.874095    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:54.926575 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:54.926548    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:56.110962 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:56.110933    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:04:56.229710 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:04:56.229673    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:05:00.099165 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.099137    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:05:00.215639 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.215618    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-credential-socket\") pod \"ad430434-e37c-4eb6-9c35-53554563e393\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") "
Jun 04 00:05:00.215797 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.215671    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad430434-e37c-4eb6-9c35-53554563e393-istio-podinfo\") pod \"ad430434-e37c-4eb6-9c35-53554563e393\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") "
Jun 04 00:05:00.215797 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.215717    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-istio-envoy\") pod \"ad430434-e37c-4eb6-9c35-53554563e393\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") "
Jun 04 00:05:00.215797 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.215741    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad430434-e37c-4eb6-9c35-53554563e393-istiod-ca-cert\") pod \"ad430434-e37c-4eb6-9c35-53554563e393\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") "
Jun 04 00:05:00.215948 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.215804    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad430434-e37c-4eb6-9c35-53554563e393-istio-token\") pod \"ad430434-e37c-4eb6-9c35-53554563e393\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") "
Jun 04 00:05:00.215948 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.215847    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-istio-data\") pod \"ad430434-e37c-4eb6-9c35-53554563e393\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") "
Jun 04 00:05:00.215948 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.215897    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c98bw\" (UniqueName: \"kubernetes.io/projected/ad430434-e37c-4eb6-9c35-53554563e393-kube-api-access-c98bw\") pod \"ad430434-e37c-4eb6-9c35-53554563e393\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") "
Jun 04 00:05:00.215948 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.215934    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-workload-certs\") pod \"ad430434-e37c-4eb6-9c35-53554563e393\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") "
Jun 04 00:05:00.216163 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.215983    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-workload-socket\") pod \"ad430434-e37c-4eb6-9c35-53554563e393\" (UID: \"ad430434-e37c-4eb6-9c35-53554563e393\") "
Jun 04 00:05:00.216163 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.215889    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ad430434-e37c-4eb6-9c35-53554563e393" (UID: "ad430434-e37c-4eb6-9c35-53554563e393"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 04 00:05:00.216163 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.216123    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-istio-data" (OuterVolumeSpecName: "istio-data") pod "ad430434-e37c-4eb6-9c35-53554563e393" (UID: "ad430434-e37c-4eb6-9c35-53554563e393"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 04 00:05:00.216350 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.216228    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad430434-e37c-4eb6-9c35-53554563e393-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ad430434-e37c-4eb6-9c35-53554563e393" (UID: "ad430434-e37c-4eb6-9c35-53554563e393"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 04 00:05:00.216350 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.216246    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ad430434-e37c-4eb6-9c35-53554563e393" (UID: "ad430434-e37c-4eb6-9c35-53554563e393"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 04 00:05:00.216350 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.216342    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ad430434-e37c-4eb6-9c35-53554563e393" (UID: "ad430434-e37c-4eb6-9c35-53554563e393"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 04 00:05:00.216515 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.216420    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-workload-socket\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:05:00.216515 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.216433    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-credential-socket\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:05:00.216515 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.216446    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad430434-e37c-4eb6-9c35-53554563e393-istiod-ca-cert\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:05:00.216515 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.216462    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-istio-data\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:05:00.216515 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.216474    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-workload-certs\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:05:00.217893 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.217871    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad430434-e37c-4eb6-9c35-53554563e393-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ad430434-e37c-4eb6-9c35-53554563e393" (UID: "ad430434-e37c-4eb6-9c35-53554563e393"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jun 04 00:05:00.218049 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.218031    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ad430434-e37c-4eb6-9c35-53554563e393" (UID: "ad430434-e37c-4eb6-9c35-53554563e393"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 04 00:05:00.218401 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.218378    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad430434-e37c-4eb6-9c35-53554563e393-kube-api-access-c98bw" (OuterVolumeSpecName: "kube-api-access-c98bw") pod "ad430434-e37c-4eb6-9c35-53554563e393" (UID: "ad430434-e37c-4eb6-9c35-53554563e393"). InnerVolumeSpecName "kube-api-access-c98bw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 04 00:05:00.218486 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.218413    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad430434-e37c-4eb6-9c35-53554563e393-istio-token" (OuterVolumeSpecName: "istio-token") pod "ad430434-e37c-4eb6-9c35-53554563e393" (UID: "ad430434-e37c-4eb6-9c35-53554563e393"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 04 00:05:00.317863 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.317820    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c98bw\" (UniqueName: \"kubernetes.io/projected/ad430434-e37c-4eb6-9c35-53554563e393-kube-api-access-c98bw\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:05:00.317863 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.317857    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad430434-e37c-4eb6-9c35-53554563e393-istio-podinfo\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:05:00.317863 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.317870    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad430434-e37c-4eb6-9c35-53554563e393-istio-envoy\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:05:00.318105 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.317884    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad430434-e37c-4eb6-9c35-53554563e393-istio-token\") on node \"ip-10-0-129-203.ec2.internal\" DevicePath \"\""
Jun 04 00:05:00.803766 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.803680    2561 generic.go:356] "Generic (PLEG): container finished" podID="ad430434-e37c-4eb6-9c35-53554563e393" containerID="cdd3519e936163b07a5e689039b1b2d904cce1a188e031f69197e2012cfb999e" exitCode=0
Jun 04 00:05:00.803766 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.803724    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"
Jun 04 00:05:00.803766 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.803736    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72" event={"ID":"ad430434-e37c-4eb6-9c35-53554563e393","Type":"ContainerDied","Data":"cdd3519e936163b07a5e689039b1b2d904cce1a188e031f69197e2012cfb999e"}
Jun 04 00:05:00.804012 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.803780    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72" event={"ID":"ad430434-e37c-4eb6-9c35-53554563e393","Type":"ContainerDied","Data":"9c8336603b35427d685c21ed2dda7d590cb4d22c78d05c8bb5c48d6320c1a9fe"}
Jun 04 00:05:00.804012 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.803802    2561 scope.go:117] "RemoveContainer" containerID="cdd3519e936163b07a5e689039b1b2d904cce1a188e031f69197e2012cfb999e"
Jun 04 00:05:00.813147 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.813130    2561 scope.go:117] "RemoveContainer" containerID="cdd3519e936163b07a5e689039b1b2d904cce1a188e031f69197e2012cfb999e"
Jun 04 00:05:00.813417 ip-10-0-129-203 kubenswrapper[2561]: E0604 00:05:00.813395    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdd3519e936163b07a5e689039b1b2d904cce1a188e031f69197e2012cfb999e\": container with ID starting with cdd3519e936163b07a5e689039b1b2d904cce1a188e031f69197e2012cfb999e not found: ID does not exist" containerID="cdd3519e936163b07a5e689039b1b2d904cce1a188e031f69197e2012cfb999e"
Jun 04 00:05:00.813491 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.813428    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdd3519e936163b07a5e689039b1b2d904cce1a188e031f69197e2012cfb999e"} err="failed to get container status \"cdd3519e936163b07a5e689039b1b2d904cce1a188e031f69197e2012cfb999e\": rpc error: code = NotFound desc = could not find container \"cdd3519e936163b07a5e689039b1b2d904cce1a188e031f69197e2012cfb999e\": container with ID starting with cdd3519e936163b07a5e689039b1b2d904cce1a188e031f69197e2012cfb999e not found: ID does not exist"
Jun 04 00:05:00.821509 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.821487    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"]
Jun 04 00:05:00.825593 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:00.825572    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2d67fd09-openshift-default-5b4946b4f4-vpx72"]
Jun 04 00:05:02.180702 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:02.180671    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:05:02.280948 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:02.280919    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:05:02.528476 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:02.528442    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad430434-e37c-4eb6-9c35-53554563e393" path="/var/lib/kubelet/pods/ad430434-e37c-4eb6-9c35-53554563e393/volumes"
Jun 04 00:05:13.519193 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:13.519122    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7c7b778c9c-w6lkl_22750ee4-dcdf-406e-9cf4-e016caf003f2/nginx/0.log"
Jun 04 00:05:14.600615 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:14.600586    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f87df8b57-ksd6x_51cd6649-53ef-4b46-85d9-a7cdcaba7517/copy-manifests/0.log"
Jun 04 00:05:14.607151 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:14.607117    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f87df8b57-ksd6x_51cd6649-53ef-4b46-85d9-a7cdcaba7517/manager/0.log"
Jun 04 00:05:16.441991 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:16.441954    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vlnbl_4c8e44f8-381a-4579-b642-f7496123a754/manager/0.log"
Jun 04 00:05:16.672745 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:16.672717    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-wpdd8_c05b70e2-12d6-44d6-8693-7ea13eabda6f/kuadrant-console-plugin/0.log"
Jun 04 00:05:16.797464 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:16.797436    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tp276_afe31876-7cab-4faf-b423-e715dcf61b47/registry-server/0.log"
Jun 04 00:05:17.042890 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:17.042858    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qmttl_9a9dc818-275c-4a9d-a107-4061aba7bcef/limitador/0.log"
Jun 04 00:05:17.161262 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:17.161191    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-wtzgc_e45df8e2-6e1a-4998-a4a8-e08adb06ee3c/manager/0.log"
Jun 04 00:05:17.527760 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:17.527733    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795n6skq_38d57b94-6fc5-467a-b7a2-86f8628f3387/istio-proxy/0.log"
Jun 04 00:05:18.013652 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:18.013623    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-969c5_f5037a6c-d404-4612-b511-7174fa6b8049/istio-proxy/1.log"
Jun 04 00:05:18.859103 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:18.859072    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-t79gc_da702d52-6456-4538-b6bc-4ecc5c267d53/storage-initializer/0.log"
Jun 04 00:05:18.866779 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:18.866755    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-t79gc_da702d52-6456-4538-b6bc-4ecc5c267d53/main/0.log"
Jun 04 00:05:18.980991 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:18.980960    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z_eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51/storage-initializer/0.log"
Jun 04 00:05:18.988000 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:18.987972    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-nrc8z_eff8ebf6-50ab-4a16-8ef7-ca6fca81ec51/main/0.log"
Jun 04 00:05:23.381035 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.381001    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w6rbj/must-gather-fgxfn"]
Jun 04 00:05:23.381704 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.381679    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad430434-e37c-4eb6-9c35-53554563e393" containerName="istio-proxy"
Jun 04 00:05:23.381796 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.381707    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad430434-e37c-4eb6-9c35-53554563e393" containerName="istio-proxy"
Jun 04 00:05:23.381853 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.381845    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad430434-e37c-4eb6-9c35-53554563e393" containerName="istio-proxy"
Jun 04 00:05:23.386561 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.386537    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6rbj/must-gather-fgxfn"
Jun 04 00:05:23.389170 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.389149    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w6rbj\"/\"openshift-service-ca.crt\""
Jun 04 00:05:23.389313 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.389154    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w6rbj\"/\"default-dockercfg-nw9sd\""
Jun 04 00:05:23.389578 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.389564    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w6rbj\"/\"kube-root-ca.crt\""
Jun 04 00:05:23.396231 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.396202    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6rbj/must-gather-fgxfn"]
Jun 04 00:05:23.396686 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.396665    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:05:23.492905 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.492871    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log" limit=1024
Jun 04 00:05:23.540932 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.540895    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a8a58f5b-0148-43dd-92d7-00e55b63a298-must-gather-output\") pod \"must-gather-fgxfn\" (UID: \"a8a58f5b-0148-43dd-92d7-00e55b63a298\") " pod="openshift-must-gather-w6rbj/must-gather-fgxfn"
Jun 04 00:05:23.541140 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.541066    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvhns\" (UniqueName: \"kubernetes.io/projected/a8a58f5b-0148-43dd-92d7-00e55b63a298-kube-api-access-mvhns\") pod \"must-gather-fgxfn\" (UID: \"a8a58f5b-0148-43dd-92d7-00e55b63a298\") " pod="openshift-must-gather-w6rbj/must-gather-fgxfn"
Jun 04 00:05:23.641907 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.641814    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvhns\" (UniqueName: \"kubernetes.io/projected/a8a58f5b-0148-43dd-92d7-00e55b63a298-kube-api-access-mvhns\") pod \"must-gather-fgxfn\" (UID: \"a8a58f5b-0148-43dd-92d7-00e55b63a298\") " pod="openshift-must-gather-w6rbj/must-gather-fgxfn"
Jun 04 00:05:23.641907 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.641890    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a8a58f5b-0148-43dd-92d7-00e55b63a298-must-gather-output\") pod \"must-gather-fgxfn\" (UID: \"a8a58f5b-0148-43dd-92d7-00e55b63a298\") " pod="openshift-must-gather-w6rbj/must-gather-fgxfn"
Jun 04 00:05:23.642239 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.642223    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a8a58f5b-0148-43dd-92d7-00e55b63a298-must-gather-output\") pod \"must-gather-fgxfn\" (UID: \"a8a58f5b-0148-43dd-92d7-00e55b63a298\") " pod="openshift-must-gather-w6rbj/must-gather-fgxfn"
Jun 04 00:05:23.650181 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.650153    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvhns\" (UniqueName: \"kubernetes.io/projected/a8a58f5b-0148-43dd-92d7-00e55b63a298-kube-api-access-mvhns\") pod \"must-gather-fgxfn\" (UID: \"a8a58f5b-0148-43dd-92d7-00e55b63a298\") " pod="openshift-must-gather-w6rbj/must-gather-fgxfn"
Jun 04 00:05:23.698129 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.698104    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6rbj/must-gather-fgxfn"
Jun 04 00:05:23.833538 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.833504    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6rbj/must-gather-fgxfn"]
Jun 04 00:05:23.835090 ip-10-0-129-203 kubenswrapper[2561]: W0604 00:05:23.835059    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8a58f5b_0148_43dd_92d7_00e55b63a298.slice/crio-146348547dc3e89e3594c234920c5d5b8bfb6b384e9899e3eb290bba4718136c WatchSource:0}: Error finding container 146348547dc3e89e3594c234920c5d5b8bfb6b384e9899e3eb290bba4718136c: Status 404 returned error can't find the container with id 146348547dc3e89e3594c234920c5d5b8bfb6b384e9899e3eb290bba4718136c
Jun 04 00:05:23.837050 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.837034    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 04 00:05:23.933084 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:23.932994    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6rbj/must-gather-fgxfn" event={"ID":"a8a58f5b-0148-43dd-92d7-00e55b63a298","Type":"ContainerStarted","Data":"146348547dc3e89e3594c234920c5d5b8bfb6b384e9899e3eb290bba4718136c"}
Jun 04 00:05:24.945894 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:24.945801    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6rbj/must-gather-fgxfn" event={"ID":"a8a58f5b-0148-43dd-92d7-00e55b63a298","Type":"ContainerStarted","Data":"c28a5d1c7c72f05d29f0d2accc7a3569daa072ac528953b2380c256484aea084"}
Jun 04 00:05:24.945894 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:24.945853    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6rbj/must-gather-fgxfn" event={"ID":"a8a58f5b-0148-43dd-92d7-00e55b63a298","Type":"ContainerStarted","Data":"ca09161cf8622367441a6f58f2eb5d4e9e06b454dc4732f7d1df42381251ba39"}
Jun 04 00:05:24.962946 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:24.962885    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w6rbj/must-gather-fgxfn" podStartSLOduration=1.156187943 podStartE2EDuration="1.962863978s" totalImagesPullingTime="806.676035ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-04 00:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 00:05:24.960657301 +0000 UTC m=+2484.859559577" watchObservedRunningTime="2026-06-04 00:05:24.962863978 +0000 UTC m=+2484.861766231"
Jun 04 00:05:26.589409 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:26.589377    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-smlbs_7ab889b5-7e4f-4f60-9caf-50b04a6bdc3c/global-pull-secret-syncer/0.log"
Jun 04 00:05:26.643408 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:26.643373    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2twnm_ab54e225-32ec-4324-bdc2-b8c9e495ff3e/konnectivity-agent/0.log"
Jun 04 00:05:26.753645 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:26.753615    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-203.ec2.internal_a93bc6515e10faef9b23786f0c77b15e/haproxy/0.log"
Jun 04 00:05:31.934121 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:31.934085    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vlnbl_4c8e44f8-381a-4579-b642-f7496123a754/manager/0.log"
Jun 04 00:05:31.996060 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:31.996027    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-wpdd8_c05b70e2-12d6-44d6-8693-7ea13eabda6f/kuadrant-console-plugin/0.log"
Jun 04 00:05:32.043411 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:32.043382    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tp276_afe31876-7cab-4faf-b423-e715dcf61b47/registry-server/0.log"
Jun 04 00:05:32.144874 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:32.144844    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qmttl_9a9dc818-275c-4a9d-a107-4061aba7bcef/limitador/0.log"
Jun 04 00:05:32.227833 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:32.227784    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-wtzgc_e45df8e2-6e1a-4998-a4a8-e08adb06ee3c/manager/0.log"
Jun 04 00:05:33.912215 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:33.912182    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e/alertmanager/0.log"
Jun 04 00:05:33.934702 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:33.934662    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e/config-reloader/0.log"
Jun 04 00:05:33.958293 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:33.958218    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e/kube-rbac-proxy-web/0.log"
Jun 04 00:05:33.978766 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:33.978730    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e/kube-rbac-proxy/0.log"
Jun 04 00:05:34.000817 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.000789    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e/kube-rbac-proxy-metric/0.log"
Jun 04 00:05:34.024371 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.024343    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e/prom-label-proxy/0.log"
Jun 04 00:05:34.046057 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.046029    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ec6bb77-ab9d-45b3-8aaf-4b866f8c136e/init-config-reloader/0.log"
Jun 04 00:05:34.112598 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.112573    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-rlbs8_43f297f3-5920-4ee3-b54b-ecfaaee92f83/kube-state-metrics/0.log"
Jun 04 00:05:34.130497 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.130466    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-rlbs8_43f297f3-5920-4ee3-b54b-ecfaaee92f83/kube-rbac-proxy-main/0.log"
Jun 04 00:05:34.157416 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.157386    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-79fb7d47d4-rlbs8_43f297f3-5920-4ee3-b54b-ecfaaee92f83/kube-rbac-proxy-self/0.log"
Jun 04 00:05:34.267609 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.267566    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-79ctc_719ba6b8-8607-4094-9323-fe570d677c7e/node-exporter/0.log"
Jun 04 00:05:34.296154 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.296130    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-79ctc_719ba6b8-8607-4094-9323-fe570d677c7e/kube-rbac-proxy/0.log"
Jun 04 00:05:34.316161 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.316128    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-79ctc_719ba6b8-8607-4094-9323-fe570d677c7e/init-textfile/0.log"
Jun 04 00:05:34.488129 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.488086    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-6xxxp_120fa87d-2b5d-434c-af7c-63394b120b54/kube-rbac-proxy-main/0.log"
Jun 04 00:05:34.510882 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.510858    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-6xxxp_120fa87d-2b5d-434c-af7c-63394b120b54/kube-rbac-proxy-self/0.log"
Jun 04 00:05:34.546233 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.545594    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-6xxxp_120fa87d-2b5d-434c-af7c-63394b120b54/openshift-state-metrics/0.log"
Jun 04 00:05:34.604890 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.604866    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_105b4dd0-d309-4bd6-8c88-c5a178a18046/prometheus/0.log"
Jun 04 00:05:34.677621 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.677589    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_105b4dd0-d309-4bd6-8c88-c5a178a18046/config-reloader/0.log"
Jun 04 00:05:34.723205 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.723149    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_105b4dd0-d309-4bd6-8c88-c5a178a18046/thanos-sidecar/0.log"
Jun 04 00:05:34.750849 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.750751    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_105b4dd0-d309-4bd6-8c88-c5a178a18046/kube-rbac-proxy-web/0.log"
Jun 04 00:05:34.783819 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.783755    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_105b4dd0-d309-4bd6-8c88-c5a178a18046/kube-rbac-proxy/0.log"
Jun 04 00:05:34.807645 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.807581    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_105b4dd0-d309-4bd6-8c88-c5a178a18046/kube-rbac-proxy-thanos/0.log"
Jun 04 00:05:34.838788 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.838729    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_105b4dd0-d309-4bd6-8c88-c5a178a18046/init-config-reloader/0.log"
Jun 04 00:05:34.933213 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.932320    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-gmtv4_b124d11b-082b-4413-8f9d-5226285a39d2/prometheus-operator-admission-webhook/0.log"
Jun 04 00:05:34.967494 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.967459    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-794dbddbc5-ngnt5_129432be-4ef1-4e85-b007-87da70db0c26/telemeter-client/0.log"
Jun 04 00:05:34.989461 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:34.989430    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-794dbddbc5-ngnt5_129432be-4ef1-4e85-b007-87da70db0c26/reload/0.log"
Jun 04 00:05:35.011357 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:35.011257    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-794dbddbc5-ngnt5_129432be-4ef1-4e85-b007-87da70db0c26/kube-rbac-proxy/0.log"
Jun 04 00:05:35.044646 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:35.044611    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c768cc9d9-zg4bw_c8e72b98-3ff9-449b-83a4-7e477779a080/thanos-query/0.log"
Jun 04 00:05:35.070337 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:35.070308    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c768cc9d9-zg4bw_c8e72b98-3ff9-449b-83a4-7e477779a080/kube-rbac-proxy-web/0.log"
Jun 04 00:05:35.098372 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:35.098342    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c768cc9d9-zg4bw_c8e72b98-3ff9-449b-83a4-7e477779a080/kube-rbac-proxy/0.log"
Jun 04 00:05:35.121192 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:35.121163    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c768cc9d9-zg4bw_c8e72b98-3ff9-449b-83a4-7e477779a080/prom-label-proxy/0.log"
Jun 04 00:05:35.146223 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:35.146199    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c768cc9d9-zg4bw_c8e72b98-3ff9-449b-83a4-7e477779a080/kube-rbac-proxy-rules/0.log"
Jun 04 00:05:35.168774 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:35.168742    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c768cc9d9-zg4bw_c8e72b98-3ff9-449b-83a4-7e477779a080/kube-rbac-proxy-metrics/0.log"
Jun 04 00:05:36.623293 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:36.623237    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-68d6b54856-xv274_3ccfd2d2-e09b-43e0-921b-e5c2341b1ff1/networking-console-plugin/0.log"
Jun 04 00:05:38.866149 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:38.866083    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"]
Jun 04 00:05:38.883196 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:38.883147    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"]
Jun 04 00:05:38.883395 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:38.883299    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.038117 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.038081    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7126a3c-71c9-4a0d-a563-d7103e00dc00-lib-modules\") pod \"perf-node-gather-daemonset-rnxx7\" (UID: \"f7126a3c-71c9-4a0d-a563-d7103e00dc00\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.038355 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.038133    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7126a3c-71c9-4a0d-a563-d7103e00dc00-sys\") pod \"perf-node-gather-daemonset-rnxx7\" (UID: \"f7126a3c-71c9-4a0d-a563-d7103e00dc00\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.038355 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.038228    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn6hz\" (UniqueName: \"kubernetes.io/projected/f7126a3c-71c9-4a0d-a563-d7103e00dc00-kube-api-access-gn6hz\") pod \"perf-node-gather-daemonset-rnxx7\" (UID: \"f7126a3c-71c9-4a0d-a563-d7103e00dc00\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.038355 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.038261    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f7126a3c-71c9-4a0d-a563-d7103e00dc00-proc\") pod \"perf-node-gather-daemonset-rnxx7\" (UID: \"f7126a3c-71c9-4a0d-a563-d7103e00dc00\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.038355 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.038351    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f7126a3c-71c9-4a0d-a563-d7103e00dc00-podres\") pod \"perf-node-gather-daemonset-rnxx7\" (UID: \"f7126a3c-71c9-4a0d-a563-d7103e00dc00\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.140144 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.140052    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7126a3c-71c9-4a0d-a563-d7103e00dc00-sys\") pod \"perf-node-gather-daemonset-rnxx7\" (UID: \"f7126a3c-71c9-4a0d-a563-d7103e00dc00\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.140559 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.140538    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn6hz\" (UniqueName: \"kubernetes.io/projected/f7126a3c-71c9-4a0d-a563-d7103e00dc00-kube-api-access-gn6hz\") pod \"perf-node-gather-daemonset-rnxx7\" (UID: \"f7126a3c-71c9-4a0d-a563-d7103e00dc00\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.140689 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.140676    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f7126a3c-71c9-4a0d-a563-d7103e00dc00-proc\") pod \"perf-node-gather-daemonset-rnxx7\" (UID: \"f7126a3c-71c9-4a0d-a563-d7103e00dc00\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.141166 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.140440    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7126a3c-71c9-4a0d-a563-d7103e00dc00-sys\") pod \"perf-node-gather-daemonset-rnxx7\" (UID: \"f7126a3c-71c9-4a0d-a563-d7103e00dc00\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.141323 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.140850    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f7126a3c-71c9-4a0d-a563-d7103e00dc00-proc\") pod \"perf-node-gather-daemonset-rnxx7\" (UID: \"f7126a3c-71c9-4a0d-a563-d7103e00dc00\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.141467 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.141451    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f7126a3c-71c9-4a0d-a563-d7103e00dc00-podres\") pod \"perf-node-gather-daemonset-rnxx7\" (UID: \"f7126a3c-71c9-4a0d-a563-d7103e00dc00\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.141655 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.141642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7126a3c-71c9-4a0d-a563-d7103e00dc00-lib-modules\") pod \"perf-node-gather-daemonset-rnxx7\" (UID: \"f7126a3c-71c9-4a0d-a563-d7103e00dc00\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.141886 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.141872    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7126a3c-71c9-4a0d-a563-d7103e00dc00-lib-modules\") pod \"perf-node-gather-daemonset-rnxx7\" (UID: \"f7126a3c-71c9-4a0d-a563-d7103e00dc00\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.142087 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.142054    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f7126a3c-71c9-4a0d-a563-d7103e00dc00-podres\") pod \"perf-node-gather-daemonset-rnxx7\" (UID: \"f7126a3c-71c9-4a0d-a563-d7103e00dc00\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.151598 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.151573    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn6hz\" (UniqueName: \"kubernetes.io/projected/f7126a3c-71c9-4a0d-a563-d7103e00dc00-kube-api-access-gn6hz\") pod \"perf-node-gather-daemonset-rnxx7\" (UID: \"f7126a3c-71c9-4a0d-a563-d7103e00dc00\") " pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.202313 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.202258    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:39.401680 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:39.401646    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"]
Jun 04 00:05:39.403127 ip-10-0-129-203 kubenswrapper[2561]: W0604 00:05:39.403096    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf7126a3c_71c9_4a0d_a563_d7103e00dc00.slice/crio-e449dc97ce04fe3a077d3f681ec2948f923b2149cf7d2ab8099b83b15fdefb37 WatchSource:0}: Error finding container e449dc97ce04fe3a077d3f681ec2948f923b2149cf7d2ab8099b83b15fdefb37: Status 404 returned error can't find the container with id e449dc97ce04fe3a077d3f681ec2948f923b2149cf7d2ab8099b83b15fdefb37
Jun 04 00:05:40.070770 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:40.070738    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mqj5m_5396ae25-295d-49a4-8b66-3fe3ecefdfe4/dns/0.log"
Jun 04 00:05:40.076109 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:40.076079    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7" event={"ID":"f7126a3c-71c9-4a0d-a563-d7103e00dc00","Type":"ContainerStarted","Data":"36450e74fa148e6a941a06b2502be64b031eafaedb2828f92cc1d7e8167c63ed"}
Jun 04 00:05:40.076304 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:40.076141    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7" event={"ID":"f7126a3c-71c9-4a0d-a563-d7103e00dc00","Type":"ContainerStarted","Data":"e449dc97ce04fe3a077d3f681ec2948f923b2149cf7d2ab8099b83b15fdefb37"}
Jun 04 00:05:40.076304 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:40.076231    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:40.101613 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:40.101554    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7" podStartSLOduration=2.101532236 podStartE2EDuration="2.101532236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 00:05:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 00:05:40.098007858 +0000 UTC m=+2499.996910112" watchObservedRunningTime="2026-06-04 00:05:40.101532236 +0000 UTC m=+2500.000434487"
Jun 04 00:05:40.109215 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:40.109192    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mqj5m_5396ae25-295d-49a4-8b66-3fe3ecefdfe4/kube-rbac-proxy/0.log"
Jun 04 00:05:40.140568 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:40.140528    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-95bsc_d5772818-6f15-419b-b75d-7b8787218fcc/dns-node-resolver/0.log"
Jun 04 00:05:40.744390 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:40.744362    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29675520-wgzxm_96d8bd5c-e3b8-4544-a1e3-92319df06283/image-pruner/0.log"
Jun 04 00:05:40.848431 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:40.848400    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n89kn_c0773ad3-6650-4e53-bb83-ef9be98635d0/node-ca/0.log"
Jun 04 00:05:41.814048 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:41.814015    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795n6skq_38d57b94-6fc5-467a-b7a2-86f8628f3387/istio-proxy/0.log"
Jun 04 00:05:41.976830 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:41.976799    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-969c5_f5037a6c-d404-4612-b511-7174fa6b8049/istio-proxy/0.log"
Jun 04 00:05:42.027970 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:42.027776    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-969c5_f5037a6c-d404-4612-b511-7174fa6b8049/istio-proxy/1.log"
Jun 04 00:05:42.857992 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:42.857967    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xrmc4_7165ed2f-9fbf-4c4a-89b7-9e46e653cb82/serve-healthcheck-canary/0.log"
Jun 04 00:05:43.357507 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:43.357414    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-vrf65_e6b70489-bf56-47d9-b873-eaa3aa386f4c/insights-operator/0.log"
Jun 04 00:05:43.358686 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:43.358656    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-69684796bc-vrf65_e6b70489-bf56-47d9-b873-eaa3aa386f4c/insights-operator/1.log"
Jun 04 00:05:43.379970 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:43.379945    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gz8cg_de20ac2f-afb8-4e3e-b153-ab95f1d499d6/kube-rbac-proxy/0.log"
Jun 04 00:05:43.400613 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:43.400586    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gz8cg_de20ac2f-afb8-4e3e-b153-ab95f1d499d6/exporter/0.log"
Jun 04 00:05:43.425009 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:43.424981    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gz8cg_de20ac2f-afb8-4e3e-b153-ab95f1d499d6/extractor/0.log"
Jun 04 00:05:45.922501 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:45.922475    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7c7b778c9c-w6lkl_22750ee4-dcdf-406e-9cf4-e016caf003f2/nginx/0.log"
Jun 04 00:05:46.094205 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:46.094172    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w6rbj/perf-node-gather-daemonset-rnxx7"
Jun 04 00:05:46.263230 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:46.263200    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f87df8b57-ksd6x_51cd6649-53ef-4b46-85d9-a7cdcaba7517/manager/0.log"
Jun 04 00:05:46.281928 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:46.281897    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f87df8b57-ksd6x_51cd6649-53ef-4b46-85d9-a7cdcaba7517/copy-manifests/0.log"
Jun 04 00:05:48.188885 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:48.188852    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6845fb6b5-dfh7l_42c61bc2-9682-4dc7-ac2a-b682c802d49b/manager/0.log"
Jun 04 00:05:48.215932 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:48.215901    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ztz7j_a5b6372c-f0a9-4aeb-987c-7d199c7cb8a6/openshift-lws-operator/0.log"
Jun 04 00:05:52.202386 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:52.202350    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795n6skq_38d57b94-6fc5-467a-b7a2-86f8628f3387/istio-proxy/0.log"
Jun 04 00:05:52.339188 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:52.339148    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-969c5_f5037a6c-d404-4612-b511-7174fa6b8049/istio-proxy/0.log"
Jun 04 00:05:52.387947 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:52.387912    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-969c5_f5037a6c-d404-4612-b511-7174fa6b8049/istio-proxy/1.log"
Jun 04 00:05:53.640724 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:53.640698    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795n6skq_38d57b94-6fc5-467a-b7a2-86f8628f3387/istio-proxy/0.log"
Jun 04 00:05:53.711956 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:53.711930    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-77ljk_551b45fe-b4cb-4813-92bf-2d0f653ea6b5/migrator/0.log"
Jun 04 00:05:53.734198 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:53.734173    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-77ljk_551b45fe-b4cb-4813-92bf-2d0f653ea6b5/graceful-termination/0.log"
Jun 04 00:05:53.761138 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:53.761105    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-969c5_f5037a6c-d404-4612-b511-7174fa6b8049/istio-proxy/0.log"
Jun 04 00:05:53.808383 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:53.808353    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-969c5_f5037a6c-d404-4612-b511-7174fa6b8049/istio-proxy/1.log"
Jun 04 00:05:54.232417 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:54.232389    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf_7de16cf1-50d0-45d3-9910-e6576f3574d8/kube-storage-version-migrator-operator/1.log"
Jun 04 00:05:54.233186 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:54.233148    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6dfc7c8b9f-dn5gf_7de16cf1-50d0-45d3-9910-e6576f3574d8/kube-storage-version-migrator-operator/0.log"
Jun 04 00:05:55.609881 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:55.609853    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795n6skq_38d57b94-6fc5-467a-b7a2-86f8628f3387/istio-proxy/0.log"
Jun 04 00:05:55.712704 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:55.712676    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxlch_d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d/kube-multus-additional-cni-plugins/0.log"
Jun 04 00:05:55.737999 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:55.737970    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxlch_d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d/egress-router-binary-copy/0.log"
Jun 04 00:05:55.740785 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:55.740765    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-969c5_f5037a6c-d404-4612-b511-7174fa6b8049/istio-proxy/0.log"
Jun 04 00:05:55.759562 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:55.759527    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxlch_d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d/cni-plugins/0.log"
Jun 04 00:05:55.783760 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:55.783706    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxlch_d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d/bond-cni-plugin/0.log"
Jun 04 00:05:55.784678 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:55.784651    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-969c5_f5037a6c-d404-4612-b511-7174fa6b8049/istio-proxy/1.log"
Jun 04 00:05:55.804763 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:55.804739    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxlch_d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d/routeoverride-cni/0.log"
Jun 04 00:05:55.825136 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:55.825107    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxlch_d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d/whereabouts-cni-bincopy/0.log"
Jun 04 00:05:55.845650 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:55.845615    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxlch_d35da287-2ed2-4ca4-8da9-7e70ff5d6f7d/whereabouts-cni/0.log"
Jun 04 00:05:55.878185 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:55.878063    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hg6q2_bd6f3a91-46a4-4bd5-bbcf-581f27e27417/kube-multus/0.log"
Jun 04 00:05:55.952472 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:55.952439    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5t7nh_2be4b6b6-ca95-4f1f-afce-1ff311ee9989/network-metrics-daemon/0.log"
Jun 04 00:05:55.971339 ip-10-0-129-203 kubenswrapper[2561]: I0604 00:05:55.971306    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5t7nh_2be4b6b6-ca95-4f1f-afce-1ff311ee9989/kube-rbac-proxy/0.log"