Jun 10 00:18:53.564320 ip-10-0-128-167 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jun 10 00:18:53.564335 ip-10-0-128-167 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jun 10 00:18:53.564346 ip-10-0-128-167 systemd[1]: kubelet.service: Failed with result 'resources'.
Jun 10 00:18:53.564689 ip-10-0-128-167 systemd[1]: Failed to start Kubernetes Kubelet.
Jun 10 00:19:03.011133 ip-10-0-128-167 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jun 10 00:19:03.011145 ip-10-0-128-167 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ee01fc60f91344f58e76f50f5c7c8bfc --
Jun 10 00:21:33.004124 ip-10-0-128-167 systemd[1]: Starting Kubernetes Kubelet...
Jun 10 00:21:33.441070 ip-10-0-128-167 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 10 00:21:33.441070 ip-10-0-128-167 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 10 00:21:33.441070 ip-10-0-128-167 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 10 00:21:33.441070 ip-10-0-128-167 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 10 00:21:33.441070 ip-10-0-128-167 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 10 00:21:33.442096 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.442008    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 10 00:21:33.445421 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445403    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 00:21:33.445421 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445422    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445425    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445429    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445432    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445435    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445438    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445441    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445444    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445447    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445449    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445452    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445454    2560 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445457    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445460    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445468    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445471    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445476    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445479    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445482    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 00:21:33.445490 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445485    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445488    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445490    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445493    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445495    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445498    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445501    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445504    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445507    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445509    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445512    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445514    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445517    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445519    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445522    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445526    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445529    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445532    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445535    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445537    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 00:21:33.445980 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445540    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445542    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445544    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445547    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445549    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445552    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445554    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445556    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445565    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445567    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445570    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445572    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445574    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445577    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445580    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445583    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445585    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445588    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445590    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 00:21:33.446507 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445593    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445595    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445598    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445600    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445602    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445605    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445607    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445610    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445613    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445615    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445618    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445622    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445626    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445629    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445632    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445635    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445637    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445639    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445642    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445644    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 00:21:33.447002 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445647    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445650    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445658    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445660    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445662    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445665    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445668    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445672    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445675    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445678    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445680    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445683    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445694    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445699    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445701    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445704    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445707    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445709    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445712    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.445714    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 00:21:33.447488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446641    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446654    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446659    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446662    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446665    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446667    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446670    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446673    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446676    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446678    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446681    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446683    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446686    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446690    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446692    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446695    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446698    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446700    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446703    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446706    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 00:21:33.447995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446708    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446711    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446714    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446724    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446727    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446731    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446733    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446753    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446758    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446762    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446765    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446767    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446770    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446774    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446777    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446780    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446782    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446785    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446787    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 00:21:33.448501 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446790    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446793    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446795    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446798    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446801    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446803    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446806    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446808    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446811    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446813    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446816    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446818    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446821    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446824    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446826    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446829    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446832    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446841    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446844    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446846    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 00:21:33.448985 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446849    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446851    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446854    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446857    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446859    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446862    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446865    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446868    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446870    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446873    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446875    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446878    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446880    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446883    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446885    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446888    2560 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446890    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446892    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446895    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 00:21:33.449520 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446898    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446903    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446908    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446911    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446915    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446918    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446921    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446924    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446927    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446930    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446932    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446941    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446944    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446947    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446949    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446952    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446955    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446957    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446960    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 00:21:33.450020 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446963    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.446965    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447451    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447457    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447460    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447463    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447466    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447469    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447472    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447474    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447477    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447479    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447482    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447485    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447487    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447490    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447493    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447495    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447499    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447502    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 00:21:33.450493 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447506    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447510    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447514    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447517    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447525    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447528    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447531    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447534    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447536    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447541    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447544    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447548    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447551    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447554    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447556    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447559    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447562    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447564    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 00:21:33.451000 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447567    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447570    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447572    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447575    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447577    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447580    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447582    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447584    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447587    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447589    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447592    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447595    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447597    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447601    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447603    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447606    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447609    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447611    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447614    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447624    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 00:21:33.451461 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447626    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447629    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447631    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447634    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447637    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447639    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447641    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447644    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447646    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447649    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447651    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447655    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447659    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447662    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447665    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447667    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447670    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447672    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447674    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447677    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 00:21:33.451977 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447679    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447682    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447685    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447688    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447690    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447693    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447695    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447698    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447700    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447703    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447705    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447708    2560 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447716    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447718    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447721    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447723    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447726    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447728    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447730    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447733    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 00:21:33.452451 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447735    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447782    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.447786    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447866    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447874    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447887    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447892    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447896    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447899    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447904    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447908    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447911    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447914    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447918    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447921    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447924    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447927    2560 flags.go:64] FLAG: --cgroup-root=""
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447930    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447933    2560 flags.go:64] FLAG: --client-ca-file=""
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447936    2560 flags.go:64] FLAG: --cloud-provider="external"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447939    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447945    2560 flags.go:64] FLAG: --cluster-domain=""
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447948    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447951    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 10 00:21:33.452995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447954    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447963    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447967    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447970    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447973    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447976    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447979    2560 flags.go:64] FLAG: --contention-profiling="false"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447983    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447986    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447990    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447993    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.447997    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448000    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448003    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448006    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448009    2560 flags.go:64] FLAG: --enable-server="true"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448012    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448020    2560 flags.go:64] FLAG: --event-burst="100"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448023    2560 flags.go:64] FLAG: --event-qps="50"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448025    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448028    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448031    2560 flags.go:64] FLAG: --eviction-hard=""
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448035    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448038    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448041    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 10 00:21:33.453582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448044    2560 flags.go:64] FLAG: --eviction-soft=""
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448047    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448049    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448052    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448055    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448058    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448061    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448064    2560 flags.go:64] FLAG: --feature-gates=""
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448067    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448076    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448080    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448083    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448086    2560 flags.go:64] FLAG: --healthz-port="10248"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448089    2560 flags.go:64] FLAG: --help="false"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448091    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-128-167.ec2.internal"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448094    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448098    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448101    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448104    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448107    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448110    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448113    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448116    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 10 00:21:33.454217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448119    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448122    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448125    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448127    2560 flags.go:64] FLAG: --kube-reserved=""
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448130    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448133    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448136    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448138    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448141    2560 flags.go:64] FLAG: --lock-file=""
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448144    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448147    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448150    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448155    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448158    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448160    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448163    2560 flags.go:64] FLAG: --logging-format="text"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448166    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448172    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448174    2560 flags.go:64] FLAG: --manifest-url=""
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448183    2560 flags.go:64] FLAG: --manifest-url-header=""
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448187    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448190    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448194    2560 flags.go:64] FLAG: --max-pods="110"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448197    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448200    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 10 00:21:33.454836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448203    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448206    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448209    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448213    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448216    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448232    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448235    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448238    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448241    2560 flags.go:64] FLAG: --pod-cidr=""
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448243    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448249    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448252    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448255    2560 flags.go:64] FLAG: --pods-per-core="0"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448258    2560 flags.go:64] FLAG: --port="10250"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448260    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448263    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06bb5e6298f0d8203"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448266    2560 flags.go:64] FLAG: --qos-reserved=""
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448269    2560 flags.go:64] FLAG: --read-only-port="10255"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448272    2560 flags.go:64] FLAG: --register-node="true"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448275    2560 flags.go:64] FLAG: --register-with-taints=""
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448279    2560 flags.go:64] FLAG: --registry-burst="10"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448281    2560 flags.go:64] FLAG: --registry-qps="5"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448284    2560 flags.go:64] FLAG: --reserved-cpus=""
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448287    2560 flags.go:64] FLAG: --reserved-memory=""
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448294    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 10 00:21:33.455458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448297    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448300    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448309    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448312    2560 flags.go:64] FLAG: --runonce="false"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448315    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448317    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448321    2560 flags.go:64] FLAG: --seccomp-default="false"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448323    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448327    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448330    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448334    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448337    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448340    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448343    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448345    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448348    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448351    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448354    2560 flags.go:64] FLAG: --system-cgroups=""
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448357    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448362    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448364    2560 flags.go:64] FLAG: --tls-cert-file=""
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448367    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448373    2560 flags.go:64] FLAG: --tls-min-version=""
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448376    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448378    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 10 00:21:33.456098 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448381    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448384    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448387    2560 flags.go:64] FLAG: --v="2"
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448395    2560 flags.go:64] FLAG: --version="false"
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448399    2560 flags.go:64] FLAG: --vmodule=""
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448403    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.448407    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448595    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448600    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448603    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448612    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448614    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448617    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448619    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448622    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448626    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448629    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448632    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448635    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448638    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448640    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 00:21:33.456898 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448643    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448645    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448648    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448650    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448653    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448655    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448657    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448660    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448663    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448665    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448668    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448670    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448673    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448676    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448678    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448681    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448683    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448687    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448690    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448692    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 00:21:33.457725 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448695    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448697    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448707    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448709    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448712    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448715    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448718    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448721    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448723    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448726    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448728    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448731    2560 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448733    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448753    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448758    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448761    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448764    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448766    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448769    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448771    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 00:21:33.458312 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448776    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448779    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448782    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448785    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448787    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448790    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448793    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448796    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448798    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448802    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448805    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448807    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448810    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448813    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448816    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448824    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448827    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448830    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448835    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448839    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 00:21:33.458904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448842    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448845    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448847    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448850    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448852    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448855    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448857    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448860    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448862    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448865    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448867    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448870    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448872    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448875    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448878    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448880    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448883    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448885    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448888    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 00:21:33.459392 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448891    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 00:21:33.459881 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448893    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 00:21:33.459881 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448897    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 00:21:33.459881 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448900    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 00:21:33.459881 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448902    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 00:21:33.459881 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.448906    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 00:21:33.459881 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.449425    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 10 00:21:33.459881 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.458784    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 10 00:21:33.459881 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.458803    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 10 00:21:33.459881 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.458824    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 10 00:21:33.459881 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.458834    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 10 00:21:33.459881 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458895    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 00:21:33.459881 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458900    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 00:21:33.459881 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458904    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 00:21:33.459881 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458907    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458911    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458913    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458916    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458919    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458922    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458925    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458928    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458930    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458933    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458936    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458940    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458944    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458947    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458950    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458953    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458956    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458958    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458961    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 00:21:33.460240 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458963    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458966    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458968    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458971    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458973    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458981    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458984    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458988    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458991    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458993    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458996    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.458998    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459001    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459004    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459006    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459009    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459012    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459014    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459017    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459019    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 00:21:33.460749 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459022    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459024    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459027    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459030    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459032    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459035    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459037    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459040    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459042    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459045    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459048    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459050    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459053    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459057    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459060    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459063    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459066    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459069    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459072    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 00:21:33.461301 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459075    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459078    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459081    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459084    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459086    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459090    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459094    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459096    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459099    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459102    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459104    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459107    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459109    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459112    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459114    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459117    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459119    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459122    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459125    2560 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459128    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 00:21:33.461837 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459131    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459133    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459136    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459138    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459141    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459143    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459146    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459148    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459151    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459153    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459156    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459158    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459162    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459165    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459168    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459170    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459173    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 00:21:33.462349 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459176    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 00:21:33.463052 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.459181    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 10 00:21:33.463052 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459302    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 00:21:33.463052 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459308    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 00:21:33.463052 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459311    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 00:21:33.463052 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459314    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 00:21:33.463052 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459317    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 00:21:33.463052 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459320    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 00:21:33.463052 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459323    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 00:21:33.463052 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459326    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 00:21:33.463052 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459329    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 00:21:33.463052 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459332    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 00:21:33.463052 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459334    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 00:21:33.463052 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459337    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 00:21:33.463052 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459340    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 00:21:33.463052 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459343    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459345    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459348    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459350    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459353    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459356    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459358    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459361    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459363    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459366    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459368    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459371    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459373    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459376    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459379    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459381    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459384    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459387    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459389    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459392    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 00:21:33.463431 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459394    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459397    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459400    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459403    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459405    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459408    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459411    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459413    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459415    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459418    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459420    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459423    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459427    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459429    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459432    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459434    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459437    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459439    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459441    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459444    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 00:21:33.464175 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459446    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459449    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459452    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459454    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459457    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459460    2560 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459462    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459464    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459467    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459470    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459472    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459475    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459477    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459480    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459482    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459484    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459487    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459489    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459492    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 00:21:33.464921 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459494    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459497    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459499    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459502    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459505    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459508    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459511    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459514    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459517    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459520    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459522    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459526    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459529    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459532    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459535    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459538    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459541    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459543    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459546    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 00:21:33.465417 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459549    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 00:21:33.466025 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459551    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 00:21:33.466025 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459553    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 00:21:33.466025 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459556    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 00:21:33.466025 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459559    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 00:21:33.466025 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459561    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 00:21:33.466025 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459565    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 00:21:33.466025 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:33.459568    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 00:21:33.466025 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.459573    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 10 00:21:33.466025 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.459705    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 10 00:21:33.466025 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.462251    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 10 00:21:33.466025 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.463543    2560 server.go:1019] "Starting client certificate rotation"
Jun 10 00:21:33.466025 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.463664    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 10 00:21:33.466025 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.463713    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 10 00:21:33.466366 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.466096    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 10 00:21:33.467316 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.467294    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 10 00:21:33.481894 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.481864    2560 log.go:25] "Validated CRI v1 runtime API"
Jun 10 00:21:33.486310 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.485784    2560 log.go:25] "Validated CRI v1 image API"
Jun 10 00:21:33.487409 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.487254    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 10 00:21:33.489966 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.489941    2560 fs.go:135] Filesystem UUIDs: map[2ddbc07f-17c2-4f52-9c44-a748b1aff2ae:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 97d38eee-1240-4d8d-97ab-438b6e1074c3:/dev/nvme0n1p4]
Jun 10 00:21:33.490063 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.489965    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 10 00:21:33.493526 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.493504    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 10 00:21:33.496022 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.495902    2560 manager.go:216] Machine: {Timestamp:2026-06-10 00:21:33.494583106 +0000 UTC m=+0.365359224 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099980 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21a1c225530ec7966a677c415c649f SystemUUID:ec21a1c2-2553-0ec7-966a-677c415c649f BootID:ee01fc60-f913-44f5-8e76-f50f5c7c8bfc Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d1:d4:59:c4:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d1:d4:59:c4:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:f6:cb:ba:6e:ca Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 10 00:21:33.496022 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.496010    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 10 00:21:33.496181 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.496121    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 10 00:21:33.499281 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.499251    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 10 00:21:33.499423 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.499284    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-167.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 10 00:21:33.500227 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.500217    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jun 10 00:21:33.500259 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.500230    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jun 10 00:21:33.500259 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.500238    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 10 00:21:33.501065 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.501053    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 10 00:21:33.502676 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.502663    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 10 00:21:33.505710 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.505684    2560 state_mem.go:36] "Initialized new in-memory state store"
Jun 10 00:21:33.505865 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.505854    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 10 00:21:33.505903 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.505887    2560 kubelet.go:486] "Attempting to sync node with API server"
Jun 10 00:21:33.505903 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.505898    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 10 00:21:33.505979 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.505913    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 10 00:21:33.505979 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.505924    2560 kubelet.go:398] "Adding apiserver pod source"
Jun 10 00:21:33.505979 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.505935    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 10 00:21:33.506502 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.506475    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 10 00:21:33.506502 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.506506    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 10 00:21:33.509285 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.509251    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-78cmz"
Jun 10 00:21:33.509285 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.509258    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 10 00:21:33.510800 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.510784    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 10 00:21:33.510869 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.510816    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 10 00:21:33.511422 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.511411    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 10 00:21:33.511469 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.511428    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 10 00:21:33.511469 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.511435    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 10 00:21:33.511469 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.511441    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 10 00:21:33.511469 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.511450    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 10 00:21:33.511469 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.511456    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 10 00:21:33.511469 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.511464    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 10 00:21:33.511469 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.511469    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 10 00:21:33.511651 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.511477    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 10 00:21:33.511651 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.511483    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 10 00:21:33.511651 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.511493    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 10 00:21:33.511651 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.511498    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 10 00:21:33.512962 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.512951    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 10 00:21:33.513002 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.512963    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 10 00:21:33.518990 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.518967    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-167.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 10 00:21:33.518990 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:33.518981    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 10 00:21:33.519149 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:33.519062    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 10 00:21:33.519149 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.519079    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-78cmz"
Jun 10 00:21:33.522665 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.522648    2560 server.go:1268] "Started kubelet"
Jun 10 00:21:33.522802 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.522756    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 10 00:21:33.522902 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.522781    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 10 00:21:33.522902 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.522861    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 10 00:21:33.523776 ip-10-0-128-167 systemd[1]: Started Kubernetes Kubelet.
Jun 10 00:21:33.524470 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.524392    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 10 00:21:33.525345 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.525331    2560 server.go:310] "Adding debug handlers to kubelet server"
Jun 10 00:21:33.528838 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:33.528805    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 10 00:21:33.529508 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.529490    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 10 00:21:33.529576 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.529488    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 10 00:21:33.529626 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:33.529571    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-167.ec2.internal\" not found"
Jun 10 00:21:33.530135 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.530063    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 10 00:21:33.530135 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.530078    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 10 00:21:33.530284 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.530256    2560 reconstruct.go:97] "Volume reconstruction finished"
Jun 10 00:21:33.530284 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.530265    2560 reconciler.go:29] "Reconciler: start to sync state"
Jun 10 00:21:33.530621 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.530419    2560 factory.go:55] Registering systemd factory
Jun 10 00:21:33.530621 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.530452    2560 factory.go:223] Registration of the systemd container factory successfully
Jun 10 00:21:33.530621 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.530467    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 10 00:21:33.531465 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.531445    2560 factory.go:153] Registering CRI-O factory
Jun 10 00:21:33.531465 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.531465    2560 factory.go:223] Registration of the crio container factory successfully
Jun 10 00:21:33.531637 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.531465    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 00:21:33.531637 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.531529    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 10 00:21:33.531637 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.531551    2560 factory.go:103] Registering Raw factory
Jun 10 00:21:33.531637 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.531565    2560 manager.go:1196] Started watching for new ooms in manager
Jun 10 00:21:33.532475 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.532461    2560 manager.go:349] Starting recovery of all containers
Jun 10 00:21:33.534098 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:33.534074    2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-167.ec2.internal\" not found" node="ip-10-0-128-167.ec2.internal"
Jun 10 00:21:33.544104 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.544087    2560 manager.go:354] Recovery completed
Jun 10 00:21:33.548159 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.548141    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 00:21:33.550203 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.550179    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 00:21:33.550290 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.550224    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 00:21:33.550290 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.550240    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasSufficientPID"
Jun 10 00:21:33.550848 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.550831    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 10 00:21:33.550848 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.550845    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 10 00:21:33.551012 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.550866    2560 state_mem.go:36] "Initialized new in-memory state store"
Jun 10 00:21:33.551012 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.550846    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 00:21:33.551609 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.551590    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 00:21:33.551680 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.551626    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 00:21:33.551680 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.551641    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasSufficientPID"
Jun 10 00:21:33.552314 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.552303    2560 policy_none.go:49] "None policy: Start"
Jun 10 00:21:33.552350 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.552320    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 10 00:21:33.552350 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.552330    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 10 00:21:33.553336 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.553326    2560 policy_none.go:47] "Start"
Jun 10 00:21:33.595449 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.595427    2560 manager.go:337] "Starting Device Plugin manager"
Jun 10 00:21:33.609526 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:33.595517    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 10 00:21:33.609526 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.595532    2560 server.go:87] "Starting device plugin registration server"
Jun 10 00:21:33.609526 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.595844    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 10 00:21:33.609526 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.595868    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 10 00:21:33.609526 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.595954    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 10 00:21:33.609526 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.596033    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 10 00:21:33.609526 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.596041    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 10 00:21:33.609526 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:33.596899    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 10 00:21:33.609526 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:33.596957    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-167.ec2.internal\" not found"
Jun 10 00:21:33.609526 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.607054    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 10 00:21:33.609526 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.608399    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 10 00:21:33.609526 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.608438    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 10 00:21:33.609526 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.608465    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 10 00:21:33.609526 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:33.608506    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 10 00:21:33.610579 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.610470    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 00:21:33.696898 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.696816    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 00:21:33.699469 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.699450    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 00:21:33.699588 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.699486    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 00:21:33.699588 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.699499    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasSufficientPID"
Jun 10 00:21:33.699588 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.699525    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-167.ec2.internal"
Jun 10 00:21:33.708148 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.708129    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-167.ec2.internal"
Jun 10 00:21:33.708198 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:33.708151    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-167.ec2.internal\": node \"ip-10-0-128-167.ec2.internal\" not found"
Jun 10 00:21:33.709324 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.709307    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-167.ec2.internal"]
Jun 10 00:21:33.709376 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.709367    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 00:21:33.711116 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.711098    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 00:21:33.711193 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.711129    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 00:21:33.711193 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.711143    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasSufficientPID"
Jun 10 00:21:33.712440 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.712428    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 00:21:33.712571 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.712557    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal"
Jun 10 00:21:33.712607 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.712587    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 00:21:33.713143 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.713125    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 00:21:33.713226 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.713153    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 00:21:33.713226 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.713165    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasSufficientPID"
Jun 10 00:21:33.713226 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.713204    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 00:21:33.713360 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.713228    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 00:21:33.713360 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.713242    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasSufficientPID"
Jun 10 00:21:33.714406 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.714389    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-167.ec2.internal"
Jun 10 00:21:33.714475 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.714418    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 00:21:33.715145 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.715131    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 00:21:33.715223 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.715155    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 00:21:33.715223 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.715164    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeHasSufficientPID"
Jun 10 00:21:33.721082 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:33.721066    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-167.ec2.internal\" not found"
Jun 10 00:21:33.748438 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:33.748421    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-167.ec2.internal\" not found" node="ip-10-0-128-167.ec2.internal"
Jun 10 00:21:33.752867 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:33.752852    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-167.ec2.internal\" not found" node="ip-10-0-128-167.ec2.internal"
Jun 10 00:21:33.821797 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:33.821769    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-167.ec2.internal\" not found"
Jun 10 00:21:33.831253 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.831227    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ca4f4a5acfec7984defd00fd8ab5031c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal\" (UID: \"ca4f4a5acfec7984defd00fd8ab5031c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal"
Jun 10 00:21:33.831322 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.831257    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca4f4a5acfec7984defd00fd8ab5031c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal\" (UID: \"ca4f4a5acfec7984defd00fd8ab5031c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal"
Jun 10 00:21:33.831322 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.831281    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f522f44fabdb60b97c5c2bd02ff0a7a2-config\") pod \"kube-apiserver-proxy-ip-10-0-128-167.ec2.internal\" (UID: \"f522f44fabdb60b97c5c2bd02ff0a7a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-167.ec2.internal"
Jun 10 00:21:33.922398 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:33.922356    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-167.ec2.internal\" not found"
Jun 10 00:21:33.931638 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.931616    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ca4f4a5acfec7984defd00fd8ab5031c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal\" (UID: \"ca4f4a5acfec7984defd00fd8ab5031c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal"
Jun 10 00:21:33.931695 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.931647    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca4f4a5acfec7984defd00fd8ab5031c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal\" (UID: \"ca4f4a5acfec7984defd00fd8ab5031c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal"
Jun 10 00:21:33.931695 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.931669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f522f44fabdb60b97c5c2bd02ff0a7a2-config\") pod \"kube-apiserver-proxy-ip-10-0-128-167.ec2.internal\" (UID: \"f522f44fabdb60b97c5c2bd02ff0a7a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-167.ec2.internal"
Jun 10 00:21:33.931809 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.931712    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ca4f4a5acfec7984defd00fd8ab5031c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal\" (UID: \"ca4f4a5acfec7984defd00fd8ab5031c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal"
Jun 10 00:21:33.931809 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.931759    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f522f44fabdb60b97c5c2bd02ff0a7a2-config\") pod \"kube-apiserver-proxy-ip-10-0-128-167.ec2.internal\" (UID: \"f522f44fabdb60b97c5c2bd02ff0a7a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-167.ec2.internal"
Jun 10 00:21:33.931809 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:33.931783    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca4f4a5acfec7984defd00fd8ab5031c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal\" (UID: \"ca4f4a5acfec7984defd00fd8ab5031c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal"
Jun 10 00:21:34.023060 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:34.023027    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-167.ec2.internal\" not found"
Jun 10 00:21:34.052509 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.052484    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal"
Jun 10 00:21:34.056730 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.056714    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-167.ec2.internal"
Jun 10 00:21:34.123643 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:34.123610    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-167.ec2.internal\" not found"
Jun 10 00:21:34.224144 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:34.224111    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-167.ec2.internal\" not found"
Jun 10 00:21:34.324757 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:34.324649    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-167.ec2.internal\" not found"
Jun 10 00:21:34.348209 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.348183    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 00:21:34.430890 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.430862    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal"
Jun 10 00:21:34.441490 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.441469    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 10 00:21:34.443520 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.443494    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-167.ec2.internal"
Jun 10 00:21:34.449390 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.449373    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 10 00:21:34.463498 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.463472    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 10 00:21:34.463712 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.463693    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 10 00:21:34.463712 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.463694    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 10 00:21:34.463823 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.463696    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 10 00:21:34.507357 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.507124    2560 apiserver.go:52] "Watching apiserver"
Jun 10 00:21:34.521815 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.521797    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 10 00:21:34.524377 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.522959    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-n2z9z","openshift-network-diagnostics/network-check-target-xxdm4","kube-system/konnectivity-agent-2fgmj","kube-system/kube-apiserver-proxy-ip-10-0-128-167.ec2.internal","openshift-image-registry/node-ca-6jdzv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal","openshift-multus/multus-additional-cni-plugins-fbxcs","openshift-network-operator/iptables-alerter-h59kg","openshift-ovn-kubernetes/ovnkube-node-v87bq","kube-system/global-pull-secret-syncer-6lgs7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr","openshift-cluster-node-tuning-operator/tuned-8tjl2","openshift-dns/node-resolver-lv968","openshift-multus/multus-l9pvv"]
Jun 10 00:21:34.524377 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.523478    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 00:16:33 +0000 UTC" deadline="2027-12-20 23:28:46.064759179 +0000 UTC"
Jun 10 00:21:34.524377 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.523545    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13415h7m11.541217928s"
Jun 10 00:21:34.524932 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.524651    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:34.525032 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:34.524996    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:21:34.526348 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.526325    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lv968"
Jun 10 00:21:34.526701 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:34.526662    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca4f4a5acfec7984defd00fd8ab5031c.slice/crio-a5084ff9e01eee8ae091fd5ea1a6eec7cf8e0b6e5f9984fabfdae05d6650b174 WatchSource:0}: Error finding container a5084ff9e01eee8ae091fd5ea1a6eec7cf8e0b6e5f9984fabfdae05d6650b174: Status 404 returned error can't find the container with id a5084ff9e01eee8ae091fd5ea1a6eec7cf8e0b6e5f9984fabfdae05d6650b174
Jun 10 00:21:34.527040 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:34.527020    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf522f44fabdb60b97c5c2bd02ff0a7a2.slice/crio-0129a84215a1f8734eac88b43201af4a0df6bc70c5ae7a6bbbbd86fb797a5fe4 WatchSource:0}: Error finding container 0129a84215a1f8734eac88b43201af4a0df6bc70c5ae7a6bbbbd86fb797a5fe4: Status 404 returned error can't find the container with id 0129a84215a1f8734eac88b43201af4a0df6bc70c5ae7a6bbbbd86fb797a5fe4
Jun 10 00:21:34.527586 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.527436    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2fgmj"
Jun 10 00:21:34.528718 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.528697    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.528903 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.528771    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 10 00:21:34.529510 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.529491    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 10 00:21:34.529633 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.529616    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 10 00:21:34.529833 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.529817    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 10 00:21:34.529936 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.529883    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sbgfz\""
Jun 10 00:21:34.529994 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.529888    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6jdzv"
Jun 10 00:21:34.529994 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.529957    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 10 00:21:34.530307 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.530223    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hvnvb\""
Jun 10 00:21:34.530906 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.530759    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 10 00:21:34.530906 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.530854    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 10 00:21:34.531077 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.530980    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 10 00:21:34.531077 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.531025    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 10 00:21:34.531202 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.531188    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h59kg"
Jun 10 00:21:34.531610 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.531597    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gdccc\""
Jun 10 00:21:34.532097 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.532080    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 10 00:21:34.532203 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.532169    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 10 00:21:34.532203 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.532191    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xmtsj\""
Jun 10 00:21:34.532423 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.532379    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 10 00:21:34.533121 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.533100    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 10 00:21:34.533506 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.533484    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.534074 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.533941    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 10 00:21:34.534074 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.533980    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qxz4s\""
Jun 10 00:21:34.534074 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534020    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 10 00:21:34.534074 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534026    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 10 00:21:34.534282 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret\") pod \"global-pull-secret-syncer-6lgs7\" (UID: \"e9b93119-1e4a-45dc-8298-e6cdaaad0e06\") " pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:34.534282 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534197    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-system-cni-dir\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.534282 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534256    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-multus-socket-dir-parent\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.534282 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534272    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm4ww\" (UniqueName: \"kubernetes.io/projected/f9145353-43cf-472c-ba12-c3f093cfcccc-kube-api-access-bm4ww\") pod \"node-resolver-lv968\" (UID: \"f9145353-43cf-472c-ba12-c3f093cfcccc\") " pod="openshift-dns/node-resolver-lv968"
Jun 10 00:21:34.534525 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534293    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-cnibin\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.534525 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534315    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-multus-conf-dir\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.534525 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534336    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eab4de7c-fcdc-4f58-80c0-b7607ec77386-host\") pod \"node-ca-6jdzv\" (UID: \"eab4de7c-fcdc-4f58-80c0-b7607ec77386\") " pod="openshift-image-registry/node-ca-6jdzv"
Jun 10 00:21:34.534525 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534364    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.534525 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534377    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhdbg\" (UniqueName: \"kubernetes.io/projected/eab4de7c-fcdc-4f58-80c0-b7607ec77386-kube-api-access-zhdbg\") pod \"node-ca-6jdzv\" (UID: \"eab4de7c-fcdc-4f58-80c0-b7607ec77386\") " pod="openshift-image-registry/node-ca-6jdzv"
Jun 10 00:21:34.534525 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-kubelet-config\") pod \"global-pull-secret-syncer-6lgs7\" (UID: \"e9b93119-1e4a-45dc-8298-e6cdaaad0e06\") " pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:34.534525 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c301dd86-f816-4e5e-ba88-67e9d95614bd-cni-binary-copy\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.534525 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534459    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-var-lib-kubelet\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.534525 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534485    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c301dd86-f816-4e5e-ba88-67e9d95614bd-multus-daemon-config\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.534525 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534507    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v47pp\" (UniqueName: \"kubernetes.io/projected/d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d-kube-api-access-v47pp\") pod \"iptables-alerter-h59kg\" (UID: \"d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d\") " pod="openshift-network-operator/iptables-alerter-h59kg"
Jun 10 00:21:34.534525 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534530    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9145353-43cf-472c-ba12-c3f093cfcccc-hosts-file\") pod \"node-resolver-lv968\" (UID: \"f9145353-43cf-472c-ba12-c3f093cfcccc\") " pod="openshift-dns/node-resolver-lv968"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534555    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-run-multus-certs\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d-host-slash\") pod \"iptables-alerter-h59kg\" (UID: \"d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d\") " pod="openshift-network-operator/iptables-alerter-h59kg"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534607    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9145353-43cf-472c-ba12-c3f093cfcccc-tmp-dir\") pod \"node-resolver-lv968\" (UID: \"f9145353-43cf-472c-ba12-c3f093cfcccc\") " pod="openshift-dns/node-resolver-lv968"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534646    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-os-release\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534682    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-var-lib-cni-bin\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534723    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-dbus\") pod \"global-pull-secret-syncer-6lgs7\" (UID: \"e9b93119-1e4a-45dc-8298-e6cdaaad0e06\") " pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534773    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3309e0e0-4f8c-4c87-ba1f-5103e69d6311-konnectivity-ca\") pod \"konnectivity-agent-2fgmj\" (UID: \"3309e0e0-4f8c-4c87-ba1f-5103e69d6311\") " pod="kube-system/konnectivity-agent-2fgmj"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-run-k8s-cni-cncf-io\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-run-netns\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534848    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-hostroot\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534867    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eab4de7c-fcdc-4f58-80c0-b7607ec77386-serviceca\") pod \"node-ca-6jdzv\" (UID: \"eab4de7c-fcdc-4f58-80c0-b7607ec77386\") " pod="openshift-image-registry/node-ca-6jdzv"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534882    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-multus-cni-dir\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534901    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3309e0e0-4f8c-4c87-ba1f-5103e69d6311-agent-certs\") pod \"konnectivity-agent-2fgmj\" (UID: \"3309e0e0-4f8c-4c87-ba1f-5103e69d6311\") " pod="kube-system/konnectivity-agent-2fgmj"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534924    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-var-lib-cni-multus\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534948    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-etc-kubernetes\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.534971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx95v\" (UniqueName: \"kubernetes.io/projected/c301dd86-f816-4e5e-ba88-67e9d95614bd-kube-api-access-rx95v\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.535456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.535020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d-iptables-alerter-script\") pod \"iptables-alerter-h59kg\" (UID: \"d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d\") " pod="openshift-network-operator/iptables-alerter-h59kg"
Jun 10 00:21:34.536090 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.535565    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 10 00:21:34.536090 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.535613    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:34.536090 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:34.535672    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:21:34.536288 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.536265    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 10 00:21:34.536395 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.536271    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 10 00:21:34.536608 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.536594    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 10 00:21:34.536734 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.536632    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t8kps\""
Jun 10 00:21:34.536941 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.536922    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 10 00:21:34.537085 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.537022    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 10 00:21:34.537085 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.537038    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 10 00:21:34.537085 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.537040    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 10 00:21:34.537247 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.537134    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nl74c\""
Jun 10 00:21:34.538403 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.538387    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:34.538484 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:34.538435    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:21:34.540113 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.540096    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.541547 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.541530    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.542116 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.542093    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 10 00:21:34.542208 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.542099    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 10 00:21:34.542208 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.542146    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 10 00:21:34.542314 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.542225    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v65qk\""
Jun 10 00:21:34.544883 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.542833    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 10 00:21:34.545426 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.545381    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 10 00:21:34.545426 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.545403    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 10 00:21:34.545426 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.545423    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jc2ff\""
Jun 10 00:21:34.558197 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.558182    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8pbwf"
Jun 10 00:21:34.565038 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.565022    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8pbwf"
Jun 10 00:21:34.611625 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.611578    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-167.ec2.internal" event={"ID":"f522f44fabdb60b97c5c2bd02ff0a7a2","Type":"ContainerStarted","Data":"0129a84215a1f8734eac88b43201af4a0df6bc70c5ae7a6bbbbd86fb797a5fe4"}
Jun 10 00:21:34.612606 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.612586    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal" event={"ID":"ca4f4a5acfec7984defd00fd8ab5031c","Type":"ContainerStarted","Data":"a5084ff9e01eee8ae091fd5ea1a6eec7cf8e0b6e5f9984fabfdae05d6650b174"}
Jun 10 00:21:34.631542 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.631512    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 10 00:21:34.635616 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-multus-socket-dir-parent\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.635697 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635624    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm4ww\" (UniqueName: \"kubernetes.io/projected/f9145353-43cf-472c-ba12-c3f093cfcccc-kube-api-access-bm4ww\") pod \"node-resolver-lv968\" (UID: \"f9145353-43cf-472c-ba12-c3f093cfcccc\") " pod="openshift-dns/node-resolver-lv968"
Jun 10 00:21:34.635697 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-log-socket\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.635697 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635660    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-device-dir\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.635697 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635680    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.635863 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635710    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-modprobe-d\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.635863 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635776    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-multus-conf-dir\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.635863 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635783    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-multus-socket-dir-parent\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.635863 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635812    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-multus-conf-dir\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.635863 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635812    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eab4de7c-fcdc-4f58-80c0-b7607ec77386-host\") pod \"node-ca-6jdzv\" (UID: \"eab4de7c-fcdc-4f58-80c0-b7607ec77386\") " pod="openshift-image-registry/node-ca-6jdzv"
Jun 10 00:21:34.635863 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635841    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eab4de7c-fcdc-4f58-80c0-b7607ec77386-host\") pod \"node-ca-6jdzv\" (UID: \"eab4de7c-fcdc-4f58-80c0-b7607ec77386\") " pod="openshift-image-registry/node-ca-6jdzv"
Jun 10 00:21:34.635863 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635852    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhdbg\" (UniqueName: \"kubernetes.io/projected/eab4de7c-fcdc-4f58-80c0-b7607ec77386-kube-api-access-zhdbg\") pod \"node-ca-6jdzv\" (UID: \"eab4de7c-fcdc-4f58-80c0-b7607ec77386\") " pod="openshift-image-registry/node-ca-6jdzv"
Jun 10 00:21:34.636133 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635875    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-slash\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.636133 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635900    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.636133 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635928    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efa66c73-cab4-45b5-9b89-cbff0b25fc86-system-cni-dir\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.636133 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635951    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-sys\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.636133 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.635976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dr67\" (UniqueName: \"kubernetes.io/projected/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-kube-api-access-9dr67\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.636133 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c301dd86-f816-4e5e-ba88-67e9d95614bd-cni-binary-copy\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.636133 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636022    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-var-lib-kubelet\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.636133 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636045    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c301dd86-f816-4e5e-ba88-67e9d95614bd-multus-daemon-config\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.636133 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636069    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v47pp\" (UniqueName: \"kubernetes.io/projected/d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d-kube-api-access-v47pp\") pod \"iptables-alerter-h59kg\" (UID: \"d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d\") " pod="openshift-network-operator/iptables-alerter-h59kg"
Jun 10 00:21:34.636133 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9145353-43cf-472c-ba12-c3f093cfcccc-hosts-file\") pod \"node-resolver-lv968\" (UID: \"f9145353-43cf-472c-ba12-c3f093cfcccc\") " pod="openshift-dns/node-resolver-lv968"
Jun 10 00:21:34.636133 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636113    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-run-ovn\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.636484 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636136    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-cni-bin\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.636484 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636121    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-var-lib-kubelet\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.636484 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636173    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f9145353-43cf-472c-ba12-c3f093cfcccc-hosts-file\") pod \"node-resolver-lv968\" (UID: \"f9145353-43cf-472c-ba12-c3f093cfcccc\") " pod="openshift-dns/node-resolver-lv968"
Jun 10 00:21:34.636484 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636190    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efa66c73-cab4-45b5-9b89-cbff0b25fc86-cnibin\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.636484 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-run-multus-certs\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.636484 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636278    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d-host-slash\") pod \"iptables-alerter-h59kg\" (UID: \"d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d\") " pod="openshift-network-operator/iptables-alerter-h59kg"
Jun 10 00:21:34.636484 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636290    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-run-multus-certs\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.636484 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636321    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d-host-slash\") pod \"iptables-alerter-h59kg\" (UID: \"d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d\") " pod="openshift-network-operator/iptables-alerter-h59kg"
Jun 10 00:21:34.636484 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9145353-43cf-472c-ba12-c3f093cfcccc-tmp-dir\") pod \"node-resolver-lv968\" (UID: \"f9145353-43cf-472c-ba12-c3f093cfcccc\") " pod="openshift-dns/node-resolver-lv968"
Jun 10 00:21:34.636484 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-cni-netd\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.636484 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/efa66c73-cab4-45b5-9b89-cbff0b25fc86-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.636484 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636396    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-sysctl-conf\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.636484 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636418    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-lib-modules\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.636484 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-os-release\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-var-lib-cni-bin\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3309e0e0-4f8c-4c87-ba1f-5103e69d6311-konnectivity-ca\") pod \"konnectivity-agent-2fgmj\" (UID: \"3309e0e0-4f8c-4c87-ba1f-5103e69d6311\") " pod="kube-system/konnectivity-agent-2fgmj"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636560    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-os-release\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636603    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-var-lib-cni-bin\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-kubelet\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636636    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9145353-43cf-472c-ba12-c3f093cfcccc-tmp-dir\") pod \"node-resolver-lv968\" (UID: \"f9145353-43cf-472c-ba12-c3f093cfcccc\") " pod="openshift-dns/node-resolver-lv968"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636638    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c301dd86-f816-4e5e-ba88-67e9d95614bd-cni-binary-copy\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636655    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c301dd86-f816-4e5e-ba88-67e9d95614bd-multus-daemon-config\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636696    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8g7f\" (UniqueName: \"kubernetes.io/projected/4d3fdb97-b961-4d04-abaf-6487c7a130f1-kube-api-access-f8g7f\") pod \"network-metrics-daemon-n2z9z\" (UID: \"4d3fdb97-b961-4d04-abaf-6487c7a130f1\") " pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636787    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-sysctl-d\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636810    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-host\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636836    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-run-netns\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636860    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42e8ed02-5ca0-478a-9642-562b92e21674-ovnkube-script-lib\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636887    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/efa66c73-cab4-45b5-9b89-cbff0b25fc86-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.636934    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfclb\" (UniqueName: \"kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb\") pod \"network-check-target-xxdm4\" (UID: \"43c24dbb-e33a-404e-89eb-7d6e88b4699e\") " pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:34.637057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637028    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-multus-cni-dir\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637031    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3309e0e0-4f8c-4c87-ba1f-5103e69d6311-konnectivity-ca\") pod \"konnectivity-agent-2fgmj\" (UID: \"3309e0e0-4f8c-4c87-ba1f-5103e69d6311\") " pod="kube-system/konnectivity-agent-2fgmj"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637069    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-systemd-units\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637103    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-run-systemd\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-run-openvswitch\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637120    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-multus-cni-dir\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637140    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcd5f\" (UniqueName: \"kubernetes.io/projected/42e8ed02-5ca0-478a-9642-562b92e21674-kube-api-access-vcd5f\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-tmp\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637185    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-var-lib-cni-multus\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637204    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs\") pod \"network-metrics-daemon-n2z9z\" (UID: \"4d3fdb97-b961-4d04-abaf-6487c7a130f1\") " pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637219    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-sys-fs\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-system-cni-dir\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637250    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-var-lib-cni-multus\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637258    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-var-lib-openvswitch\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637273    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-systemd\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637281    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-system-cni-dir\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637287    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-run\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.637679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637300    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-var-lib-kubelet\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637316    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-cnibin\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637334    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-kubelet-config\") pod \"global-pull-secret-syncer-6lgs7\" (UID: \"e9b93119-1e4a-45dc-8298-e6cdaaad0e06\") " pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637374    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-cnibin\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637411    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-node-log\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637437    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-kubelet-config\") pod \"global-pull-secret-syncer-6lgs7\" (UID: \"e9b93119-1e4a-45dc-8298-e6cdaaad0e06\") " pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637468    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42e8ed02-5ca0-478a-9642-562b92e21674-env-overrides\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637496    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-kubernetes\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637511    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-etc-openvswitch\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637526    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efa66c73-cab4-45b5-9b89-cbff0b25fc86-os-release\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637540    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efa66c73-cab4-45b5-9b89-cbff0b25fc86-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-socket-dir\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637597    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-registration-dir\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-tuned\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-dbus\") pod \"global-pull-secret-syncer-6lgs7\" (UID: \"e9b93119-1e4a-45dc-8298-e6cdaaad0e06\") " pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637699    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42e8ed02-5ca0-478a-9642-562b92e21674-ovn-node-metrics-cert\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efa66c73-cab4-45b5-9b89-cbff0b25fc86-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.638401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637779    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-dbus\") pod \"global-pull-secret-syncer-6lgs7\" (UID: \"e9b93119-1e4a-45dc-8298-e6cdaaad0e06\") " pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637778    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzbx2\" (UniqueName: \"kubernetes.io/projected/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-kube-api-access-gzbx2\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-run-k8s-cni-cncf-io\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637829    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-run-netns\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637844    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-run-k8s-cni-cncf-io\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637869    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-hostroot\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eab4de7c-fcdc-4f58-80c0-b7607ec77386-serviceca\") pod \"node-ca-6jdzv\" (UID: \"eab4de7c-fcdc-4f58-80c0-b7607ec77386\") " pod="openshift-image-registry/node-ca-6jdzv"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637905    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42e8ed02-5ca0-478a-9642-562b92e21674-ovnkube-config\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637921    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-hostroot\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637943    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z7xp\" (UniqueName: \"kubernetes.io/projected/efa66c73-cab4-45b5-9b89-cbff0b25fc86-kube-api-access-2z7xp\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637959    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3309e0e0-4f8c-4c87-ba1f-5103e69d6311-agent-certs\") pod \"konnectivity-agent-2fgmj\" (UID: \"3309e0e0-4f8c-4c87-ba1f-5103e69d6311\") " pod="kube-system/konnectivity-agent-2fgmj"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.637987    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-sysconfig\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.638006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-etc-kubernetes\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.638011    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-host-run-netns\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.638021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx95v\" (UniqueName: \"kubernetes.io/projected/c301dd86-f816-4e5e-ba88-67e9d95614bd-kube-api-access-rx95v\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.638197    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c301dd86-f816-4e5e-ba88-67e9d95614bd-etc-kubernetes\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.638267    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.638272    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d-iptables-alerter-script\") pod \"iptables-alerter-h59kg\" (UID: \"d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d\") " pod="openshift-network-operator/iptables-alerter-h59kg"
Jun 10 00:21:34.638920 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.638302    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret\") pod \"global-pull-secret-syncer-6lgs7\" (UID: \"e9b93119-1e4a-45dc-8298-e6cdaaad0e06\") " pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:34.639421 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.638306    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eab4de7c-fcdc-4f58-80c0-b7607ec77386-serviceca\") pod \"node-ca-6jdzv\" (UID: \"eab4de7c-fcdc-4f58-80c0-b7607ec77386\") " pod="openshift-image-registry/node-ca-6jdzv"
Jun 10 00:21:34.639421 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.638338    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-run-ovn-kubernetes\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.639421 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:34.638374    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 00:21:34.639421 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:34.638449    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret podName:e9b93119-1e4a-45dc-8298-e6cdaaad0e06 nodeName:}" failed. No retries permitted until 2026-06-10 00:21:35.138422366 +0000 UTC m=+2.009198489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret") pod "global-pull-secret-syncer-6lgs7" (UID: "e9b93119-1e4a-45dc-8298-e6cdaaad0e06") : object "kube-system"/"original-pull-secret" not registered
Jun 10 00:21:34.639421 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.638674    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d-iptables-alerter-script\") pod \"iptables-alerter-h59kg\" (UID: \"d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d\") " pod="openshift-network-operator/iptables-alerter-h59kg"
Jun 10 00:21:34.641851 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.641829    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3309e0e0-4f8c-4c87-ba1f-5103e69d6311-agent-certs\") pod \"konnectivity-agent-2fgmj\" (UID: \"3309e0e0-4f8c-4c87-ba1f-5103e69d6311\") " pod="kube-system/konnectivity-agent-2fgmj"
Jun 10 00:21:34.647093 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.647061    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx95v\" (UniqueName: \"kubernetes.io/projected/c301dd86-f816-4e5e-ba88-67e9d95614bd-kube-api-access-rx95v\") pod \"multus-l9pvv\" (UID: \"c301dd86-f816-4e5e-ba88-67e9d95614bd\") " pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.647216 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.647140    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhdbg\" (UniqueName: \"kubernetes.io/projected/eab4de7c-fcdc-4f58-80c0-b7607ec77386-kube-api-access-zhdbg\") pod \"node-ca-6jdzv\" (UID: \"eab4de7c-fcdc-4f58-80c0-b7607ec77386\") " pod="openshift-image-registry/node-ca-6jdzv"
Jun 10 00:21:34.647322 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.647303    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v47pp\" (UniqueName: \"kubernetes.io/projected/d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d-kube-api-access-v47pp\") pod \"iptables-alerter-h59kg\" (UID: \"d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d\") " pod="openshift-network-operator/iptables-alerter-h59kg"
Jun 10 00:21:34.649339 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.649316    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm4ww\" (UniqueName: \"kubernetes.io/projected/f9145353-43cf-472c-ba12-c3f093cfcccc-kube-api-access-bm4ww\") pod \"node-resolver-lv968\" (UID: \"f9145353-43cf-472c-ba12-c3f093cfcccc\") " pod="openshift-dns/node-resolver-lv968"
Jun 10 00:21:34.697351 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.697316    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 00:21:34.738752 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-log-socket\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.738752 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-device-dir\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.738989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738770    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.738989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-modprobe-d\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.738989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738812    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-slash\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.738989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738828    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.738989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738834    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-device-dir\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.738989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efa66c73-cab4-45b5-9b89-cbff0b25fc86-system-cni-dir\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.738989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738865    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-sys\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.738989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738824    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-log-socket\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.738989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738889    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dr67\" (UniqueName: \"kubernetes.io/projected/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-kube-api-access-9dr67\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.738989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738890    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-slash\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.738989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738901    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.738989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738930    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-sys\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.738989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738932    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-modprobe-d\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.738989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738955    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.738989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.738963    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-run-ovn\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-cni-bin\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739015    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efa66c73-cab4-45b5-9b89-cbff0b25fc86-system-cni-dir\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739028    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efa66c73-cab4-45b5-9b89-cbff0b25fc86-cnibin\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739033    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-cni-bin\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739001    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-run-ovn\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739053    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-cni-netd\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739071    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/efa66c73-cab4-45b5-9b89-cbff0b25fc86-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-sysctl-conf\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739106    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efa66c73-cab4-45b5-9b89-cbff0b25fc86-cnibin\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739113    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-lib-modules\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739154    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-cni-netd\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739175    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-kubelet\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739206    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8g7f\" (UniqueName: \"kubernetes.io/projected/4d3fdb97-b961-4d04-abaf-6487c7a130f1-kube-api-access-f8g7f\") pod \"network-metrics-daemon-n2z9z\" (UID: \"4d3fdb97-b961-4d04-abaf-6487c7a130f1\") " pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739224    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-lib-modules\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739255    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-sysctl-conf\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739255    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-kubelet\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.739662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-sysctl-d\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739318    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739335    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-host\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739356    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-run-netns\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42e8ed02-5ca0-478a-9642-562b92e21674-ovnkube-script-lib\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739386    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-sysctl-d\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/efa66c73-cab4-45b5-9b89-cbff0b25fc86-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739426    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-run-netns\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739428    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfclb\" (UniqueName: \"kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb\") pod \"network-check-target-xxdm4\" (UID: \"43c24dbb-e33a-404e-89eb-7d6e88b4699e\") " pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739465    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-systemd-units\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739478    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-host\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739485    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-run-systemd\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739512    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-run-systemd\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-run-openvswitch\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739546    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-systemd-units\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739556    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcd5f\" (UniqueName: \"kubernetes.io/projected/42e8ed02-5ca0-478a-9642-562b92e21674-kube-api-access-vcd5f\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.740428 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-tmp\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739626    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-run-openvswitch\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs\") pod \"network-metrics-daemon-n2z9z\" (UID: \"4d3fdb97-b961-4d04-abaf-6487c7a130f1\") " pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-sys-fs\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739660    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/efa66c73-cab4-45b5-9b89-cbff0b25fc86-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739713    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-var-lib-openvswitch\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:34.739727    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-systemd\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-run\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739839    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-systemd\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739849    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-var-lib-kubelet\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739885    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-node-log\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739889    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-run\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739900    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-var-lib-kubelet\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739779    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-sys-fs\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739911    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/efa66c73-cab4-45b5-9b89-cbff0b25fc86-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739813    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-var-lib-openvswitch\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.741419 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:34.739935    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs podName:4d3fdb97-b961-4d04-abaf-6487c7a130f1 nodeName:}" failed. No retries permitted until 2026-06-10 00:21:35.239916792 +0000 UTC m=+2.110692916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs") pod "network-metrics-daemon-n2z9z" (UID: "4d3fdb97-b961-4d04-abaf-6487c7a130f1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739940    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-node-log\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739911    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42e8ed02-5ca0-478a-9642-562b92e21674-env-overrides\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.739978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-kubernetes\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740006    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-etc-openvswitch\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efa66c73-cab4-45b5-9b89-cbff0b25fc86-os-release\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740052    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42e8ed02-5ca0-478a-9642-562b92e21674-ovnkube-script-lib\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740053    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-kubernetes\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740055    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efa66c73-cab4-45b5-9b89-cbff0b25fc86-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740091    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-etc-openvswitch\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740104    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-socket-dir\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-registration-dir\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-tuned\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740136    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efa66c73-cab4-45b5-9b89-cbff0b25fc86-os-release\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740184    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42e8ed02-5ca0-478a-9642-562b92e21674-ovn-node-metrics-cert\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740196    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-registration-dir\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efa66c73-cab4-45b5-9b89-cbff0b25fc86-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.742321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740232    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-socket-dir\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.742907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzbx2\" (UniqueName: \"kubernetes.io/projected/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-kube-api-access-gzbx2\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.742907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740264    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42e8ed02-5ca0-478a-9642-562b92e21674-env-overrides\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.742907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740281    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42e8ed02-5ca0-478a-9642-562b92e21674-ovnkube-config\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.742907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z7xp\" (UniqueName: \"kubernetes.io/projected/efa66c73-cab4-45b5-9b89-cbff0b25fc86-kube-api-access-2z7xp\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.742907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740337    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-sysconfig\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.742907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740375    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-run-ovn-kubernetes\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.742907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740435    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efa66c73-cab4-45b5-9b89-cbff0b25fc86-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.742907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740443    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42e8ed02-5ca0-478a-9642-562b92e21674-host-run-ovn-kubernetes\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.742907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740490    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-sysconfig\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.742907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.740536    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efa66c73-cab4-45b5-9b89-cbff0b25fc86-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.742907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.741070    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42e8ed02-5ca0-478a-9642-562b92e21674-ovnkube-config\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.742907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.742260    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-tmp\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.742907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.742309    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-etc-tuned\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.742907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.742692    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42e8ed02-5ca0-478a-9642-562b92e21674-ovn-node-metrics-cert\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.747977 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:34.747950    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 00:21:34.747977 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:34.747976    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 00:21:34.748180 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:34.747988    2560 projected.go:196] Error preparing data for projected volume kube-api-access-pfclb for pod openshift-network-diagnostics/network-check-target-xxdm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 00:21:34.748180 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:34.748059    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb podName:43c24dbb-e33a-404e-89eb-7d6e88b4699e nodeName:}" failed. No retries permitted until 2026-06-10 00:21:35.248042612 +0000 UTC m=+2.118818727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pfclb" (UniqueName: "kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb") pod "network-check-target-xxdm4" (UID: "43c24dbb-e33a-404e-89eb-7d6e88b4699e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 00:21:34.750417 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.750390    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzbx2\" (UniqueName: \"kubernetes.io/projected/1a30d2f4-3d50-43f1-9cdd-49cd308a38f1-kube-api-access-gzbx2\") pod \"aws-ebs-csi-driver-node-bx7xr\" (UID: \"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.750505 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.750429    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z7xp\" (UniqueName: \"kubernetes.io/projected/efa66c73-cab4-45b5-9b89-cbff0b25fc86-kube-api-access-2z7xp\") pod \"multus-additional-cni-plugins-fbxcs\" (UID: \"efa66c73-cab4-45b5-9b89-cbff0b25fc86\") " pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.750505 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.750392    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dr67\" (UniqueName: \"kubernetes.io/projected/62dfadf3-681c-4cdc-a45c-533d3b7c1eb2-kube-api-access-9dr67\") pod \"tuned-8tjl2\" (UID: \"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2\") " pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.750933 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.750916    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcd5f\" (UniqueName: \"kubernetes.io/projected/42e8ed02-5ca0-478a-9642-562b92e21674-kube-api-access-vcd5f\") pod \"ovnkube-node-v87bq\" (UID: \"42e8ed02-5ca0-478a-9642-562b92e21674\") " pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.751451 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.751431    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8g7f\" (UniqueName: \"kubernetes.io/projected/4d3fdb97-b961-4d04-abaf-6487c7a130f1-kube-api-access-f8g7f\") pod \"network-metrics-daemon-n2z9z\" (UID: \"4d3fdb97-b961-4d04-abaf-6487c7a130f1\") " pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:34.838333 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.838243    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lv968"
Jun 10 00:21:34.846226 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.846205    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2fgmj"
Jun 10 00:21:34.847305 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:34.847274    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9145353_43cf_472c_ba12_c3f093cfcccc.slice/crio-21eee540887adece14843c49ba4e1dc7a232b4b87ad701a8c76e40b5d9913005 WatchSource:0}: Error finding container 21eee540887adece14843c49ba4e1dc7a232b4b87ad701a8c76e40b5d9913005: Status 404 returned error can't find the container with id 21eee540887adece14843c49ba4e1dc7a232b4b87ad701a8c76e40b5d9913005
Jun 10 00:21:34.853299 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.853276    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l9pvv"
Jun 10 00:21:34.853545 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:34.853524    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3309e0e0_4f8c_4c87_ba1f_5103e69d6311.slice/crio-5caf749f651c3630b99fef965f5467b1ea526a38991a8bbc6d105afd2c0a472d WatchSource:0}: Error finding container 5caf749f651c3630b99fef965f5467b1ea526a38991a8bbc6d105afd2c0a472d: Status 404 returned error can't find the container with id 5caf749f651c3630b99fef965f5467b1ea526a38991a8bbc6d105afd2c0a472d
Jun 10 00:21:34.857622 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.857605    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6jdzv"
Jun 10 00:21:34.861611 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:34.861586    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc301dd86_f816_4e5e_ba88_67e9d95614bd.slice/crio-c7332190334105629289389e93f690b098fff5f4f3a48e193649a4f8ff947848 WatchSource:0}: Error finding container c7332190334105629289389e93f690b098fff5f4f3a48e193649a4f8ff947848: Status 404 returned error can't find the container with id c7332190334105629289389e93f690b098fff5f4f3a48e193649a4f8ff947848
Jun 10 00:21:34.863016 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.862997    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h59kg"
Jun 10 00:21:34.867757 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:34.867712    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab4de7c_fcdc_4f58_80c0_b7607ec77386.slice/crio-94afa9aac77b2e3f783cb1c34c255cb96cd2bdb5d327cb5d493bc3b3c95a3f3e WatchSource:0}: Error finding container 94afa9aac77b2e3f783cb1c34c255cb96cd2bdb5d327cb5d493bc3b3c95a3f3e: Status 404 returned error can't find the container with id 94afa9aac77b2e3f783cb1c34c255cb96cd2bdb5d327cb5d493bc3b3c95a3f3e
Jun 10 00:21:34.868173 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.868152    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:21:34.871513 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:34.871494    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3a30cb3_38b0_4ad8_9956_0d2c682bfa8d.slice/crio-fa927ea47065edfee4763f30500b0fcfffc974497649a09f2010bb29aa28ddda WatchSource:0}: Error finding container fa927ea47065edfee4763f30500b0fcfffc974497649a09f2010bb29aa28ddda: Status 404 returned error can't find the container with id fa927ea47065edfee4763f30500b0fcfffc974497649a09f2010bb29aa28ddda
Jun 10 00:21:34.873443 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.873426    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fbxcs"
Jun 10 00:21:34.876146 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:34.876126    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e8ed02_5ca0_478a_9642_562b92e21674.slice/crio-d66f6d13a3b50082c89542284715286b9540d5c4841b1da50a8605e24804f16c WatchSource:0}: Error finding container d66f6d13a3b50082c89542284715286b9540d5c4841b1da50a8605e24804f16c: Status 404 returned error can't find the container with id d66f6d13a3b50082c89542284715286b9540d5c4841b1da50a8605e24804f16c
Jun 10 00:21:34.878572 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.878550    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr"
Jun 10 00:21:34.881842 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:34.881824    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa66c73_cab4_45b5_9b89_cbff0b25fc86.slice/crio-e5cafe06ce20472c32ba043cae72de0593d1666df09cf8b19da5dd619ee9999c WatchSource:0}: Error finding container e5cafe06ce20472c32ba043cae72de0593d1666df09cf8b19da5dd619ee9999c: Status 404 returned error can't find the container with id e5cafe06ce20472c32ba043cae72de0593d1666df09cf8b19da5dd619ee9999c
Jun 10 00:21:34.883011 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:34.882993    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8tjl2"
Jun 10 00:21:34.886939 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:34.886916    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a30d2f4_3d50_43f1_9cdd_49cd308a38f1.slice/crio-182df0a9fd693435b4e2c1acfd5e712f1575be5d8524348c8cf9a3234fc85e7c WatchSource:0}: Error finding container 182df0a9fd693435b4e2c1acfd5e712f1575be5d8524348c8cf9a3234fc85e7c: Status 404 returned error can't find the container with id 182df0a9fd693435b4e2c1acfd5e712f1575be5d8524348c8cf9a3234fc85e7c
Jun 10 00:21:34.891491 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:21:34.891467    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62dfadf3_681c_4cdc_a45c_533d3b7c1eb2.slice/crio-b11a15f07096e53a4c5ee82140c16da09f26563f5b5c62c7577cefb42a391c1f WatchSource:0}: Error finding container b11a15f07096e53a4c5ee82140c16da09f26563f5b5c62c7577cefb42a391c1f: Status 404 returned error can't find the container with id b11a15f07096e53a4c5ee82140c16da09f26563f5b5c62c7577cefb42a391c1f
Jun 10 00:21:35.143978 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.143894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret\") pod \"global-pull-secret-syncer-6lgs7\" (UID: \"e9b93119-1e4a-45dc-8298-e6cdaaad0e06\") " pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:35.144184 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:35.144035    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 00:21:35.144184 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:35.144103    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret podName:e9b93119-1e4a-45dc-8298-e6cdaaad0e06 nodeName:}" failed. No retries permitted until 2026-06-10 00:21:36.144083852 +0000 UTC m=+3.014859972 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret") pod "global-pull-secret-syncer-6lgs7" (UID: "e9b93119-1e4a-45dc-8298-e6cdaaad0e06") : object "kube-system"/"original-pull-secret" not registered
Jun 10 00:21:35.244407 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.244371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs\") pod \"network-metrics-daemon-n2z9z\" (UID: \"4d3fdb97-b961-4d04-abaf-6487c7a130f1\") " pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:35.244681 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:35.244660    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 00:21:35.244770 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:35.244753    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs podName:4d3fdb97-b961-4d04-abaf-6487c7a130f1 nodeName:}" failed. No retries permitted until 2026-06-10 00:21:36.244717768 +0000 UTC m=+3.115493879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs") pod "network-metrics-daemon-n2z9z" (UID: "4d3fdb97-b961-4d04-abaf-6487c7a130f1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 00:21:35.344830 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.344709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfclb\" (UniqueName: \"kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb\") pod \"network-check-target-xxdm4\" (UID: \"43c24dbb-e33a-404e-89eb-7d6e88b4699e\") " pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:35.344994 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:35.344929    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 00:21:35.344994 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:35.344952    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 00:21:35.345121 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:35.344967    2560 projected.go:196] Error preparing data for projected volume kube-api-access-pfclb for pod openshift-network-diagnostics/network-check-target-xxdm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 00:21:35.345121 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:35.345062    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb podName:43c24dbb-e33a-404e-89eb-7d6e88b4699e nodeName:}" failed. No retries permitted until 2026-06-10 00:21:36.345043007 +0000 UTC m=+3.215819114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfclb" (UniqueName: "kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb") pod "network-check-target-xxdm4" (UID: "43c24dbb-e33a-404e-89eb-7d6e88b4699e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 00:21:35.507946 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.507723    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 00:21:35.567654 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.567601    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:16:34 +0000 UTC" deadline="2028-03-03 17:06:26.282224432 +0000 UTC"
Jun 10 00:21:35.567654 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.567652    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15184h44m50.714577915s"
Jun 10 00:21:35.608911 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.608864    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:35.609074 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:35.609022    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:21:35.639804 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.637956    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8tjl2" event={"ID":"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2","Type":"ContainerStarted","Data":"b11a15f07096e53a4c5ee82140c16da09f26563f5b5c62c7577cefb42a391c1f"}
Jun 10 00:21:35.663048 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.663005    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr" event={"ID":"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1","Type":"ContainerStarted","Data":"182df0a9fd693435b4e2c1acfd5e712f1575be5d8524348c8cf9a3234fc85e7c"}
Jun 10 00:21:35.676693 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.676561    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbxcs" event={"ID":"efa66c73-cab4-45b5-9b89-cbff0b25fc86","Type":"ContainerStarted","Data":"e5cafe06ce20472c32ba043cae72de0593d1666df09cf8b19da5dd619ee9999c"}
Jun 10 00:21:35.679952 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.679922    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq" event={"ID":"42e8ed02-5ca0-478a-9642-562b92e21674","Type":"ContainerStarted","Data":"d66f6d13a3b50082c89542284715286b9540d5c4841b1da50a8605e24804f16c"}
Jun 10 00:21:35.686731 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.686701    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2fgmj" event={"ID":"3309e0e0-4f8c-4c87-ba1f-5103e69d6311","Type":"ContainerStarted","Data":"5caf749f651c3630b99fef965f5467b1ea526a38991a8bbc6d105afd2c0a472d"}
Jun 10 00:21:35.696813 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.696781    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lv968" event={"ID":"f9145353-43cf-472c-ba12-c3f093cfcccc","Type":"ContainerStarted","Data":"21eee540887adece14843c49ba4e1dc7a232b4b87ad701a8c76e40b5d9913005"}
Jun 10 00:21:35.706258 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.706227    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h59kg" event={"ID":"d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d","Type":"ContainerStarted","Data":"fa927ea47065edfee4763f30500b0fcfffc974497649a09f2010bb29aa28ddda"}
Jun 10 00:21:35.713366 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.713157    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 00:21:35.721952 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.721914    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6jdzv" event={"ID":"eab4de7c-fcdc-4f58-80c0-b7607ec77386","Type":"ContainerStarted","Data":"94afa9aac77b2e3f783cb1c34c255cb96cd2bdb5d327cb5d493bc3b3c95a3f3e"}
Jun 10 00:21:35.728484 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:35.728427    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l9pvv" event={"ID":"c301dd86-f816-4e5e-ba88-67e9d95614bd","Type":"ContainerStarted","Data":"c7332190334105629289389e93f690b098fff5f4f3a48e193649a4f8ff947848"}
Jun 10 00:21:36.151354 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:36.151306    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret\") pod \"global-pull-secret-syncer-6lgs7\" (UID: \"e9b93119-1e4a-45dc-8298-e6cdaaad0e06\") " pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:36.151540 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:36.151479    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 00:21:36.151601 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:36.151543    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret podName:e9b93119-1e4a-45dc-8298-e6cdaaad0e06 nodeName:}" failed. No retries permitted until 2026-06-10 00:21:38.151524638 +0000 UTC m=+5.022300758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret") pod "global-pull-secret-syncer-6lgs7" (UID: "e9b93119-1e4a-45dc-8298-e6cdaaad0e06") : object "kube-system"/"original-pull-secret" not registered
Jun 10 00:21:36.252625 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:36.252585    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs\") pod \"network-metrics-daemon-n2z9z\" (UID: \"4d3fdb97-b961-4d04-abaf-6487c7a130f1\") " pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:36.252839 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:36.252732    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 00:21:36.252839 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:36.252815    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs podName:4d3fdb97-b961-4d04-abaf-6487c7a130f1 nodeName:}" failed. No retries permitted until 2026-06-10 00:21:38.252796684 +0000 UTC m=+5.123572801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs") pod "network-metrics-daemon-n2z9z" (UID: "4d3fdb97-b961-4d04-abaf-6487c7a130f1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 00:21:36.353652 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:36.353614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfclb\" (UniqueName: \"kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb\") pod \"network-check-target-xxdm4\" (UID: \"43c24dbb-e33a-404e-89eb-7d6e88b4699e\") " pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:36.355327 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:36.353843    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 00:21:36.355327 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:36.353866    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 00:21:36.355327 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:36.353878    2560 projected.go:196] Error preparing data for projected volume kube-api-access-pfclb for pod openshift-network-diagnostics/network-check-target-xxdm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 00:21:36.355327 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:36.353938    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb podName:43c24dbb-e33a-404e-89eb-7d6e88b4699e nodeName:}" failed. No retries permitted until 2026-06-10 00:21:38.353919192 +0000 UTC m=+5.224695298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfclb" (UniqueName: "kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb") pod "network-check-target-xxdm4" (UID: "43c24dbb-e33a-404e-89eb-7d6e88b4699e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 00:21:36.536126 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:36.536097    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 00:21:36.568237 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:36.568174    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:16:34 +0000 UTC" deadline="2027-12-08 21:54:41.406582392 +0000 UTC"
Jun 10 00:21:36.568237 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:36.568238    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13125h33m4.83835053s"
Jun 10 00:21:36.608778 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:36.608723    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:36.608959 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:36.608870    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:21:36.609355 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:36.609334    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:36.609653 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:36.609630    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:21:37.611283 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:37.611250    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:37.611722 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:37.611402    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:21:38.170556 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:38.169987    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret\") pod \"global-pull-secret-syncer-6lgs7\" (UID: \"e9b93119-1e4a-45dc-8298-e6cdaaad0e06\") " pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:38.170556 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:38.170144    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 00:21:38.170556 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:38.170213    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret podName:e9b93119-1e4a-45dc-8298-e6cdaaad0e06 nodeName:}" failed. No retries permitted until 2026-06-10 00:21:42.170191014 +0000 UTC m=+9.040967139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret") pod "global-pull-secret-syncer-6lgs7" (UID: "e9b93119-1e4a-45dc-8298-e6cdaaad0e06") : object "kube-system"/"original-pull-secret" not registered
Jun 10 00:21:38.271453 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:38.271416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs\") pod \"network-metrics-daemon-n2z9z\" (UID: \"4d3fdb97-b961-4d04-abaf-6487c7a130f1\") " pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:38.271620 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:38.271552    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 00:21:38.271688 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:38.271648    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs podName:4d3fdb97-b961-4d04-abaf-6487c7a130f1 nodeName:}" failed. No retries permitted until 2026-06-10 00:21:42.271625698 +0000 UTC m=+9.142401836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs") pod "network-metrics-daemon-n2z9z" (UID: "4d3fdb97-b961-4d04-abaf-6487c7a130f1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 00:21:38.372606 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:38.372572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfclb\" (UniqueName: \"kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb\") pod \"network-check-target-xxdm4\" (UID: \"43c24dbb-e33a-404e-89eb-7d6e88b4699e\") " pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:38.372815 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:38.372799    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 00:21:38.372892 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:38.372824    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 00:21:38.372892 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:38.372837    2560 projected.go:196] Error preparing data for projected volume kube-api-access-pfclb for pod openshift-network-diagnostics/network-check-target-xxdm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 00:21:38.372892 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:38.372891    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb podName:43c24dbb-e33a-404e-89eb-7d6e88b4699e nodeName:}" failed. No retries permitted until 2026-06-10 00:21:42.372873618 +0000 UTC m=+9.243649737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfclb" (UniqueName: "kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb") pod "network-check-target-xxdm4" (UID: "43c24dbb-e33a-404e-89eb-7d6e88b4699e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 00:21:38.608936 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:38.608900    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:38.609115 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:38.609012    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:21:38.609396 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:38.609376    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:38.609489 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:38.609471    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:21:39.610013 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:39.609460    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:39.610013 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:39.609642    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:21:40.609755 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:40.609699    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:40.609932 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:40.609697    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:40.609932 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:40.609867    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:21:40.610059 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:40.609947    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:21:41.609833 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:41.609790    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:41.610013 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:41.609937    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:21:42.204033 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:42.203993    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret\") pod \"global-pull-secret-syncer-6lgs7\" (UID: \"e9b93119-1e4a-45dc-8298-e6cdaaad0e06\") " pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:42.204492 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:42.204189    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 00:21:42.204492 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:42.204251    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret podName:e9b93119-1e4a-45dc-8298-e6cdaaad0e06 nodeName:}" failed. No retries permitted until 2026-06-10 00:21:50.204232894 +0000 UTC m=+17.075009005 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret") pod "global-pull-secret-syncer-6lgs7" (UID: "e9b93119-1e4a-45dc-8298-e6cdaaad0e06") : object "kube-system"/"original-pull-secret" not registered
Jun 10 00:21:42.305517 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:42.305466    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs\") pod \"network-metrics-daemon-n2z9z\" (UID: \"4d3fdb97-b961-4d04-abaf-6487c7a130f1\") " pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:42.305670 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:42.305596    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 00:21:42.305670 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:42.305652    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs podName:4d3fdb97-b961-4d04-abaf-6487c7a130f1 nodeName:}" failed. No retries permitted until 2026-06-10 00:21:50.3056381 +0000 UTC m=+17.176414205 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs") pod "network-metrics-daemon-n2z9z" (UID: "4d3fdb97-b961-4d04-abaf-6487c7a130f1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 00:21:42.406115 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:42.406074    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfclb\" (UniqueName: \"kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb\") pod \"network-check-target-xxdm4\" (UID: \"43c24dbb-e33a-404e-89eb-7d6e88b4699e\") " pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:42.406275 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:42.406235    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 00:21:42.406275 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:42.406252    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 00:21:42.406275 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:42.406261    2560 projected.go:196] Error preparing data for projected volume kube-api-access-pfclb for pod openshift-network-diagnostics/network-check-target-xxdm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 00:21:42.406391 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:42.406319    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb podName:43c24dbb-e33a-404e-89eb-7d6e88b4699e nodeName:}" failed. No retries permitted until 2026-06-10 00:21:50.40629956 +0000 UTC m=+17.277075665 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfclb" (UniqueName: "kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb") pod "network-check-target-xxdm4" (UID: "43c24dbb-e33a-404e-89eb-7d6e88b4699e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 00:21:42.609285 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:42.608675    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:42.609285 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:42.608810    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:21:42.609285 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:42.609152    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:42.609285 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:42.609237    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:21:43.609569 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:43.609540    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:43.610002 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:43.609673    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:21:44.609462 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:44.609423    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:44.609658 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:44.609559    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:21:44.609995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:44.609946    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:44.610061 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:44.610039    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:21:45.609231 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:45.609196    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:45.609411 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:45.609352    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:21:46.609104 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:46.609025    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:46.609707 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:46.609134    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:21:46.609707 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:46.609198    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:46.609707 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:46.609291    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:21:47.609558 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:47.609524    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:47.610065 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:47.609662    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:21:48.609171 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:48.609139    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:48.609344 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:48.609258    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:21:48.609344 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:48.609317    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:48.609465 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:48.609438    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:21:49.609999 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:49.609449    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:49.609999 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:49.609595    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:21:50.263905 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:50.263875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret\") pod \"global-pull-secret-syncer-6lgs7\" (UID: \"e9b93119-1e4a-45dc-8298-e6cdaaad0e06\") " pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:50.264055 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:50.264012    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 00:21:50.264097 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:50.264068    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret podName:e9b93119-1e4a-45dc-8298-e6cdaaad0e06 nodeName:}" failed. No retries permitted until 2026-06-10 00:22:06.264053188 +0000 UTC m=+33.134829293 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret") pod "global-pull-secret-syncer-6lgs7" (UID: "e9b93119-1e4a-45dc-8298-e6cdaaad0e06") : object "kube-system"/"original-pull-secret" not registered
Jun 10 00:21:50.365075 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:50.365041    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs\") pod \"network-metrics-daemon-n2z9z\" (UID: \"4d3fdb97-b961-4d04-abaf-6487c7a130f1\") " pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:50.365210 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:50.365147    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 00:21:50.365210 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:50.365205    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs podName:4d3fdb97-b961-4d04-abaf-6487c7a130f1 nodeName:}" failed. No retries permitted until 2026-06-10 00:22:06.365185722 +0000 UTC m=+33.235961833 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs") pod "network-metrics-daemon-n2z9z" (UID: "4d3fdb97-b961-4d04-abaf-6487c7a130f1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 00:21:50.466056 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:50.465989    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfclb\" (UniqueName: \"kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb\") pod \"network-check-target-xxdm4\" (UID: \"43c24dbb-e33a-404e-89eb-7d6e88b4699e\") " pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:50.466184 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:50.466109    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 00:21:50.466184 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:50.466124    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 00:21:50.466184 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:50.466132    2560 projected.go:196] Error preparing data for projected volume kube-api-access-pfclb for pod openshift-network-diagnostics/network-check-target-xxdm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 00:21:50.466184 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:50.466177    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb podName:43c24dbb-e33a-404e-89eb-7d6e88b4699e nodeName:}" failed. No retries permitted until 2026-06-10 00:22:06.466163785 +0000 UTC m=+33.336939890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfclb" (UniqueName: "kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb") pod "network-check-target-xxdm4" (UID: "43c24dbb-e33a-404e-89eb-7d6e88b4699e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 00:21:50.609254 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:50.609207    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:50.609438 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:50.609222    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:50.609438 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:50.609367    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:21:50.609525 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:50.609447    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:21:51.608917 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:51.608869    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:51.609375 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:51.609012    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:21:52.609600 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:52.609565    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:52.609600 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:52.609590    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:52.610227 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:52.609707    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:21:52.610227 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:52.609860    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:21:53.610325 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:53.610292    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:53.610782 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:53.610402    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:21:54.609416 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:54.609377    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:54.609604 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:54.609381    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:54.609604 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:54.609505    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:21:54.609604 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:54.609595    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:21:55.608929 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:55.608731    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:55.609561 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:55.609045    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:21:55.779918 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:55.779593    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8tjl2" event={"ID":"62dfadf3-681c-4cdc-a45c-533d3b7c1eb2","Type":"ContainerStarted","Data":"dc39bdf6d4b0d04554ed82b95c81e7d95264632c59017dfe349ae896c63aaa98"}
Jun 10 00:21:55.783329 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:55.783306    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v87bq_42e8ed02-5ca0-478a-9642-562b92e21674/ovn-acl-logging/0.log"
Jun 10 00:21:55.783762 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:55.783719    2560 generic.go:356] "Generic (PLEG): container finished" podID="42e8ed02-5ca0-478a-9642-562b92e21674" containerID="efb40031b16ca05a1a4189ef641e0ef9b758b7cee95a72e0d4117a45bdced303" exitCode=1
Jun 10 00:21:55.783851 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:55.783769    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq" event={"ID":"42e8ed02-5ca0-478a-9642-562b92e21674","Type":"ContainerStarted","Data":"59069d925a502974ed182b4015f0368966a9ca8b815f9b91f49b4811f1e3d9d4"}
Jun 10 00:21:55.783851 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:55.783834    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq" event={"ID":"42e8ed02-5ca0-478a-9642-562b92e21674","Type":"ContainerStarted","Data":"7c593db7bbc07ae773ddfe4b9034ce7b3d8015fc293071a502249b4af7444aa2"}
Jun 10 00:21:55.783960 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:55.783881    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq" event={"ID":"42e8ed02-5ca0-478a-9642-562b92e21674","Type":"ContainerStarted","Data":"1b38213bdfa8851d8277e53a9695f40f57f4e756f3b1718d390ea44711fba49e"}
Jun 10 00:21:55.783960 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:55.783930    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq" event={"ID":"42e8ed02-5ca0-478a-9642-562b92e21674","Type":"ContainerDied","Data":"efb40031b16ca05a1a4189ef641e0ef9b758b7cee95a72e0d4117a45bdced303"}
Jun 10 00:21:55.784041 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:55.783977    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq" event={"ID":"42e8ed02-5ca0-478a-9642-562b92e21674","Type":"ContainerStarted","Data":"dd124b827e1a939ebb7c3a6f7641f89578f78905cbeb6061e66d89768593d616"}
Jun 10 00:21:55.786030 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:55.786011    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-167.ec2.internal" event={"ID":"f522f44fabdb60b97c5c2bd02ff0a7a2","Type":"ContainerStarted","Data":"16e0f73bb48ca0ac646950076b1997f3132ca5ded1a1b749e712d89e8d21e4a7"}
Jun 10 00:21:55.787080 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:55.787060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l9pvv" event={"ID":"c301dd86-f816-4e5e-ba88-67e9d95614bd","Type":"ContainerStarted","Data":"4b8286aae251e14c3d811fd7fafaa11b8502f11404e100813cc31e3eb2642842"}
Jun 10 00:21:55.796073 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:55.796034    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8tjl2" podStartSLOduration=2.770860296 podStartE2EDuration="22.796023224s" totalImagesPullingTime="20.025162928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:55.794988095 +0000 UTC m=+22.665764315" watchObservedRunningTime="2026-06-10 00:21:55.796023224 +0000 UTC m=+22.666799350"
Jun 10 00:21:55.812252 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:55.812201    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-l9pvv" podStartSLOduration=2.256534982 podStartE2EDuration="22.812185216s" totalImagesPullingTime="20.555650234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:55.811871879 +0000 UTC m=+22.682648005" watchObservedRunningTime="2026-06-10 00:21:55.812185216 +0000 UTC m=+22.682961343"
Jun 10 00:21:55.823424 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:55.823351    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-167.ec2.internal" podStartSLOduration=21.823330751 podStartE2EDuration="21.823330751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:55.823026522 +0000 UTC m=+22.693802646" watchObservedRunningTime="2026-06-10 00:21:55.823330751 +0000 UTC m=+22.694106879"
Jun 10 00:21:56.609458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.609359    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:56.609458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.609383    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:56.610022 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:56.609497    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:21:56.610022 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:56.609612    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:21:56.790802 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.790767    2560 generic.go:356] "Generic (PLEG): container finished" podID="ca4f4a5acfec7984defd00fd8ab5031c" containerID="28e0c9c963fd1c2a115abd4a3a45c834972f1f8b0e536893f4917722de22891c" exitCode=0
Jun 10 00:21:56.791000 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.790853    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal" event={"ID":"ca4f4a5acfec7984defd00fd8ab5031c","Type":"ContainerDied","Data":"28e0c9c963fd1c2a115abd4a3a45c834972f1f8b0e536893f4917722de22891c"}
Jun 10 00:21:56.792387 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.792366    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr" event={"ID":"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1","Type":"ContainerStarted","Data":"21c304b8ed3ddf684e7d6ff5e11641ee202c71099b4eadb46b7310e6304301ad"}
Jun 10 00:21:56.793859 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.793837    2560 generic.go:356] "Generic (PLEG): container finished" podID="efa66c73-cab4-45b5-9b89-cbff0b25fc86" containerID="eba3f993917b541c118d4b05a50a51d5b92a0616d4784c12c0a3a5ba88214e93" exitCode=0
Jun 10 00:21:56.793954 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.793917    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbxcs" event={"ID":"efa66c73-cab4-45b5-9b89-cbff0b25fc86","Type":"ContainerDied","Data":"eba3f993917b541c118d4b05a50a51d5b92a0616d4784c12c0a3a5ba88214e93"}
Jun 10 00:21:56.796909 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.796893    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v87bq_42e8ed02-5ca0-478a-9642-562b92e21674/ovn-acl-logging/0.log"
Jun 10 00:21:56.797242 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.797224    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq" event={"ID":"42e8ed02-5ca0-478a-9642-562b92e21674","Type":"ContainerStarted","Data":"b1a3a1818680b1327cc4a877188370e07916647fc42f8ac64d8998012516c1fb"}
Jun 10 00:21:56.798588 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.798566    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2fgmj" event={"ID":"3309e0e0-4f8c-4c87-ba1f-5103e69d6311","Type":"ContainerStarted","Data":"457e4a60006b4174d0112d28c660e91bc65a77f0a37a3c8a268f4205002e6f9c"}
Jun 10 00:21:56.799954 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.799934    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lv968" event={"ID":"f9145353-43cf-472c-ba12-c3f093cfcccc","Type":"ContainerStarted","Data":"37b38bc1a1a7da4316a591d7924a361893a8e30da9d71e69d81d84ffa6ba8b02"}
Jun 10 00:21:56.801374 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.801338    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h59kg" event={"ID":"d3a30cb3-38b0-4ad8-9956-0d2c682bfa8d","Type":"ContainerStarted","Data":"171bdb214ba38f5a26dfc886ba8058ac6ebd71504a4b5defd65372e19d249ede"}
Jun 10 00:21:56.802635 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.802614    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6jdzv" event={"ID":"eab4de7c-fcdc-4f58-80c0-b7607ec77386","Type":"ContainerStarted","Data":"d1b46b092ba074c5c16831ae8abc1141cb03d4037262cb7074413d9bfd66367c"}
Jun 10 00:21:56.820156 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.820023    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h59kg" podStartSLOduration=3.770849583 podStartE2EDuration="23.820009114s" totalImagesPullingTime="20.049159531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:56.819671506 +0000 UTC m=+23.690447633" watchObservedRunningTime="2026-06-10 00:21:56.820009114 +0000 UTC m=+23.690785240"
Jun 10 00:21:56.864201 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.864010    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2fgmj" podStartSLOduration=3.815027823 podStartE2EDuration="23.863995703s" totalImagesPullingTime="20.04896788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:56.863957511 +0000 UTC m=+23.734733637" watchObservedRunningTime="2026-06-10 00:21:56.863995703 +0000 UTC m=+23.734771830"
Jun 10 00:21:56.864654 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.864629    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lv968" podStartSLOduration=3.809441153 podStartE2EDuration="23.864622262s" totalImagesPullingTime="20.055181109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:56.85090035 +0000 UTC m=+23.721676480" watchObservedRunningTime="2026-06-10 00:21:56.864622262 +0000 UTC m=+23.735398388"
Jun 10 00:21:56.878969 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:56.878921    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6jdzv" podStartSLOduration=3.893028368 podStartE2EDuration="23.878907671s" totalImagesPullingTime="19.985879303s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:56.878882288 +0000 UTC m=+23.749658412" watchObservedRunningTime="2026-06-10 00:21:56.878907671 +0000 UTC m=+23.749683795"
Jun 10 00:21:57.609600 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:57.609579    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:57.610064 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:57.609693    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:21:57.628505 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:57.628477    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 10 00:21:57.805879 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:57.805847    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr" event={"ID":"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1","Type":"ContainerStarted","Data":"db899b36c473df238a1cadb709f20e9e3dc2bb882965c0aa485e8c619f313aff"}
Jun 10 00:21:57.807661 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:57.807629    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal" event={"ID":"ca4f4a5acfec7984defd00fd8ab5031c","Type":"ContainerStarted","Data":"02320acba903b0eac24bd98f55e9438b9d1bcdf412e277bada18139ebf7e1940"}
Jun 10 00:21:58.019903 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:58.019875    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2fgmj"
Jun 10 00:21:58.020368 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:58.020348    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2fgmj"
Jun 10 00:21:58.034271 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:58.034174    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-167.ec2.internal" podStartSLOduration=24.034161455 podStartE2EDuration="24.034161455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:57.821975331 +0000 UTC m=+24.692751469" watchObservedRunningTime="2026-06-10 00:21:58.034161455 +0000 UTC m=+24.904937584"
Jun 10 00:21:58.609303 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:58.609266    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:21:58.609303 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:58.609311    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:21:58.609643 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:58.609404    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:21:58.609643 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:58.609504    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:21:58.609643 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:58.609541    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T00:21:57.628500569Z","UUID":"7870db8c-8bbb-44cc-9138-1015e4accf74","Handler":null,"Name":"","Endpoint":""}
Jun 10 00:21:58.611414 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:58.611393    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 10 00:21:58.611500 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:58.611436    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 10 00:21:58.813676 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:58.813651    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v87bq_42e8ed02-5ca0-478a-9642-562b92e21674/ovn-acl-logging/0.log"
Jun 10 00:21:58.814046 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:58.814022    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq" event={"ID":"42e8ed02-5ca0-478a-9642-562b92e21674","Type":"ContainerStarted","Data":"8e1ce9b7a574ff9dc3262e72b3047def95ab8e285477f9d8ce246ad5c1b3cc42"}
Jun 10 00:21:58.814216 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:58.814198    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2fgmj"
Jun 10 00:21:58.814840 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:58.814826    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2fgmj"
Jun 10 00:21:59.609325 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:59.609291    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:21:59.609495 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:21:59.609392    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:21:59.819361 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:59.819318    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr" event={"ID":"1a30d2f4-3d50-43f1-9cdd-49cd308a38f1","Type":"ContainerStarted","Data":"1bfa01e87c9a73ef055bd5395096197d1d64163f4b1fe44d54c327cb8dca40ad"}
Jun 10 00:21:59.835712 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:21:59.835665    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7xr" podStartSLOduration=4.568942594 podStartE2EDuration="26.835650044s" totalImagesPullingTime="22.26670745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:21:59.835328167 +0000 UTC m=+26.706104294" watchObservedRunningTime="2026-06-10 00:21:59.835650044 +0000 UTC m=+26.706426171"
Jun 10 00:22:00.609534 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:00.609353    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:22:00.609751 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:00.609411    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:22:00.609751 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:00.609614    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:22:00.609751 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:00.609696    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:22:00.824927 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:00.824902    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v87bq_42e8ed02-5ca0-478a-9642-562b92e21674/ovn-acl-logging/0.log"
Jun 10 00:22:00.825361 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:00.825335    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq" event={"ID":"42e8ed02-5ca0-478a-9642-562b92e21674","Type":"ContainerStarted","Data":"fc7250a9ee39fabd04b6ef3b279478010c34ffeea921b07cf832540daa8a35c0"}
Jun 10 00:22:00.825759 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:00.825727    2560 scope.go:117] "RemoveContainer" containerID="efb40031b16ca05a1a4189ef641e0ef9b758b7cee95a72e0d4117a45bdced303"
Jun 10 00:22:01.608841 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:01.608803    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:22:01.609008 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:01.608978    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:22:01.832200 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:01.832167    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v87bq_42e8ed02-5ca0-478a-9642-562b92e21674/ovn-acl-logging/0.log"
Jun 10 00:22:01.832610 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:01.832582    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq" event={"ID":"42e8ed02-5ca0-478a-9642-562b92e21674","Type":"ContainerStarted","Data":"6c3e18029bdfc5547115370a8fe344eda3a4c8e3ecabc813f994c1c12a8f74b6"}
Jun 10 00:22:01.833212 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:01.833050    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:22:01.833212 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:01.833125    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:22:01.833212 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:01.833167    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:22:01.852005 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:01.851975    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:22:01.852870 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:01.852849    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:22:01.859433 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:01.858959    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq" podStartSLOduration=8.541194614 podStartE2EDuration="28.858944791s" totalImagesPullingTime="20.317750177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:22:01.857484894 +0000 UTC m=+28.728261022" watchObservedRunningTime="2026-06-10 00:22:01.858944791 +0000 UTC m=+28.729720920"
Jun 10 00:22:02.129614 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:02.129544    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6lgs7"]
Jun 10 00:22:02.129804 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:02.129679    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:22:02.129859 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:02.129799    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:22:02.133584 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:02.133538    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n2z9z"]
Jun 10 00:22:02.133724 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:02.133667    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:22:02.133814 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:02.133772    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:22:02.134544 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:02.134330    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xxdm4"]
Jun 10 00:22:02.134544 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:02.134421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:22:02.134544 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:02.134499    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:22:03.610214 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:03.610190    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:22:03.610625 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:03.610297    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:22:03.610625 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:03.610292    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:22:03.610625 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:03.610378    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:22:03.610625 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:03.610533    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:22:03.610832 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:03.610635    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:22:03.839040 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:03.839008    2560 generic.go:356] "Generic (PLEG): container finished" podID="efa66c73-cab4-45b5-9b89-cbff0b25fc86" containerID="3ac2b9b64a81fb7e4a517b694960998ee693fd2a52145531e6327ad27ab5ac15" exitCode=0
Jun 10 00:22:03.839177 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:03.839100    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbxcs" event={"ID":"efa66c73-cab4-45b5-9b89-cbff0b25fc86","Type":"ContainerDied","Data":"3ac2b9b64a81fb7e4a517b694960998ee693fd2a52145531e6327ad27ab5ac15"}
Jun 10 00:22:05.608938 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:05.608762    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:22:05.609394 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:05.608762    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:22:05.609394 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:05.609005    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:22:05.609394 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:05.609111    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:22:05.609394 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:05.608818    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:22:05.609394 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:05.609213    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:22:05.845692 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:05.845659    2560 generic.go:356] "Generic (PLEG): container finished" podID="efa66c73-cab4-45b5-9b89-cbff0b25fc86" containerID="a1e5507f62d9bb21f6a81da625ce3f8fae0a65ae402bd1f6fbe665e4b8ccecc1" exitCode=0
Jun 10 00:22:05.845837 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:05.845711    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbxcs" event={"ID":"efa66c73-cab4-45b5-9b89-cbff0b25fc86","Type":"ContainerDied","Data":"a1e5507f62d9bb21f6a81da625ce3f8fae0a65ae402bd1f6fbe665e4b8ccecc1"}
Jun 10 00:22:06.281191 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:06.281163    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret\") pod \"global-pull-secret-syncer-6lgs7\" (UID: \"e9b93119-1e4a-45dc-8298-e6cdaaad0e06\") " pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:22:06.281336 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:06.281283    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 00:22:06.281390 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:06.281339    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret podName:e9b93119-1e4a-45dc-8298-e6cdaaad0e06 nodeName:}" failed. No retries permitted until 2026-06-10 00:22:38.281323661 +0000 UTC m=+65.152099780 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret") pod "global-pull-secret-syncer-6lgs7" (UID: "e9b93119-1e4a-45dc-8298-e6cdaaad0e06") : object "kube-system"/"original-pull-secret" not registered
Jun 10 00:22:06.381805 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:06.381765    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs\") pod \"network-metrics-daemon-n2z9z\" (UID: \"4d3fdb97-b961-4d04-abaf-6487c7a130f1\") " pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:22:06.381972 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:06.381898    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 00:22:06.381972 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:06.381955    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs podName:4d3fdb97-b961-4d04-abaf-6487c7a130f1 nodeName:}" failed. No retries permitted until 2026-06-10 00:22:38.381941495 +0000 UTC m=+65.252717601 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs") pod "network-metrics-daemon-n2z9z" (UID: "4d3fdb97-b961-4d04-abaf-6487c7a130f1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 00:22:06.482848 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:06.482812    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfclb\" (UniqueName: \"kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb\") pod \"network-check-target-xxdm4\" (UID: \"43c24dbb-e33a-404e-89eb-7d6e88b4699e\") " pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:22:06.483021 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:06.482974    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 00:22:06.483021 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:06.482996    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 00:22:06.483021 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:06.483009    2560 projected.go:196] Error preparing data for projected volume kube-api-access-pfclb for pod openshift-network-diagnostics/network-check-target-xxdm4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 00:22:06.483182 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:06.483090    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb podName:43c24dbb-e33a-404e-89eb-7d6e88b4699e nodeName:}" failed. No retries permitted until 2026-06-10 00:22:38.483069527 +0000 UTC m=+65.353845635 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pfclb" (UniqueName: "kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb") pod "network-check-target-xxdm4" (UID: "43c24dbb-e33a-404e-89eb-7d6e88b4699e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 00:22:07.609442 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:07.609403    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:22:07.609850 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:07.609417    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:22:07.609850 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:07.609510    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xxdm4" podUID="43c24dbb-e33a-404e-89eb-7d6e88b4699e"
Jun 10 00:22:07.609850 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:07.609589    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:22:07.609850 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:07.609639    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:22:07.609850 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:07.609700    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lgs7" podUID="e9b93119-1e4a-45dc-8298-e6cdaaad0e06"
Jun 10 00:22:07.855570 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:07.855529    2560 generic.go:356] "Generic (PLEG): container finished" podID="efa66c73-cab4-45b5-9b89-cbff0b25fc86" containerID="788eda0d3517da4090320d918977de28133d3c110d0e9142e3c08c8e8ace9361" exitCode=0
Jun 10 00:22:07.855753 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:07.855606    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbxcs" event={"ID":"efa66c73-cab4-45b5-9b89-cbff0b25fc86","Type":"ContainerDied","Data":"788eda0d3517da4090320d918977de28133d3c110d0e9142e3c08c8e8ace9361"}
Jun 10 00:22:08.441713 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.441682    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-167.ec2.internal" event="NodeReady"
Jun 10 00:22:08.441896 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.441858    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 10 00:22:08.480592 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.480557    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8jqf6"]
Jun 10 00:22:08.482700 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.482677    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:08.484175 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.484152    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pbk85"]
Jun 10 00:22:08.485592 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.485564    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 10 00:22:08.485789 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.485564    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vpwdb\""
Jun 10 00:22:08.485865 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.485568    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 10 00:22:08.486102 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.486081    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pbk85"
Jun 10 00:22:08.488302 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.488272    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q8775\""
Jun 10 00:22:08.488386 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.488339    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 10 00:22:08.488386 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.488276    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 10 00:22:08.488499 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.488432    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 10 00:22:08.492809 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.492787    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8jqf6"]
Jun 10 00:22:08.495801 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.495757    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pbk85"]
Jun 10 00:22:08.599001 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.598965    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3b9ce6a-5198-4698-b05d-7137726b59d6-cert\") pod \"ingress-canary-pbk85\" (UID: \"a3b9ce6a-5198-4698-b05d-7137726b59d6\") " pod="openshift-ingress-canary/ingress-canary-pbk85"
Jun 10 00:22:08.599001 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.599009    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e79505-9bdf-48ae-934e-33d497801737-tmp-dir\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:08.599221 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.599050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16e79505-9bdf-48ae-934e-33d497801737-config-volume\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:08.599221 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.599110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:08.599221 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.599146    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxrrz\" (UniqueName: \"kubernetes.io/projected/16e79505-9bdf-48ae-934e-33d497801737-kube-api-access-xxrrz\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:08.599350 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.599240    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7ht9\" (UniqueName: \"kubernetes.io/projected/a3b9ce6a-5198-4698-b05d-7137726b59d6-kube-api-access-m7ht9\") pod \"ingress-canary-pbk85\" (UID: \"a3b9ce6a-5198-4698-b05d-7137726b59d6\") " pod="openshift-ingress-canary/ingress-canary-pbk85"
Jun 10 00:22:08.700279 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.700189    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7ht9\" (UniqueName: \"kubernetes.io/projected/a3b9ce6a-5198-4698-b05d-7137726b59d6-kube-api-access-m7ht9\") pod \"ingress-canary-pbk85\" (UID: \"a3b9ce6a-5198-4698-b05d-7137726b59d6\") " pod="openshift-ingress-canary/ingress-canary-pbk85"
Jun 10 00:22:08.700279 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.700256    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3b9ce6a-5198-4698-b05d-7137726b59d6-cert\") pod \"ingress-canary-pbk85\" (UID: \"a3b9ce6a-5198-4698-b05d-7137726b59d6\") " pod="openshift-ingress-canary/ingress-canary-pbk85"
Jun 10 00:22:08.700279 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.700280    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e79505-9bdf-48ae-934e-33d497801737-tmp-dir\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:08.700809 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.700301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16e79505-9bdf-48ae-934e-33d497801737-config-volume\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:08.700809 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.700320    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:08.700809 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.700343    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxrrz\" (UniqueName: \"kubernetes.io/projected/16e79505-9bdf-48ae-934e-33d497801737-kube-api-access-xxrrz\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:08.700809 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:08.700658    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 00:22:08.700809 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.700680    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16e79505-9bdf-48ae-934e-33d497801737-tmp-dir\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:08.700809 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:08.700706    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls podName:16e79505-9bdf-48ae-934e-33d497801737 nodeName:}" failed. No retries permitted until 2026-06-10 00:22:09.200692044 +0000 UTC m=+36.071468149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls") pod "dns-default-8jqf6" (UID: "16e79505-9bdf-48ae-934e-33d497801737") : secret "dns-default-metrics-tls" not found
Jun 10 00:22:08.701032 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.701008    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16e79505-9bdf-48ae-934e-33d497801737-config-volume\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:08.705734 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.705698    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a3b9ce6a-5198-4698-b05d-7137726b59d6-cert\") pod \"ingress-canary-pbk85\" (UID: \"a3b9ce6a-5198-4698-b05d-7137726b59d6\") " pod="openshift-ingress-canary/ingress-canary-pbk85"
Jun 10 00:22:08.708565 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.708542    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxrrz\" (UniqueName: \"kubernetes.io/projected/16e79505-9bdf-48ae-934e-33d497801737-kube-api-access-xxrrz\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:08.708849 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.708827    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7ht9\" (UniqueName: \"kubernetes.io/projected/a3b9ce6a-5198-4698-b05d-7137726b59d6-kube-api-access-m7ht9\") pod \"ingress-canary-pbk85\" (UID: \"a3b9ce6a-5198-4698-b05d-7137726b59d6\") " pod="openshift-ingress-canary/ingress-canary-pbk85"
Jun 10 00:22:08.803081 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.803042    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pbk85"
Jun 10 00:22:08.955869 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:08.955777    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pbk85"]
Jun 10 00:22:08.960862 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:22:08.960830    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b9ce6a_5198_4698_b05d_7137726b59d6.slice/crio-5ea50f7b78dfdc59d4d12636a759f39edcb5639a6d40fd0b70f099e1b9c312b8 WatchSource:0}: Error finding container 5ea50f7b78dfdc59d4d12636a759f39edcb5639a6d40fd0b70f099e1b9c312b8: Status 404 returned error can't find the container with id 5ea50f7b78dfdc59d4d12636a759f39edcb5639a6d40fd0b70f099e1b9c312b8
Jun 10 00:22:09.204134 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:09.203934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:09.204304 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:09.204082    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 00:22:09.204304 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:09.204276    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls podName:16e79505-9bdf-48ae-934e-33d497801737 nodeName:}" failed. No retries permitted until 2026-06-10 00:22:10.204255321 +0000 UTC m=+37.075031436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls") pod "dns-default-8jqf6" (UID: "16e79505-9bdf-48ae-934e-33d497801737") : secret "dns-default-metrics-tls" not found
Jun 10 00:22:09.608882 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:09.608846    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:22:09.609161 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:09.608846    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:22:09.609236 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:09.608847    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:22:09.611376 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:09.611353    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 10 00:22:09.612255 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:09.612229    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 10 00:22:09.612255 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:09.612249    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8r5c2\""
Jun 10 00:22:09.612501 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:09.612333    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 10 00:22:09.612501 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:09.612408    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tn48h\""
Jun 10 00:22:09.612501 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:09.612424    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 10 00:22:09.862338 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:09.862254    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pbk85" event={"ID":"a3b9ce6a-5198-4698-b05d-7137726b59d6","Type":"ContainerStarted","Data":"5ea50f7b78dfdc59d4d12636a759f39edcb5639a6d40fd0b70f099e1b9c312b8"}
Jun 10 00:22:10.213821 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:10.213717    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:10.213976 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:10.213896    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 00:22:10.213976 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:10.213967    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls podName:16e79505-9bdf-48ae-934e-33d497801737 nodeName:}" failed. No retries permitted until 2026-06-10 00:22:12.213949454 +0000 UTC m=+39.084725561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls") pod "dns-default-8jqf6" (UID: "16e79505-9bdf-48ae-934e-33d497801737") : secret "dns-default-metrics-tls" not found
Jun 10 00:22:12.230010 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:12.229972    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:12.230507 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:12.230128    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 00:22:12.230507 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:12.230192    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls podName:16e79505-9bdf-48ae-934e-33d497801737 nodeName:}" failed. No retries permitted until 2026-06-10 00:22:16.230174686 +0000 UTC m=+43.100950793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls") pod "dns-default-8jqf6" (UID: "16e79505-9bdf-48ae-934e-33d497801737") : secret "dns-default-metrics-tls" not found
Jun 10 00:22:12.508032 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:12.507997    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:12.582890 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:12.582817    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:12.872307 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:12.872271    2560 generic.go:356] "Generic (PLEG): container finished" podID="efa66c73-cab4-45b5-9b89-cbff0b25fc86" containerID="a4405c715a373f8d6048ebbe57af190e6178c19690ad8d4bc65cb3ec0191fcae" exitCode=0
Jun 10 00:22:12.872506 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:12.872364    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbxcs" event={"ID":"efa66c73-cab4-45b5-9b89-cbff0b25fc86","Type":"ContainerDied","Data":"a4405c715a373f8d6048ebbe57af190e6178c19690ad8d4bc65cb3ec0191fcae"}
Jun 10 00:22:12.873871 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:12.873850    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pbk85" event={"ID":"a3b9ce6a-5198-4698-b05d-7137726b59d6","Type":"ContainerStarted","Data":"2ffcb9b64e9475315a1216871179f7f2edf4ad55dd3ff172fe0cdb1681079f67"}
Jun 10 00:22:12.931287 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:12.931250    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:12.942374 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:12.942318    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pbk85" podStartSLOduration=1.436665567 podStartE2EDuration="4.942297344s" totalImagesPullingTime="3.505631777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:22:12.941454232 +0000 UTC m=+39.812230360" watchObservedRunningTime="2026-06-10 00:22:12.942297344 +0000 UTC m=+39.813073473"
Jun 10 00:22:13.024367 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:13.024344    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:13.879422 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:13.879384    2560 generic.go:356] "Generic (PLEG): container finished" podID="efa66c73-cab4-45b5-9b89-cbff0b25fc86" containerID="4b3a1262571840d73068314588caac59ccf8ac7a48a0761d2bd46cf6c0f3d8cc" exitCode=0
Jun 10 00:22:13.879883 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:13.879467    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbxcs" event={"ID":"efa66c73-cab4-45b5-9b89-cbff0b25fc86","Type":"ContainerDied","Data":"4b3a1262571840d73068314588caac59ccf8ac7a48a0761d2bd46cf6c0f3d8cc"}
Jun 10 00:22:14.885128 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:14.885094    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbxcs" event={"ID":"efa66c73-cab4-45b5-9b89-cbff0b25fc86","Type":"ContainerStarted","Data":"66140f269f433354e1caa74102307035653d076f829afec0db2c171a12557eb2"}
Jun 10 00:22:14.905536 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:14.905495    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fbxcs" podStartSLOduration=8.424398406 podStartE2EDuration="41.905479981s" totalImagesPullingTime="33.481081575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:22:14.904105086 +0000 UTC m=+41.774881213" watchObservedRunningTime="2026-06-10 00:22:14.905479981 +0000 UTC m=+41.776256107"
Jun 10 00:22:15.025045 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:15.025005    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:15.075790 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:15.075729    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:15.372627 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:15.372592    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:15.420660 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:15.420619    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:16.133717 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:16.133675    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:16.235118 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:16.235085    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:16.258069 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:16.258038    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:16.258184 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:16.258150    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 00:22:16.258219 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:16.258202    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls podName:16e79505-9bdf-48ae-934e-33d497801737 nodeName:}" failed. No retries permitted until 2026-06-10 00:22:24.258190151 +0000 UTC m=+51.128966255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls") pod "dns-default-8jqf6" (UID: "16e79505-9bdf-48ae-934e-33d497801737") : secret "dns-default-metrics-tls" not found
Jun 10 00:22:18.746973 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:18.746929    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:18.793731 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:18.793689    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:24.312157 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:24.312119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:24.312600 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:24.312224    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 00:22:24.312600 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:24.312277    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls podName:16e79505-9bdf-48ae-934e-33d497801737 nodeName:}" failed. No retries permitted until 2026-06-10 00:22:40.312261953 +0000 UTC m=+67.183038057 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls") pod "dns-default-8jqf6" (UID: "16e79505-9bdf-48ae-934e-33d497801737") : secret "dns-default-metrics-tls" not found
Jun 10 00:22:25.767934 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:25.767904    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"]
Jun 10 00:22:25.794136 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:25.794109    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"]
Jun 10 00:22:25.794275 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:25.794197    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:22:25.796480 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:25.796456    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jun 10 00:22:25.796598 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:25.796492    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 10 00:22:25.797369 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:25.797350    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 10 00:22:25.797462 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:25.797406    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 10 00:22:25.922656 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:25.922616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/95e80606-43ce-4354-8d7f-74a02a9acd7f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7487cc8f78-kdfs8\" (UID: \"95e80606-43ce-4354-8d7f-74a02a9acd7f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:22:25.922884 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:25.922756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvqth\" (UniqueName: \"kubernetes.io/projected/95e80606-43ce-4354-8d7f-74a02a9acd7f-kube-api-access-fvqth\") pod \"klusterlet-addon-workmgr-7487cc8f78-kdfs8\" (UID: \"95e80606-43ce-4354-8d7f-74a02a9acd7f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:22:25.922884 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:25.922796    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95e80606-43ce-4354-8d7f-74a02a9acd7f-tmp\") pod \"klusterlet-addon-workmgr-7487cc8f78-kdfs8\" (UID: \"95e80606-43ce-4354-8d7f-74a02a9acd7f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:22:26.023937 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:26.023851    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95e80606-43ce-4354-8d7f-74a02a9acd7f-tmp\") pod \"klusterlet-addon-workmgr-7487cc8f78-kdfs8\" (UID: \"95e80606-43ce-4354-8d7f-74a02a9acd7f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:22:26.023937 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:26.023896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/95e80606-43ce-4354-8d7f-74a02a9acd7f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7487cc8f78-kdfs8\" (UID: \"95e80606-43ce-4354-8d7f-74a02a9acd7f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:22:26.024110 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:26.024027    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvqth\" (UniqueName: \"kubernetes.io/projected/95e80606-43ce-4354-8d7f-74a02a9acd7f-kube-api-access-fvqth\") pod \"klusterlet-addon-workmgr-7487cc8f78-kdfs8\" (UID: \"95e80606-43ce-4354-8d7f-74a02a9acd7f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:22:26.024266 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:26.024245    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95e80606-43ce-4354-8d7f-74a02a9acd7f-tmp\") pod \"klusterlet-addon-workmgr-7487cc8f78-kdfs8\" (UID: \"95e80606-43ce-4354-8d7f-74a02a9acd7f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:22:26.027450 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:26.027431    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/95e80606-43ce-4354-8d7f-74a02a9acd7f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7487cc8f78-kdfs8\" (UID: \"95e80606-43ce-4354-8d7f-74a02a9acd7f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:22:26.032404 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:26.032375    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvqth\" (UniqueName: \"kubernetes.io/projected/95e80606-43ce-4354-8d7f-74a02a9acd7f-kube-api-access-fvqth\") pod \"klusterlet-addon-workmgr-7487cc8f78-kdfs8\" (UID: \"95e80606-43ce-4354-8d7f-74a02a9acd7f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:22:26.103369 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:26.103325    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:22:26.246717 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:26.246689    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"]
Jun 10 00:22:26.250370 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:22:26.250331    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e80606_43ce_4354_8d7f_74a02a9acd7f.slice/crio-2e3f0fa06e28b021b1f63a271fdd89916ae8474c3fe87c152224f1c93c9cd538 WatchSource:0}: Error finding container 2e3f0fa06e28b021b1f63a271fdd89916ae8474c3fe87c152224f1c93c9cd538: Status 404 returned error can't find the container with id 2e3f0fa06e28b021b1f63a271fdd89916ae8474c3fe87c152224f1c93c9cd538
Jun 10 00:22:26.915334 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:26.915298    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8" event={"ID":"95e80606-43ce-4354-8d7f-74a02a9acd7f","Type":"ContainerStarted","Data":"2e3f0fa06e28b021b1f63a271fdd89916ae8474c3fe87c152224f1c93c9cd538"}
Jun 10 00:22:31.930617 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:31.930574    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8" event={"ID":"95e80606-43ce-4354-8d7f-74a02a9acd7f","Type":"ContainerStarted","Data":"daa1c6a67f789e62627d784ddf623b1180fc7b4332cbac1623bfbd63bf28a935"}
Jun 10 00:22:31.931041 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:31.930770    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:22:31.932471 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:31.932452    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:22:31.945244 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:31.945198    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8" podStartSLOduration=2.164675523 podStartE2EDuration="6.945185071s" totalImagesPullingTime="4.780509548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:22:31.944291801 +0000 UTC m=+58.815067928" watchObservedRunningTime="2026-06-10 00:22:31.945185071 +0000 UTC m=+58.815961198"
Jun 10 00:22:32.900129 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:32.900094    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:32.953178 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:32.952361    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:33.854093 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:33.854066    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v87bq"
Jun 10 00:22:34.004188 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:34.004149    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:34.101418 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:34.101367    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:37.321576 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:37.321545    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:37.377416 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:37.377376    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:38.315631 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:38.315569    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret\") pod \"global-pull-secret-syncer-6lgs7\" (UID: \"e9b93119-1e4a-45dc-8298-e6cdaaad0e06\") " pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:22:38.318195 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:38.318176    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 10 00:22:38.328571 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:38.328540    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b93119-1e4a-45dc-8298-e6cdaaad0e06-original-pull-secret\") pod \"global-pull-secret-syncer-6lgs7\" (UID: \"e9b93119-1e4a-45dc-8298-e6cdaaad0e06\") " pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:22:38.416327 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:38.416286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs\") pod \"network-metrics-daemon-n2z9z\" (UID: \"4d3fdb97-b961-4d04-abaf-6487c7a130f1\") " pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:22:38.418698 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:38.418676    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 10 00:22:38.420792 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:38.420776    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lgs7"
Jun 10 00:22:38.427379 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:38.427358    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 10 00:22:38.427458 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:38.427446    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs podName:4d3fdb97-b961-4d04-abaf-6487c7a130f1 nodeName:}" failed. No retries permitted until 2026-06-10 00:23:42.427424055 +0000 UTC m=+129.298200164 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs") pod "network-metrics-daemon-n2z9z" (UID: "4d3fdb97-b961-4d04-abaf-6487c7a130f1") : secret "metrics-daemon-secret" not found
Jun 10 00:22:38.517453 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:38.517423    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfclb\" (UniqueName: \"kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb\") pod \"network-check-target-xxdm4\" (UID: \"43c24dbb-e33a-404e-89eb-7d6e88b4699e\") " pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:22:38.519820 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:38.519796    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 10 00:22:38.530568 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:38.530545    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 10 00:22:38.539128 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:38.539099    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6lgs7"]
Jun 10 00:22:38.542274 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:38.542255    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfclb\" (UniqueName: \"kubernetes.io/projected/43c24dbb-e33a-404e-89eb-7d6e88b4699e-kube-api-access-pfclb\") pod \"network-check-target-xxdm4\" (UID: \"43c24dbb-e33a-404e-89eb-7d6e88b4699e\") " pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:22:38.543069 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:22:38.543038    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b93119_1e4a_45dc_8298_e6cdaaad0e06.slice/crio-ea87cee0be246ef16b4dfcde48a4cc0c0fe5832749f751f8d85dfc9d90acf3b6 WatchSource:0}: Error finding container ea87cee0be246ef16b4dfcde48a4cc0c0fe5832749f751f8d85dfc9d90acf3b6: Status 404 returned error can't find the container with id ea87cee0be246ef16b4dfcde48a4cc0c0fe5832749f751f8d85dfc9d90acf3b6
Jun 10 00:22:38.730480 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:38.730386    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tn48h\""
Jun 10 00:22:38.738279 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:38.738254    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:22:38.860655 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:38.860622    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xxdm4"]
Jun 10 00:22:38.864583 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:22:38.864557    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c24dbb_e33a_404e_89eb_7d6e88b4699e.slice/crio-55deb814744855da4b61a907fb348dead8c737db3d21c1e5e65e0553812e62d2 WatchSource:0}: Error finding container 55deb814744855da4b61a907fb348dead8c737db3d21c1e5e65e0553812e62d2: Status 404 returned error can't find the container with id 55deb814744855da4b61a907fb348dead8c737db3d21c1e5e65e0553812e62d2
Jun 10 00:22:38.947449 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:38.947402    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xxdm4" event={"ID":"43c24dbb-e33a-404e-89eb-7d6e88b4699e","Type":"ContainerStarted","Data":"55deb814744855da4b61a907fb348dead8c737db3d21c1e5e65e0553812e62d2"}
Jun 10 00:22:38.948633 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:38.948603    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6lgs7" event={"ID":"e9b93119-1e4a-45dc-8298-e6cdaaad0e06","Type":"ContainerStarted","Data":"ea87cee0be246ef16b4dfcde48a4cc0c0fe5832749f751f8d85dfc9d90acf3b6"}
Jun 10 00:22:40.331056 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:40.331017    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:22:40.331527 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:40.331220    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 00:22:40.331527 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:22:40.331290    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls podName:16e79505-9bdf-48ae-934e-33d497801737 nodeName:}" failed. No retries permitted until 2026-06-10 00:23:12.331270935 +0000 UTC m=+99.202047043 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls") pod "dns-default-8jqf6" (UID: "16e79505-9bdf-48ae-934e-33d497801737") : secret "dns-default-metrics-tls" not found
Jun 10 00:22:43.965033 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:43.964994    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6lgs7" event={"ID":"e9b93119-1e4a-45dc-8298-e6cdaaad0e06","Type":"ContainerStarted","Data":"8f87a6bae6d2f3636fd56fac2925cbb968d494aec8ee0c8f870c07bd7c65c0cd"}
Jun 10 00:22:43.966452 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:43.966425    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xxdm4" event={"ID":"43c24dbb-e33a-404e-89eb-7d6e88b4699e","Type":"ContainerStarted","Data":"f66b678d5798e4009305a7f5936046dffefaad27f409c651f02223e7c4751c8e"}
Jun 10 00:22:43.966582 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:43.966566    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:22:43.983048 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:43.982993    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6lgs7" podStartSLOduration=66.441590282 podStartE2EDuration="1m10.982979723s" totalImagesPullingTime="4.541389441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:22:43.982598268 +0000 UTC m=+70.853374394" watchObservedRunningTime="2026-06-10 00:22:43.982979723 +0000 UTC m=+70.853755849"
Jun 10 00:22:43.995570 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:43.995522    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xxdm4" podStartSLOduration=66.779954111 podStartE2EDuration="1m10.995508502s" totalImagesPullingTime="4.215554391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:22:43.995082697 +0000 UTC m=+70.865858823" watchObservedRunningTime="2026-06-10 00:22:43.995508502 +0000 UTC m=+70.866284671"
Jun 10 00:22:48.423319 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:48.423279    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:22:48.523482 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:22:48.523452    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:23:12.336943 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:23:12.336905    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:23:12.337412 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:23:12.337066    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 00:23:12.337412 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:23:12.337147    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls podName:16e79505-9bdf-48ae-934e-33d497801737 nodeName:}" failed. No retries permitted until 2026-06-10 00:24:16.337129608 +0000 UTC m=+163.207905713 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls") pod "dns-default-8jqf6" (UID: "16e79505-9bdf-48ae-934e-33d497801737") : secret "dns-default-metrics-tls" not found
Jun 10 00:23:14.970939 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:23:14.970911    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xxdm4"
Jun 10 00:23:42.435052 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:23:42.435012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs\") pod \"network-metrics-daemon-n2z9z\" (UID: \"4d3fdb97-b961-4d04-abaf-6487c7a130f1\") " pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:23:42.435535 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:23:42.435147    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 10 00:23:42.435535 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:23:42.435209    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs podName:4d3fdb97-b961-4d04-abaf-6487c7a130f1 nodeName:}" failed. No retries permitted until 2026-06-10 00:25:44.435194342 +0000 UTC m=+251.305970448 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs") pod "network-metrics-daemon-n2z9z" (UID: "4d3fdb97-b961-4d04-abaf-6487c7a130f1") : secret "metrics-daemon-secret" not found
Jun 10 00:24:11.495968 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:11.495902    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8jqf6" podUID="16e79505-9bdf-48ae-934e-33d497801737"
Jun 10 00:24:11.767169 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:11.767134    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:12.181410 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:12.181330    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:24:12.632821 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:12.632781    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-n2z9z" podUID="4d3fdb97-b961-4d04-abaf-6487c7a130f1"
Jun 10 00:24:16.366171 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:16.366135    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:24:16.366567 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:16.366243    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 00:24:16.366567 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:16.366300    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls podName:16e79505-9bdf-48ae-934e-33d497801737 nodeName:}" failed. No retries permitted until 2026-06-10 00:26:18.366286085 +0000 UTC m=+285.237062191 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls") pod "dns-default-8jqf6" (UID: "16e79505-9bdf-48ae-934e-33d497801737") : secret "dns-default-metrics-tls" not found
Jun 10 00:24:27.609439 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:27.609346    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:24:31.228924 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:31.228898    2560 generic.go:356] "Generic (PLEG): container finished" podID="95e80606-43ce-4354-8d7f-74a02a9acd7f" containerID="daa1c6a67f789e62627d784ddf623b1180fc7b4332cbac1623bfbd63bf28a935" exitCode=1
Jun 10 00:24:31.229215 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:31.228938    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8" event={"ID":"95e80606-43ce-4354-8d7f-74a02a9acd7f","Type":"ContainerDied","Data":"daa1c6a67f789e62627d784ddf623b1180fc7b4332cbac1623bfbd63bf28a935"}
Jun 10 00:24:31.229215 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:31.229206    2560 scope.go:117] "RemoveContainer" containerID="daa1c6a67f789e62627d784ddf623b1180fc7b4332cbac1623bfbd63bf28a935"
Jun 10 00:24:31.931251 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:31.931193    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:24:32.234039 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.233942    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8" event={"ID":"95e80606-43ce-4354-8d7f-74a02a9acd7f","Type":"ContainerStarted","Data":"86eb79708bcb84c0aa8bbc4ceb080ea494de8fb4d0029b440f1c65f5ce34cd6d"}
Jun 10 00:24:32.234471 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.234155    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:24:32.234766 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.234726    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:24:32.241225 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.241200    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bc5df5cbf-d95tp"]
Jun 10 00:24:32.242964 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.242946    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.245270 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.245251    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c5ppl\""
Jun 10 00:24:32.245471 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.245458    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 10 00:24:32.245603 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.245588    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 10 00:24:32.245892 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.245878    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 10 00:24:32.251154 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.251131    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 10 00:24:32.265535 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.265509    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bc5df5cbf-d95tp"]
Jun 10 00:24:32.331878 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.331845    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh"]
Jun 10 00:24:32.333558 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.333543    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh"
Jun 10 00:24:32.337010 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.336986    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xlg49\""
Jun 10 00:24:32.337549 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.337532    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jun 10 00:24:32.337549 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.337542    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jun 10 00:24:32.338000 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.337850    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jun 10 00:24:32.338549 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.338493    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jun 10 00:24:32.339181 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.339162    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"]
Jun 10 00:24:32.341224 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.341206    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5f5dccfcff-pbm8v"]
Jun 10 00:24:32.341338 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.341324    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"
Jun 10 00:24:32.342864 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.342847    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:32.343982 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.343964    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jun 10 00:24:32.344058 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.343988    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jun 10 00:24:32.344058 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.343965    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rmhkm\""
Jun 10 00:24:32.345097 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.345079    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 10 00:24:32.345179 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.345086    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jun 10 00:24:32.345346 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.345329    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jun 10 00:24:32.345430 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.345348    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qr6ls\""
Jun 10 00:24:32.345430 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.345386    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jun 10 00:24:32.345637 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.345623    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 10 00:24:32.345675 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.345623    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jun 10 00:24:32.351176 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.351158    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh"]
Jun 10 00:24:32.355573 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.355531    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"]
Jun 10 00:24:32.356675 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.356652    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f5dccfcff-pbm8v"]
Jun 10 00:24:32.378865 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.378834    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-image-registry-private-configuration\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.378999 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.378898    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-ca-trust-extracted\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.378999 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.378924    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-trusted-ca\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.378999 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.378948    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-certificates\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.378999 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.378974    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.378999 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.378990    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ghfl\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-kube-api-access-4ghfl\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.379154 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.379056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-installation-pull-secrets\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.379154 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.379078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-bound-sa-token\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.431959 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.431925    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-f2wfw"]
Jun 10 00:24:32.433856 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.433834    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-f2wfw"
Jun 10 00:24:32.436199 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.436178    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7p9bl\""
Jun 10 00:24:32.444616 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.444589    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-f2wfw"]
Jun 10 00:24:32.472817 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.472768    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:32.479749 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.479715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-installation-pull-secrets\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.479837 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.479772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-default-certificate\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:32.479879 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.479869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkfhm\" (UniqueName: \"kubernetes.io/projected/2353b550-71e8-4fcf-aa55-a550828732ec-kube-api-access-xkfhm\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:32.479912 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.479891    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nv72t\" (UID: \"6cc7f6de-2406-49f6-a738-dc124c17db96\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"
Jun 10 00:24:32.479946 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.479918    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/391f1235-4644-47de-9bfa-ce9280888777-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m7drh\" (UID: \"391f1235-4644-47de-9bfa-ce9280888777\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh"
Jun 10 00:24:32.479946 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.479937    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-stats-auth\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:32.480013 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.479954    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/391f1235-4644-47de-9bfa-ce9280888777-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m7drh\" (UID: \"391f1235-4644-47de-9bfa-ce9280888777\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh"
Jun 10 00:24:32.480013 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.479974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-certificates\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.480013 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.480000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.480102 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.480059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-ca-trust-extracted\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.480102 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:32.480075    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 10 00:24:32.480102 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:32.480090    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bc5df5cbf-d95tp: secret "image-registry-tls" not found
Jun 10 00:24:32.480102 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.480096    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-trusted-ca\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.480275 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:32.480131    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls podName:6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae nodeName:}" failed. No retries permitted until 2026-06-10 00:24:32.980117985 +0000 UTC m=+179.850894091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls") pod "image-registry-5bc5df5cbf-d95tp" (UID: "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae") : secret "image-registry-tls" not found
Jun 10 00:24:32.480275 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.480142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn8cv\" (UniqueName: \"kubernetes.io/projected/391f1235-4644-47de-9bfa-ce9280888777-kube-api-access-sn8cv\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m7drh\" (UID: \"391f1235-4644-47de-9bfa-ce9280888777\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh"
Jun 10 00:24:32.480275 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.480164    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6cc7f6de-2406-49f6-a738-dc124c17db96-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-nv72t\" (UID: \"6cc7f6de-2406-49f6-a738-dc124c17db96\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"
Jun 10 00:24:32.480275 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.480195    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-bound-sa-token\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.480275 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.480259    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:32.480685 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.480307    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-image-registry-private-configuration\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.480685 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.480337    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ghfl\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-kube-api-access-4ghfl\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.480685 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.480389    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:32.480685 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.480407    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-ca-trust-extracted\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.480685 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.480601    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-certificates\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.481126 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.481107    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-trusted-ca\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.482474 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.482449    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-installation-pull-secrets\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.482753 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.482711    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-image-registry-private-configuration\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.491776 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.491698    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-bound-sa-token\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.492008 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.491990    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ghfl\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-kube-api-access-4ghfl\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.572926 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.572894    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:32.580852 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.580825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nv72t\" (UID: \"6cc7f6de-2406-49f6-a738-dc124c17db96\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"
Jun 10 00:24:32.580947 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.580863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/391f1235-4644-47de-9bfa-ce9280888777-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m7drh\" (UID: \"391f1235-4644-47de-9bfa-ce9280888777\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh"
Jun 10 00:24:32.580947 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.580889    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w4l4\" (UniqueName: \"kubernetes.io/projected/a0302622-8022-4810-b111-413d319f5d00-kube-api-access-4w4l4\") pod \"network-check-source-dbd9cf844-f2wfw\" (UID: \"a0302622-8022-4810-b111-413d319f5d00\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-f2wfw"
Jun 10 00:24:32.581037 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:32.580973    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 10 00:24:32.581037 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.580986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-stats-auth\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:32.581037 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.581022    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/391f1235-4644-47de-9bfa-ce9280888777-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m7drh\" (UID: \"391f1235-4644-47de-9bfa-ce9280888777\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh"
Jun 10 00:24:32.581175 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:32.581084    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert podName:6cc7f6de-2406-49f6-a738-dc124c17db96 nodeName:}" failed. No retries permitted until 2026-06-10 00:24:33.081068621 +0000 UTC m=+179.951844726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-nv72t" (UID: "6cc7f6de-2406-49f6-a738-dc124c17db96") : secret "networking-console-plugin-cert" not found
Jun 10 00:24:32.581175 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.581107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn8cv\" (UniqueName: \"kubernetes.io/projected/391f1235-4644-47de-9bfa-ce9280888777-kube-api-access-sn8cv\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m7drh\" (UID: \"391f1235-4644-47de-9bfa-ce9280888777\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh"
Jun 10 00:24:32.581175 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.581136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6cc7f6de-2406-49f6-a738-dc124c17db96-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-nv72t\" (UID: \"6cc7f6de-2406-49f6-a738-dc124c17db96\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"
Jun 10 00:24:32.581328 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.581195    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:32.581328 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.581243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:32.581328 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.581290    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-default-certificate\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:32.581482 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:32.581325    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle podName:2353b550-71e8-4fcf-aa55-a550828732ec nodeName:}" failed. No retries permitted until 2026-06-10 00:24:33.081308042 +0000 UTC m=+179.952084150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle") pod "router-default-5f5dccfcff-pbm8v" (UID: "2353b550-71e8-4fcf-aa55-a550828732ec") : configmap references non-existent config key: service-ca.crt
Jun 10 00:24:32.581482 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.581349    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkfhm\" (UniqueName: \"kubernetes.io/projected/2353b550-71e8-4fcf-aa55-a550828732ec-kube-api-access-xkfhm\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:32.581482 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:32.581399    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 10 00:24:32.581482 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:32.581464    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs podName:2353b550-71e8-4fcf-aa55-a550828732ec nodeName:}" failed. No retries permitted until 2026-06-10 00:24:33.081445324 +0000 UTC m=+179.952221437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs") pod "router-default-5f5dccfcff-pbm8v" (UID: "2353b550-71e8-4fcf-aa55-a550828732ec") : secret "router-metrics-certs-default" not found
Jun 10 00:24:32.581840 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.581556    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/391f1235-4644-47de-9bfa-ce9280888777-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m7drh\" (UID: \"391f1235-4644-47de-9bfa-ce9280888777\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh"
Jun 10 00:24:32.581918 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.581892    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6cc7f6de-2406-49f6-a738-dc124c17db96-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-nv72t\" (UID: \"6cc7f6de-2406-49f6-a738-dc124c17db96\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"
Jun 10 00:24:32.583561 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.583541    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-stats-auth\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:32.583668 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.583587    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/391f1235-4644-47de-9bfa-ce9280888777-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m7drh\" (UID: \"391f1235-4644-47de-9bfa-ce9280888777\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh"
Jun 10 00:24:32.583668 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.583660    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-default-certificate\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:32.589176 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.589150    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn8cv\" (UniqueName: \"kubernetes.io/projected/391f1235-4644-47de-9bfa-ce9280888777-kube-api-access-sn8cv\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-m7drh\" (UID: \"391f1235-4644-47de-9bfa-ce9280888777\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh"
Jun 10 00:24:32.589270 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.589245    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkfhm\" (UniqueName: \"kubernetes.io/projected/2353b550-71e8-4fcf-aa55-a550828732ec-kube-api-access-xkfhm\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:32.643637 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.643610    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh"
Jun 10 00:24:32.682469 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.682434    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w4l4\" (UniqueName: \"kubernetes.io/projected/a0302622-8022-4810-b111-413d319f5d00-kube-api-access-4w4l4\") pod \"network-check-source-dbd9cf844-f2wfw\" (UID: \"a0302622-8022-4810-b111-413d319f5d00\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-f2wfw"
Jun 10 00:24:32.690409 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.690376    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w4l4\" (UniqueName: \"kubernetes.io/projected/a0302622-8022-4810-b111-413d319f5d00-kube-api-access-4w4l4\") pod \"network-check-source-dbd9cf844-f2wfw\" (UID: \"a0302622-8022-4810-b111-413d319f5d00\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-f2wfw"
Jun 10 00:24:32.742425 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.742347    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-f2wfw"
Jun 10 00:24:32.764510 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.764480    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh"]
Jun 10 00:24:32.767529 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:24:32.767499    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod391f1235_4644_47de_9bfa_ce9280888777.slice/crio-a4fdceec7543552fd26b59303ffabe95040103f33bbc51cdd310ca2cf85a2af9 WatchSource:0}: Error finding container a4fdceec7543552fd26b59303ffabe95040103f33bbc51cdd310ca2cf85a2af9: Status 404 returned error can't find the container with id a4fdceec7543552fd26b59303ffabe95040103f33bbc51cdd310ca2cf85a2af9
Jun 10 00:24:32.861730 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.861702    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-f2wfw"]
Jun 10 00:24:32.865003 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:24:32.864979    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0302622_8022_4810_b111_413d319f5d00.slice/crio-862e77e64275c55691c22400f154272f6ca11b94001720c24ab51d9bee134bbd WatchSource:0}: Error finding container 862e77e64275c55691c22400f154272f6ca11b94001720c24ab51d9bee134bbd: Status 404 returned error can't find the container with id 862e77e64275c55691c22400f154272f6ca11b94001720c24ab51d9bee134bbd
Jun 10 00:24:32.985794 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:32.985730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:32.985976 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:32.985902    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 10 00:24:32.985976 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:32.985921    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bc5df5cbf-d95tp: secret "image-registry-tls" not found
Jun 10 00:24:32.986052 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:32.985988    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls podName:6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae nodeName:}" failed. No retries permitted until 2026-06-10 00:24:33.985969468 +0000 UTC m=+180.856745581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls") pod "image-registry-5bc5df5cbf-d95tp" (UID: "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae") : secret "image-registry-tls" not found
Jun 10 00:24:33.086609 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:33.086573    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:33.086804 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:33.086620    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:33.086804 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:33.086654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nv72t\" (UID: \"6cc7f6de-2406-49f6-a738-dc124c17db96\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"
Jun 10 00:24:33.086915 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:33.086799    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle podName:2353b550-71e8-4fcf-aa55-a550828732ec nodeName:}" failed. No retries permitted until 2026-06-10 00:24:34.086776216 +0000 UTC m=+180.957552335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle") pod "router-default-5f5dccfcff-pbm8v" (UID: "2353b550-71e8-4fcf-aa55-a550828732ec") : configmap references non-existent config key: service-ca.crt
Jun 10 00:24:33.086915 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:33.086809    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 10 00:24:33.086915 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:33.086866    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs podName:2353b550-71e8-4fcf-aa55-a550828732ec nodeName:}" failed. No retries permitted until 2026-06-10 00:24:34.086854412 +0000 UTC m=+180.957630517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs") pod "router-default-5f5dccfcff-pbm8v" (UID: "2353b550-71e8-4fcf-aa55-a550828732ec") : secret "router-metrics-certs-default" not found
Jun 10 00:24:33.086915 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:33.086809    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 10 00:24:33.086915 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:33.086903    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert podName:6cc7f6de-2406-49f6-a738-dc124c17db96 nodeName:}" failed. No retries permitted until 2026-06-10 00:24:34.086896601 +0000 UTC m=+180.957672707 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-nv72t" (UID: "6cc7f6de-2406-49f6-a738-dc124c17db96") : secret "networking-console-plugin-cert" not found
Jun 10 00:24:33.239028 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:33.238995    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-f2wfw" event={"ID":"a0302622-8022-4810-b111-413d319f5d00","Type":"ContainerStarted","Data":"867a99dc698066c07eb9f2dc8ff2d621b686cae30d7e9de6622f9debdd830534"}
Jun 10 00:24:33.239511 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:33.239050    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-f2wfw" event={"ID":"a0302622-8022-4810-b111-413d319f5d00","Type":"ContainerStarted","Data":"862e77e64275c55691c22400f154272f6ca11b94001720c24ab51d9bee134bbd"}
Jun 10 00:24:33.240245 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:33.240224    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh" event={"ID":"391f1235-4644-47de-9bfa-ce9280888777","Type":"ContainerStarted","Data":"a4fdceec7543552fd26b59303ffabe95040103f33bbc51cdd310ca2cf85a2af9"}
Jun 10 00:24:33.252327 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:33.252284    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-f2wfw" podStartSLOduration=1.252270194 podStartE2EDuration="1.252270194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:24:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:24:33.252177435 +0000 UTC m=+180.122953563" watchObservedRunningTime="2026-06-10 00:24:33.252270194 +0000 UTC m=+180.123046320"
Jun 10 00:24:33.994873 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:33.994838    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:33.995050 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:33.994982    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 10 00:24:33.995050 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:33.995001    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bc5df5cbf-d95tp: secret "image-registry-tls" not found
Jun 10 00:24:33.995160 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:33.995060    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls podName:6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae nodeName:}" failed. No retries permitted until 2026-06-10 00:24:35.995044825 +0000 UTC m=+182.865820930 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls") pod "image-registry-5bc5df5cbf-d95tp" (UID: "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae") : secret "image-registry-tls" not found
Jun 10 00:24:34.095368 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:34.095330    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:34.095554 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:34.095376    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:34.095554 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:34.095421    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nv72t\" (UID: \"6cc7f6de-2406-49f6-a738-dc124c17db96\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"
Jun 10 00:24:34.095554 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:34.095507    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 10 00:24:34.095554 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:34.095508    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 10 00:24:34.095554 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:34.095526    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle podName:2353b550-71e8-4fcf-aa55-a550828732ec nodeName:}" failed. No retries permitted until 2026-06-10 00:24:36.095507439 +0000 UTC m=+182.966283547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle") pod "router-default-5f5dccfcff-pbm8v" (UID: "2353b550-71e8-4fcf-aa55-a550828732ec") : configmap references non-existent config key: service-ca.crt
Jun 10 00:24:34.095841 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:34.095578    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs podName:2353b550-71e8-4fcf-aa55-a550828732ec nodeName:}" failed. No retries permitted until 2026-06-10 00:24:36.095565542 +0000 UTC m=+182.966341659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs") pod "router-default-5f5dccfcff-pbm8v" (UID: "2353b550-71e8-4fcf-aa55-a550828732ec") : secret "router-metrics-certs-default" not found
Jun 10 00:24:34.095841 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:34.095592    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert podName:6cc7f6de-2406-49f6-a738-dc124c17db96 nodeName:}" failed. No retries permitted until 2026-06-10 00:24:36.095584244 +0000 UTC m=+182.966360364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-nv72t" (UID: "6cc7f6de-2406-49f6-a738-dc124c17db96") : secret "networking-console-plugin-cert" not found
Jun 10 00:24:35.228211 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:35.228146    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:35.326888 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:35.326852    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:36.010111 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:36.010076    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:36.010296 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:36.010223    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 10 00:24:36.010296 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:36.010239    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bc5df5cbf-d95tp: secret "image-registry-tls" not found
Jun 10 00:24:36.010401 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:36.010308    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls podName:6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae nodeName:}" failed. No retries permitted until 2026-06-10 00:24:40.010288285 +0000 UTC m=+186.881064408 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls") pod "image-registry-5bc5df5cbf-d95tp" (UID: "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae") : secret "image-registry-tls" not found
Jun 10 00:24:36.111077 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:36.111030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nv72t\" (UID: \"6cc7f6de-2406-49f6-a738-dc124c17db96\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"
Jun 10 00:24:36.111254 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:36.111149    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:36.111254 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:36.111167    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 10 00:24:36.111254 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:36.111194    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:36.111254 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:36.111243    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert podName:6cc7f6de-2406-49f6-a738-dc124c17db96 nodeName:}" failed. No retries permitted until 2026-06-10 00:24:40.111221583 +0000 UTC m=+186.981997696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-nv72t" (UID: "6cc7f6de-2406-49f6-a738-dc124c17db96") : secret "networking-console-plugin-cert" not found
Jun 10 00:24:36.111463 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:36.111299    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 10 00:24:36.111463 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:36.111348    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs podName:2353b550-71e8-4fcf-aa55-a550828732ec nodeName:}" failed. No retries permitted until 2026-06-10 00:24:40.111331744 +0000 UTC m=+186.982107852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs") pod "router-default-5f5dccfcff-pbm8v" (UID: "2353b550-71e8-4fcf-aa55-a550828732ec") : secret "router-metrics-certs-default" not found
Jun 10 00:24:36.111463 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:36.111364    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle podName:2353b550-71e8-4fcf-aa55-a550828732ec nodeName:}" failed. No retries permitted until 2026-06-10 00:24:40.111354923 +0000 UTC m=+186.982131047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle") pod "router-default-5f5dccfcff-pbm8v" (UID: "2353b550-71e8-4fcf-aa55-a550828732ec") : configmap references non-existent config key: service-ca.crt
Jun 10 00:24:37.255283 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:37.255251    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh" event={"ID":"391f1235-4644-47de-9bfa-ce9280888777","Type":"ContainerStarted","Data":"0fc38a83858c14044a606b83f1ef80ceecbb24ec4caeb2356465dfacab2d99a6"}
Jun 10 00:24:37.273042 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:37.272982    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh" podStartSLOduration=1.778419185 podStartE2EDuration="5.272963124s" totalImagesPullingTime="3.494543939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:24:37.272263288 +0000 UTC m=+184.143039415" watchObservedRunningTime="2026-06-10 00:24:37.272963124 +0000 UTC m=+184.143739251"
Jun 10 00:24:37.692594 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:37.692508    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:37.788176 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:37.788140    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:37.888817 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:37.888790    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:37.942065 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:37.942033    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:38.130938 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:38.130898    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:38.528839 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:38.528813    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:38.640334 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:38.640307    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:40.037804 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:40.037732    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:40.038217 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:40.037851    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 10 00:24:40.038217 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:40.037873    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bc5df5cbf-d95tp: secret "image-registry-tls" not found
Jun 10 00:24:40.038217 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:40.037927    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls podName:6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae nodeName:}" failed. No retries permitted until 2026-06-10 00:24:48.03791298 +0000 UTC m=+194.908689085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls") pod "image-registry-5bc5df5cbf-d95tp" (UID: "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae") : secret "image-registry-tls" not found
Jun 10 00:24:40.138688 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:40.138655    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nv72t\" (UID: \"6cc7f6de-2406-49f6-a738-dc124c17db96\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"
Jun 10 00:24:40.138897 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:40.138756    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:40.138897 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:40.138799    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:40.138897 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:40.138847    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 10 00:24:40.139046 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:40.138902    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 10 00:24:40.139046 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:40.138915    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert podName:6cc7f6de-2406-49f6-a738-dc124c17db96 nodeName:}" failed. No retries permitted until 2026-06-10 00:24:48.138895661 +0000 UTC m=+195.009671771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-nv72t" (UID: "6cc7f6de-2406-49f6-a738-dc124c17db96") : secret "networking-console-plugin-cert" not found
Jun 10 00:24:40.139046 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:40.138945    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle podName:2353b550-71e8-4fcf-aa55-a550828732ec nodeName:}" failed. No retries permitted until 2026-06-10 00:24:48.138924328 +0000 UTC m=+195.009700433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle") pod "router-default-5f5dccfcff-pbm8v" (UID: "2353b550-71e8-4fcf-aa55-a550828732ec") : configmap references non-existent config key: service-ca.crt
Jun 10 00:24:40.139046 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:40.138975    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs podName:2353b550-71e8-4fcf-aa55-a550828732ec nodeName:}" failed. No retries permitted until 2026-06-10 00:24:48.138964988 +0000 UTC m=+195.009741108 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs") pod "router-default-5f5dccfcff-pbm8v" (UID: "2353b550-71e8-4fcf-aa55-a550828732ec") : secret "router-metrics-certs-default" not found
Jun 10 00:24:40.152797 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:40.152764    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:40.253628 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:40.253592    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:40.353092 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:40.353003    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:40.850490 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:40.850460    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lv968_f9145353-43cf-472c-ba12-c3f093cfcccc/dns-node-resolver/0.log"
Jun 10 00:24:41.003710 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:41.003677    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:41.652272 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:41.652241    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6jdzv_eab4de7c-fcdc-4f58-80c0-b7607ec77386/node-ca/0.log"
Jun 10 00:24:42.139629 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:42.139591    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:42.294581 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:42.294540    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:42.394016 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:42.393917    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:42.494409 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:42.494365    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:42.618429 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:42.618392    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:42.701306 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:42.701222    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:42.838997 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:42.838952    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:42.849696 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:42.849668    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pbk85_a3b9ce6a-5198-4698-b05d-7137726b59d6/serve-healthcheck-canary/0.log"
Jun 10 00:24:43.442988 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:43.442937    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:43.451727 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:43.451690    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-m7drh_391f1235-4644-47de-9bfa-ce9280888777/kube-storage-version-migrator-operator/0.log"
Jun 10 00:24:43.544026 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:43.543987    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:44.040350 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:44.040312    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:44.436283 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:44.436196    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:44.833810 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:44.833763    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:45.035682 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:45.035648    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:45.436080 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:45.436040    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:45.839565 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:45.839527    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:46.035257 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:46.035220    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:46.367494 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:46.367459    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:46.468709 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:46.468679    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:46.891578 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:46.891543    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:47.035107 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:47.035073    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:47.234978 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:47.234887    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:47.444858 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:47.444822    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:47.838926 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:47.838892    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:48.104075 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:48.103979    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:48.106613 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:48.106580    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls\") pod \"image-registry-5bc5df5cbf-d95tp\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") " pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:48.153448 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:48.153424    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c5ppl\""
Jun 10 00:24:48.162293 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:48.162273    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:48.204584 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:48.204559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:48.204732 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:48.204605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nv72t\" (UID: \"6cc7f6de-2406-49f6-a738-dc124c17db96\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"
Jun 10 00:24:48.204732 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:48.204650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:48.204835 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:48.204774    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle podName:2353b550-71e8-4fcf-aa55-a550828732ec nodeName:}" failed. No retries permitted until 2026-06-10 00:25:04.204758432 +0000 UTC m=+211.075534561 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle") pod "router-default-5f5dccfcff-pbm8v" (UID: "2353b550-71e8-4fcf-aa55-a550828732ec") : configmap references non-existent config key: service-ca.crt
Jun 10 00:24:48.204835 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:48.204784    2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 10 00:24:48.204916 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:24:48.204839    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert podName:6cc7f6de-2406-49f6-a738-dc124c17db96 nodeName:}" failed. No retries permitted until 2026-06-10 00:25:04.204821011 +0000 UTC m=+211.075597117 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-nv72t" (UID: "6cc7f6de-2406-49f6-a738-dc124c17db96") : secret "networking-console-plugin-cert" not found
Jun 10 00:24:48.207170 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:48.207149    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2353b550-71e8-4fcf-aa55-a550828732ec-metrics-certs\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:24:48.291234 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:48.291200    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bc5df5cbf-d95tp"]
Jun 10 00:24:48.295193 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:24:48.295162    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6809c5d9_5ece_43f7_a25f_0b14e8b8e1ae.slice/crio-19384706fc2a0a884688fdfdd67c586b1c9a4a8a8821fb33d0326ab773c05409 WatchSource:0}: Error finding container 19384706fc2a0a884688fdfdd67c586b1c9a4a8a8821fb33d0326ab773c05409: Status 404 returned error can't find the container with id 19384706fc2a0a884688fdfdd67c586b1c9a4a8a8821fb33d0326ab773c05409
Jun 10 00:24:48.433484 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:48.433397    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:48.717369 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:48.717281    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:49.037410 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:49.037374    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:49.243107 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:49.243066    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:49.290635 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:49.290545    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp" event={"ID":"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae","Type":"ContainerStarted","Data":"e5c9819cc4da9f2fb488ceeabc06dad96140486b3ffc7b4e0f4ed3bcaadfd8a8"}
Jun 10 00:24:49.290635 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:49.290591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp" event={"ID":"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae","Type":"ContainerStarted","Data":"19384706fc2a0a884688fdfdd67c586b1c9a4a8a8821fb33d0326ab773c05409"}
Jun 10 00:24:49.290635 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:49.290619    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:24:49.308654 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:49.308610    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp" podStartSLOduration=17.308596363 podStartE2EDuration="17.308596363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:24:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:24:49.307779375 +0000 UTC m=+196.178555503" watchObservedRunningTime="2026-06-10 00:24:49.308596363 +0000 UTC m=+196.179372490"
Jun 10 00:24:49.436478 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:49.436446    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:49.634189 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:49.634103    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:50.637494 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:50.637466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:50.794077 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:50.794034    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:51.037635 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:51.037602    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:51.237728 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:51.237695    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:51.434148 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:51.434025    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:51.639132 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:51.639093    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:52.432258 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:52.432226    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:52.637307 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:52.637270    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:52.837761 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:52.837678    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:59.484862 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.484821    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-njcff"]
Jun 10 00:24:59.490174 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.490151    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.493086 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.493065    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 10 00:24:59.493942 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.493923    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 10 00:24:59.494153 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.494140    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 10 00:24:59.494274 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.494257    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8qttn\""
Jun 10 00:24:59.495213 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.495198    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 10 00:24:59.500289 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.500270    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-njcff"]
Jun 10 00:24:59.583673 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.583635    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bc5df5cbf-d95tp"]
Jun 10 00:24:59.589631 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.589601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b037bc7a-8ab0-4489-8c80-aa1153c7b69a-data-volume\") pod \"insights-runtime-extractor-njcff\" (UID: \"b037bc7a-8ab0-4489-8c80-aa1153c7b69a\") " pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.589631 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.589634    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b037bc7a-8ab0-4489-8c80-aa1153c7b69a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-njcff\" (UID: \"b037bc7a-8ab0-4489-8c80-aa1153c7b69a\") " pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.589883 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.589714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b037bc7a-8ab0-4489-8c80-aa1153c7b69a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njcff\" (UID: \"b037bc7a-8ab0-4489-8c80-aa1153c7b69a\") " pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.589883 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.589798    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b037bc7a-8ab0-4489-8c80-aa1153c7b69a-crio-socket\") pod \"insights-runtime-extractor-njcff\" (UID: \"b037bc7a-8ab0-4489-8c80-aa1153c7b69a\") " pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.589883 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.589831    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq77q\" (UniqueName: \"kubernetes.io/projected/b037bc7a-8ab0-4489-8c80-aa1153c7b69a-kube-api-access-nq77q\") pod \"insights-runtime-extractor-njcff\" (UID: \"b037bc7a-8ab0-4489-8c80-aa1153c7b69a\") " pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.655245 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.655212    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:59.691190 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.691153    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b037bc7a-8ab0-4489-8c80-aa1153c7b69a-data-volume\") pod \"insights-runtime-extractor-njcff\" (UID: \"b037bc7a-8ab0-4489-8c80-aa1153c7b69a\") " pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.691335 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.691200    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b037bc7a-8ab0-4489-8c80-aa1153c7b69a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-njcff\" (UID: \"b037bc7a-8ab0-4489-8c80-aa1153c7b69a\") " pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.691335 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.691239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b037bc7a-8ab0-4489-8c80-aa1153c7b69a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njcff\" (UID: \"b037bc7a-8ab0-4489-8c80-aa1153c7b69a\") " pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.691335 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.691268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b037bc7a-8ab0-4489-8c80-aa1153c7b69a-crio-socket\") pod \"insights-runtime-extractor-njcff\" (UID: \"b037bc7a-8ab0-4489-8c80-aa1153c7b69a\") " pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.691335 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.691319    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq77q\" (UniqueName: \"kubernetes.io/projected/b037bc7a-8ab0-4489-8c80-aa1153c7b69a-kube-api-access-nq77q\") pod \"insights-runtime-extractor-njcff\" (UID: \"b037bc7a-8ab0-4489-8c80-aa1153c7b69a\") " pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.691560 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.691388    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b037bc7a-8ab0-4489-8c80-aa1153c7b69a-crio-socket\") pod \"insights-runtime-extractor-njcff\" (UID: \"b037bc7a-8ab0-4489-8c80-aa1153c7b69a\") " pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.691560 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.691536    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b037bc7a-8ab0-4489-8c80-aa1153c7b69a-data-volume\") pod \"insights-runtime-extractor-njcff\" (UID: \"b037bc7a-8ab0-4489-8c80-aa1153c7b69a\") " pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.692104 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.692087    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b037bc7a-8ab0-4489-8c80-aa1153c7b69a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-njcff\" (UID: \"b037bc7a-8ab0-4489-8c80-aa1153c7b69a\") " pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.693662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.693643    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b037bc7a-8ab0-4489-8c80-aa1153c7b69a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njcff\" (UID: \"b037bc7a-8ab0-4489-8c80-aa1153c7b69a\") " pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.699068 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.699048    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq77q\" (UniqueName: \"kubernetes.io/projected/b037bc7a-8ab0-4489-8c80-aa1153c7b69a-kube-api-access-nq77q\") pod \"insights-runtime-extractor-njcff\" (UID: \"b037bc7a-8ab0-4489-8c80-aa1153c7b69a\") " pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.755071 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.755049    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:24:59.799290 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.799262    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-njcff"
Jun 10 00:24:59.922893 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:24:59.922863    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-njcff"]
Jun 10 00:24:59.926065 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:24:59.926038    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb037bc7a_8ab0_4489_8c80_aa1153c7b69a.slice/crio-7188dc711e0935c75eb7eb36af9c85c16382efed8c052289a4a09954e2b999ee WatchSource:0}: Error finding container 7188dc711e0935c75eb7eb36af9c85c16382efed8c052289a4a09954e2b999ee: Status 404 returned error can't find the container with id 7188dc711e0935c75eb7eb36af9c85c16382efed8c052289a4a09954e2b999ee
Jun 10 00:25:00.325851 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:00.325817    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-njcff" event={"ID":"b037bc7a-8ab0-4489-8c80-aa1153c7b69a","Type":"ContainerStarted","Data":"ca2b6e2f58b67f5678013c212199fee6427304c87d3a3ace3699d537b12761af"}
Jun 10 00:25:00.326017 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:00.325871    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-njcff" event={"ID":"b037bc7a-8ab0-4489-8c80-aa1153c7b69a","Type":"ContainerStarted","Data":"7188dc711e0935c75eb7eb36af9c85c16382efed8c052289a4a09954e2b999ee"}
Jun 10 00:25:01.330434 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:01.330400    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-njcff" event={"ID":"b037bc7a-8ab0-4489-8c80-aa1153c7b69a","Type":"ContainerStarted","Data":"4681095396a832fde4740b66bb4647ca8da3b45d7522a50693178db60843cec8"}
Jun 10 00:25:02.334954 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:02.334917    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-njcff" event={"ID":"b037bc7a-8ab0-4489-8c80-aa1153c7b69a","Type":"ContainerStarted","Data":"717e273741016cb8a30ba95bc0997654f740181dad4e83c07243cb4df5e17083"}
Jun 10 00:25:02.350345 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:02.350289    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-njcff" podStartSLOduration=1.2770913099999999 podStartE2EDuration="3.350273539s" totalImagesPullingTime="2.073182229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:24:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:02.349887988 +0000 UTC m=+209.220664115" watchObservedRunningTime="2026-06-10 00:25:02.350273539 +0000 UTC m=+209.221049668"
Jun 10 00:25:03.831313 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:03.831274    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:03.878460 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:03.878430    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:04.224865 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:04.224731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:25:04.224865 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:04.224837    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nv72t\" (UID: \"6cc7f6de-2406-49f6-a738-dc124c17db96\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"
Jun 10 00:25:04.225450 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:04.225420    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2353b550-71e8-4fcf-aa55-a550828732ec-service-ca-bundle\") pod \"router-default-5f5dccfcff-pbm8v\" (UID: \"2353b550-71e8-4fcf-aa55-a550828732ec\") " pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:25:04.227295 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:04.227276    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6cc7f6de-2406-49f6-a738-dc124c17db96-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nv72t\" (UID: \"6cc7f6de-2406-49f6-a738-dc124c17db96\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"
Jun 10 00:25:04.454400 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:04.454363    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rmhkm\""
Jun 10 00:25:04.460190 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:04.460167    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qr6ls\""
Jun 10 00:25:04.461721 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:04.461707    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"
Jun 10 00:25:04.469013 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:04.468993    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:25:04.599225 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:04.599192    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t"]
Jun 10 00:25:04.602893 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:25:04.602867    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc7f6de_2406_49f6_a738_dc124c17db96.slice/crio-5881e7840c883f1e10b554ede76a34e1f3e2ece3b1b614fc91ee2ee136df10bd WatchSource:0}: Error finding container 5881e7840c883f1e10b554ede76a34e1f3e2ece3b1b614fc91ee2ee136df10bd: Status 404 returned error can't find the container with id 5881e7840c883f1e10b554ede76a34e1f3e2ece3b1b614fc91ee2ee136df10bd
Jun 10 00:25:04.616564 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:04.616540    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f5dccfcff-pbm8v"]
Jun 10 00:25:04.619649 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:25:04.619624    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2353b550_71e8_4fcf_aa55_a550828732ec.slice/crio-7283f30827cf7ade80151006580df93720f130a959960892454f4d368ef131d6 WatchSource:0}: Error finding container 7283f30827cf7ade80151006580df93720f130a959960892454f4d368ef131d6: Status 404 returned error can't find the container with id 7283f30827cf7ade80151006580df93720f130a959960892454f4d368ef131d6
Jun 10 00:25:05.345685 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:05.345651    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f5dccfcff-pbm8v" event={"ID":"2353b550-71e8-4fcf-aa55-a550828732ec","Type":"ContainerStarted","Data":"d035bd946831fa67a6bd2523b3ba07b958d879de6b2b5d8bb93287485b1e8d78"}
Jun 10 00:25:05.346144 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:05.345704    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f5dccfcff-pbm8v" event={"ID":"2353b550-71e8-4fcf-aa55-a550828732ec","Type":"ContainerStarted","Data":"7283f30827cf7ade80151006580df93720f130a959960892454f4d368ef131d6"}
Jun 10 00:25:05.346795 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:05.346770    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t" event={"ID":"6cc7f6de-2406-49f6-a738-dc124c17db96","Type":"ContainerStarted","Data":"5881e7840c883f1e10b554ede76a34e1f3e2ece3b1b614fc91ee2ee136df10bd"}
Jun 10 00:25:05.364286 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:05.364247    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5f5dccfcff-pbm8v" podStartSLOduration=33.364235097 podStartE2EDuration="33.364235097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:24:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:05.362992974 +0000 UTC m=+212.233769113" watchObservedRunningTime="2026-06-10 00:25:05.364235097 +0000 UTC m=+212.235011223"
Jun 10 00:25:05.469623 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:05.469594    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:25:05.472557 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:05.472532    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:25:06.351574 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:06.351531    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t" event={"ID":"6cc7f6de-2406-49f6-a738-dc124c17db96","Type":"ContainerStarted","Data":"d8c11d82bbf16214943d55567cdcf15dfeb0be164c15a899c97f32af634944e5"}
Jun 10 00:25:06.352079 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:06.351831    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:25:06.352904 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:06.352886    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5f5dccfcff-pbm8v"
Jun 10 00:25:06.365934 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:06.365892    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nv72t" podStartSLOduration=33.147182713 podStartE2EDuration="34.36587779s" totalImagesPullingTime="1.218695077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:06.364790878 +0000 UTC m=+213.235567008" watchObservedRunningTime="2026-06-10 00:25:06.36587779 +0000 UTC m=+213.236653911"
Jun 10 00:25:06.455669 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:06.455627    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:06.556007 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:06.555972    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:06.604682 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:06.604590    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:07.101794 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:07.101729    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:07.197918 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:07.197881    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:07.258717 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:07.258688    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnrp"]
Jun 10 00:25:07.259149 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:07.259109    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:07.262019 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:07.262004    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnrp"
Jun 10 00:25:07.264381 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:07.264366    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jun 10 00:25:07.264470 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:07.264436    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kz5k9\""
Jun 10 00:25:07.271051 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:07.271024    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnrp"]
Jun 10 00:25:07.352254 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:07.352152    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2824e107-94db-41c1-b117-08b90a31e2ab-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-9pnrp\" (UID: \"2824e107-94db-41c1-b117-08b90a31e2ab\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnrp"
Jun 10 00:25:07.453401 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:07.453162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2824e107-94db-41c1-b117-08b90a31e2ab-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-9pnrp\" (UID: \"2824e107-94db-41c1-b117-08b90a31e2ab\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnrp"
Jun 10 00:25:07.453401 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:25:07.453286    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jun 10 00:25:07.453401 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:25:07.453358    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2824e107-94db-41c1-b117-08b90a31e2ab-tls-certificates podName:2824e107-94db-41c1-b117-08b90a31e2ab nodeName:}" failed. No retries permitted until 2026-06-10 00:25:07.953335646 +0000 UTC m=+214.824111769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2824e107-94db-41c1-b117-08b90a31e2ab-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-9pnrp" (UID: "2824e107-94db-41c1-b117-08b90a31e2ab") : secret "prometheus-operator-admission-webhook-tls" not found
Jun 10 00:25:07.570265 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:07.570233    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:07.957887 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:07.957847    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2824e107-94db-41c1-b117-08b90a31e2ab-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-9pnrp\" (UID: \"2824e107-94db-41c1-b117-08b90a31e2ab\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnrp"
Jun 10 00:25:07.960388 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:07.960364    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2824e107-94db-41c1-b117-08b90a31e2ab-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-9pnrp\" (UID: \"2824e107-94db-41c1-b117-08b90a31e2ab\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnrp"
Jun 10 00:25:08.171328 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:08.171298    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnrp"
Jun 10 00:25:08.293941 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:08.293911    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnrp"]
Jun 10 00:25:08.297298 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:25:08.297269    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2824e107_94db_41c1_b117_08b90a31e2ab.slice/crio-c760336998db59c4ee037d90bde59e10136687707cd1b44f26b858792f92c58f WatchSource:0}: Error finding container c760336998db59c4ee037d90bde59e10136687707cd1b44f26b858792f92c58f: Status 404 returned error can't find the container with id c760336998db59c4ee037d90bde59e10136687707cd1b44f26b858792f92c58f
Jun 10 00:25:08.359217 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:08.359178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnrp" event={"ID":"2824e107-94db-41c1-b117-08b90a31e2ab","Type":"ContainerStarted","Data":"c760336998db59c4ee037d90bde59e10136687707cd1b44f26b858792f92c58f"}
Jun 10 00:25:09.589625 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:09.589531    2560 patch_prober.go:28] interesting pod/image-registry-5bc5df5cbf-d95tp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 10 00:25:09.589625 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:09.589588    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp" podUID="6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 10 00:25:10.366666 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:10.366628    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnrp" event={"ID":"2824e107-94db-41c1-b117-08b90a31e2ab","Type":"ContainerStarted","Data":"577af7386c287b00c674f2f528f672ca5989d0ab85de22b4ff6681989eba59e3"}
Jun 10 00:25:10.366988 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:10.366777    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnrp"
Jun 10 00:25:10.371376 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:10.371353    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnrp"
Jun 10 00:25:10.380975 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:10.380698    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-9pnrp" podStartSLOduration=2.363735867 podStartE2EDuration="3.380682213s" totalImagesPullingTime="1.016946346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:10.380146063 +0000 UTC m=+217.250922190" watchObservedRunningTime="2026-06-10 00:25:10.380682213 +0000 UTC m=+217.251458341"
Jun 10 00:25:11.285631 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:11.285599    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:11.386494 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:11.386458    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:11.582721 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:11.582631    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:14.167586 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:14.167547    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:16.410553 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.410521    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:16.515383 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.515350    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:16.622236 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.622180    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:16.642351 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.642321    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"]
Jun 10 00:25:16.645767 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.645732    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"
Jun 10 00:25:16.647934 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.647914    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jun 10 00:25:16.648211 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.648186    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 10 00:25:16.648317 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.648231    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jun 10 00:25:16.648317 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.648256    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 10 00:25:16.648947 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.648929    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-cjr8x\""
Jun 10 00:25:16.649040 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.649001    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 10 00:25:16.654535 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.654516    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"]
Jun 10 00:25:16.661088 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.661038    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"]
Jun 10 00:25:16.663870 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.663848    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.664899 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.664881    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9jx59"]
Jun 10 00:25:16.666345 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.666328    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jun 10 00:25:16.666445 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.666422    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jun 10 00:25:16.666445 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.666439    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jun 10 00:25:16.666544 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.666458    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7qd4p\""
Jun 10 00:25:16.667804 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.667787    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.670015 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.669997    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 10 00:25:16.670235 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.670214    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 10 00:25:16.670434 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.670418    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 10 00:25:16.670700 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.670639    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-45hv7\""
Jun 10 00:25:16.677559 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.677538    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"]
Jun 10 00:25:16.700113 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.700082    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:16.722001 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.721970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.722121 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/453e7b09-69c7-424c-8f3d-ce0a046e172f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.722121 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722034    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9ccd\" (UniqueName: \"kubernetes.io/projected/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-kube-api-access-t9ccd\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.722121 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722058    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/453e7b09-69c7-424c-8f3d-ce0a046e172f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.722121 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-root\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.722268 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/453e7b09-69c7-424c-8f3d-ce0a046e172f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.722268 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722140    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d33ba09-ee5e-4fbf-877e-c27e6a946215-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-4l2df\" (UID: \"8d33ba09-ee5e-4fbf-877e-c27e6a946215\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"
Jun 10 00:25:16.722268 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722154    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2s54\" (UniqueName: \"kubernetes.io/projected/453e7b09-69c7-424c-8f3d-ce0a046e172f-kube-api-access-n2s54\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.722268 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722198    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-tls\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.722268 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722216    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-wtmp\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.722268 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722255    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/453e7b09-69c7-424c-8f3d-ce0a046e172f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.722514 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d33ba09-ee5e-4fbf-877e-c27e6a946215-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-4l2df\" (UID: \"8d33ba09-ee5e-4fbf-877e-c27e6a946215\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"
Jun 10 00:25:16.722514 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722307    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d33ba09-ee5e-4fbf-877e-c27e6a946215-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-4l2df\" (UID: \"8d33ba09-ee5e-4fbf-877e-c27e6a946215\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"
Jun 10 00:25:16.722514 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722338    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-sys\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.722514 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722366    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-metrics-client-ca\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.722514 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722385    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7bkt\" (UniqueName: \"kubernetes.io/projected/8d33ba09-ee5e-4fbf-877e-c27e6a946215-kube-api-access-b7bkt\") pod \"openshift-state-metrics-65f78d5c66-4l2df\" (UID: \"8d33ba09-ee5e-4fbf-877e-c27e6a946215\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"
Jun 10 00:25:16.722514 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-accelerators-collector-config\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.722514 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-textfile\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.722514 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.722452    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/453e7b09-69c7-424c-8f3d-ce0a046e172f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.766679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.766648    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:16.822979 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.822946    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-textfile\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.823139 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.822982    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/453e7b09-69c7-424c-8f3d-ce0a046e172f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.823139 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823015    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.823139 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823042    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/453e7b09-69c7-424c-8f3d-ce0a046e172f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.823139 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9ccd\" (UniqueName: \"kubernetes.io/projected/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-kube-api-access-t9ccd\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.823139 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/453e7b09-69c7-424c-8f3d-ce0a046e172f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.823373 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-root\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.823373 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823190    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/453e7b09-69c7-424c-8f3d-ce0a046e172f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.823373 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823215    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d33ba09-ee5e-4fbf-877e-c27e6a946215-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-4l2df\" (UID: \"8d33ba09-ee5e-4fbf-877e-c27e6a946215\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"
Jun 10 00:25:16.823373 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823238    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2s54\" (UniqueName: \"kubernetes.io/projected/453e7b09-69c7-424c-8f3d-ce0a046e172f-kube-api-access-n2s54\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.823373 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823268    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-root\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.823373 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823290    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-tls\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.823373 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823343    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-wtmp\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.823373 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823348    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-textfile\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.823373 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:25:16.823363    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jun 10 00:25:16.823840 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/453e7b09-69c7-424c-8f3d-ce0a046e172f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.823840 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823407    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/453e7b09-69c7-424c-8f3d-ce0a046e172f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.823840 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:25:16.823423    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-tls podName:d8eb2989-c5ec-4e12-b619-c1d9dec1fa48 nodeName:}" failed. No retries permitted until 2026-06-10 00:25:17.323401553 +0000 UTC m=+224.194177658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-tls") pod "node-exporter-9jx59" (UID: "d8eb2989-c5ec-4e12-b619-c1d9dec1fa48") : secret "node-exporter-tls" not found
Jun 10 00:25:16.823840 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d33ba09-ee5e-4fbf-877e-c27e6a946215-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-4l2df\" (UID: \"8d33ba09-ee5e-4fbf-877e-c27e6a946215\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"
Jun 10 00:25:16.823840 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:25:16.823545    2560 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jun 10 00:25:16.823840 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823566    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-wtmp\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.823840 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:25:16.823596    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/453e7b09-69c7-424c-8f3d-ce0a046e172f-kube-state-metrics-tls podName:453e7b09-69c7-424c-8f3d-ce0a046e172f nodeName:}" failed. No retries permitted until 2026-06-10 00:25:17.323579034 +0000 UTC m=+224.194355146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/453e7b09-69c7-424c-8f3d-ce0a046e172f-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-v92ft" (UID: "453e7b09-69c7-424c-8f3d-ce0a046e172f") : secret "kube-state-metrics-tls" not found
Jun 10 00:25:16.824220 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823851    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d33ba09-ee5e-4fbf-877e-c27e6a946215-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-4l2df\" (UID: \"8d33ba09-ee5e-4fbf-877e-c27e6a946215\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"
Jun 10 00:25:16.824220 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.823992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-sys\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.824220 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.824020    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-metrics-client-ca\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.824220 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.824049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7bkt\" (UniqueName: \"kubernetes.io/projected/8d33ba09-ee5e-4fbf-877e-c27e6a946215-kube-api-access-b7bkt\") pod \"openshift-state-metrics-65f78d5c66-4l2df\" (UID: \"8d33ba09-ee5e-4fbf-877e-c27e6a946215\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"
Jun 10 00:25:16.824220 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.824056    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/453e7b09-69c7-424c-8f3d-ce0a046e172f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.824220 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.824081    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-accelerators-collector-config\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.824220 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.824132    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-sys\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.824220 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:25:16.824209    2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jun 10 00:25:16.824818 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.824238    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/453e7b09-69c7-424c-8f3d-ce0a046e172f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.824818 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:25:16.824263    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d33ba09-ee5e-4fbf-877e-c27e6a946215-openshift-state-metrics-tls podName:8d33ba09-ee5e-4fbf-877e-c27e6a946215 nodeName:}" failed. No retries permitted until 2026-06-10 00:25:17.324247796 +0000 UTC m=+224.195023902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8d33ba09-ee5e-4fbf-877e-c27e6a946215-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-4l2df" (UID: "8d33ba09-ee5e-4fbf-877e-c27e6a946215") : secret "openshift-state-metrics-tls" not found
Jun 10 00:25:16.824818 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.824320    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d33ba09-ee5e-4fbf-877e-c27e6a946215-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-4l2df\" (UID: \"8d33ba09-ee5e-4fbf-877e-c27e6a946215\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"
Jun 10 00:25:16.824818 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.824676    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-metrics-client-ca\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.824818 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.824698    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-accelerators-collector-config\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.825685 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.825661    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.826020 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.826002    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/453e7b09-69c7-424c-8f3d-ce0a046e172f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.826129 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.826113    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d33ba09-ee5e-4fbf-877e-c27e6a946215-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-4l2df\" (UID: \"8d33ba09-ee5e-4fbf-877e-c27e6a946215\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"
Jun 10 00:25:16.832023 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.832001    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9ccd\" (UniqueName: \"kubernetes.io/projected/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-kube-api-access-t9ccd\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:16.832162 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.832113    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2s54\" (UniqueName: \"kubernetes.io/projected/453e7b09-69c7-424c-8f3d-ce0a046e172f-kube-api-access-n2s54\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:16.832341 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.832315    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7bkt\" (UniqueName: \"kubernetes.io/projected/8d33ba09-ee5e-4fbf-877e-c27e6a946215-kube-api-access-b7bkt\") pod \"openshift-state-metrics-65f78d5c66-4l2df\" (UID: \"8d33ba09-ee5e-4fbf-877e-c27e6a946215\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"
Jun 10 00:25:16.997768 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:16.997635    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:17.104166 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.104127    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:17.198602 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.198571    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:17.246551 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.246521    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:17.329592 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.329561    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/453e7b09-69c7-424c-8f3d-ce0a046e172f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:17.329789 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.329610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-tls\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:17.329789 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.329640    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d33ba09-ee5e-4fbf-877e-c27e6a946215-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-4l2df\" (UID: \"8d33ba09-ee5e-4fbf-877e-c27e6a946215\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"
Jun 10 00:25:17.332180 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.332152    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/453e7b09-69c7-424c-8f3d-ce0a046e172f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-v92ft\" (UID: \"453e7b09-69c7-424c-8f3d-ce0a046e172f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:17.332283 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.332201    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d33ba09-ee5e-4fbf-877e-c27e6a946215-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-4l2df\" (UID: \"8d33ba09-ee5e-4fbf-877e-c27e6a946215\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"
Jun 10 00:25:17.332283 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.332201    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8eb2989-c5ec-4e12-b619-c1d9dec1fa48-node-exporter-tls\") pod \"node-exporter-9jx59\" (UID: \"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48\") " pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:17.480057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.480010    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:17.555306 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.555269    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"
Jun 10 00:25:17.573644 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.573621    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"
Jun 10 00:25:17.579544 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.579525    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9jx59"
Jun 10 00:25:17.580731 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.580673    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:17.591677 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:25:17.591651    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8eb2989_c5ec_4e12_b619_c1d9dec1fa48.slice/crio-13cb5d5d93a784ed6b80a7cc06f06bd87fd735a1c00d179e7a54a2a7fa1564d6 WatchSource:0}: Error finding container 13cb5d5d93a784ed6b80a7cc06f06bd87fd735a1c00d179e7a54a2a7fa1564d6: Status 404 returned error can't find the container with id 13cb5d5d93a784ed6b80a7cc06f06bd87fd735a1c00d179e7a54a2a7fa1564d6
Jun 10 00:25:17.683004 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.682459    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:17.719999 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.719365    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 00:25:17.724133 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.724114    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df"]
Jun 10 00:25:17.724278 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.724262    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.725430 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:25:17.725402    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d33ba09_ee5e_4fbf_877e_c27e6a946215.slice/crio-3fe4b44494a18f77007983fca96eda6fd21fddd99c9f0500718837d49df3f661 WatchSource:0}: Error finding container 3fe4b44494a18f77007983fca96eda6fd21fddd99c9f0500718837d49df3f661: Status 404 returned error can't find the container with id 3fe4b44494a18f77007983fca96eda6fd21fddd99c9f0500718837d49df3f661
Jun 10 00:25:17.726427 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.726410    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 10 00:25:17.726664 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.726649    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 10 00:25:17.726998 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.726975    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 10 00:25:17.727136 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.727004    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 10 00:25:17.727136 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.727010    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4mfh6\""
Jun 10 00:25:17.727136 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.727065    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 10 00:25:17.727136 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.727131    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 10 00:25:17.727451 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.727340    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 10 00:25:17.727451 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.727350    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 10 00:25:17.727451 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.727339    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 10 00:25:17.733315 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.733250    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft"]
Jun 10 00:25:17.735301 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.735279    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 00:25:17.736917 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:25:17.736895    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453e7b09_69c7_424c_8f3d_ce0a046e172f.slice/crio-b8a6ef8118353e8e5918eeb97ba44d00d835cd4872dc5fc7f67c2125d8f7095d WatchSource:0}: Error finding container b8a6ef8118353e8e5918eeb97ba44d00d835cd4872dc5fc7f67c2125d8f7095d: Status 404 returned error can't find the container with id b8a6ef8118353e8e5918eeb97ba44d00d835cd4872dc5fc7f67c2125d8f7095d
Jun 10 00:25:17.755532 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.755466    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:17.834552 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.834482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f69fa56-543d-44ce-972d-8e91c512d1f5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.834552 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.834523    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.834552 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.834545    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-web-config\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.834843 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.834569    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f69fa56-543d-44ce-972d-8e91c512d1f5-config-out\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.834843 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.834591    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f69fa56-543d-44ce-972d-8e91c512d1f5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.834843 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.834640    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.834843 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.834664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.834843 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.834705    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f69fa56-543d-44ce-972d-8e91c512d1f5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.834843 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.834765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.834843 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.834789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f69fa56-543d-44ce-972d-8e91c512d1f5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.834843 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.834817    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.834843 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.834837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.835305 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.834908    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjcqz\" (UniqueName: \"kubernetes.io/projected/5f69fa56-543d-44ce-972d-8e91c512d1f5-kube-api-access-rjcqz\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.883071 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.883038    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:17.935701 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.935669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.935701 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.935700    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.935902 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.935772    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjcqz\" (UniqueName: \"kubernetes.io/projected/5f69fa56-543d-44ce-972d-8e91c512d1f5-kube-api-access-rjcqz\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.935902 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.935792    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f69fa56-543d-44ce-972d-8e91c512d1f5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.935902 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.935826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.935902 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.935878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-web-config\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.936073 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.935912    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f69fa56-543d-44ce-972d-8e91c512d1f5-config-out\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.936073 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.935938    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f69fa56-543d-44ce-972d-8e91c512d1f5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.936473 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.936184    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.936473 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.936243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.936473 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.936277    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f69fa56-543d-44ce-972d-8e91c512d1f5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.936473 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.936332    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.936473 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.936384    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f69fa56-543d-44ce-972d-8e91c512d1f5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.937508 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.936999    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f69fa56-543d-44ce-972d-8e91c512d1f5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.937696 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.937671    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f69fa56-543d-44ce-972d-8e91c512d1f5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.938567 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.938491    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f69fa56-543d-44ce-972d-8e91c512d1f5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.939417 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.939352    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-web-config\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.939417 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.939419    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.939733 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.939696    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f69fa56-543d-44ce-972d-8e91c512d1f5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.939936 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.939916    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.940117 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.940097    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.940165 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.940122    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.940956 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.940921    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.941164 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.941147    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f69fa56-543d-44ce-972d-8e91c512d1f5-config-out\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.941397 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.941368    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:17.943262 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:17.943241    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjcqz\" (UniqueName: \"kubernetes.io/projected/5f69fa56-543d-44ce-972d-8e91c512d1f5-kube-api-access-rjcqz\") pod \"alertmanager-main-0\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:18.035806 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.035778    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:25:18.186550 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.186520    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 00:25:18.189467 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:25:18.189436    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f69fa56_543d_44ce_972d_8e91c512d1f5.slice/crio-6596901c372518b834d5d511cec8eddc2577a5bc1659c271093509d7bc59c96a WatchSource:0}: Error finding container 6596901c372518b834d5d511cec8eddc2577a5bc1659c271093509d7bc59c96a: Status 404 returned error can't find the container with id 6596901c372518b834d5d511cec8eddc2577a5bc1659c271093509d7bc59c96a
Jun 10 00:25:18.400672 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.400578    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f69fa56-543d-44ce-972d-8e91c512d1f5","Type":"ContainerStarted","Data":"6596901c372518b834d5d511cec8eddc2577a5bc1659c271093509d7bc59c96a"}
Jun 10 00:25:18.402219 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.402127    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9jx59" event={"ID":"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48","Type":"ContainerStarted","Data":"13cb5d5d93a784ed6b80a7cc06f06bd87fd735a1c00d179e7a54a2a7fa1564d6"}
Jun 10 00:25:18.403807 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.403779    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft" event={"ID":"453e7b09-69c7-424c-8f3d-ce0a046e172f","Type":"ContainerStarted","Data":"b8a6ef8118353e8e5918eeb97ba44d00d835cd4872dc5fc7f67c2125d8f7095d"}
Jun 10 00:25:18.406121 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.406084    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df" event={"ID":"8d33ba09-ee5e-4fbf-877e-c27e6a946215","Type":"ContainerStarted","Data":"471931d05741d110401e1a3e8614a1403fdf08170cee1d1ccf0d402d7077b43c"}
Jun 10 00:25:18.406236 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.406142    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df" event={"ID":"8d33ba09-ee5e-4fbf-877e-c27e6a946215","Type":"ContainerStarted","Data":"79e5a8d847ccc772c4f24b0ff093b8b62f013a20a3034efffa47ed9591486751"}
Jun 10 00:25:18.406236 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.406164    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df" event={"ID":"8d33ba09-ee5e-4fbf-877e-c27e6a946215","Type":"ContainerStarted","Data":"3fe4b44494a18f77007983fca96eda6fd21fddd99c9f0500718837d49df3f661"}
Jun 10 00:25:18.639304 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.639274    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-bf75bb48d-zd77x"]
Jun 10 00:25:18.643242 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.643221    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.645550 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.645523    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 10 00:25:18.645550 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.645539    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 10 00:25:18.645811 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.645794    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 10 00:25:18.646235 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.646040    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 10 00:25:18.646235 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.646103    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-m6z7k\""
Jun 10 00:25:18.646235 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.646137    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 10 00:25:18.646235 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.646219    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c1pgjfaplik17\""
Jun 10 00:25:18.660633 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.660203    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-bf75bb48d-zd77x"]
Jun 10 00:25:18.744691 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.744652    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsrs6\" (UniqueName: \"kubernetes.io/projected/4044affd-3609-4a6f-9180-1e6b9b84bcf5-kube-api-access-nsrs6\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.744915 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.744721    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-thanos-querier-tls\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.744915 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.744805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.744915 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.744835    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4044affd-3609-4a6f-9180-1e6b9b84bcf5-metrics-client-ca\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.744915 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.744858    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-grpc-tls\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.744915 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.744886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.745231 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.744922    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.745231 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.745014    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.846313 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.846276    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.846508 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.846329    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.846508 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.846379    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.846508 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.846462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsrs6\" (UniqueName: \"kubernetes.io/projected/4044affd-3609-4a6f-9180-1e6b9b84bcf5-kube-api-access-nsrs6\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.846697 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.846515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-thanos-querier-tls\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.846697 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.846551    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.846697 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.846595    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4044affd-3609-4a6f-9180-1e6b9b84bcf5-metrics-client-ca\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.846697 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.846623    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-grpc-tls\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.847583 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.847526    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4044affd-3609-4a6f-9180-1e6b9b84bcf5-metrics-client-ca\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.849801 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.849723    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.850018 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.849972    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.850959 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.850911    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-grpc-tls\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.851170 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.851144    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-thanos-querier-tls\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.851917 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.851864    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.852556 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.852189    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4044affd-3609-4a6f-9180-1e6b9b84bcf5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.855031 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.854990    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsrs6\" (UniqueName: \"kubernetes.io/projected/4044affd-3609-4a6f-9180-1e6b9b84bcf5-kube-api-access-nsrs6\") pod \"thanos-querier-bf75bb48d-zd77x\" (UID: \"4044affd-3609-4a6f-9180-1e6b9b84bcf5\") " pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:18.955093 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:18.955005    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:19.135801 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:19.135734    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-bf75bb48d-zd77x"]
Jun 10 00:25:19.140276 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:25:19.140232    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4044affd_3609_4a6f_9180_1e6b9b84bcf5.slice/crio-fe5be687eacf63a752b2f442aa9facb03caff9b74b34d013247bcbc0d924ca93 WatchSource:0}: Error finding container fe5be687eacf63a752b2f442aa9facb03caff9b74b34d013247bcbc0d924ca93: Status 404 returned error can't find the container with id fe5be687eacf63a752b2f442aa9facb03caff9b74b34d013247bcbc0d924ca93
Jun 10 00:25:19.411324 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:19.411292    2560 generic.go:356] "Generic (PLEG): container finished" podID="d8eb2989-c5ec-4e12-b619-c1d9dec1fa48" containerID="07835eecd07b8584fba4d51f8998b1403018cbec154f7995a1413c2f7bcb86b6" exitCode=0
Jun 10 00:25:19.411531 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:19.411394    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9jx59" event={"ID":"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48","Type":"ContainerDied","Data":"07835eecd07b8584fba4d51f8998b1403018cbec154f7995a1413c2f7bcb86b6"}
Jun 10 00:25:19.414170 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:19.414142    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df" event={"ID":"8d33ba09-ee5e-4fbf-877e-c27e6a946215","Type":"ContainerStarted","Data":"fa918535c48f68801b4aa86e2269a9f63e60cfe64243c4024e3753c1b4b83c85"}
Jun 10 00:25:19.415443 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:19.415417    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x" event={"ID":"4044affd-3609-4a6f-9180-1e6b9b84bcf5","Type":"ContainerStarted","Data":"fe5be687eacf63a752b2f442aa9facb03caff9b74b34d013247bcbc0d924ca93"}
Jun 10 00:25:19.443259 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:19.443194    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4l2df" podStartSLOduration=2.265260546 podStartE2EDuration="3.443172081s" totalImagesPullingTime="1.177911535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:19.441263074 +0000 UTC m=+226.312039202" watchObservedRunningTime="2026-06-10 00:25:19.443172081 +0000 UTC m=+226.313948213"
Jun 10 00:25:19.589230 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:19.589196    2560 patch_prober.go:28] interesting pod/image-registry-5bc5df5cbf-d95tp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 10 00:25:19.589400 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:19.589254    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp" podUID="6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 10 00:25:19.602408 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:19.602330    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:19.703840 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:19.703705    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:19.795563 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:19.795536    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:19.931462 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:19.931402    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:20.422229 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:20.422195    2560 generic.go:356] "Generic (PLEG): container finished" podID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerID="3a8ab2649c02bbc5f100347ceeb0f15de044db8fe4b06625c349e4fa5cd64f59" exitCode=0
Jun 10 00:25:20.422404 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:20.422286    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f69fa56-543d-44ce-972d-8e91c512d1f5","Type":"ContainerDied","Data":"3a8ab2649c02bbc5f100347ceeb0f15de044db8fe4b06625c349e4fa5cd64f59"}
Jun 10 00:25:20.424795 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:20.424771    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9jx59" event={"ID":"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48","Type":"ContainerStarted","Data":"7b4b50a2fb3c9e4d9bf5dbf0fe512f153d61c1cdc1b822e699494eb763a2a0d7"}
Jun 10 00:25:20.424902 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:20.424835    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9jx59" event={"ID":"d8eb2989-c5ec-4e12-b619-c1d9dec1fa48","Type":"ContainerStarted","Data":"87fc1743525e9642e7e6aca8534722fe5edfb1cad0d2aef6495ea0ea07dc89cc"}
Jun 10 00:25:20.427026 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:20.427001    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft" event={"ID":"453e7b09-69c7-424c-8f3d-ce0a046e172f","Type":"ContainerStarted","Data":"cdc212b13fdce5c24635039973105c18ab3eb6ca01941a7c3d0f4b53f9a89d68"}
Jun 10 00:25:20.427127 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:20.427056    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft" event={"ID":"453e7b09-69c7-424c-8f3d-ce0a046e172f","Type":"ContainerStarted","Data":"41139f2f7fe2ebfef231259472fb68dd947bd808ae78cb79cfa85d9f03768e88"}
Jun 10 00:25:20.427127 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:20.427087    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft" event={"ID":"453e7b09-69c7-424c-8f3d-ce0a046e172f","Type":"ContainerStarted","Data":"4af777b42d651b518f5927d574cee8358deec62e1046e928db603eb4405ef8d2"}
Jun 10 00:25:20.461422 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:20.461364    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9jx59" podStartSLOduration=3.395824414 podStartE2EDuration="4.461346594s" totalImagesPullingTime="973.103664ms" totalInitContainerRuntime="92.418516ms" isStatefulPod=true podCreationTimestamp="2026-06-10 00:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:20.459939027 +0000 UTC m=+227.330715161" watchObservedRunningTime="2026-06-10 00:25:20.461346594 +0000 UTC m=+227.332122720"
Jun 10 00:25:20.475982 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:20.475911    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v92ft" podStartSLOduration=2.436302038 podStartE2EDuration="4.475898649s" totalImagesPullingTime="2.039596611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:20.47518484 +0000 UTC m=+227.345960984" watchObservedRunningTime="2026-06-10 00:25:20.475898649 +0000 UTC m=+227.346674775"
Jun 10 00:25:21.426233 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:21.426171    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:21.431560 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:21.430617    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-kzjnh"]
Jun 10 00:25:21.436210 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:21.436185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kzjnh"
Jun 10 00:25:21.439982 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:21.439956    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jun 10 00:25:21.440120 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:21.439994    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wlzjl\""
Jun 10 00:25:21.441598 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:21.441543    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-kzjnh"]
Jun 10 00:25:21.574642 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:21.574596    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f393efef-1843-492a-ae30-21e8295ceed8-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kzjnh\" (UID: \"f393efef-1843-492a-ae30-21e8295ceed8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kzjnh"
Jun 10 00:25:21.574822 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:21.574699    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c668j\" (UniqueName: \"kubernetes.io/projected/f393efef-1843-492a-ae30-21e8295ceed8-kube-api-access-c668j\") pod \"monitoring-plugin-76b68cc874-kzjnh\" (UID: \"f393efef-1843-492a-ae30-21e8295ceed8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kzjnh"
Jun 10 00:25:21.669121 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:21.669082    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:21.675881 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:21.675857    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f393efef-1843-492a-ae30-21e8295ceed8-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kzjnh\" (UID: \"f393efef-1843-492a-ae30-21e8295ceed8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kzjnh"
Jun 10 00:25:21.675991 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:21.675906    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c668j\" (UniqueName: \"kubernetes.io/projected/f393efef-1843-492a-ae30-21e8295ceed8-kube-api-access-c668j\") pod \"monitoring-plugin-76b68cc874-kzjnh\" (UID: \"f393efef-1843-492a-ae30-21e8295ceed8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kzjnh"
Jun 10 00:25:21.679297 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:21.679192    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f393efef-1843-492a-ae30-21e8295ceed8-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-kzjnh\" (UID: \"f393efef-1843-492a-ae30-21e8295ceed8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kzjnh"
Jun 10 00:25:21.683886 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:21.683848    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c668j\" (UniqueName: \"kubernetes.io/projected/f393efef-1843-492a-ae30-21e8295ceed8-kube-api-access-c668j\") pod \"monitoring-plugin-76b68cc874-kzjnh\" (UID: \"f393efef-1843-492a-ae30-21e8295ceed8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-kzjnh"
Jun 10 00:25:21.748876 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:21.748852    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kzjnh"
Jun 10 00:25:21.883056 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:21.883026    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-kzjnh"]
Jun 10 00:25:21.886072 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:25:21.886042    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf393efef_1843_492a_ae30_21e8295ceed8.slice/crio-a2fa2a0d95c54e21c76caceb3d846e06cba3118400294e80ce262b9013977cf1 WatchSource:0}: Error finding container a2fa2a0d95c54e21c76caceb3d846e06cba3118400294e80ce262b9013977cf1: Status 404 returned error can't find the container with id a2fa2a0d95c54e21c76caceb3d846e06cba3118400294e80ce262b9013977cf1
Jun 10 00:25:22.442474 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:22.442426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kzjnh" event={"ID":"f393efef-1843-492a-ae30-21e8295ceed8","Type":"ContainerStarted","Data":"a2fa2a0d95c54e21c76caceb3d846e06cba3118400294e80ce262b9013977cf1"}
Jun 10 00:25:22.444812 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:22.444784    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x" event={"ID":"4044affd-3609-4a6f-9180-1e6b9b84bcf5","Type":"ContainerStarted","Data":"1269598b51e916b3566783e21a80d21035c7818d3b29edff66f3fc22f3483813"}
Jun 10 00:25:22.444936 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:22.444846    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x" event={"ID":"4044affd-3609-4a6f-9180-1e6b9b84bcf5","Type":"ContainerStarted","Data":"6867119668d4adabdfcb267c983e7aa2d6ad02d5ab8ade17566c0a1ec4a0813e"}
Jun 10 00:25:22.444936 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:22.444887    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x" event={"ID":"4044affd-3609-4a6f-9180-1e6b9b84bcf5","Type":"ContainerStarted","Data":"3bdb4b79ec682868c09d1559f797b3cc0b78ef0e8469f06c191ee108c0cb31b7"}
Jun 10 00:25:22.850097 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:22.849976    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:23.452250 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:23.452215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x" event={"ID":"4044affd-3609-4a6f-9180-1e6b9b84bcf5","Type":"ContainerStarted","Data":"7c3a41edae22abcac2ab8afcaa2c7d1f92f75a76dd2e3cb50feff3105df07d72"}
Jun 10 00:25:23.452677 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:23.452300    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x" event={"ID":"4044affd-3609-4a6f-9180-1e6b9b84bcf5","Type":"ContainerStarted","Data":"11b9fe3156731743880bb56d9f599b9044c24052ead91264c18a7b374eeb34e6"}
Jun 10 00:25:23.452677 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:23.452335    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x" event={"ID":"4044affd-3609-4a6f-9180-1e6b9b84bcf5","Type":"ContainerStarted","Data":"13897afc981c9f786c2b2b37397931b94f79c5c34e11c8938365dd706f808526"}
Jun 10 00:25:23.452677 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:23.452383    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:23.455600 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:23.455569    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f69fa56-543d-44ce-972d-8e91c512d1f5","Type":"ContainerStarted","Data":"36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d"}
Jun 10 00:25:23.455758 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:23.455645    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f69fa56-543d-44ce-972d-8e91c512d1f5","Type":"ContainerStarted","Data":"0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173"}
Jun 10 00:25:23.455758 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:23.455684    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f69fa56-543d-44ce-972d-8e91c512d1f5","Type":"ContainerStarted","Data":"b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644"}
Jun 10 00:25:23.455758 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:23.455720    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f69fa56-543d-44ce-972d-8e91c512d1f5","Type":"ContainerStarted","Data":"00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af"}
Jun 10 00:25:23.455907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:23.455785    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f69fa56-543d-44ce-972d-8e91c512d1f5","Type":"ContainerStarted","Data":"4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0"}
Jun 10 00:25:23.455907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:23.455828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f69fa56-543d-44ce-972d-8e91c512d1f5","Type":"ContainerStarted","Data":"c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86"}
Jun 10 00:25:23.474543 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:23.474483    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x" podStartSLOduration=2.11294971 podStartE2EDuration="5.474466759s" totalImagesPullingTime="3.361517049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:25:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:23.472944841 +0000 UTC m=+230.343720968" watchObservedRunningTime="2026-06-10 00:25:23.474466759 +0000 UTC m=+230.345242886"
Jun 10 00:25:23.497353 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:23.497261    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.606192092 podStartE2EDuration="6.497234948s" totalImagesPullingTime="3.868553209s" totalInitContainerRuntime="22.489647ms" isStatefulPod=false podCreationTimestamp="2026-06-10 00:25:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:23.495469728 +0000 UTC m=+230.366245856" watchObservedRunningTime="2026-06-10 00:25:23.497234948 +0000 UTC m=+230.368011077"
Jun 10 00:25:24.462564 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:24.462526    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kzjnh" event={"ID":"f393efef-1843-492a-ae30-21e8295ceed8","Type":"ContainerStarted","Data":"3d7517304b423a41e6a22c2237cbb90fcd821f94687dc65a266a150c50be69ab"}
Jun 10 00:25:24.463223 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:24.463197    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kzjnh"
Jun 10 00:25:24.467355 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:24.467332    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kzjnh"
Jun 10 00:25:24.476881 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:24.476838    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-kzjnh" podStartSLOduration=1.371121761 podStartE2EDuration="3.476823152s" totalImagesPullingTime="2.105701391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:24.47607138 +0000 UTC m=+231.346847507" watchObservedRunningTime="2026-06-10 00:25:24.476823152 +0000 UTC m=+231.347599279"
Jun 10 00:25:24.603533 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:24.603478    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp" podUID="6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae" containerName="registry" containerID="cri-o://e5c9819cc4da9f2fb488ceeabc06dad96140486b3ffc7b4e0f4ed3bcaadfd8a8" gracePeriod=30
Jun 10 00:25:24.842257 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:24.842234    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:25:25.006298 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.006271    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-image-registry-private-configuration\") pod \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") "
Jun 10 00:25:25.006453 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.006320    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-ca-trust-extracted\") pod \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") "
Jun 10 00:25:25.006453 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.006349    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls\") pod \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") "
Jun 10 00:25:25.006453 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.006369    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ghfl\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-kube-api-access-4ghfl\") pod \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") "
Jun 10 00:25:25.006453 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.006391    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-bound-sa-token\") pod \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") "
Jun 10 00:25:25.006453 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.006411    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-certificates\") pod \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") "
Jun 10 00:25:25.006453 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.006427    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-trusted-ca\") pod \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") "
Jun 10 00:25:25.006711 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.006458    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-installation-pull-secrets\") pod \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\" (UID: \"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae\") "
Jun 10 00:25:25.007161 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.007021    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae" (UID: "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 00:25:25.007161 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.007124    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae" (UID: "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 00:25:25.009134 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.009058    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae" (UID: "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 00:25:25.009231 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.009198    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae" (UID: "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 00:25:25.009285 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.009241    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-kube-api-access-4ghfl" (OuterVolumeSpecName: "kube-api-access-4ghfl") pod "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae" (UID: "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae"). InnerVolumeSpecName "kube-api-access-4ghfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:25:25.009285 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.009264    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae" (UID: "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:25:25.009358 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.009293    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae" (UID: "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:25:25.015301 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.015275    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae" (UID: "6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:25:25.108067 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.108020    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ghfl\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-kube-api-access-4ghfl\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:25:25.108067 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.108058    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-bound-sa-token\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:25:25.108067 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.108073    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-certificates\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:25:25.108282 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.108085    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-trusted-ca\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:25:25.108282 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.108098    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-installation-pull-secrets\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:25:25.108282 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.108111    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-image-registry-private-configuration\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:25:25.108282 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.108125    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-ca-trust-extracted\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:25:25.108282 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.108136    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae-registry-tls\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:25:25.471537 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.471446    2560 generic.go:356] "Generic (PLEG): container finished" podID="6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae" containerID="e5c9819cc4da9f2fb488ceeabc06dad96140486b3ffc7b4e0f4ed3bcaadfd8a8" exitCode=0
Jun 10 00:25:25.471537 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.471514    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp"
Jun 10 00:25:25.472020 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.471528    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp" event={"ID":"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae","Type":"ContainerDied","Data":"e5c9819cc4da9f2fb488ceeabc06dad96140486b3ffc7b4e0f4ed3bcaadfd8a8"}
Jun 10 00:25:25.472020 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.471601    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bc5df5cbf-d95tp" event={"ID":"6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae","Type":"ContainerDied","Data":"19384706fc2a0a884688fdfdd67c586b1c9a4a8a8821fb33d0326ab773c05409"}
Jun 10 00:25:25.472020 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.471621    2560 scope.go:117] "RemoveContainer" containerID="e5c9819cc4da9f2fb488ceeabc06dad96140486b3ffc7b4e0f4ed3bcaadfd8a8"
Jun 10 00:25:25.480351 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.480333    2560 scope.go:117] "RemoveContainer" containerID="e5c9819cc4da9f2fb488ceeabc06dad96140486b3ffc7b4e0f4ed3bcaadfd8a8"
Jun 10 00:25:25.480594 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:25:25.480575    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5c9819cc4da9f2fb488ceeabc06dad96140486b3ffc7b4e0f4ed3bcaadfd8a8\": container with ID starting with e5c9819cc4da9f2fb488ceeabc06dad96140486b3ffc7b4e0f4ed3bcaadfd8a8 not found: ID does not exist" containerID="e5c9819cc4da9f2fb488ceeabc06dad96140486b3ffc7b4e0f4ed3bcaadfd8a8"
Jun 10 00:25:25.480645 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.480602    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5c9819cc4da9f2fb488ceeabc06dad96140486b3ffc7b4e0f4ed3bcaadfd8a8"} err="failed to get container status \"e5c9819cc4da9f2fb488ceeabc06dad96140486b3ffc7b4e0f4ed3bcaadfd8a8\": rpc error: code = NotFound desc = could not find container \"e5c9819cc4da9f2fb488ceeabc06dad96140486b3ffc7b4e0f4ed3bcaadfd8a8\": container with ID starting with e5c9819cc4da9f2fb488ceeabc06dad96140486b3ffc7b4e0f4ed3bcaadfd8a8 not found: ID does not exist"
Jun 10 00:25:25.490719 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.490688    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bc5df5cbf-d95tp"]
Jun 10 00:25:25.493714 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.493693    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bc5df5cbf-d95tp"]
Jun 10 00:25:25.613887 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:25.613852    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae" path="/var/lib/kubelet/pods/6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae/volumes"
Jun 10 00:25:29.467805 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:29.467779    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-bf75bb48d-zd77x"
Jun 10 00:25:29.809352 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:29.809315    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-jsp2v"]
Jun 10 00:25:29.809719 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:29.809703    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae" containerName="registry"
Jun 10 00:25:29.809856 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:29.809722    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae" containerName="registry"
Jun 10 00:25:29.809856 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:29.809819    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6809c5d9-5ece-43f7-a25f-0b14e8b8e1ae" containerName="registry"
Jun 10 00:25:29.814875 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:29.814854    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-jsp2v"
Jun 10 00:25:29.817101 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:29.817076    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 10 00:25:29.817101 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:29.817095    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lbgst\""
Jun 10 00:25:29.817289 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:29.817097    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 10 00:25:29.820551 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:29.820529    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-jsp2v"]
Jun 10 00:25:29.830271 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:29.830243    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:29.918561 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:29.918517    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:29.949000 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:29.948971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9xds\" (UniqueName: \"kubernetes.io/projected/9e106869-564a-438a-a6cd-867eb1e343b7-kube-api-access-w9xds\") pod \"downloads-6657875f97-jsp2v\" (UID: \"9e106869-564a-438a-a6cd-867eb1e343b7\") " pod="openshift-console/downloads-6657875f97-jsp2v"
Jun 10 00:25:30.018519 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:30.018485    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:30.049589 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:30.049552    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9xds\" (UniqueName: \"kubernetes.io/projected/9e106869-564a-438a-a6cd-867eb1e343b7-kube-api-access-w9xds\") pod \"downloads-6657875f97-jsp2v\" (UID: \"9e106869-564a-438a-a6cd-867eb1e343b7\") " pod="openshift-console/downloads-6657875f97-jsp2v"
Jun 10 00:25:30.058866 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:30.058841    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9xds\" (UniqueName: \"kubernetes.io/projected/9e106869-564a-438a-a6cd-867eb1e343b7-kube-api-access-w9xds\") pod \"downloads-6657875f97-jsp2v\" (UID: \"9e106869-564a-438a-a6cd-867eb1e343b7\") " pod="openshift-console/downloads-6657875f97-jsp2v"
Jun 10 00:25:30.119012 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:30.118924    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:30.131468 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:30.131439    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-jsp2v"
Jun 10 00:25:30.258388 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:30.258359    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-jsp2v"]
Jun 10 00:25:30.261249 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:25:30.261222    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e106869_564a_438a_a6cd_867eb1e343b7.slice/crio-cde9bf9517cf1141280ca042dd5bd4976ca71283ed554d2b99810b3a34031ed8 WatchSource:0}: Error finding container cde9bf9517cf1141280ca042dd5bd4976ca71283ed554d2b99810b3a34031ed8: Status 404 returned error can't find the container with id cde9bf9517cf1141280ca042dd5bd4976ca71283ed554d2b99810b3a34031ed8
Jun 10 00:25:30.277037 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:30.277012    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:30.333159 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:30.333123    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:30.481552 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:30.481440    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:30.495587 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:30.495559    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-jsp2v" event={"ID":"9e106869-564a-438a-a6cd-867eb1e343b7","Type":"ContainerStarted","Data":"cde9bf9517cf1141280ca042dd5bd4976ca71283ed554d2b99810b3a34031ed8"}
Jun 10 00:25:30.711947 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:30.711910    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:30.761758 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:30.761706    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:30.901055 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:30.901001    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:31.683039 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:31.683003    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:31.899926 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:31.899888    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:32.478630 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:32.478594    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:32.701983 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:32.701945    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:32.752283 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:32.752202    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:36.097016 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:36.096971    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:36.147915 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:36.147878    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:38.717633 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.717594    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b79c6b4b-6jrd4"]
Jun 10 00:25:38.723080 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.723054    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.725357 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.725326    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 10 00:25:38.725494 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.725335    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 10 00:25:38.726226 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.726193    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 10 00:25:38.726332 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.726253    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 10 00:25:38.726332 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.726286    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dqssp\""
Jun 10 00:25:38.726580 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.726561    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 10 00:25:38.728709 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.728685    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b79c6b4b-6jrd4"]
Jun 10 00:25:38.831407 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.831374    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-serving-cert\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.831407 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.831413    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-oauth-serving-cert\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.831634 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.831453    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c78tj\" (UniqueName: \"kubernetes.io/projected/e9936858-25f4-476c-8fda-149b6e1ed1c0-kube-api-access-c78tj\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.831634 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.831592    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-service-ca\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.831705 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.831633    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-config\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.831705 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.831677    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-oauth-config\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.932310 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.932271    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-oauth-serving-cert\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.932500 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.932323    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c78tj\" (UniqueName: \"kubernetes.io/projected/e9936858-25f4-476c-8fda-149b6e1ed1c0-kube-api-access-c78tj\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.932500 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.932403    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-service-ca\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.932500 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.932436    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-config\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.932500 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.932481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-oauth-config\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.932711 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.932511    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-serving-cert\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.933159 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.933106    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-oauth-serving-cert\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.933159 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.933134    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-service-ca\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.933343 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.933321    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-config\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.935704 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.935685    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-serving-cert\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.935806 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.935776    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-oauth-config\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:38.939969 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:38.939947    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c78tj\" (UniqueName: \"kubernetes.io/projected/e9936858-25f4-476c-8fda-149b6e1ed1c0-kube-api-access-c78tj\") pod \"console-b79c6b4b-6jrd4\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") " pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:39.035544 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:39.035476    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:39.182903 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:39.182869    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b79c6b4b-6jrd4"]
Jun 10 00:25:39.185938 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:25:39.185910    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9936858_25f4_476c_8fda_149b6e1ed1c0.slice/crio-9df8992f45198cc2d492583e9aee768504c561a96c1e48c561ea289f7bad3a0c WatchSource:0}: Error finding container 9df8992f45198cc2d492583e9aee768504c561a96c1e48c561ea289f7bad3a0c: Status 404 returned error can't find the container with id 9df8992f45198cc2d492583e9aee768504c561a96c1e48c561ea289f7bad3a0c
Jun 10 00:25:39.538081 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:39.538046    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b79c6b4b-6jrd4" event={"ID":"e9936858-25f4-476c-8fda-149b6e1ed1c0","Type":"ContainerStarted","Data":"9df8992f45198cc2d492583e9aee768504c561a96c1e48c561ea289f7bad3a0c"}
Jun 10 00:25:43.557275 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:43.557239    2560 generic.go:356] "Generic (PLEG): container finished" podID="391f1235-4644-47de-9bfa-ce9280888777" containerID="0fc38a83858c14044a606b83f1ef80ceecbb24ec4caeb2356465dfacab2d99a6" exitCode=0
Jun 10 00:25:43.557275 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:43.557285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh" event={"ID":"391f1235-4644-47de-9bfa-ce9280888777","Type":"ContainerDied","Data":"0fc38a83858c14044a606b83f1ef80ceecbb24ec4caeb2356465dfacab2d99a6"}
Jun 10 00:25:43.557829 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:43.557677    2560 scope.go:117] "RemoveContainer" containerID="0fc38a83858c14044a606b83f1ef80ceecbb24ec4caeb2356465dfacab2d99a6"
Jun 10 00:25:43.899051 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:43.898939    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:43.943400 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:43.943359    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:44.484016 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:44.483977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs\") pod \"network-metrics-daemon-n2z9z\" (UID: \"4d3fdb97-b961-4d04-abaf-6487c7a130f1\") " pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:25:44.486704 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:44.486672    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3fdb97-b961-4d04-abaf-6487c7a130f1-metrics-certs\") pod \"network-metrics-daemon-n2z9z\" (UID: \"4d3fdb97-b961-4d04-abaf-6487c7a130f1\") " pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:25:44.712681 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:44.712646    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8r5c2\""
Jun 10 00:25:44.720479 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:44.720448    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n2z9z"
Jun 10 00:25:45.543446 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:45.543407    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:45.597729 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:45.597640    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:47.300237 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:47.300197    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:47.400957 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:47.400916    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:48.805559 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:48.805519    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:48.857710 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:48.857661    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:50.476013 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:50.475973    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n2z9z"]
Jun 10 00:25:50.480097 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:25:50.480071    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d3fdb97_b961_4d04_abaf_6487c7a130f1.slice/crio-7d1c900254d26d363c254cf5826a1ccd4cf0a9f1905701445872dabf689f0bc9 WatchSource:0}: Error finding container 7d1c900254d26d363c254cf5826a1ccd4cf0a9f1905701445872dabf689f0bc9: Status 404 returned error can't find the container with id 7d1c900254d26d363c254cf5826a1ccd4cf0a9f1905701445872dabf689f0bc9
Jun 10 00:25:50.592883 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:50.592819    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b79c6b4b-6jrd4" event={"ID":"e9936858-25f4-476c-8fda-149b6e1ed1c0","Type":"ContainerStarted","Data":"60cfb3e12dbb454288acf0a6b79d62ff3ee380f626e7305ad6250a8298c07079"}
Jun 10 00:25:50.594597 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:50.594551    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-jsp2v" event={"ID":"9e106869-564a-438a-a6cd-867eb1e343b7","Type":"ContainerStarted","Data":"7bc6e5e0f88cab4db6ccc331df73d18ead7c54edfb5c64b201425e1a300a722a"}
Jun 10 00:25:50.594859 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:50.594841    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-jsp2v"
Jun 10 00:25:50.596140 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:50.596082    2560 patch_prober.go:28] interesting pod/downloads-6657875f97-jsp2v container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.21:8080/\": dial tcp 10.133.0.21:8080: connect: connection refused" start-of-body=
Jun 10 00:25:50.596140 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:50.596129    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6657875f97-jsp2v" podUID="9e106869-564a-438a-a6cd-867eb1e343b7" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.21:8080/\": dial tcp 10.133.0.21:8080: connect: connection refused"
Jun 10 00:25:50.596545 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:50.596523    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n2z9z" event={"ID":"4d3fdb97-b961-4d04-abaf-6487c7a130f1","Type":"ContainerStarted","Data":"7d1c900254d26d363c254cf5826a1ccd4cf0a9f1905701445872dabf689f0bc9"}
Jun 10 00:25:50.598497 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:50.598478    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-m7drh" event={"ID":"391f1235-4644-47de-9bfa-ce9280888777","Type":"ContainerStarted","Data":"2d2e92a59df50db4826ed6bd061c845c67ccf6a125299a3d0b6646c313064039"}
Jun 10 00:25:50.611593 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:50.611531    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b79c6b4b-6jrd4" podStartSLOduration=1.467495438 podStartE2EDuration="12.6115094s" totalImagesPullingTime="11.144013962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:50.610077595 +0000 UTC m=+257.480853725" watchObservedRunningTime="2026-06-10 00:25:50.6115094 +0000 UTC m=+257.482285522"
Jun 10 00:25:50.624163 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:50.624105    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-jsp2v" podStartSLOduration=1.498015309 podStartE2EDuration="21.624089154s" totalImagesPullingTime="20.126073845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:50.623317161 +0000 UTC m=+257.494093286" watchObservedRunningTime="2026-06-10 00:25:50.624089154 +0000 UTC m=+257.494865281"
Jun 10 00:25:50.971779 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:50.971645    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:51.026331 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:51.026289    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:51.616190 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:51.616158    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-jsp2v"
Jun 10 00:25:52.611012 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:52.610963    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n2z9z" event={"ID":"4d3fdb97-b961-4d04-abaf-6487c7a130f1","Type":"ContainerStarted","Data":"42ee6f4920bd0598037b69aa3c6f980d05e054d3d4f6f84852c9f883d309ced8"}
Jun 10 00:25:52.611225 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:52.611037    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n2z9z" event={"ID":"4d3fdb97-b961-4d04-abaf-6487c7a130f1","Type":"ContainerStarted","Data":"83adcf53d768d2a7e6c469415d50bc80fac12314640a9a8fec883fb34f5abf41"}
Jun 10 00:25:52.627087 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:52.627031    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n2z9z" podStartSLOduration=258.483438499 podStartE2EDuration="4m19.627012979s" totalImagesPullingTime="1.14357448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:25:52.62555217 +0000 UTC m=+259.496328299" watchObservedRunningTime="2026-06-10 00:25:52.627012979 +0000 UTC m=+259.497789105"
Jun 10 00:25:52.706517 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:52.706475    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:52.760076 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:52.760025    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:53.311234 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:53.311198    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:53.411139 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:53.411103    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:56.676644 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:56.676596    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:56.776950 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:56.776908    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:25:59.035853 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:59.035812    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:59.036417 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:59.035919    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:25:59.037387 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:59.037359    2560 patch_prober.go:28] interesting pod/console-b79c6b4b-6jrd4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body=
Jun 10 00:25:59.037526 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:25:59.037425    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b79c6b4b-6jrd4" podUID="e9936858-25f4-476c-8fda-149b6e1ed1c0" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused"
Jun 10 00:26:05.259181 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:05.259141    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f69fa56-543d-44ce-972d-8e91c512d1f5/init-config-reloader/0.log"
Jun 10 00:26:05.459567 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:05.459513    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f69fa56-543d-44ce-972d-8e91c512d1f5/alertmanager/0.log"
Jun 10 00:26:05.659360 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:05.659279    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f69fa56-543d-44ce-972d-8e91c512d1f5/config-reloader/0.log"
Jun 10 00:26:05.858258 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:05.858204    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f69fa56-543d-44ce-972d-8e91c512d1f5/kube-rbac-proxy-web/0.log"
Jun 10 00:26:06.059705 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:06.059676    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f69fa56-543d-44ce-972d-8e91c512d1f5/kube-rbac-proxy/0.log"
Jun 10 00:26:06.091354 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:06.091322    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:06.192166 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:06.192130    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:06.261365 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:06.261334    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f69fa56-543d-44ce-972d-8e91c512d1f5/kube-rbac-proxy-metric/0.log"
Jun 10 00:26:06.458442 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:06.458355    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f69fa56-543d-44ce-972d-8e91c512d1f5/prom-label-proxy/0.log"
Jun 10 00:26:06.768430 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:06.768400    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:06.859558 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:06.859508    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v92ft_453e7b09-69c7-424c-8f3d-ce0a046e172f/kube-state-metrics/0.log"
Jun 10 00:26:07.059181 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:07.059100    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v92ft_453e7b09-69c7-424c-8f3d-ce0a046e172f/kube-rbac-proxy-main/0.log"
Jun 10 00:26:07.259037 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:07.259001    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v92ft_453e7b09-69c7-424c-8f3d-ce0a046e172f/kube-rbac-proxy-self/0.log"
Jun 10 00:26:07.658641 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:07.658604    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-kzjnh_f393efef-1843-492a-ae30-21e8295ceed8/monitoring-plugin/0.log"
Jun 10 00:26:07.858969 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:07.858942    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9jx59_d8eb2989-c5ec-4e12-b619-c1d9dec1fa48/init-textfile/0.log"
Jun 10 00:26:08.060329 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:08.060298    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9jx59_d8eb2989-c5ec-4e12-b619-c1d9dec1fa48/node-exporter/0.log"
Jun 10 00:26:08.258951 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:08.258916    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9jx59_d8eb2989-c5ec-4e12-b619-c1d9dec1fa48/kube-rbac-proxy/0.log"
Jun 10 00:26:09.036348 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:09.036311    2560 patch_prober.go:28] interesting pod/console-b79c6b4b-6jrd4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body=
Jun 10 00:26:09.036758 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:09.036369    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b79c6b4b-6jrd4" podUID="e9936858-25f4-476c-8fda-149b6e1ed1c0" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused"
Jun 10 00:26:09.659125 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:09.659090    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4l2df_8d33ba09-ee5e-4fbf-877e-c27e6a946215/kube-rbac-proxy-main/0.log"
Jun 10 00:26:09.859602 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:09.859566    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4l2df_8d33ba09-ee5e-4fbf-877e-c27e6a946215/kube-rbac-proxy-self/0.log"
Jun 10 00:26:10.059722 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:10.059689    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4l2df_8d33ba09-ee5e-4fbf-877e-c27e6a946215/openshift-state-metrics/0.log"
Jun 10 00:26:12.059601 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:12.059572    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-9pnrp_2824e107-94db-41c1-b117-08b90a31e2ab/prometheus-operator-admission-webhook/0.log"
Jun 10 00:26:12.859087 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:12.859053    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf75bb48d-zd77x_4044affd-3609-4a6f-9180-1e6b9b84bcf5/thanos-query/0.log"
Jun 10 00:26:13.059062 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:13.059030    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf75bb48d-zd77x_4044affd-3609-4a6f-9180-1e6b9b84bcf5/kube-rbac-proxy-web/0.log"
Jun 10 00:26:13.259238 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:13.259210    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf75bb48d-zd77x_4044affd-3609-4a6f-9180-1e6b9b84bcf5/kube-rbac-proxy/0.log"
Jun 10 00:26:13.459395 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:13.459371    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf75bb48d-zd77x_4044affd-3609-4a6f-9180-1e6b9b84bcf5/prom-label-proxy/0.log"
Jun 10 00:26:13.659455 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:13.659364    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf75bb48d-zd77x_4044affd-3609-4a6f-9180-1e6b9b84bcf5/kube-rbac-proxy-rules/0.log"
Jun 10 00:26:13.859527 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:13.859471    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf75bb48d-zd77x_4044affd-3609-4a6f-9180-1e6b9b84bcf5/kube-rbac-proxy-metrics/0.log"
Jun 10 00:26:14.059163 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:14.059138    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-nv72t_6cc7f6de-2406-49f6-a738-dc124c17db96/networking-console-plugin/0.log"
Jun 10 00:26:14.659104 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:14.659073    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b79c6b4b-6jrd4_e9936858-25f4-476c-8fda-149b6e1ed1c0/console/0.log"
Jun 10 00:26:15.061393 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:15.061362    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-jsp2v_9e106869-564a-438a-a6cd-867eb1e343b7/download-server/0.log"
Jun 10 00:26:15.182447 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:26:15.182402    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8jqf6" podUID="16e79505-9bdf-48ae-934e-33d497801737"
Jun 10 00:26:15.553055 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:15.553020    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:15.603440 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:15.603406    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:15.712612 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:15.712579    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:26:16.658177 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:16.658139    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lv968_f9145353-43cf-472c-ba12-c3f093cfcccc/dns-node-resolver/0.log"
Jun 10 00:26:17.458907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:17.458876    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6jdzv_eab4de7c-fcdc-4f58-80c0-b7607ec77386/node-ca/0.log"
Jun 10 00:26:18.059324 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:18.059298    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f5dccfcff-pbm8v_2353b550-71e8-4fcf-aa55-a550828732ec/router/0.log"
Jun 10 00:26:18.400779 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:18.400679    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:26:18.403130 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:18.403109    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16e79505-9bdf-48ae-934e-33d497801737-metrics-tls\") pod \"dns-default-8jqf6\" (UID: \"16e79505-9bdf-48ae-934e-33d497801737\") " pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:26:18.415798 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:18.415768    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vpwdb\""
Jun 10 00:26:18.423476 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:18.423458    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:26:18.636821 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:18.636781    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8jqf6"]
Jun 10 00:26:18.639951 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:26:18.639925    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e79505_9bdf_48ae_934e_33d497801737.slice/crio-2c1dc9ce2980f1c0e086d8e05155a2a6de5f88f84a9d81576f2b17bc041367e1 WatchSource:0}: Error finding container 2c1dc9ce2980f1c0e086d8e05155a2a6de5f88f84a9d81576f2b17bc041367e1: Status 404 returned error can't find the container with id 2c1dc9ce2980f1c0e086d8e05155a2a6de5f88f84a9d81576f2b17bc041367e1
Jun 10 00:26:18.658160 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:18.658097    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pbk85_a3b9ce6a-5198-4698-b05d-7137726b59d6/serve-healthcheck-canary/0.log"
Jun 10 00:26:18.726545 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:18.726508    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8jqf6" event={"ID":"16e79505-9bdf-48ae-934e-33d497801737","Type":"ContainerStarted","Data":"2c1dc9ce2980f1c0e086d8e05155a2a6de5f88f84a9d81576f2b17bc041367e1"}
Jun 10 00:26:19.036604 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:19.036570    2560 patch_prober.go:28] interesting pod/console-b79c6b4b-6jrd4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body=
Jun 10 00:26:19.036784 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:19.036629    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b79c6b4b-6jrd4" podUID="e9936858-25f4-476c-8fda-149b6e1ed1c0" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused"
Jun 10 00:26:22.747925 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:22.747832    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8jqf6" event={"ID":"16e79505-9bdf-48ae-934e-33d497801737","Type":"ContainerStarted","Data":"e8591244fb79cb3ceec15332936ab50d8348748f3e4843d1629ed83910ab4075"}
Jun 10 00:26:22.747925 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:22.747920    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8jqf6" event={"ID":"16e79505-9bdf-48ae-934e-33d497801737","Type":"ContainerStarted","Data":"f12f97951f24bac850f01f940f2aa341896e5d56d2da9d4f550b7c3eeb479edc"}
Jun 10 00:26:22.748335 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:22.747987    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:26:22.763619 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:22.763554    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8jqf6" podStartSLOduration=251.192337835 podStartE2EDuration="4m14.763534571s" totalImagesPullingTime="3.571196736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:26:22.762207682 +0000 UTC m=+289.632983822" watchObservedRunningTime="2026-06-10 00:26:22.763534571 +0000 UTC m=+289.634310700"
Jun 10 00:26:25.249971 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:25.249939    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:25.350665 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:25.350628    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:29.036885 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:29.036847    2560 patch_prober.go:28] interesting pod/console-b79c6b4b-6jrd4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body=
Jun 10 00:26:29.037265 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:29.036896    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b79c6b4b-6jrd4" podUID="e9936858-25f4-476c-8fda-149b6e1ed1c0" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused"
Jun 10 00:26:31.785105 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:31.785074    2560 generic.go:356] "Generic (PLEG): container finished" podID="95e80606-43ce-4354-8d7f-74a02a9acd7f" containerID="86eb79708bcb84c0aa8bbc4ceb080ea494de8fb4d0029b440f1c65f5ce34cd6d" exitCode=1
Jun 10 00:26:31.785542 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:31.785136    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8" event={"ID":"95e80606-43ce-4354-8d7f-74a02a9acd7f","Type":"ContainerDied","Data":"86eb79708bcb84c0aa8bbc4ceb080ea494de8fb4d0029b440f1c65f5ce34cd6d"}
Jun 10 00:26:31.785542 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:31.785194    2560 scope.go:117] "RemoveContainer" containerID="daa1c6a67f789e62627d784ddf623b1180fc7b4332cbac1623bfbd63bf28a935"
Jun 10 00:26:31.785638 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:31.785539    2560 scope.go:117] "RemoveContainer" containerID="86eb79708bcb84c0aa8bbc4ceb080ea494de8fb4d0029b440f1c65f5ce34cd6d"
Jun 10 00:26:31.785775 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:26:31.785734    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7487cc8f78-kdfs8_open-cluster-management-agent-addon(95e80606-43ce-4354-8d7f-74a02a9acd7f)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8" podUID="95e80606-43ce-4354-8d7f-74a02a9acd7f"
Jun 10 00:26:32.234500 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:32.234410    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:26:32.737491 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:32.737439    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:32.753798 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:32.753770    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8jqf6"
Jun 10 00:26:32.792509 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:32.792481    2560 scope.go:117] "RemoveContainer" containerID="86eb79708bcb84c0aa8bbc4ceb080ea494de8fb4d0029b440f1c65f5ce34cd6d"
Jun 10 00:26:32.793029 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:26:32.792708    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7487cc8f78-kdfs8_open-cluster-management-agent-addon(95e80606-43ce-4354-8d7f-74a02a9acd7f)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8" podUID="95e80606-43ce-4354-8d7f-74a02a9acd7f"
Jun 10 00:26:32.810222 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:32.810188    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:33.170419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:33.170383    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:33.272333 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:33.272297    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:33.323986 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:33.323949    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:33.550999 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:33.550967    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b79c6b4b-6jrd4"]
Jun 10 00:26:33.559569 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:33.559545    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v87bq_42e8ed02-5ca0-478a-9642-562b92e21674/ovn-acl-logging/0.log"
Jun 10 00:26:33.562726 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:33.562705    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v87bq_42e8ed02-5ca0-478a-9642-562b92e21674/ovn-acl-logging/0.log"
Jun 10 00:26:33.564316 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:33.564296    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jun 10 00:26:34.727285 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:34.727243    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:36.103930 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:36.103887    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:26:36.104320 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:36.104311    2560 scope.go:117] "RemoveContainer" containerID="86eb79708bcb84c0aa8bbc4ceb080ea494de8fb4d0029b440f1c65f5ce34cd6d"
Jun 10 00:26:36.104500 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:26:36.104478    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7487cc8f78-kdfs8_open-cluster-management-agent-addon(95e80606-43ce-4354-8d7f-74a02a9acd7f)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8" podUID="95e80606-43ce-4354-8d7f-74a02a9acd7f"
Jun 10 00:26:36.748094 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:36.748055    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:36.795949 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:36.795908    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:36.966012 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:36.965980    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:37.016520 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:37.016479    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 00:26:37.016804 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:37.016779    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="alertmanager" containerID="cri-o://c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86" gracePeriod=120
Jun 10 00:26:37.016874 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:37.016841    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="kube-rbac-proxy-metric" containerID="cri-o://0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173" gracePeriod=120
Jun 10 00:26:37.016934 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:37.016872    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="kube-rbac-proxy-web" containerID="cri-o://00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af" gracePeriod=120
Jun 10 00:26:37.016934 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:37.016889    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="config-reloader" containerID="cri-o://4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0" gracePeriod=120
Jun 10 00:26:37.017045 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:37.016948    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="prom-label-proxy" containerID="cri-o://36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d" gracePeriod=120
Jun 10 00:26:37.017045 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:37.016909    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="kube-rbac-proxy" containerID="cri-o://b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644" gracePeriod=120
Jun 10 00:26:37.025837 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:37.025805    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:37.815043 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:37.815014    2560 generic.go:356] "Generic (PLEG): container finished" podID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerID="36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d" exitCode=0
Jun 10 00:26:37.815043 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:37.815039    2560 generic.go:356] "Generic (PLEG): container finished" podID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerID="b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644" exitCode=0
Jun 10 00:26:37.815043 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:37.815048    2560 generic.go:356] "Generic (PLEG): container finished" podID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerID="4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0" exitCode=0
Jun 10 00:26:37.815491 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:37.815056    2560 generic.go:356] "Generic (PLEG): container finished" podID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerID="c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86" exitCode=0
Jun 10 00:26:37.815491 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:37.815083    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f69fa56-543d-44ce-972d-8e91c512d1f5","Type":"ContainerDied","Data":"36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d"}
Jun 10 00:26:37.815491 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:37.815149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f69fa56-543d-44ce-972d-8e91c512d1f5","Type":"ContainerDied","Data":"b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644"}
Jun 10 00:26:37.815491 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:37.815178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f69fa56-543d-44ce-972d-8e91c512d1f5","Type":"ContainerDied","Data":"4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0"}
Jun 10 00:26:37.815491 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:37.815201    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f69fa56-543d-44ce-972d-8e91c512d1f5","Type":"ContainerDied","Data":"c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86"}
Jun 10 00:26:38.067256 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.067162    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:38.165264 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.165219    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:38.258159 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.258130    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:38.365187 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.365106    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy-web\") pod \"5f69fa56-543d-44ce-972d-8e91c512d1f5\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") "
Jun 10 00:26:38.365187 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.365158    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f69fa56-543d-44ce-972d-8e91c512d1f5-metrics-client-ca\") pod \"5f69fa56-543d-44ce-972d-8e91c512d1f5\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") "
Jun 10 00:26:38.365397 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.365192    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f69fa56-543d-44ce-972d-8e91c512d1f5-tls-assets\") pod \"5f69fa56-543d-44ce-972d-8e91c512d1f5\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") "
Jun 10 00:26:38.365397 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.365226    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f69fa56-543d-44ce-972d-8e91c512d1f5-alertmanager-main-db\") pod \"5f69fa56-543d-44ce-972d-8e91c512d1f5\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") "
Jun 10 00:26:38.365397 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.365262    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f69fa56-543d-44ce-972d-8e91c512d1f5-config-out\") pod \"5f69fa56-543d-44ce-972d-8e91c512d1f5\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") "
Jun 10 00:26:38.365397 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.365285    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-main-tls\") pod \"5f69fa56-543d-44ce-972d-8e91c512d1f5\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") "
Jun 10 00:26:38.365397 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.365309    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5f69fa56-543d-44ce-972d-8e91c512d1f5\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") "
Jun 10 00:26:38.365397 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.365339    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjcqz\" (UniqueName: \"kubernetes.io/projected/5f69fa56-543d-44ce-972d-8e91c512d1f5-kube-api-access-rjcqz\") pod \"5f69fa56-543d-44ce-972d-8e91c512d1f5\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") "
Jun 10 00:26:38.365397 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.365378    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f69fa56-543d-44ce-972d-8e91c512d1f5-alertmanager-trusted-ca-bundle\") pod \"5f69fa56-543d-44ce-972d-8e91c512d1f5\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") "
Jun 10 00:26:38.365783 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.365402    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-cluster-tls-config\") pod \"5f69fa56-543d-44ce-972d-8e91c512d1f5\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") "
Jun 10 00:26:38.365783 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.365449    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-web-config\") pod \"5f69fa56-543d-44ce-972d-8e91c512d1f5\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") "
Jun 10 00:26:38.365783 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.365483    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-config-volume\") pod \"5f69fa56-543d-44ce-972d-8e91c512d1f5\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") "
Jun 10 00:26:38.365783 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.365522    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy\") pod \"5f69fa56-543d-44ce-972d-8e91c512d1f5\" (UID: \"5f69fa56-543d-44ce-972d-8e91c512d1f5\") "
Jun 10 00:26:38.365783 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.365641    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f69fa56-543d-44ce-972d-8e91c512d1f5-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5f69fa56-543d-44ce-972d-8e91c512d1f5" (UID: "5f69fa56-543d-44ce-972d-8e91c512d1f5"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:26:38.366059 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.365883    2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f69fa56-543d-44ce-972d-8e91c512d1f5-alertmanager-main-db\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:38.366059 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.365924    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f69fa56-543d-44ce-972d-8e91c512d1f5-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5f69fa56-543d-44ce-972d-8e91c512d1f5" (UID: "5f69fa56-543d-44ce-972d-8e91c512d1f5"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 00:26:38.366856 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.366826    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f69fa56-543d-44ce-972d-8e91c512d1f5-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5f69fa56-543d-44ce-972d-8e91c512d1f5" (UID: "5f69fa56-543d-44ce-972d-8e91c512d1f5"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 00:26:38.368549 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.368511    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5f69fa56-543d-44ce-972d-8e91c512d1f5" (UID: "5f69fa56-543d-44ce-972d-8e91c512d1f5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 00:26:38.368858 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.368727    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5f69fa56-543d-44ce-972d-8e91c512d1f5" (UID: "5f69fa56-543d-44ce-972d-8e91c512d1f5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 00:26:38.368858 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.368774    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f69fa56-543d-44ce-972d-8e91c512d1f5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5f69fa56-543d-44ce-972d-8e91c512d1f5" (UID: "5f69fa56-543d-44ce-972d-8e91c512d1f5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:26:38.368858 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.368775    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f69fa56-543d-44ce-972d-8e91c512d1f5-config-out" (OuterVolumeSpecName: "config-out") pod "5f69fa56-543d-44ce-972d-8e91c512d1f5" (UID: "5f69fa56-543d-44ce-972d-8e91c512d1f5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:26:38.368858 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.368821    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5f69fa56-543d-44ce-972d-8e91c512d1f5" (UID: "5f69fa56-543d-44ce-972d-8e91c512d1f5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 00:26:38.369156 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.369093    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5f69fa56-543d-44ce-972d-8e91c512d1f5" (UID: "5f69fa56-543d-44ce-972d-8e91c512d1f5"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 00:26:38.369233 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.369209    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-config-volume" (OuterVolumeSpecName: "config-volume") pod "5f69fa56-543d-44ce-972d-8e91c512d1f5" (UID: "5f69fa56-543d-44ce-972d-8e91c512d1f5"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 00:26:38.370399 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.370375    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f69fa56-543d-44ce-972d-8e91c512d1f5-kube-api-access-rjcqz" (OuterVolumeSpecName: "kube-api-access-rjcqz") pod "5f69fa56-543d-44ce-972d-8e91c512d1f5" (UID: "5f69fa56-543d-44ce-972d-8e91c512d1f5"). InnerVolumeSpecName "kube-api-access-rjcqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:26:38.373784 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.373645    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5f69fa56-543d-44ce-972d-8e91c512d1f5" (UID: "5f69fa56-543d-44ce-972d-8e91c512d1f5"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 00:26:38.380097 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.380077    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-web-config" (OuterVolumeSpecName: "web-config") pod "5f69fa56-543d-44ce-972d-8e91c512d1f5" (UID: "5f69fa56-543d-44ce-972d-8e91c512d1f5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 00:26:38.467118 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.467083    2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:38.467118 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.467114    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjcqz\" (UniqueName: \"kubernetes.io/projected/5f69fa56-543d-44ce-972d-8e91c512d1f5-kube-api-access-rjcqz\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:38.467118 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.467126    2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f69fa56-543d-44ce-972d-8e91c512d1f5-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:38.467356 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.467136    2560 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-cluster-tls-config\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:38.467356 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.467146    2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-web-config\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:38.467356 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.467154    2560 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-config-volume\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:38.467356 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.467162    2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:38.467356 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.467170    2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:38.467356 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.467178    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f69fa56-543d-44ce-972d-8e91c512d1f5-metrics-client-ca\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:38.467356 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.467188    2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f69fa56-543d-44ce-972d-8e91c512d1f5-tls-assets\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:38.467356 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.467195    2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f69fa56-543d-44ce-972d-8e91c512d1f5-config-out\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:38.467356 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.467203    2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f69fa56-543d-44ce-972d-8e91c512d1f5-secret-alertmanager-main-tls\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:38.822367 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.822335    2560 generic.go:356] "Generic (PLEG): container finished" podID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerID="0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173" exitCode=0
Jun 10 00:26:38.822367 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.822361    2560 generic.go:356] "Generic (PLEG): container finished" podID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerID="00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af" exitCode=0
Jun 10 00:26:38.822934 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.822415    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f69fa56-543d-44ce-972d-8e91c512d1f5","Type":"ContainerDied","Data":"0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173"}
Jun 10 00:26:38.822934 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.822431    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:38.822934 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.822488    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f69fa56-543d-44ce-972d-8e91c512d1f5","Type":"ContainerDied","Data":"00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af"}
Jun 10 00:26:38.822934 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.822518    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f69fa56-543d-44ce-972d-8e91c512d1f5","Type":"ContainerDied","Data":"6596901c372518b834d5d511cec8eddc2577a5bc1659c271093509d7bc59c96a"}
Jun 10 00:26:38.822934 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.822555    2560 scope.go:117] "RemoveContainer" containerID="36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d"
Jun 10 00:26:38.831116 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.831095    2560 scope.go:117] "RemoveContainer" containerID="0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173"
Jun 10 00:26:38.838627 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.838605    2560 scope.go:117] "RemoveContainer" containerID="b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644"
Jun 10 00:26:38.846057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.846030    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 00:26:38.846244 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.846214    2560 scope.go:117] "RemoveContainer" containerID="00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af"
Jun 10 00:26:38.849936 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.849906    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 00:26:38.853820 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.853803    2560 scope.go:117] "RemoveContainer" containerID="4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0"
Jun 10 00:26:38.861110 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.861092    2560 scope.go:117] "RemoveContainer" containerID="c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86"
Jun 10 00:26:38.868516 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.868497    2560 scope.go:117] "RemoveContainer" containerID="3a8ab2649c02bbc5f100347ceeb0f15de044db8fe4b06625c349e4fa5cd64f59"
Jun 10 00:26:38.872046 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872024    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 00:26:38.872312 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872300    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="config-reloader"
Jun 10 00:26:38.872366 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872313    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="config-reloader"
Jun 10 00:26:38.872366 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872326    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="kube-rbac-proxy"
Jun 10 00:26:38.872366 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872331    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="kube-rbac-proxy"
Jun 10 00:26:38.872366 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872339    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="kube-rbac-proxy-metric"
Jun 10 00:26:38.872366 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872344    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="kube-rbac-proxy-metric"
Jun 10 00:26:38.872366 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872351    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="prom-label-proxy"
Jun 10 00:26:38.872366 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872356    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="prom-label-proxy"
Jun 10 00:26:38.872366 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872365    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="kube-rbac-proxy-web"
Jun 10 00:26:38.872591 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872370    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="kube-rbac-proxy-web"
Jun 10 00:26:38.872591 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872381    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="init-config-reloader"
Jun 10 00:26:38.872591 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872385    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="init-config-reloader"
Jun 10 00:26:38.872591 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872397    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="alertmanager"
Jun 10 00:26:38.872591 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872402    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="alertmanager"
Jun 10 00:26:38.872591 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872445    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="prom-label-proxy"
Jun 10 00:26:38.872591 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872453    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="kube-rbac-proxy-metric"
Jun 10 00:26:38.872591 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872460    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="config-reloader"
Jun 10 00:26:38.872591 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872466    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="alertmanager"
Jun 10 00:26:38.872591 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872471    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="kube-rbac-proxy-web"
Jun 10 00:26:38.872591 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.872476    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" containerName="kube-rbac-proxy"
Jun 10 00:26:38.876050 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.875965    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:38.876106 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.876089    2560 scope.go:117] "RemoveContainer" containerID="36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d"
Jun 10 00:26:38.876414 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:26:38.876385    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d\": container with ID starting with 36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d not found: ID does not exist" containerID="36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d"
Jun 10 00:26:38.876517 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.876427    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d"} err="failed to get container status \"36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d\": rpc error: code = NotFound desc = could not find container \"36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d\": container with ID starting with 36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d not found: ID does not exist"
Jun 10 00:26:38.876517 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.876452    2560 scope.go:117] "RemoveContainer" containerID="0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173"
Jun 10 00:26:38.876791 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:26:38.876767    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173\": container with ID starting with 0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173 not found: ID does not exist" containerID="0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173"
Jun 10 00:26:38.876857 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.876803    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173"} err="failed to get container status \"0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173\": rpc error: code = NotFound desc = could not find container \"0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173\": container with ID starting with 0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173 not found: ID does not exist"
Jun 10 00:26:38.876857 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.876825    2560 scope.go:117] "RemoveContainer" containerID="b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644"
Jun 10 00:26:38.877141 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:26:38.877124    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644\": container with ID starting with b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644 not found: ID does not exist" containerID="b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644"
Jun 10 00:26:38.877206 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.877150    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644"} err="failed to get container status \"b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644\": rpc error: code = NotFound desc = could not find container \"b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644\": container with ID starting with b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644 not found: ID does not exist"
Jun 10 00:26:38.877206 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.877171    2560 scope.go:117] "RemoveContainer" containerID="00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af"
Jun 10 00:26:38.877476 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:26:38.877459    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af\": container with ID starting with 00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af not found: ID does not exist" containerID="00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af"
Jun 10 00:26:38.877518 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.877481    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af"} err="failed to get container status \"00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af\": rpc error: code = NotFound desc = could not find container \"00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af\": container with ID starting with 00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af not found: ID does not exist"
Jun 10 00:26:38.877518 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.877497    2560 scope.go:117] "RemoveContainer" containerID="4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0"
Jun 10 00:26:38.877774 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:26:38.877732    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0\": container with ID starting with 4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0 not found: ID does not exist" containerID="4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0"
Jun 10 00:26:38.877846 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.877777    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0"} err="failed to get container status \"4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0\": rpc error: code = NotFound desc = could not find container \"4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0\": container with ID starting with 4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0 not found: ID does not exist"
Jun 10 00:26:38.877846 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.877791    2560 scope.go:117] "RemoveContainer" containerID="c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86"
Jun 10 00:26:38.878000 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:26:38.877981    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86\": container with ID starting with c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86 not found: ID does not exist" containerID="c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86"
Jun 10 00:26:38.878052 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.878006    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86"} err="failed to get container status \"c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86\": rpc error: code = NotFound desc = could not find container \"c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86\": container with ID starting with c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86 not found: ID does not exist"
Jun 10 00:26:38.878052 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.878024    2560 scope.go:117] "RemoveContainer" containerID="3a8ab2649c02bbc5f100347ceeb0f15de044db8fe4b06625c349e4fa5cd64f59"
Jun 10 00:26:38.878279 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:26:38.878257    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a8ab2649c02bbc5f100347ceeb0f15de044db8fe4b06625c349e4fa5cd64f59\": container with ID starting with 3a8ab2649c02bbc5f100347ceeb0f15de044db8fe4b06625c349e4fa5cd64f59 not found: ID does not exist" containerID="3a8ab2649c02bbc5f100347ceeb0f15de044db8fe4b06625c349e4fa5cd64f59"
Jun 10 00:26:38.878349 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.878287    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a8ab2649c02bbc5f100347ceeb0f15de044db8fe4b06625c349e4fa5cd64f59"} err="failed to get container status \"3a8ab2649c02bbc5f100347ceeb0f15de044db8fe4b06625c349e4fa5cd64f59\": rpc error: code = NotFound desc = could not find container \"3a8ab2649c02bbc5f100347ceeb0f15de044db8fe4b06625c349e4fa5cd64f59\": container with ID starting with 3a8ab2649c02bbc5f100347ceeb0f15de044db8fe4b06625c349e4fa5cd64f59 not found: ID does not exist"
Jun 10 00:26:38.878349 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.878307    2560 scope.go:117] "RemoveContainer" containerID="36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d"
Jun 10 00:26:38.878457 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.878368    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 10 00:26:38.878457 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.878379    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 10 00:26:38.878457 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.878449    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 10 00:26:38.878609 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.878515    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 10 00:26:38.878609 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.878523    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 10 00:26:38.878609 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.878521    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 10 00:26:38.878609 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.878564    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 10 00:26:38.878609 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.878601    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4mfh6\""
Jun 10 00:26:38.878873 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.878650    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 10 00:26:38.879017 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.878992    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d"} err="failed to get container status \"36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d\": rpc error: code = NotFound desc = could not find container \"36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d\": container with ID starting with 36dba9cc70f347b2b3e33f631337cd2c4de98a2a3f642528e2fa47a1b10da42d not found: ID does not exist"
Jun 10 00:26:38.879064 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.879020    2560 scope.go:117] "RemoveContainer" containerID="0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173"
Jun 10 00:26:38.879387 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.879361    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173"} err="failed to get container status \"0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173\": rpc error: code = NotFound desc = could not find container \"0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173\": container with ID starting with 0b0a17818cb022f1a9d60b4c4a9806b52524e900eec71f98b9cb53c568b04173 not found: ID does not exist"
Jun 10 00:26:38.879456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.879390    2560 scope.go:117] "RemoveContainer" containerID="b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644"
Jun 10 00:26:38.879696 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.879674    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644"} err="failed to get container status \"b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644\": rpc error: code = NotFound desc = could not find container \"b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644\": container with ID starting with b3afcc2cc7cda7100a934eef328436b30e9da28a0ed02b9590cf9adcc46d3644 not found: ID does not exist"
Jun 10 00:26:38.879800 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.879699    2560 scope.go:117] "RemoveContainer" containerID="00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af"
Jun 10 00:26:38.879979 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.879955    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af"} err="failed to get container status \"00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af\": rpc error: code = NotFound desc = could not find container \"00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af\": container with ID starting with 00ac6f41456c1d44e96b1d2797d3e24d336fc0c8a3f4e6d07ce154bace5b47af not found: ID does not exist"
Jun 10 00:26:38.880053 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.879982    2560 scope.go:117] "RemoveContainer" containerID="4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0"
Jun 10 00:26:38.880273 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.880248    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0"} err="failed to get container status \"4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0\": rpc error: code = NotFound desc = could not find container \"4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0\": container with ID starting with 4afdb9c89a6bf411b890b42f1a5c225cf323086b2f0a1bdef4a763feb6266ef0 not found: ID does not exist"
Jun 10 00:26:38.880357 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.880275    2560 scope.go:117] "RemoveContainer" containerID="c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86"
Jun 10 00:26:38.880567 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.880546    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86"} err="failed to get container status \"c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86\": rpc error: code = NotFound desc = could not find container \"c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86\": container with ID starting with c97eaae70153d323d745472dbaace60b111f373afe106bc2e5386fefedd51a86 not found: ID does not exist"
Jun 10 00:26:38.880638 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.880568    2560 scope.go:117] "RemoveContainer" containerID="3a8ab2649c02bbc5f100347ceeb0f15de044db8fe4b06625c349e4fa5cd64f59"
Jun 10 00:26:38.881321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.880881    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a8ab2649c02bbc5f100347ceeb0f15de044db8fe4b06625c349e4fa5cd64f59"} err="failed to get container status \"3a8ab2649c02bbc5f100347ceeb0f15de044db8fe4b06625c349e4fa5cd64f59\": rpc error: code = NotFound desc = could not find container \"3a8ab2649c02bbc5f100347ceeb0f15de044db8fe4b06625c349e4fa5cd64f59\": container with ID starting with 3a8ab2649c02bbc5f100347ceeb0f15de044db8fe4b06625c349e4fa5cd64f59 not found: ID does not exist"
Jun 10 00:26:38.888919 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.888898    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 10 00:26:38.890562 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.890543    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 00:26:38.971733 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.971702    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8793e6be-6504-46e1-8095-ea27cfda13df-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:38.971899 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.971766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:38.971899 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.971792    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp9px\" (UniqueName: \"kubernetes.io/projected/8793e6be-6504-46e1-8095-ea27cfda13df-kube-api-access-rp9px\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:38.971899 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.971818    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8793e6be-6504-46e1-8095-ea27cfda13df-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:38.971899 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.971840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-config-volume\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:38.972029 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.971918    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:38.972029 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.971947    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8793e6be-6504-46e1-8095-ea27cfda13df-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:38.972029 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.971968    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8793e6be-6504-46e1-8095-ea27cfda13df-config-out\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:38.972029 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.971982    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-web-config\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:38.972150 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.972024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8793e6be-6504-46e1-8095-ea27cfda13df-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:38.972150 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.972048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:38.972150 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.972070    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:38.972150 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:38.972088    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.073052 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.072962    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.073052 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.073012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.073052 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.073049    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8793e6be-6504-46e1-8095-ea27cfda13df-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.073419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.073086    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.073419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.073107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp9px\" (UniqueName: \"kubernetes.io/projected/8793e6be-6504-46e1-8095-ea27cfda13df-kube-api-access-rp9px\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.073419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.073142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8793e6be-6504-46e1-8095-ea27cfda13df-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.073419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.073172    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-config-volume\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.073419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.073212    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.073419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.073235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8793e6be-6504-46e1-8095-ea27cfda13df-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.073419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.073262    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8793e6be-6504-46e1-8095-ea27cfda13df-config-out\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.073419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.073286    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-web-config\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.073419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.073315    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8793e6be-6504-46e1-8095-ea27cfda13df-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.073419 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.073345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.076351 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.076233    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8793e6be-6504-46e1-8095-ea27cfda13df-config-out\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.076949 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.076385    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8793e6be-6504-46e1-8095-ea27cfda13df-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.076949 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.076400    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.076949 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.076404    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.076949 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.076491    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.076949 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.076525    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8793e6be-6504-46e1-8095-ea27cfda13df-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.076949 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.076822    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.076949 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.076853    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-config-volume\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.076949 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.076898    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.077317 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.077112    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8793e6be-6504-46e1-8095-ea27cfda13df-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.077317 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.077148    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8793e6be-6504-46e1-8095-ea27cfda13df-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.078353 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.078335    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8793e6be-6504-46e1-8095-ea27cfda13df-web-config\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.080298 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.080278    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp9px\" (UniqueName: \"kubernetes.io/projected/8793e6be-6504-46e1-8095-ea27cfda13df-kube-api-access-rp9px\") pod \"alertmanager-main-0\" (UID: \"8793e6be-6504-46e1-8095-ea27cfda13df\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.189674 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.189634    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 00:26:39.336383 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.336223    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 00:26:39.338882 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:26:39.338854    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8793e6be_6504_46e1_8095_ea27cfda13df.slice/crio-e2db8d35868a3acb86058e0a05100dcc619a86ad3d04064a5f0973f2c8c798ee WatchSource:0}: Error finding container e2db8d35868a3acb86058e0a05100dcc619a86ad3d04064a5f0973f2c8c798ee: Status 404 returned error can't find the container with id e2db8d35868a3acb86058e0a05100dcc619a86ad3d04064a5f0973f2c8c798ee
Jun 10 00:26:39.614265 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.614191    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f69fa56-543d-44ce-972d-8e91c512d1f5" path="/var/lib/kubelet/pods/5f69fa56-543d-44ce-972d-8e91c512d1f5/volumes"
Jun 10 00:26:39.829492 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.829457    2560 generic.go:356] "Generic (PLEG): container finished" podID="8793e6be-6504-46e1-8095-ea27cfda13df" containerID="7b1521838749b63a69283c1887eb6851518c112e8e1573c03c50b89b6edffab6" exitCode=0
Jun 10 00:26:39.829924 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.829550    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8793e6be-6504-46e1-8095-ea27cfda13df","Type":"ContainerDied","Data":"7b1521838749b63a69283c1887eb6851518c112e8e1573c03c50b89b6edffab6"}
Jun 10 00:26:39.829924 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:39.829622    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8793e6be-6504-46e1-8095-ea27cfda13df","Type":"ContainerStarted","Data":"e2db8d35868a3acb86058e0a05100dcc619a86ad3d04064a5f0973f2c8c798ee"}
Jun 10 00:26:40.837035 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:40.836998    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8793e6be-6504-46e1-8095-ea27cfda13df","Type":"ContainerStarted","Data":"dce67d9603fcdad2cceaab2eff0127b524babbc896d07e1baaf1caeacceb65b3"}
Jun 10 00:26:40.837455 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:40.837060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8793e6be-6504-46e1-8095-ea27cfda13df","Type":"ContainerStarted","Data":"43f5cc6ea9eb356f1ff3423a878877f115a2b4f2458fea2ac843646ee31dc108"}
Jun 10 00:26:40.837455 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:40.837089    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8793e6be-6504-46e1-8095-ea27cfda13df","Type":"ContainerStarted","Data":"1ad3c7634d3acd06519238e66ea64b2223c10616e0c0364ff0c718418621401d"}
Jun 10 00:26:40.837455 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:40.837138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8793e6be-6504-46e1-8095-ea27cfda13df","Type":"ContainerStarted","Data":"1fb8aceb589bafe98812dd61205130484cbd91ff168d0d51096e28e11dbdaa06"}
Jun 10 00:26:40.837455 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:40.837162    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8793e6be-6504-46e1-8095-ea27cfda13df","Type":"ContainerStarted","Data":"2f9b30cb5835b14a5f77d7a73a8d4c1c0a9e026a79b765828184c889c12da9ab"}
Jun 10 00:26:40.837455 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:40.837186    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8793e6be-6504-46e1-8095-ea27cfda13df","Type":"ContainerStarted","Data":"45c9a547a3588c87a21bfcc3cea1acd00bbb46e8ee5ee05925c8a32e305333b4"}
Jun 10 00:26:40.863304 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:40.863251    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.848328769 podStartE2EDuration="2.863235669s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.9069ms" isStatefulPod=false podCreationTimestamp="2026-06-10 00:26:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:26:40.861095158 +0000 UTC m=+307.731871284" watchObservedRunningTime="2026-06-10 00:26:40.863235669 +0000 UTC m=+307.734011795"
Jun 10 00:26:41.742708 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:41.742675    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:41.807626 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:41.807588    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:44.231467 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:44.231432    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:44.331600 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:44.331563    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:44.516662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:44.516626    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:44.575249 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:44.575218    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:48.609493 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:48.609464    2560 scope.go:117] "RemoveContainer" containerID="86eb79708bcb84c0aa8bbc4ceb080ea494de8fb4d0029b440f1c65f5ce34cd6d"
Jun 10 00:26:48.803631 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:48.803587    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:48.855686 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:48.855646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:48.874565 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:48.874477    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8" event={"ID":"95e80606-43ce-4354-8d7f-74a02a9acd7f","Type":"ContainerStarted","Data":"73d66c6826c3d56858d075fa2799fd9f06a2a859e4030b1dbfdf9368c46bb082"}
Jun 10 00:26:48.874797 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:48.874779    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:26:48.876133 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:48.876113    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7487cc8f78-kdfs8"
Jun 10 00:26:50.743100 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:50.743060    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:53.695931 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:53.695892    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:53.742168 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:53.742136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:26:58.574273 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.574227    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b79c6b4b-6jrd4" podUID="e9936858-25f4-476c-8fda-149b6e1ed1c0" containerName="console" containerID="cri-o://60cfb3e12dbb454288acf0a6b79d62ff3ee380f626e7305ad6250a8298c07079" gracePeriod=15
Jun 10 00:26:58.819162 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.819137    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:26:58.916548 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.916464    2560 generic.go:356] "Generic (PLEG): container finished" podID="e9936858-25f4-476c-8fda-149b6e1ed1c0" containerID="60cfb3e12dbb454288acf0a6b79d62ff3ee380f626e7305ad6250a8298c07079" exitCode=0
Jun 10 00:26:58.916548 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.916520    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b79c6b4b-6jrd4"
Jun 10 00:26:58.916724 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.916556    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b79c6b4b-6jrd4" event={"ID":"e9936858-25f4-476c-8fda-149b6e1ed1c0","Type":"ContainerDied","Data":"60cfb3e12dbb454288acf0a6b79d62ff3ee380f626e7305ad6250a8298c07079"}
Jun 10 00:26:58.916724 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.916609    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b79c6b4b-6jrd4" event={"ID":"e9936858-25f4-476c-8fda-149b6e1ed1c0","Type":"ContainerDied","Data":"9df8992f45198cc2d492583e9aee768504c561a96c1e48c561ea289f7bad3a0c"}
Jun 10 00:26:58.916724 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.916638    2560 scope.go:117] "RemoveContainer" containerID="60cfb3e12dbb454288acf0a6b79d62ff3ee380f626e7305ad6250a8298c07079"
Jun 10 00:26:58.924643 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.924628    2560 scope.go:117] "RemoveContainer" containerID="60cfb3e12dbb454288acf0a6b79d62ff3ee380f626e7305ad6250a8298c07079"
Jun 10 00:26:58.924887 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:26:58.924867    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60cfb3e12dbb454288acf0a6b79d62ff3ee380f626e7305ad6250a8298c07079\": container with ID starting with 60cfb3e12dbb454288acf0a6b79d62ff3ee380f626e7305ad6250a8298c07079 not found: ID does not exist" containerID="60cfb3e12dbb454288acf0a6b79d62ff3ee380f626e7305ad6250a8298c07079"
Jun 10 00:26:58.924932 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.924896    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60cfb3e12dbb454288acf0a6b79d62ff3ee380f626e7305ad6250a8298c07079"} err="failed to get container status \"60cfb3e12dbb454288acf0a6b79d62ff3ee380f626e7305ad6250a8298c07079\": rpc error: code = NotFound desc = could not find container \"60cfb3e12dbb454288acf0a6b79d62ff3ee380f626e7305ad6250a8298c07079\": container with ID starting with 60cfb3e12dbb454288acf0a6b79d62ff3ee380f626e7305ad6250a8298c07079 not found: ID does not exist"
Jun 10 00:26:58.936686 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.936662    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-config\") pod \"e9936858-25f4-476c-8fda-149b6e1ed1c0\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") "
Jun 10 00:26:58.936821 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.936706    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-oauth-config\") pod \"e9936858-25f4-476c-8fda-149b6e1ed1c0\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") "
Jun 10 00:26:58.936821 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.936729    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-service-ca\") pod \"e9936858-25f4-476c-8fda-149b6e1ed1c0\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") "
Jun 10 00:26:58.936906 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.936889    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c78tj\" (UniqueName: \"kubernetes.io/projected/e9936858-25f4-476c-8fda-149b6e1ed1c0-kube-api-access-c78tj\") pod \"e9936858-25f4-476c-8fda-149b6e1ed1c0\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") "
Jun 10 00:26:58.936949 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.936922    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-serving-cert\") pod \"e9936858-25f4-476c-8fda-149b6e1ed1c0\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") "
Jun 10 00:26:58.937122 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.937079    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-oauth-serving-cert\") pod \"e9936858-25f4-476c-8fda-149b6e1ed1c0\" (UID: \"e9936858-25f4-476c-8fda-149b6e1ed1c0\") "
Jun 10 00:26:58.937251 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.937123    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-service-ca" (OuterVolumeSpecName: "service-ca") pod "e9936858-25f4-476c-8fda-149b6e1ed1c0" (UID: "e9936858-25f4-476c-8fda-149b6e1ed1c0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 00:26:58.937251 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.937131    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-config" (OuterVolumeSpecName: "console-config") pod "e9936858-25f4-476c-8fda-149b6e1ed1c0" (UID: "e9936858-25f4-476c-8fda-149b6e1ed1c0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 00:26:58.937384 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.937364    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-service-ca\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:58.937447 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.937391    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-config\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:58.937447 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.937408    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e9936858-25f4-476c-8fda-149b6e1ed1c0" (UID: "e9936858-25f4-476c-8fda-149b6e1ed1c0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 00:26:58.939206 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.939186    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e9936858-25f4-476c-8fda-149b6e1ed1c0" (UID: "e9936858-25f4-476c-8fda-149b6e1ed1c0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 00:26:58.939549 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.939533    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e9936858-25f4-476c-8fda-149b6e1ed1c0" (UID: "e9936858-25f4-476c-8fda-149b6e1ed1c0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 00:26:58.939612 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:58.939560    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9936858-25f4-476c-8fda-149b6e1ed1c0-kube-api-access-c78tj" (OuterVolumeSpecName: "kube-api-access-c78tj") pod "e9936858-25f4-476c-8fda-149b6e1ed1c0" (UID: "e9936858-25f4-476c-8fda-149b6e1ed1c0"). InnerVolumeSpecName "kube-api-access-c78tj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:26:59.038173 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:59.038134    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-oauth-config\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:59.038173 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:59.038165    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c78tj\" (UniqueName: \"kubernetes.io/projected/e9936858-25f4-476c-8fda-149b6e1ed1c0-kube-api-access-c78tj\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:59.038173 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:59.038175    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9936858-25f4-476c-8fda-149b6e1ed1c0-console-serving-cert\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:59.038173 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:59.038183    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9936858-25f4-476c-8fda-149b6e1ed1c0-oauth-serving-cert\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:26:59.240400 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:59.240360    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b79c6b4b-6jrd4"]
Jun 10 00:26:59.244497 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:59.244467    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b79c6b4b-6jrd4"]
Jun 10 00:26:59.614725 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:26:59.614688    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9936858-25f4-476c-8fda-149b6e1ed1c0" path="/var/lib/kubelet/pods/e9936858-25f4-476c-8fda-149b6e1ed1c0/volumes"
Jun 10 00:27:02.805169 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:27:02.805106    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:27:02.909198 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:27:02.909165    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:27:03.804611 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:27:03.804576    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:27:03.906322 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:27:03.906284    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:27:33.242589 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:27:33.242506    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:27:33.341689 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:27:33.341651    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:27:33.809063 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:27:33.809026    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:27:33.910015 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:27:33.909916    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:27:46.372968 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:27:46.372932    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:01.282982 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.282934    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:01.382680 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.382644    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:01.765568 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.765528    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh"]
Jun 10 00:28:01.765916 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.765901    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9936858-25f4-476c-8fda-149b6e1ed1c0" containerName="console"
Jun 10 00:28:01.765974 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.765918    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9936858-25f4-476c-8fda-149b6e1ed1c0" containerName="console"
Jun 10 00:28:01.766009 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.765988    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9936858-25f4-476c-8fda-149b6e1ed1c0" containerName="console"
Jun 10 00:28:01.768970 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.768950    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh"
Jun 10 00:28:01.771430 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.771412    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 10 00:28:01.771521 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.771425    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-56dt5\""
Jun 10 00:28:01.772317 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.772299    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 10 00:28:01.776023 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.776004    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh"]
Jun 10 00:28:01.847394 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.847353    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpztm\" (UniqueName: \"kubernetes.io/projected/582c7633-bbde-4693-ac07-6e042ffa742a-kube-api-access-hpztm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh\" (UID: \"582c7633-bbde-4693-ac07-6e042ffa742a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh"
Jun 10 00:28:01.847394 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.847392    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/582c7633-bbde-4693-ac07-6e042ffa742a-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh\" (UID: \"582c7633-bbde-4693-ac07-6e042ffa742a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh"
Jun 10 00:28:01.847665 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.847422    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/582c7633-bbde-4693-ac07-6e042ffa742a-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh\" (UID: \"582c7633-bbde-4693-ac07-6e042ffa742a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh"
Jun 10 00:28:01.948280 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.948238    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpztm\" (UniqueName: \"kubernetes.io/projected/582c7633-bbde-4693-ac07-6e042ffa742a-kube-api-access-hpztm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh\" (UID: \"582c7633-bbde-4693-ac07-6e042ffa742a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh"
Jun 10 00:28:01.948280 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.948283    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/582c7633-bbde-4693-ac07-6e042ffa742a-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh\" (UID: \"582c7633-bbde-4693-ac07-6e042ffa742a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh"
Jun 10 00:28:01.948529 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.948505    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/582c7633-bbde-4693-ac07-6e042ffa742a-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh\" (UID: \"582c7633-bbde-4693-ac07-6e042ffa742a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh"
Jun 10 00:28:01.948692 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.948676    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/582c7633-bbde-4693-ac07-6e042ffa742a-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh\" (UID: \"582c7633-bbde-4693-ac07-6e042ffa742a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh"
Jun 10 00:28:01.948862 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.948847    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/582c7633-bbde-4693-ac07-6e042ffa742a-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh\" (UID: \"582c7633-bbde-4693-ac07-6e042ffa742a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh"
Jun 10 00:28:01.956672 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:01.956640    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpztm\" (UniqueName: \"kubernetes.io/projected/582c7633-bbde-4693-ac07-6e042ffa742a-kube-api-access-hpztm\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh\" (UID: \"582c7633-bbde-4693-ac07-6e042ffa742a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh"
Jun 10 00:28:02.078686 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:02.078594    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh"
Jun 10 00:28:02.211703 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:02.211659    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh"]
Jun 10 00:28:02.214509 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:28:02.214474    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod582c7633_bbde_4693_ac07_6e042ffa742a.slice/crio-f27de0c7bea471f7dc45f00ae3ffab960a487337e1204a840f3d59dc742cc4e7 WatchSource:0}: Error finding container f27de0c7bea471f7dc45f00ae3ffab960a487337e1204a840f3d59dc742cc4e7: Status 404 returned error can't find the container with id f27de0c7bea471f7dc45f00ae3ffab960a487337e1204a840f3d59dc742cc4e7
Jun 10 00:28:02.216494 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:02.216476    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 10 00:28:03.176540 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:03.176505    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh" event={"ID":"582c7633-bbde-4693-ac07-6e042ffa742a","Type":"ContainerStarted","Data":"f27de0c7bea471f7dc45f00ae3ffab960a487337e1204a840f3d59dc742cc4e7"}
Jun 10 00:28:14.226765 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:14.226708    2560 generic.go:356] "Generic (PLEG): container finished" podID="582c7633-bbde-4693-ac07-6e042ffa742a" containerID="7174f79d951fd6d70fa5bf98beef9fa2dcf77daf4fbf59fbbe93e44e42838019" exitCode=0
Jun 10 00:28:14.227223 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:14.226796    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh" event={"ID":"582c7633-bbde-4693-ac07-6e042ffa742a","Type":"ContainerDied","Data":"7174f79d951fd6d70fa5bf98beef9fa2dcf77daf4fbf59fbbe93e44e42838019"}
Jun 10 00:28:17.240762 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:17.240710    2560 generic.go:356] "Generic (PLEG): container finished" podID="582c7633-bbde-4693-ac07-6e042ffa742a" containerID="1c7424d9b07f332c44f8c359fb5b6f98aaf12b6202169fad67deca4b2a50f102" exitCode=0
Jun 10 00:28:17.241228 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:17.240788    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh" event={"ID":"582c7633-bbde-4693-ac07-6e042ffa742a","Type":"ContainerDied","Data":"1c7424d9b07f332c44f8c359fb5b6f98aaf12b6202169fad67deca4b2a50f102"}
Jun 10 00:28:26.796280 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:26.796240    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:29.298283 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:29.298247    2560 generic.go:356] "Generic (PLEG): container finished" podID="582c7633-bbde-4693-ac07-6e042ffa742a" containerID="7a6bc7247add6aa0a14ef0c3f8a00756f3708a55ff9fbe1b24bc0feea5cee1a0" exitCode=0
Jun 10 00:28:29.298656 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:29.298331    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh" event={"ID":"582c7633-bbde-4693-ac07-6e042ffa742a","Type":"ContainerDied","Data":"7a6bc7247add6aa0a14ef0c3f8a00756f3708a55ff9fbe1b24bc0feea5cee1a0"}
Jun 10 00:28:30.440126 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:30.440104    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh"
Jun 10 00:28:30.496595 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:30.496541    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/582c7633-bbde-4693-ac07-6e042ffa742a-bundle\") pod \"582c7633-bbde-4693-ac07-6e042ffa742a\" (UID: \"582c7633-bbde-4693-ac07-6e042ffa742a\") "
Jun 10 00:28:30.496595 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:30.496605    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpztm\" (UniqueName: \"kubernetes.io/projected/582c7633-bbde-4693-ac07-6e042ffa742a-kube-api-access-hpztm\") pod \"582c7633-bbde-4693-ac07-6e042ffa742a\" (UID: \"582c7633-bbde-4693-ac07-6e042ffa742a\") "
Jun 10 00:28:30.496862 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:30.496653    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/582c7633-bbde-4693-ac07-6e042ffa742a-util\") pod \"582c7633-bbde-4693-ac07-6e042ffa742a\" (UID: \"582c7633-bbde-4693-ac07-6e042ffa742a\") "
Jun 10 00:28:30.497446 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:30.497419    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/582c7633-bbde-4693-ac07-6e042ffa742a-bundle" (OuterVolumeSpecName: "bundle") pod "582c7633-bbde-4693-ac07-6e042ffa742a" (UID: "582c7633-bbde-4693-ac07-6e042ffa742a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:28:30.499040 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:30.499019    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/582c7633-bbde-4693-ac07-6e042ffa742a-kube-api-access-hpztm" (OuterVolumeSpecName: "kube-api-access-hpztm") pod "582c7633-bbde-4693-ac07-6e042ffa742a" (UID: "582c7633-bbde-4693-ac07-6e042ffa742a"). InnerVolumeSpecName "kube-api-access-hpztm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:28:30.501301 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:30.501281    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/582c7633-bbde-4693-ac07-6e042ffa742a-util" (OuterVolumeSpecName: "util") pod "582c7633-bbde-4693-ac07-6e042ffa742a" (UID: "582c7633-bbde-4693-ac07-6e042ffa742a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:28:30.597807 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:30.597717    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/582c7633-bbde-4693-ac07-6e042ffa742a-bundle\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:28:30.597807 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:30.597768    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpztm\" (UniqueName: \"kubernetes.io/projected/582c7633-bbde-4693-ac07-6e042ffa742a-kube-api-access-hpztm\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:28:30.597807 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:30.597792    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/582c7633-bbde-4693-ac07-6e042ffa742a-util\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:28:31.308713 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:31.308673    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh" event={"ID":"582c7633-bbde-4693-ac07-6e042ffa742a","Type":"ContainerDied","Data":"f27de0c7bea471f7dc45f00ae3ffab960a487337e1204a840f3d59dc742cc4e7"}
Jun 10 00:28:31.308713 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:31.308717    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d94clh"
Jun 10 00:28:31.308944 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:31.308721    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f27de0c7bea471f7dc45f00ae3ffab960a487337e1204a840f3d59dc742cc4e7"
Jun 10 00:28:32.567076 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:32.567039    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:34.130170 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.130136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:34.335385 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.335351    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2gj8x"]
Jun 10 00:28:34.335707 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.335693    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="582c7633-bbde-4693-ac07-6e042ffa742a" containerName="pull"
Jun 10 00:28:34.335778 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.335710    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="582c7633-bbde-4693-ac07-6e042ffa742a" containerName="pull"
Jun 10 00:28:34.335778 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.335722    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="582c7633-bbde-4693-ac07-6e042ffa742a" containerName="extract"
Jun 10 00:28:34.335778 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.335728    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="582c7633-bbde-4693-ac07-6e042ffa742a" containerName="extract"
Jun 10 00:28:34.335778 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.335758    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="582c7633-bbde-4693-ac07-6e042ffa742a" containerName="util"
Jun 10 00:28:34.335778 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.335767    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="582c7633-bbde-4693-ac07-6e042ffa742a" containerName="util"
Jun 10 00:28:34.335934 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.335827    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="582c7633-bbde-4693-ac07-6e042ffa742a" containerName="extract"
Jun 10 00:28:34.338914 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.338897    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2gj8x"
Jun 10 00:28:34.342606 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.342583    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jun 10 00:28:34.342766 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.342626    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jun 10 00:28:34.342766 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.342652    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-p74v7\""
Jun 10 00:28:34.357305 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.357278    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2gj8x"]
Jun 10 00:28:34.430081 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.429997    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8573c9ba-6a6e-4105-aedb-319c4f7a06c3-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2gj8x\" (UID: \"8573c9ba-6a6e-4105-aedb-319c4f7a06c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2gj8x"
Jun 10 00:28:34.430081 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.430061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpz4w\" (UniqueName: \"kubernetes.io/projected/8573c9ba-6a6e-4105-aedb-319c4f7a06c3-kube-api-access-mpz4w\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2gj8x\" (UID: \"8573c9ba-6a6e-4105-aedb-319c4f7a06c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2gj8x"
Jun 10 00:28:34.530956 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.530914    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpz4w\" (UniqueName: \"kubernetes.io/projected/8573c9ba-6a6e-4105-aedb-319c4f7a06c3-kube-api-access-mpz4w\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2gj8x\" (UID: \"8573c9ba-6a6e-4105-aedb-319c4f7a06c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2gj8x"
Jun 10 00:28:34.531136 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.530990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8573c9ba-6a6e-4105-aedb-319c4f7a06c3-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2gj8x\" (UID: \"8573c9ba-6a6e-4105-aedb-319c4f7a06c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2gj8x"
Jun 10 00:28:34.531338 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.531323    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8573c9ba-6a6e-4105-aedb-319c4f7a06c3-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2gj8x\" (UID: \"8573c9ba-6a6e-4105-aedb-319c4f7a06c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2gj8x"
Jun 10 00:28:34.542085 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.542058    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpz4w\" (UniqueName: \"kubernetes.io/projected/8573c9ba-6a6e-4105-aedb-319c4f7a06c3-kube-api-access-mpz4w\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2gj8x\" (UID: \"8573c9ba-6a6e-4105-aedb-319c4f7a06c3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2gj8x"
Jun 10 00:28:34.648148 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.648114    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2gj8x"
Jun 10 00:28:34.786195 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:34.786160    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2gj8x"]
Jun 10 00:28:34.789693 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:28:34.789666    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8573c9ba_6a6e_4105_aedb_319c4f7a06c3.slice/crio-58381eb14febd0423a21c4bdd4df54221da0cb37f2d374d86188b298dee48544 WatchSource:0}: Error finding container 58381eb14febd0423a21c4bdd4df54221da0cb37f2d374d86188b298dee48544: Status 404 returned error can't find the container with id 58381eb14febd0423a21c4bdd4df54221da0cb37f2d374d86188b298dee48544
Jun 10 00:28:35.326613 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:35.326575    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2gj8x" event={"ID":"8573c9ba-6a6e-4105-aedb-319c4f7a06c3","Type":"ContainerStarted","Data":"58381eb14febd0423a21c4bdd4df54221da0cb37f2d374d86188b298dee48544"}
Jun 10 00:28:35.972885 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:35.972846    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:36.074202 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:36.073962    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:37.337681 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:37.337642    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2gj8x" event={"ID":"8573c9ba-6a6e-4105-aedb-319c4f7a06c3","Type":"ContainerStarted","Data":"59669c6e35e101ad7fa83d622d797831d597a95f2cdf7581b54a2289e10db368"}
Jun 10 00:28:37.358935 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:37.358879    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2gj8x" podStartSLOduration=1.351137306 podStartE2EDuration="3.358863116s" totalImagesPullingTime="2.00772581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:28:37.356571876 +0000 UTC m=+424.227348003" watchObservedRunningTime="2026-06-10 00:28:37.358863116 +0000 UTC m=+424.229639242"
Jun 10 00:28:37.523954 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:37.523915    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:37.626493 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:37.626391    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:37.781161 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:37.781126    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:37.881783 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:37.881685    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:38.791439 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:38.791395    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d"]
Jun 10 00:28:38.795222 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:38.795200    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d"
Jun 10 00:28:38.797398 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:38.797379    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 10 00:28:38.797514 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:38.797484    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-56dt5\""
Jun 10 00:28:38.798345 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:38.798326    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 10 00:28:38.805986 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:38.805958    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d"]
Jun 10 00:28:38.870980 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:38.870942    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/789bb1fb-1181-476c-9266-a366518f6f53-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d\" (UID: \"789bb1fb-1181-476c-9266-a366518f6f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d"
Jun 10 00:28:38.870980 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:38.870984    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jd6f\" (UniqueName: \"kubernetes.io/projected/789bb1fb-1181-476c-9266-a366518f6f53-kube-api-access-8jd6f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d\" (UID: \"789bb1fb-1181-476c-9266-a366518f6f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d"
Jun 10 00:28:38.871189 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:38.871042    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/789bb1fb-1181-476c-9266-a366518f6f53-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d\" (UID: \"789bb1fb-1181-476c-9266-a366518f6f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d"
Jun 10 00:28:38.972132 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:38.972097    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/789bb1fb-1181-476c-9266-a366518f6f53-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d\" (UID: \"789bb1fb-1181-476c-9266-a366518f6f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d"
Jun 10 00:28:38.972292 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:38.972182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/789bb1fb-1181-476c-9266-a366518f6f53-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d\" (UID: \"789bb1fb-1181-476c-9266-a366518f6f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d"
Jun 10 00:28:38.972292 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:38.972216    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jd6f\" (UniqueName: \"kubernetes.io/projected/789bb1fb-1181-476c-9266-a366518f6f53-kube-api-access-8jd6f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d\" (UID: \"789bb1fb-1181-476c-9266-a366518f6f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d"
Jun 10 00:28:38.972565 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:38.972542    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/789bb1fb-1181-476c-9266-a366518f6f53-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d\" (UID: \"789bb1fb-1181-476c-9266-a366518f6f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d"
Jun 10 00:28:38.972603 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:38.972553    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/789bb1fb-1181-476c-9266-a366518f6f53-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d\" (UID: \"789bb1fb-1181-476c-9266-a366518f6f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d"
Jun 10 00:28:38.979970 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:38.979938    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jd6f\" (UniqueName: \"kubernetes.io/projected/789bb1fb-1181-476c-9266-a366518f6f53-kube-api-access-8jd6f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d\" (UID: \"789bb1fb-1181-476c-9266-a366518f6f53\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d"
Jun 10 00:28:39.105834 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.105727    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d"
Jun 10 00:28:39.239675 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.239600    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d"]
Jun 10 00:28:39.242389 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:28:39.242361    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod789bb1fb_1181_476c_9266_a366518f6f53.slice/crio-e8b59693e390ae9ec9e290613ec24ebaafb9541c1f62222ca54a9a17799b1ce4 WatchSource:0}: Error finding container e8b59693e390ae9ec9e290613ec24ebaafb9541c1f62222ca54a9a17799b1ce4: Status 404 returned error can't find the container with id e8b59693e390ae9ec9e290613ec24ebaafb9541c1f62222ca54a9a17799b1ce4
Jun 10 00:28:39.347810 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.347780    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d" event={"ID":"789bb1fb-1181-476c-9266-a366518f6f53","Type":"ContainerStarted","Data":"6a9788ba463cfc415996f0e952ebf76cb2b070b866841d35d8074bee8751e531"}
Jun 10 00:28:39.347945 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.347850    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d" event={"ID":"789bb1fb-1181-476c-9266-a366518f6f53","Type":"ContainerStarted","Data":"e8b59693e390ae9ec9e290613ec24ebaafb9541c1f62222ca54a9a17799b1ce4"}
Jun 10 00:28:39.478034 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.477935    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-llwtg"]
Jun 10 00:28:39.481287 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.481270    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-llwtg"
Jun 10 00:28:39.483357 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.483332    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jun 10 00:28:39.483493 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.483401    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jun 10 00:28:39.483563 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.483508    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zhr4c\""
Jun 10 00:28:39.490613 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.490592    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-llwtg"]
Jun 10 00:28:39.578237 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.578196    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slddf\" (UniqueName: \"kubernetes.io/projected/cbdbb387-5cc9-4c49-af5f-0ccce4098005-kube-api-access-slddf\") pod \"cert-manager-webhook-7dc76cbb94-llwtg\" (UID: \"cbdbb387-5cc9-4c49-af5f-0ccce4098005\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-llwtg"
Jun 10 00:28:39.578416 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.578279    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbdbb387-5cc9-4c49-af5f-0ccce4098005-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-llwtg\" (UID: \"cbdbb387-5cc9-4c49-af5f-0ccce4098005\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-llwtg"
Jun 10 00:28:39.679001 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.678960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slddf\" (UniqueName: \"kubernetes.io/projected/cbdbb387-5cc9-4c49-af5f-0ccce4098005-kube-api-access-slddf\") pod \"cert-manager-webhook-7dc76cbb94-llwtg\" (UID: \"cbdbb387-5cc9-4c49-af5f-0ccce4098005\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-llwtg"
Jun 10 00:28:39.679184 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.679035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbdbb387-5cc9-4c49-af5f-0ccce4098005-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-llwtg\" (UID: \"cbdbb387-5cc9-4c49-af5f-0ccce4098005\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-llwtg"
Jun 10 00:28:39.686988 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.686951    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbdbb387-5cc9-4c49-af5f-0ccce4098005-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-llwtg\" (UID: \"cbdbb387-5cc9-4c49-af5f-0ccce4098005\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-llwtg"
Jun 10 00:28:39.687163 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.687143    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slddf\" (UniqueName: \"kubernetes.io/projected/cbdbb387-5cc9-4c49-af5f-0ccce4098005-kube-api-access-slddf\") pod \"cert-manager-webhook-7dc76cbb94-llwtg\" (UID: \"cbdbb387-5cc9-4c49-af5f-0ccce4098005\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-llwtg"
Jun 10 00:28:39.804313 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.804285    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-llwtg"
Jun 10 00:28:39.938066 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:39.938030    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-llwtg"]
Jun 10 00:28:39.940781 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:28:39.940735    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbdbb387_5cc9_4c49_af5f_0ccce4098005.slice/crio-1b43bf19958ec77d9d19e4bc3d6b62d12f3734ea0afbd62fc3e9d9f4cc639169 WatchSource:0}: Error finding container 1b43bf19958ec77d9d19e4bc3d6b62d12f3734ea0afbd62fc3e9d9f4cc639169: Status 404 returned error can't find the container with id 1b43bf19958ec77d9d19e4bc3d6b62d12f3734ea0afbd62fc3e9d9f4cc639169
Jun 10 00:28:40.353949 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:40.353914    2560 generic.go:356] "Generic (PLEG): container finished" podID="789bb1fb-1181-476c-9266-a366518f6f53" containerID="6a9788ba463cfc415996f0e952ebf76cb2b070b866841d35d8074bee8751e531" exitCode=0
Jun 10 00:28:40.354141 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:40.354002    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d" event={"ID":"789bb1fb-1181-476c-9266-a366518f6f53","Type":"ContainerDied","Data":"6a9788ba463cfc415996f0e952ebf76cb2b070b866841d35d8074bee8751e531"}
Jun 10 00:28:40.355229 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:40.355209    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-llwtg" event={"ID":"cbdbb387-5cc9-4c49-af5f-0ccce4098005","Type":"ContainerStarted","Data":"1b43bf19958ec77d9d19e4bc3d6b62d12f3734ea0afbd62fc3e9d9f4cc639169"}
Jun 10 00:28:40.831280 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:40.831245    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:41.419635 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:41.419606    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:42.967943 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:42.967906    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:43.031086 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:43.031043    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:44.376244 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:44.376210    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-llwtg" event={"ID":"cbdbb387-5cc9-4c49-af5f-0ccce4098005","Type":"ContainerStarted","Data":"be78804f916f57287b9541ba33687d8ac17950f7bd3cb3f69840231c28f93f04"}
Jun 10 00:28:44.376683 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:44.376262    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-llwtg"
Jun 10 00:28:44.377930 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:44.377909    2560 generic.go:356] "Generic (PLEG): container finished" podID="789bb1fb-1181-476c-9266-a366518f6f53" containerID="11be0211915c43271449faef5dbd49b2f1947b7ffe67efd313625827f9accce3" exitCode=0
Jun 10 00:28:44.378023 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:44.377958    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d" event={"ID":"789bb1fb-1181-476c-9266-a366518f6f53","Type":"ContainerDied","Data":"11be0211915c43271449faef5dbd49b2f1947b7ffe67efd313625827f9accce3"}
Jun 10 00:28:44.391009 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:44.390959    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-llwtg" podStartSLOduration=1.950560872 podStartE2EDuration="5.390946031s" totalImagesPullingTime="3.440385159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:28:44.389313157 +0000 UTC m=+431.260089284" watchObservedRunningTime="2026-06-10 00:28:44.390946031 +0000 UTC m=+431.261722158"
Jun 10 00:28:45.384958 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:45.384925    2560 generic.go:356] "Generic (PLEG): container finished" podID="789bb1fb-1181-476c-9266-a366518f6f53" containerID="753862c0d38d40dec38059165cbda02773fe57e61880f4881d8f9e59f88f76c2" exitCode=0
Jun 10 00:28:45.385426 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:45.385075    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d" event={"ID":"789bb1fb-1181-476c-9266-a366518f6f53","Type":"ContainerDied","Data":"753862c0d38d40dec38059165cbda02773fe57e61880f4881d8f9e59f88f76c2"}
Jun 10 00:28:46.553706 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:46.553665    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d"
Jun 10 00:28:46.640044 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:46.639957    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jd6f\" (UniqueName: \"kubernetes.io/projected/789bb1fb-1181-476c-9266-a366518f6f53-kube-api-access-8jd6f\") pod \"789bb1fb-1181-476c-9266-a366518f6f53\" (UID: \"789bb1fb-1181-476c-9266-a366518f6f53\") "
Jun 10 00:28:46.640207 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:46.640072    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/789bb1fb-1181-476c-9266-a366518f6f53-util\") pod \"789bb1fb-1181-476c-9266-a366518f6f53\" (UID: \"789bb1fb-1181-476c-9266-a366518f6f53\") "
Jun 10 00:28:46.640207 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:46.640148    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/789bb1fb-1181-476c-9266-a366518f6f53-bundle\") pod \"789bb1fb-1181-476c-9266-a366518f6f53\" (UID: \"789bb1fb-1181-476c-9266-a366518f6f53\") "
Jun 10 00:28:46.640572 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:46.640527    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/789bb1fb-1181-476c-9266-a366518f6f53-bundle" (OuterVolumeSpecName: "bundle") pod "789bb1fb-1181-476c-9266-a366518f6f53" (UID: "789bb1fb-1181-476c-9266-a366518f6f53"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:28:46.642250 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:46.642225    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/789bb1fb-1181-476c-9266-a366518f6f53-kube-api-access-8jd6f" (OuterVolumeSpecName: "kube-api-access-8jd6f") pod "789bb1fb-1181-476c-9266-a366518f6f53" (UID: "789bb1fb-1181-476c-9266-a366518f6f53"). InnerVolumeSpecName "kube-api-access-8jd6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:28:46.644851 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:46.644830    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/789bb1fb-1181-476c-9266-a366518f6f53-util" (OuterVolumeSpecName: "util") pod "789bb1fb-1181-476c-9266-a366518f6f53" (UID: "789bb1fb-1181-476c-9266-a366518f6f53"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:28:46.742003 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:46.741964    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/789bb1fb-1181-476c-9266-a366518f6f53-bundle\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:28:46.742003 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:46.742002    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jd6f\" (UniqueName: \"kubernetes.io/projected/789bb1fb-1181-476c-9266-a366518f6f53-kube-api-access-8jd6f\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:28:46.742191 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:46.742018    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/789bb1fb-1181-476c-9266-a366518f6f53-util\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:28:47.160018 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:47.159983    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:47.234152 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:47.234121    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:47.398758 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:47.398707    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d"
Jun 10 00:28:47.398758 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:47.398729    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz7z7d" event={"ID":"789bb1fb-1181-476c-9266-a366518f6f53","Type":"ContainerDied","Data":"e8b59693e390ae9ec9e290613ec24ebaafb9541c1f62222ca54a9a17799b1ce4"}
Jun 10 00:28:47.398952 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:47.398795    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8b59693e390ae9ec9e290613ec24ebaafb9541c1f62222ca54a9a17799b1ce4"
Jun 10 00:28:49.247933 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:49.247903    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:50.387784 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:50.387733    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-llwtg"
Jun 10 00:28:52.287717 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.287636    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-pj584"]
Jun 10 00:28:52.288090 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.287999    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="789bb1fb-1181-476c-9266-a366518f6f53" containerName="pull"
Jun 10 00:28:52.288090 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.288012    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="789bb1fb-1181-476c-9266-a366518f6f53" containerName="pull"
Jun 10 00:28:52.288090 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.288020    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="789bb1fb-1181-476c-9266-a366518f6f53" containerName="util"
Jun 10 00:28:52.288090 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.288025    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="789bb1fb-1181-476c-9266-a366518f6f53" containerName="util"
Jun 10 00:28:52.288090 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.288033    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="789bb1fb-1181-476c-9266-a366518f6f53" containerName="extract"
Jun 10 00:28:52.288090 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.288039    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="789bb1fb-1181-476c-9266-a366518f6f53" containerName="extract"
Jun 10 00:28:52.288090 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.288090    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="789bb1fb-1181-476c-9266-a366518f6f53" containerName="extract"
Jun 10 00:28:52.290913 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.290897    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-pj584"
Jun 10 00:28:52.293074 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.293052    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-p4jc6\""
Jun 10 00:28:52.300817 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.300785    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-pj584"]
Jun 10 00:28:52.390107 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.390062    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvfkp\" (UniqueName: \"kubernetes.io/projected/20dd55b0-aabb-40aa-bac4-5f453c32858d-kube-api-access-tvfkp\") pod \"cert-manager-59c77684cc-pj584\" (UID: \"20dd55b0-aabb-40aa-bac4-5f453c32858d\") " pod="cert-manager/cert-manager-59c77684cc-pj584"
Jun 10 00:28:52.390293 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.390135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20dd55b0-aabb-40aa-bac4-5f453c32858d-bound-sa-token\") pod \"cert-manager-59c77684cc-pj584\" (UID: \"20dd55b0-aabb-40aa-bac4-5f453c32858d\") " pod="cert-manager/cert-manager-59c77684cc-pj584"
Jun 10 00:28:52.490658 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.490600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvfkp\" (UniqueName: \"kubernetes.io/projected/20dd55b0-aabb-40aa-bac4-5f453c32858d-kube-api-access-tvfkp\") pod \"cert-manager-59c77684cc-pj584\" (UID: \"20dd55b0-aabb-40aa-bac4-5f453c32858d\") " pod="cert-manager/cert-manager-59c77684cc-pj584"
Jun 10 00:28:52.490886 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.490699    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20dd55b0-aabb-40aa-bac4-5f453c32858d-bound-sa-token\") pod \"cert-manager-59c77684cc-pj584\" (UID: \"20dd55b0-aabb-40aa-bac4-5f453c32858d\") " pod="cert-manager/cert-manager-59c77684cc-pj584"
Jun 10 00:28:52.498090 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.498059    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20dd55b0-aabb-40aa-bac4-5f453c32858d-bound-sa-token\") pod \"cert-manager-59c77684cc-pj584\" (UID: \"20dd55b0-aabb-40aa-bac4-5f453c32858d\") " pod="cert-manager/cert-manager-59c77684cc-pj584"
Jun 10 00:28:52.498221 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.498177    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvfkp\" (UniqueName: \"kubernetes.io/projected/20dd55b0-aabb-40aa-bac4-5f453c32858d-kube-api-access-tvfkp\") pod \"cert-manager-59c77684cc-pj584\" (UID: \"20dd55b0-aabb-40aa-bac4-5f453c32858d\") " pod="cert-manager/cert-manager-59c77684cc-pj584"
Jun 10 00:28:52.607142 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.607052    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-pj584"
Jun 10 00:28:52.736997 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:52.736960    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-pj584"]
Jun 10 00:28:52.741032 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:28:52.741010    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20dd55b0_aabb_40aa_bac4_5f453c32858d.slice/crio-468869706a4edfc71e2ef347ddbf2640481895456d1694ebabb64a5a0437a281 WatchSource:0}: Error finding container 468869706a4edfc71e2ef347ddbf2640481895456d1694ebabb64a5a0437a281: Status 404 returned error can't find the container with id 468869706a4edfc71e2ef347ddbf2640481895456d1694ebabb64a5a0437a281
Jun 10 00:28:53.426158 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:53.426124    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-pj584" event={"ID":"20dd55b0-aabb-40aa-bac4-5f453c32858d","Type":"ContainerStarted","Data":"94976c39c1a55635f739c54bbeedd1faaa3425ed18266ba3d90166400d972ee7"}
Jun 10 00:28:53.426571 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:53.426166    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-pj584" event={"ID":"20dd55b0-aabb-40aa-bac4-5f453c32858d","Type":"ContainerStarted","Data":"468869706a4edfc71e2ef347ddbf2640481895456d1694ebabb64a5a0437a281"}
Jun 10 00:28:53.445978 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:53.445933    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-pj584" podStartSLOduration=1.445919039 podStartE2EDuration="1.445919039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:28:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:28:53.445180421 +0000 UTC m=+440.315956550" watchObservedRunningTime="2026-06-10 00:28:53.445919039 +0000 UTC m=+440.316695165"
Jun 10 00:28:55.176791 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:55.176758    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:55.277770 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:55.277713    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:55.575539 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:55.575503    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:28:57.402690 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:57.402651    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9jt6"]
Jun 10 00:28:57.405991 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:57.405969    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9jt6"
Jun 10 00:28:57.408228 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:57.408204    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 10 00:28:57.408332 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:57.408204    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 10 00:28:57.409091 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:57.409070    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-hp79k\""
Jun 10 00:28:57.415313 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:57.415285    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9jt6"]
Jun 10 00:28:57.533762 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:57.533707    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw2sh\" (UniqueName: \"kubernetes.io/projected/1e178309-f0e1-4582-a8c0-ca47338282b0-kube-api-access-bw2sh\") pod \"openshift-lws-operator-fd8ccff4c-v9jt6\" (UID: \"1e178309-f0e1-4582-a8c0-ca47338282b0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9jt6"
Jun 10 00:28:57.533967 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:57.533803    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e178309-f0e1-4582-a8c0-ca47338282b0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v9jt6\" (UID: \"1e178309-f0e1-4582-a8c0-ca47338282b0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9jt6"
Jun 10 00:28:57.634805 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:57.634775    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e178309-f0e1-4582-a8c0-ca47338282b0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v9jt6\" (UID: \"1e178309-f0e1-4582-a8c0-ca47338282b0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9jt6"
Jun 10 00:28:57.634963 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:57.634845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw2sh\" (UniqueName: \"kubernetes.io/projected/1e178309-f0e1-4582-a8c0-ca47338282b0-kube-api-access-bw2sh\") pod \"openshift-lws-operator-fd8ccff4c-v9jt6\" (UID: \"1e178309-f0e1-4582-a8c0-ca47338282b0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9jt6"
Jun 10 00:28:57.635203 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:57.635181    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e178309-f0e1-4582-a8c0-ca47338282b0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v9jt6\" (UID: \"1e178309-f0e1-4582-a8c0-ca47338282b0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9jt6"
Jun 10 00:28:57.643044 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:57.643015    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw2sh\" (UniqueName: \"kubernetes.io/projected/1e178309-f0e1-4582-a8c0-ca47338282b0-kube-api-access-bw2sh\") pod \"openshift-lws-operator-fd8ccff4c-v9jt6\" (UID: \"1e178309-f0e1-4582-a8c0-ca47338282b0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9jt6"
Jun 10 00:28:57.716110 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:57.716041    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9jt6"
Jun 10 00:28:57.844078 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:57.844036    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9jt6"]
Jun 10 00:28:57.848504 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:28:57.848478    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e178309_f0e1_4582_a8c0_ca47338282b0.slice/crio-8f1ddafcffc036b9376e23b96204d7afef1f6573ee5a370fdf66b10da4071146 WatchSource:0}: Error finding container 8f1ddafcffc036b9376e23b96204d7afef1f6573ee5a370fdf66b10da4071146: Status 404 returned error can't find the container with id 8f1ddafcffc036b9376e23b96204d7afef1f6573ee5a370fdf66b10da4071146
Jun 10 00:28:58.448922 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:28:58.448887    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9jt6" event={"ID":"1e178309-f0e1-4582-a8c0-ca47338282b0","Type":"ContainerStarted","Data":"8f1ddafcffc036b9376e23b96204d7afef1f6573ee5a370fdf66b10da4071146"}
Jun 10 00:29:01.464672 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:01.464625    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9jt6" event={"ID":"1e178309-f0e1-4582-a8c0-ca47338282b0","Type":"ContainerStarted","Data":"1864fdb715759d78c987d79c9fe2f856ed46e1e2de33a33aabd5e48ea0d273d1"}
Jun 10 00:29:01.481816 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:01.481771    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v9jt6" podStartSLOduration=1.419528093 podStartE2EDuration="4.481757459s" totalImagesPullingTime="3.062229366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:28:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:29:01.480210779 +0000 UTC m=+448.350986908" watchObservedRunningTime="2026-06-10 00:29:01.481757459 +0000 UTC m=+448.352533577"
Jun 10 00:29:02.161802 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:02.161768    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:02.260913 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:02.260886    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:03.912367 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:03.912332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:04.428798 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.428761    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw"]
Jun 10 00:29:04.431367 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.431348    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw"
Jun 10 00:29:04.433604 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.433583    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 10 00:29:04.433847 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.433834    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 10 00:29:04.434623 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.434604    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-56dt5\""
Jun 10 00:29:04.439701 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.439669    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw"]
Jun 10 00:29:04.597017 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.596978    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65c1bf8a-a605-4652-adc8-83a424f7da04-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw\" (UID: \"65c1bf8a-a605-4652-adc8-83a424f7da04\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw"
Jun 10 00:29:04.597211 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.597040    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65c1bf8a-a605-4652-adc8-83a424f7da04-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw\" (UID: \"65c1bf8a-a605-4652-adc8-83a424f7da04\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw"
Jun 10 00:29:04.597211 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.597111    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v25b\" (UniqueName: \"kubernetes.io/projected/65c1bf8a-a605-4652-adc8-83a424f7da04-kube-api-access-4v25b\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw\" (UID: \"65c1bf8a-a605-4652-adc8-83a424f7da04\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw"
Jun 10 00:29:04.697563 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.697482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65c1bf8a-a605-4652-adc8-83a424f7da04-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw\" (UID: \"65c1bf8a-a605-4652-adc8-83a424f7da04\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw"
Jun 10 00:29:04.697563 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.697541    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65c1bf8a-a605-4652-adc8-83a424f7da04-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw\" (UID: \"65c1bf8a-a605-4652-adc8-83a424f7da04\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw"
Jun 10 00:29:04.697780 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.697586    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v25b\" (UniqueName: \"kubernetes.io/projected/65c1bf8a-a605-4652-adc8-83a424f7da04-kube-api-access-4v25b\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw\" (UID: \"65c1bf8a-a605-4652-adc8-83a424f7da04\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw"
Jun 10 00:29:04.697978 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.697955    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65c1bf8a-a605-4652-adc8-83a424f7da04-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw\" (UID: \"65c1bf8a-a605-4652-adc8-83a424f7da04\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw"
Jun 10 00:29:04.698019 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.697999    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65c1bf8a-a605-4652-adc8-83a424f7da04-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw\" (UID: \"65c1bf8a-a605-4652-adc8-83a424f7da04\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw"
Jun 10 00:29:04.705691 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.705661    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v25b\" (UniqueName: \"kubernetes.io/projected/65c1bf8a-a605-4652-adc8-83a424f7da04-kube-api-access-4v25b\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw\" (UID: \"65c1bf8a-a605-4652-adc8-83a424f7da04\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw"
Jun 10 00:29:04.741954 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.741917    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw"
Jun 10 00:29:04.872615 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:04.872593    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw"]
Jun 10 00:29:04.875487 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:29:04.875462    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65c1bf8a_a605_4652_adc8_83a424f7da04.slice/crio-4ef7bf19cc62450343bf0d5125172fd898ff468e932f58ec9c84133257a971f0 WatchSource:0}: Error finding container 4ef7bf19cc62450343bf0d5125172fd898ff468e932f58ec9c84133257a971f0: Status 404 returned error can't find the container with id 4ef7bf19cc62450343bf0d5125172fd898ff468e932f58ec9c84133257a971f0
Jun 10 00:29:05.483304 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:05.483273    2560 generic.go:356] "Generic (PLEG): container finished" podID="65c1bf8a-a605-4652-adc8-83a424f7da04" containerID="4d1f805978e8d3dadfe293e4f7496d1719bb08b5a52d05d5847d2ea2e7487c1c" exitCode=0
Jun 10 00:29:05.483687 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:05.483356    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw" event={"ID":"65c1bf8a-a605-4652-adc8-83a424f7da04","Type":"ContainerDied","Data":"4d1f805978e8d3dadfe293e4f7496d1719bb08b5a52d05d5847d2ea2e7487c1c"}
Jun 10 00:29:05.483687 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:05.483426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw" event={"ID":"65c1bf8a-a605-4652-adc8-83a424f7da04","Type":"ContainerStarted","Data":"4ef7bf19cc62450343bf0d5125172fd898ff468e932f58ec9c84133257a971f0"}
Jun 10 00:29:06.490462 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:06.490373    2560 generic.go:356] "Generic (PLEG): container finished" podID="65c1bf8a-a605-4652-adc8-83a424f7da04" containerID="16ee82120987a2930462df1b06db75fb1fb889821e45a5e2be85719d899796b6" exitCode=0
Jun 10 00:29:06.490462 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:06.490421    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw" event={"ID":"65c1bf8a-a605-4652-adc8-83a424f7da04","Type":"ContainerDied","Data":"16ee82120987a2930462df1b06db75fb1fb889821e45a5e2be85719d899796b6"}
Jun 10 00:29:07.497123 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:07.497086    2560 generic.go:356] "Generic (PLEG): container finished" podID="65c1bf8a-a605-4652-adc8-83a424f7da04" containerID="69d1496764effd1fbd74fcb9989427a6e3b74d7937bab74bb88d4d3f2bbdb787" exitCode=0
Jun 10 00:29:07.497525 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:07.497172    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw" event={"ID":"65c1bf8a-a605-4652-adc8-83a424f7da04","Type":"ContainerDied","Data":"69d1496764effd1fbd74fcb9989427a6e3b74d7937bab74bb88d4d3f2bbdb787"}
Jun 10 00:29:08.633214 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:08.633178    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw"
Jun 10 00:29:08.734907 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:08.734860    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65c1bf8a-a605-4652-adc8-83a424f7da04-bundle\") pod \"65c1bf8a-a605-4652-adc8-83a424f7da04\" (UID: \"65c1bf8a-a605-4652-adc8-83a424f7da04\") "
Jun 10 00:29:08.735101 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:08.734935    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65c1bf8a-a605-4652-adc8-83a424f7da04-util\") pod \"65c1bf8a-a605-4652-adc8-83a424f7da04\" (UID: \"65c1bf8a-a605-4652-adc8-83a424f7da04\") "
Jun 10 00:29:08.735101 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:08.734984    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v25b\" (UniqueName: \"kubernetes.io/projected/65c1bf8a-a605-4652-adc8-83a424f7da04-kube-api-access-4v25b\") pod \"65c1bf8a-a605-4652-adc8-83a424f7da04\" (UID: \"65c1bf8a-a605-4652-adc8-83a424f7da04\") "
Jun 10 00:29:08.735567 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:08.735538    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65c1bf8a-a605-4652-adc8-83a424f7da04-bundle" (OuterVolumeSpecName: "bundle") pod "65c1bf8a-a605-4652-adc8-83a424f7da04" (UID: "65c1bf8a-a605-4652-adc8-83a424f7da04"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:29:08.737155 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:08.737126    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65c1bf8a-a605-4652-adc8-83a424f7da04-kube-api-access-4v25b" (OuterVolumeSpecName: "kube-api-access-4v25b") pod "65c1bf8a-a605-4652-adc8-83a424f7da04" (UID: "65c1bf8a-a605-4652-adc8-83a424f7da04"). InnerVolumeSpecName "kube-api-access-4v25b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:29:08.740792 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:08.740767    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65c1bf8a-a605-4652-adc8-83a424f7da04-util" (OuterVolumeSpecName: "util") pod "65c1bf8a-a605-4652-adc8-83a424f7da04" (UID: "65c1bf8a-a605-4652-adc8-83a424f7da04"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:29:08.835963 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:08.835931    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65c1bf8a-a605-4652-adc8-83a424f7da04-util\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:29:08.835963 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:08.835955    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v25b\" (UniqueName: \"kubernetes.io/projected/65c1bf8a-a605-4652-adc8-83a424f7da04-kube-api-access-4v25b\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:29:08.835963 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:08.835966    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65c1bf8a-a605-4652-adc8-83a424f7da04-bundle\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:29:09.509168 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:09.509138    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw"
Jun 10 00:29:09.509168 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:09.509159    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd5hmnw" event={"ID":"65c1bf8a-a605-4652-adc8-83a424f7da04","Type":"ContainerDied","Data":"4ef7bf19cc62450343bf0d5125172fd898ff468e932f58ec9c84133257a971f0"}
Jun 10 00:29:09.509369 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:09.509240    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ef7bf19cc62450343bf0d5125172fd898ff468e932f58ec9c84133257a971f0"
Jun 10 00:29:16.142865 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:16.142826    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:16.248711 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:16.248667    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:16.394426 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:16.394307    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:16.489196 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:16.489160    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:17.034833 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.034800    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:17.240536 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.240503    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:17.342712 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.342614    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:17.361671 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.361634    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"]
Jun 10 00:29:17.362027 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.362013    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65c1bf8a-a605-4652-adc8-83a424f7da04" containerName="extract"
Jun 10 00:29:17.362078 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.362029    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="65c1bf8a-a605-4652-adc8-83a424f7da04" containerName="extract"
Jun 10 00:29:17.362078 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.362046    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65c1bf8a-a605-4652-adc8-83a424f7da04" containerName="pull"
Jun 10 00:29:17.362078 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.362051    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="65c1bf8a-a605-4652-adc8-83a424f7da04" containerName="pull"
Jun 10 00:29:17.362078 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.362064    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65c1bf8a-a605-4652-adc8-83a424f7da04" containerName="util"
Jun 10 00:29:17.362078 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.362070    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="65c1bf8a-a605-4652-adc8-83a424f7da04" containerName="util"
Jun 10 00:29:17.362230 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.362124    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="65c1bf8a-a605-4652-adc8-83a424f7da04" containerName="extract"
Jun 10 00:29:17.367301 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.367283    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.370543 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.370514    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 10 00:29:17.370543 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.370534    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 10 00:29:17.370802 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.370516    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 10 00:29:17.370802 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.370642    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kzrn6\""
Jun 10 00:29:17.370802 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.370654    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 10 00:29:17.380823 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.380800    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"]
Jun 10 00:29:17.410199 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.410167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/844fed70-94d9-40db-804f-c06429168de5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b7d59c946-4hpcc\" (UID: \"844fed70-94d9-40db-804f-c06429168de5\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.410451 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.410428    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt9t7\" (UniqueName: \"kubernetes.io/projected/844fed70-94d9-40db-804f-c06429168de5-kube-api-access-pt9t7\") pod \"opendatahub-operator-controller-manager-7b7d59c946-4hpcc\" (UID: \"844fed70-94d9-40db-804f-c06429168de5\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.410673 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.410654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/844fed70-94d9-40db-804f-c06429168de5-tmp\") pod \"opendatahub-operator-controller-manager-7b7d59c946-4hpcc\" (UID: \"844fed70-94d9-40db-804f-c06429168de5\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.410837 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.410820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/844fed70-94d9-40db-804f-c06429168de5-manifests\") pod \"opendatahub-operator-controller-manager-7b7d59c946-4hpcc\" (UID: \"844fed70-94d9-40db-804f-c06429168de5\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.410987 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.410971    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/844fed70-94d9-40db-804f-c06429168de5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b7d59c946-4hpcc\" (UID: \"844fed70-94d9-40db-804f-c06429168de5\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.511647 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.511615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/844fed70-94d9-40db-804f-c06429168de5-manifests\") pod \"opendatahub-operator-controller-manager-7b7d59c946-4hpcc\" (UID: \"844fed70-94d9-40db-804f-c06429168de5\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.511647 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.511648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/844fed70-94d9-40db-804f-c06429168de5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b7d59c946-4hpcc\" (UID: \"844fed70-94d9-40db-804f-c06429168de5\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.511893 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.511682    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/844fed70-94d9-40db-804f-c06429168de5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b7d59c946-4hpcc\" (UID: \"844fed70-94d9-40db-804f-c06429168de5\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.511940 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.511903    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt9t7\" (UniqueName: \"kubernetes.io/projected/844fed70-94d9-40db-804f-c06429168de5-kube-api-access-pt9t7\") pod \"opendatahub-operator-controller-manager-7b7d59c946-4hpcc\" (UID: \"844fed70-94d9-40db-804f-c06429168de5\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.512008 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.511992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/844fed70-94d9-40db-804f-c06429168de5-tmp\") pod \"opendatahub-operator-controller-manager-7b7d59c946-4hpcc\" (UID: \"844fed70-94d9-40db-804f-c06429168de5\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.512129 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.512105    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/844fed70-94d9-40db-804f-c06429168de5-manifests\") pod \"opendatahub-operator-controller-manager-7b7d59c946-4hpcc\" (UID: \"844fed70-94d9-40db-804f-c06429168de5\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.514389 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.514364    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/844fed70-94d9-40db-804f-c06429168de5-tmp\") pod \"opendatahub-operator-controller-manager-7b7d59c946-4hpcc\" (UID: \"844fed70-94d9-40db-804f-c06429168de5\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.514528 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.514466    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/844fed70-94d9-40db-804f-c06429168de5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b7d59c946-4hpcc\" (UID: \"844fed70-94d9-40db-804f-c06429168de5\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.514638 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.514618    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/844fed70-94d9-40db-804f-c06429168de5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b7d59c946-4hpcc\" (UID: \"844fed70-94d9-40db-804f-c06429168de5\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.522891 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.522855    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt9t7\" (UniqueName: \"kubernetes.io/projected/844fed70-94d9-40db-804f-c06429168de5-kube-api-access-pt9t7\") pod \"opendatahub-operator-controller-manager-7b7d59c946-4hpcc\" (UID: \"844fed70-94d9-40db-804f-c06429168de5\") " pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.533692 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.533646    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:17.635232 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.635137    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:17.677498 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.677466    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:17.735333 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.735284    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:17.825408 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.825378    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"]
Jun 10 00:29:17.826282 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.826246    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:17.827562 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:29:17.827540    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod844fed70_94d9_40db_804f_c06429168de5.slice/crio-a97894cdcb4e95c1b1d6fd780267dbba634a5cb8c0f6991740d5c29c5370ac2b WatchSource:0}: Error finding container a97894cdcb4e95c1b1d6fd780267dbba634a5cb8c0f6991740d5c29c5370ac2b: Status 404 returned error can't find the container with id a97894cdcb4e95c1b1d6fd780267dbba634a5cb8c0f6991740d5c29c5370ac2b
Jun 10 00:29:17.898464 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:17.898370    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:18.013213 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:18.013173    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:18.556851 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:18.556782    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc" event={"ID":"844fed70-94d9-40db-804f-c06429168de5","Type":"ContainerStarted","Data":"a97894cdcb4e95c1b1d6fd780267dbba634a5cb8c0f6991740d5c29c5370ac2b"}
Jun 10 00:29:21.575344 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:21.575297    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc" event={"ID":"844fed70-94d9-40db-804f-c06429168de5","Type":"ContainerStarted","Data":"688fb29a68a4b30af966aadc1de6d6bf6bec43b1fd27fd356cdc7f5d6eb823af"}
Jun 10 00:29:22.581588 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:22.581489    2560 generic.go:356] "Generic (PLEG): container finished" podID="844fed70-94d9-40db-804f-c06429168de5" containerID="688fb29a68a4b30af966aadc1de6d6bf6bec43b1fd27fd356cdc7f5d6eb823af" exitCode=0
Jun 10 00:29:22.581588 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:22.581556    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc" event={"ID":"844fed70-94d9-40db-804f-c06429168de5","Type":"ContainerDied","Data":"688fb29a68a4b30af966aadc1de6d6bf6bec43b1fd27fd356cdc7f5d6eb823af"}
Jun 10 00:29:23.587990 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:23.587955    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc" event={"ID":"844fed70-94d9-40db-804f-c06429168de5","Type":"ContainerStarted","Data":"c08e3ccedd7131785c646c6cd8d37c45f54d4f901d723e286507ef8084f29105"}
Jun 10 00:29:23.588461 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:23.588109    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:23.607711 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:23.607657    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc" podStartSLOduration=1.9459894 podStartE2EDuration="6.607637712s" totalImagesPullingTime="3.610363312s" totalInitContainerRuntime="1.051285s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:29:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:29:23.606346806 +0000 UTC m=+470.477122934" watchObservedRunningTime="2026-06-10 00:29:23.607637712 +0000 UTC m=+470.478413842"
Jun 10 00:29:27.911495 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:27.911460    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:28.013310 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:28.013269    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:34.595416 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:34.595382    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b7d59c946-4hpcc"
Jun 10 00:29:36.939667 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:36.939629    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:37.043414 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.043368    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:37.242165 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.242073    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:37.388944 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.388897    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:37.448329 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.448292    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q"]
Jun 10 00:29:37.454253 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.454228    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q"
Jun 10 00:29:37.456732 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.456708    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 10 00:29:37.456832 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.456757    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 10 00:29:37.466412 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.466381    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q"]
Jun 10 00:29:37.593009 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.592967    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30394dcf-8e22-4ba4-8cbf-fcaf87f100cd-tls-certs\") pod \"kube-auth-proxy-7c998fc6cc-qsp9q\" (UID: \"30394dcf-8e22-4ba4-8cbf-fcaf87f100cd\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q"
Jun 10 00:29:37.593199 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.593030    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k958\" (UniqueName: \"kubernetes.io/projected/30394dcf-8e22-4ba4-8cbf-fcaf87f100cd-kube-api-access-4k958\") pod \"kube-auth-proxy-7c998fc6cc-qsp9q\" (UID: \"30394dcf-8e22-4ba4-8cbf-fcaf87f100cd\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q"
Jun 10 00:29:37.593199 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.593101    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30394dcf-8e22-4ba4-8cbf-fcaf87f100cd-tmp\") pod \"kube-auth-proxy-7c998fc6cc-qsp9q\" (UID: \"30394dcf-8e22-4ba4-8cbf-fcaf87f100cd\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q"
Jun 10 00:29:37.694515 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.694479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30394dcf-8e22-4ba4-8cbf-fcaf87f100cd-tls-certs\") pod \"kube-auth-proxy-7c998fc6cc-qsp9q\" (UID: \"30394dcf-8e22-4ba4-8cbf-fcaf87f100cd\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q"
Jun 10 00:29:37.694708 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.694538    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k958\" (UniqueName: \"kubernetes.io/projected/30394dcf-8e22-4ba4-8cbf-fcaf87f100cd-kube-api-access-4k958\") pod \"kube-auth-proxy-7c998fc6cc-qsp9q\" (UID: \"30394dcf-8e22-4ba4-8cbf-fcaf87f100cd\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q"
Jun 10 00:29:37.694708 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.694618    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30394dcf-8e22-4ba4-8cbf-fcaf87f100cd-tmp\") pod \"kube-auth-proxy-7c998fc6cc-qsp9q\" (UID: \"30394dcf-8e22-4ba4-8cbf-fcaf87f100cd\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q"
Jun 10 00:29:37.694708 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:29:37.694669    2560 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jun 10 00:29:37.694918 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:29:37.694763    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30394dcf-8e22-4ba4-8cbf-fcaf87f100cd-tls-certs podName:30394dcf-8e22-4ba4-8cbf-fcaf87f100cd nodeName:}" failed. No retries permitted until 2026-06-10 00:29:38.194721296 +0000 UTC m=+485.065497421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/30394dcf-8e22-4ba4-8cbf-fcaf87f100cd-tls-certs") pod "kube-auth-proxy-7c998fc6cc-qsp9q" (UID: "30394dcf-8e22-4ba4-8cbf-fcaf87f100cd") : secret "kube-auth-proxy-tls" not found
Jun 10 00:29:37.697092 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.697070    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30394dcf-8e22-4ba4-8cbf-fcaf87f100cd-tmp\") pod \"kube-auth-proxy-7c998fc6cc-qsp9q\" (UID: \"30394dcf-8e22-4ba4-8cbf-fcaf87f100cd\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q"
Jun 10 00:29:37.713526 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.713490    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-6znq9"]
Jun 10 00:29:37.714424 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.714398    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k958\" (UniqueName: \"kubernetes.io/projected/30394dcf-8e22-4ba4-8cbf-fcaf87f100cd-kube-api-access-4k958\") pod \"kube-auth-proxy-7c998fc6cc-qsp9q\" (UID: \"30394dcf-8e22-4ba4-8cbf-fcaf87f100cd\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q"
Jun 10 00:29:37.716306 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.716287    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-6znq9"
Jun 10 00:29:37.718445 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.718426    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jun 10 00:29:37.718445 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.718440    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-98mql\""
Jun 10 00:29:37.727383 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.727356    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-6znq9"]
Jun 10 00:29:37.749975 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.749941    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:37.795794 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.795734    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db6kk\" (UniqueName: \"kubernetes.io/projected/72a60b55-a1e6-41c0-94aa-e92162acf129-kube-api-access-db6kk\") pod \"odh-model-controller-6dc94f689f-6znq9\" (UID: \"72a60b55-a1e6-41c0-94aa-e92162acf129\") " pod="opendatahub/odh-model-controller-6dc94f689f-6znq9"
Jun 10 00:29:37.795996 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.795804    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72a60b55-a1e6-41c0-94aa-e92162acf129-cert\") pod \"odh-model-controller-6dc94f689f-6znq9\" (UID: \"72a60b55-a1e6-41c0-94aa-e92162acf129\") " pod="opendatahub/odh-model-controller-6dc94f689f-6znq9"
Jun 10 00:29:37.849238 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.849144    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:37.896786 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.896718    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db6kk\" (UniqueName: \"kubernetes.io/projected/72a60b55-a1e6-41c0-94aa-e92162acf129-kube-api-access-db6kk\") pod \"odh-model-controller-6dc94f689f-6znq9\" (UID: \"72a60b55-a1e6-41c0-94aa-e92162acf129\") " pod="opendatahub/odh-model-controller-6dc94f689f-6znq9"
Jun 10 00:29:37.896994 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.896805    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72a60b55-a1e6-41c0-94aa-e92162acf129-cert\") pod \"odh-model-controller-6dc94f689f-6znq9\" (UID: \"72a60b55-a1e6-41c0-94aa-e92162acf129\") " pod="opendatahub/odh-model-controller-6dc94f689f-6znq9"
Jun 10 00:29:37.896994 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:29:37.896972    2560 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jun 10 00:29:37.897131 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:29:37.897047    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72a60b55-a1e6-41c0-94aa-e92162acf129-cert podName:72a60b55-a1e6-41c0-94aa-e92162acf129 nodeName:}" failed. No retries permitted until 2026-06-10 00:29:38.397023352 +0000 UTC m=+485.267799471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/72a60b55-a1e6-41c0-94aa-e92162acf129-cert") pod "odh-model-controller-6dc94f689f-6znq9" (UID: "72a60b55-a1e6-41c0-94aa-e92162acf129") : secret "odh-model-controller-webhook-cert" not found
Jun 10 00:29:37.915860 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.915824    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db6kk\" (UniqueName: \"kubernetes.io/projected/72a60b55-a1e6-41c0-94aa-e92162acf129-kube-api-access-db6kk\") pod \"odh-model-controller-6dc94f689f-6znq9\" (UID: \"72a60b55-a1e6-41c0-94aa-e92162acf129\") " pod="opendatahub/odh-model-controller-6dc94f689f-6znq9"
Jun 10 00:29:37.949628 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:37.949591    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:38.199931 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.199845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30394dcf-8e22-4ba4-8cbf-fcaf87f100cd-tls-certs\") pod \"kube-auth-proxy-7c998fc6cc-qsp9q\" (UID: \"30394dcf-8e22-4ba4-8cbf-fcaf87f100cd\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q"
Jun 10 00:29:38.202665 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.202640    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30394dcf-8e22-4ba4-8cbf-fcaf87f100cd-tls-certs\") pod \"kube-auth-proxy-7c998fc6cc-qsp9q\" (UID: \"30394dcf-8e22-4ba4-8cbf-fcaf87f100cd\") " pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q"
Jun 10 00:29:38.343292 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.343260    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-c4rms"]
Jun 10 00:29:38.345676 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.345659    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-c4rms"
Jun 10 00:29:38.347826 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.347804    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jun 10 00:29:38.356542 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.356521    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-c4rms"]
Jun 10 00:29:38.358649 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.358615    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:38.364335 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.364313    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q"
Jun 10 00:29:38.402549 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.402497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72a60b55-a1e6-41c0-94aa-e92162acf129-cert\") pod \"odh-model-controller-6dc94f689f-6znq9\" (UID: \"72a60b55-a1e6-41c0-94aa-e92162acf129\") " pod="opendatahub/odh-model-controller-6dc94f689f-6znq9"
Jun 10 00:29:38.405960 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.405932    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72a60b55-a1e6-41c0-94aa-e92162acf129-cert\") pod \"odh-model-controller-6dc94f689f-6znq9\" (UID: \"72a60b55-a1e6-41c0-94aa-e92162acf129\") " pod="opendatahub/odh-model-controller-6dc94f689f-6znq9"
Jun 10 00:29:38.440095 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.440059    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:38.504144 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.503984    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaa53a61-dc48-43d5-abde-bdfa5272c5e8-tls-certs\") pod \"model-serving-api-5dd488fc48-c4rms\" (UID: \"eaa53a61-dc48-43d5-abde-bdfa5272c5e8\") " pod="opendatahub/model-serving-api-5dd488fc48-c4rms"
Jun 10 00:29:38.504144 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.504072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bmv8\" (UniqueName: \"kubernetes.io/projected/eaa53a61-dc48-43d5-abde-bdfa5272c5e8-kube-api-access-2bmv8\") pod \"model-serving-api-5dd488fc48-c4rms\" (UID: \"eaa53a61-dc48-43d5-abde-bdfa5272c5e8\") " pod="opendatahub/model-serving-api-5dd488fc48-c4rms"
Jun 10 00:29:38.504603 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.504579    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q"]
Jun 10 00:29:38.507086 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:29:38.507056    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30394dcf_8e22_4ba4_8cbf_fcaf87f100cd.slice/crio-129940aeed7f13a82b891e0cfb7da9e500810f3f3fb1f9b71fb866dc2f85ca65 WatchSource:0}: Error finding container 129940aeed7f13a82b891e0cfb7da9e500810f3f3fb1f9b71fb866dc2f85ca65: Status 404 returned error can't find the container with id 129940aeed7f13a82b891e0cfb7da9e500810f3f3fb1f9b71fb866dc2f85ca65
Jun 10 00:29:38.604532 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.604499    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaa53a61-dc48-43d5-abde-bdfa5272c5e8-tls-certs\") pod \"model-serving-api-5dd488fc48-c4rms\" (UID: \"eaa53a61-dc48-43d5-abde-bdfa5272c5e8\") " pod="opendatahub/model-serving-api-5dd488fc48-c4rms"
Jun 10 00:29:38.604775 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.604541    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bmv8\" (UniqueName: \"kubernetes.io/projected/eaa53a61-dc48-43d5-abde-bdfa5272c5e8-kube-api-access-2bmv8\") pod \"model-serving-api-5dd488fc48-c4rms\" (UID: \"eaa53a61-dc48-43d5-abde-bdfa5272c5e8\") " pod="opendatahub/model-serving-api-5dd488fc48-c4rms"
Jun 10 00:29:38.604775 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:29:38.604663    2560 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jun 10 00:29:38.604775 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:29:38.604731    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaa53a61-dc48-43d5-abde-bdfa5272c5e8-tls-certs podName:eaa53a61-dc48-43d5-abde-bdfa5272c5e8 nodeName:}" failed. No retries permitted until 2026-06-10 00:29:39.104715226 +0000 UTC m=+485.975491332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/eaa53a61-dc48-43d5-abde-bdfa5272c5e8-tls-certs") pod "model-serving-api-5dd488fc48-c4rms" (UID: "eaa53a61-dc48-43d5-abde-bdfa5272c5e8") : secret "model-serving-api-tls" not found
Jun 10 00:29:38.612410 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.612382    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bmv8\" (UniqueName: \"kubernetes.io/projected/eaa53a61-dc48-43d5-abde-bdfa5272c5e8-kube-api-access-2bmv8\") pod \"model-serving-api-5dd488fc48-c4rms\" (UID: \"eaa53a61-dc48-43d5-abde-bdfa5272c5e8\") " pod="opendatahub/model-serving-api-5dd488fc48-c4rms"
Jun 10 00:29:38.636357 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.636325    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-6znq9"
Jun 10 00:29:38.662128 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.662097    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q" event={"ID":"30394dcf-8e22-4ba4-8cbf-fcaf87f100cd","Type":"ContainerStarted","Data":"129940aeed7f13a82b891e0cfb7da9e500810f3f3fb1f9b71fb866dc2f85ca65"}
Jun 10 00:29:38.687040 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.687002    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:38.775555 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:38.775522    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-6znq9"]
Jun 10 00:29:38.779205 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:29:38.779176    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a60b55_a1e6_41c0_94aa_e92162acf129.slice/crio-24d09520c856a42b129e677b753236733d2b623d9c2efcd0d675d55abdb220c3 WatchSource:0}: Error finding container 24d09520c856a42b129e677b753236733d2b623d9c2efcd0d675d55abdb220c3: Status 404 returned error can't find the container with id 24d09520c856a42b129e677b753236733d2b623d9c2efcd0d675d55abdb220c3
Jun 10 00:29:39.110135 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.110095    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaa53a61-dc48-43d5-abde-bdfa5272c5e8-tls-certs\") pod \"model-serving-api-5dd488fc48-c4rms\" (UID: \"eaa53a61-dc48-43d5-abde-bdfa5272c5e8\") " pod="opendatahub/model-serving-api-5dd488fc48-c4rms"
Jun 10 00:29:39.112833 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.112805    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaa53a61-dc48-43d5-abde-bdfa5272c5e8-tls-certs\") pod \"model-serving-api-5dd488fc48-c4rms\" (UID: \"eaa53a61-dc48-43d5-abde-bdfa5272c5e8\") " pod="opendatahub/model-serving-api-5dd488fc48-c4rms"
Jun 10 00:29:39.256486 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.256395    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-c4rms"
Jun 10 00:29:39.451250 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.451223    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-c4rms"]
Jun 10 00:29:39.457225 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:29:39.457190    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa53a61_dc48_43d5_abde_bdfa5272c5e8.slice/crio-4891ee4011c20ca1b782c128b5cb234f71e721d21b0ff7fd1ce3e9c0b05e16a7 WatchSource:0}: Error finding container 4891ee4011c20ca1b782c128b5cb234f71e721d21b0ff7fd1ce3e9c0b05e16a7: Status 404 returned error can't find the container with id 4891ee4011c20ca1b782c128b5cb234f71e721d21b0ff7fd1ce3e9c0b05e16a7
Jun 10 00:29:39.496547 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.492916    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7"]
Jun 10 00:29:39.498304 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.498280    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7"
Jun 10 00:29:39.507060 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.503133    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 10 00:29:39.507060 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.503413    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 10 00:29:39.507060 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.503596    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-56dt5\""
Jun 10 00:29:39.508517 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.508445    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7"]
Jun 10 00:29:39.618303 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.617957    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5888015-0745-4957-873e-a49471ba5deb-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7\" (UID: \"a5888015-0745-4957-873e-a49471ba5deb\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7"
Jun 10 00:29:39.618303 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.618014    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5888015-0745-4957-873e-a49471ba5deb-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7\" (UID: \"a5888015-0745-4957-873e-a49471ba5deb\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7"
Jun 10 00:29:39.618303 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.618121    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkwhh\" (UniqueName: \"kubernetes.io/projected/a5888015-0745-4957-873e-a49471ba5deb-kube-api-access-fkwhh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7\" (UID: \"a5888015-0745-4957-873e-a49471ba5deb\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7"
Jun 10 00:29:39.676916 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.676831    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-c4rms" event={"ID":"eaa53a61-dc48-43d5-abde-bdfa5272c5e8","Type":"ContainerStarted","Data":"4891ee4011c20ca1b782c128b5cb234f71e721d21b0ff7fd1ce3e9c0b05e16a7"}
Jun 10 00:29:39.679727 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.679648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-6znq9" event={"ID":"72a60b55-a1e6-41c0-94aa-e92162acf129","Type":"ContainerStarted","Data":"24d09520c856a42b129e677b753236733d2b623d9c2efcd0d675d55abdb220c3"}
Jun 10 00:29:39.719775 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.718718    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkwhh\" (UniqueName: \"kubernetes.io/projected/a5888015-0745-4957-873e-a49471ba5deb-kube-api-access-fkwhh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7\" (UID: \"a5888015-0745-4957-873e-a49471ba5deb\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7"
Jun 10 00:29:39.719775 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.718828    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5888015-0745-4957-873e-a49471ba5deb-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7\" (UID: \"a5888015-0745-4957-873e-a49471ba5deb\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7"
Jun 10 00:29:39.719775 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.718866    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5888015-0745-4957-873e-a49471ba5deb-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7\" (UID: \"a5888015-0745-4957-873e-a49471ba5deb\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7"
Jun 10 00:29:39.719775 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.719291    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5888015-0745-4957-873e-a49471ba5deb-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7\" (UID: \"a5888015-0745-4957-873e-a49471ba5deb\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7"
Jun 10 00:29:39.720339 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.720299    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5888015-0745-4957-873e-a49471ba5deb-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7\" (UID: \"a5888015-0745-4957-873e-a49471ba5deb\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7"
Jun 10 00:29:39.730673 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.730628    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkwhh\" (UniqueName: \"kubernetes.io/projected/a5888015-0745-4957-873e-a49471ba5deb-kube-api-access-fkwhh\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7\" (UID: \"a5888015-0745-4957-873e-a49471ba5deb\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7"
Jun 10 00:29:39.820849 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:39.820556    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7"
Jun 10 00:29:40.031360 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:40.031056    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7"]
Jun 10 00:29:40.037488 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:29:40.037452    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5888015_0745_4957_873e_a49471ba5deb.slice/crio-c4b250b07588fefbb74f9d1a742505535d26ac56c4bb1334f3d17908f748adef WatchSource:0}: Error finding container c4b250b07588fefbb74f9d1a742505535d26ac56c4bb1334f3d17908f748adef: Status 404 returned error can't find the container with id c4b250b07588fefbb74f9d1a742505535d26ac56c4bb1334f3d17908f748adef
Jun 10 00:29:40.691367 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:40.690934    2560 generic.go:356] "Generic (PLEG): container finished" podID="a5888015-0745-4957-873e-a49471ba5deb" containerID="792dbf2aac1efdbc250e2f98c683de5632b6ec7fb91d1e2da863b275fb69c780" exitCode=0
Jun 10 00:29:40.691367 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:40.691058    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7" event={"ID":"a5888015-0745-4957-873e-a49471ba5deb","Type":"ContainerDied","Data":"792dbf2aac1efdbc250e2f98c683de5632b6ec7fb91d1e2da863b275fb69c780"}
Jun 10 00:29:40.691367 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:40.691285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7" event={"ID":"a5888015-0745-4957-873e-a49471ba5deb","Type":"ContainerStarted","Data":"c4b250b07588fefbb74f9d1a742505535d26ac56c4bb1334f3d17908f748adef"}
Jun 10 00:29:44.720420 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:44.720379    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q" event={"ID":"30394dcf-8e22-4ba4-8cbf-fcaf87f100cd","Type":"ContainerStarted","Data":"73e7484e573b5e7c264b067d9f95e52978c4b7934d8b5f21c38e83f461c4ba26"}
Jun 10 00:29:44.722057 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:44.722029    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-c4rms" event={"ID":"eaa53a61-dc48-43d5-abde-bdfa5272c5e8","Type":"ContainerStarted","Data":"0f532430ea41627af400f3a12a6325833c2d41562430a224fccf68c76d6a7224"}
Jun 10 00:29:44.722218 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:44.722087    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-c4rms"
Jun 10 00:29:44.723632 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:44.723608    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-6znq9" event={"ID":"72a60b55-a1e6-41c0-94aa-e92162acf129","Type":"ContainerStarted","Data":"bd2f7fdb521a33798963d27f84ada9533a37782ca802d7766479c3e4927dc33f"}
Jun 10 00:29:44.723772 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:44.723662    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-6znq9"
Jun 10 00:29:44.725587 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:44.725559    2560 generic.go:356] "Generic (PLEG): container finished" podID="a5888015-0745-4957-873e-a49471ba5deb" containerID="aae0612abf235d81db0c8bc52dbf11982db1ddc7ae3641036715baf0fa69decc" exitCode=0
Jun 10 00:29:44.725702 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:44.725591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7" event={"ID":"a5888015-0745-4957-873e-a49471ba5deb","Type":"ContainerDied","Data":"aae0612abf235d81db0c8bc52dbf11982db1ddc7ae3641036715baf0fa69decc"}
Jun 10 00:29:44.737072 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:44.737022    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c998fc6cc-qsp9q" podStartSLOduration=2.329247367 podStartE2EDuration="7.737003994s" totalImagesPullingTime="5.407756627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:29:44.736196348 +0000 UTC m=+491.606972477" watchObservedRunningTime="2026-06-10 00:29:44.737003994 +0000 UTC m=+491.607780121"
Jun 10 00:29:44.756346 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:44.756290    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-6znq9" podStartSLOduration=2.595016291 podStartE2EDuration="7.756269344s" totalImagesPullingTime="5.161253053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:29:44.754529377 +0000 UTC m=+491.625305505" watchObservedRunningTime="2026-06-10 00:29:44.756269344 +0000 UTC m=+491.627045471"
Jun 10 00:29:44.785079 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:44.785033    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-c4rms" podStartSLOduration=2.315774049 podStartE2EDuration="6.785017228s" totalImagesPullingTime="4.469243179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:29:44.783039514 +0000 UTC m=+491.653815642" watchObservedRunningTime="2026-06-10 00:29:44.785017228 +0000 UTC m=+491.655793355"
Jun 10 00:29:45.732177 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:45.732136    2560 generic.go:356] "Generic (PLEG): container finished" podID="a5888015-0745-4957-873e-a49471ba5deb" containerID="f48007e263398ab829e843b14a51c7a1271a36baad2dbf63c1c527d9d179e058" exitCode=0
Jun 10 00:29:45.732566 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:45.732243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7" event={"ID":"a5888015-0745-4957-873e-a49471ba5deb","Type":"ContainerDied","Data":"f48007e263398ab829e843b14a51c7a1271a36baad2dbf63c1c527d9d179e058"}
Jun 10 00:29:46.871562 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:46.871538    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7"
Jun 10 00:29:46.884729 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:46.884707    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5888015-0745-4957-873e-a49471ba5deb-bundle\") pod \"a5888015-0745-4957-873e-a49471ba5deb\" (UID: \"a5888015-0745-4957-873e-a49471ba5deb\") "
Jun 10 00:29:46.884865 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:46.884773    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkwhh\" (UniqueName: \"kubernetes.io/projected/a5888015-0745-4957-873e-a49471ba5deb-kube-api-access-fkwhh\") pod \"a5888015-0745-4957-873e-a49471ba5deb\" (UID: \"a5888015-0745-4957-873e-a49471ba5deb\") "
Jun 10 00:29:46.884865 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:46.884801    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5888015-0745-4957-873e-a49471ba5deb-util\") pod \"a5888015-0745-4957-873e-a49471ba5deb\" (UID: \"a5888015-0745-4957-873e-a49471ba5deb\") "
Jun 10 00:29:46.885568 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:46.885541    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5888015-0745-4957-873e-a49471ba5deb-bundle" (OuterVolumeSpecName: "bundle") pod "a5888015-0745-4957-873e-a49471ba5deb" (UID: "a5888015-0745-4957-873e-a49471ba5deb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:29:46.886868 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:46.886826    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5888015-0745-4957-873e-a49471ba5deb-kube-api-access-fkwhh" (OuterVolumeSpecName: "kube-api-access-fkwhh") pod "a5888015-0745-4957-873e-a49471ba5deb" (UID: "a5888015-0745-4957-873e-a49471ba5deb"). InnerVolumeSpecName "kube-api-access-fkwhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:29:46.890996 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:46.890967    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5888015-0745-4957-873e-a49471ba5deb-util" (OuterVolumeSpecName: "util") pod "a5888015-0745-4957-873e-a49471ba5deb" (UID: "a5888015-0745-4957-873e-a49471ba5deb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:29:46.985752 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:46.985702    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5888015-0745-4957-873e-a49471ba5deb-bundle\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:29:46.985752 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:46.985731    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkwhh\" (UniqueName: \"kubernetes.io/projected/a5888015-0745-4957-873e-a49471ba5deb-kube-api-access-fkwhh\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:29:46.985752 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:46.985757    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5888015-0745-4957-873e-a49471ba5deb-util\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:29:47.744238 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:47.744208    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7"
Jun 10 00:29:47.744383 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:47.744225    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06czlr7" event={"ID":"a5888015-0745-4957-873e-a49471ba5deb","Type":"ContainerDied","Data":"c4b250b07588fefbb74f9d1a742505535d26ac56c4bb1334f3d17908f748adef"}
Jun 10 00:29:47.744383 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:47.744287    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4b250b07588fefbb74f9d1a742505535d26ac56c4bb1334f3d17908f748adef"
Jun 10 00:29:47.984082 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:47.983958    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:48.077483 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.077448    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-gbl2z"]
Jun 10 00:29:48.077876 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.077852    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5888015-0745-4957-873e-a49471ba5deb" containerName="pull"
Jun 10 00:29:48.077876 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.077887    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5888015-0745-4957-873e-a49471ba5deb" containerName="pull"
Jun 10 00:29:48.077989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.077897    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5888015-0745-4957-873e-a49471ba5deb" containerName="extract"
Jun 10 00:29:48.077989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.077903    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5888015-0745-4957-873e-a49471ba5deb" containerName="extract"
Jun 10 00:29:48.077989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.077918    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5888015-0745-4957-873e-a49471ba5deb" containerName="util"
Jun 10 00:29:48.077989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.077924    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5888015-0745-4957-873e-a49471ba5deb" containerName="util"
Jun 10 00:29:48.077989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.077978    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5888015-0745-4957-873e-a49471ba5deb" containerName="extract"
Jun 10 00:29:48.080004 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.079982    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-gbl2z"
Jun 10 00:29:48.084875 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.084853    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jun 10 00:29:48.084989 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.084882    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rbfql\""
Jun 10 00:29:48.094511 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.094487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d365e48b-22bd-4138-8182-575e55131932-cert\") pod \"kserve-controller-manager-69fc866d76-gbl2z\" (UID: \"d365e48b-22bd-4138-8182-575e55131932\") " pod="opendatahub/kserve-controller-manager-69fc866d76-gbl2z"
Jun 10 00:29:48.094641 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.094522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dkrm\" (UniqueName: \"kubernetes.io/projected/d365e48b-22bd-4138-8182-575e55131932-kube-api-access-2dkrm\") pod \"kserve-controller-manager-69fc866d76-gbl2z\" (UID: \"d365e48b-22bd-4138-8182-575e55131932\") " pod="opendatahub/kserve-controller-manager-69fc866d76-gbl2z"
Jun 10 00:29:48.106071 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.106036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:48.106230 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.106214    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-gbl2z"]
Jun 10 00:29:48.122329 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.122304    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-gwl87"]
Jun 10 00:29:48.124519 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.124500    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gwl87"
Jun 10 00:29:48.127408 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.127389    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jun 10 00:29:48.127807 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.127788    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-69k5r\""
Jun 10 00:29:48.147640 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.147616    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-gwl87"]
Jun 10 00:29:48.195458 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.195425    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d365e48b-22bd-4138-8182-575e55131932-cert\") pod \"kserve-controller-manager-69fc866d76-gbl2z\" (UID: \"d365e48b-22bd-4138-8182-575e55131932\") " pod="opendatahub/kserve-controller-manager-69fc866d76-gbl2z"
Jun 10 00:29:48.195624 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.195472    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmg6n\" (UniqueName: \"kubernetes.io/projected/96a13513-4277-47a4-ae15-0d8a058ef33a-kube-api-access-cmg6n\") pod \"llmisvc-controller-manager-864bfd7bc9-gwl87\" (UID: \"96a13513-4277-47a4-ae15-0d8a058ef33a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gwl87"
Jun 10 00:29:48.195624 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.195500    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dkrm\" (UniqueName: \"kubernetes.io/projected/d365e48b-22bd-4138-8182-575e55131932-kube-api-access-2dkrm\") pod \"kserve-controller-manager-69fc866d76-gbl2z\" (UID: \"d365e48b-22bd-4138-8182-575e55131932\") " pod="opendatahub/kserve-controller-manager-69fc866d76-gbl2z"
Jun 10 00:29:48.195624 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.195571    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96a13513-4277-47a4-ae15-0d8a058ef33a-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gwl87\" (UID: \"96a13513-4277-47a4-ae15-0d8a058ef33a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gwl87"
Jun 10 00:29:48.198026 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.198005    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d365e48b-22bd-4138-8182-575e55131932-cert\") pod \"kserve-controller-manager-69fc866d76-gbl2z\" (UID: \"d365e48b-22bd-4138-8182-575e55131932\") " pod="opendatahub/kserve-controller-manager-69fc866d76-gbl2z"
Jun 10 00:29:48.203644 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.203624    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dkrm\" (UniqueName: \"kubernetes.io/projected/d365e48b-22bd-4138-8182-575e55131932-kube-api-access-2dkrm\") pod \"kserve-controller-manager-69fc866d76-gbl2z\" (UID: \"d365e48b-22bd-4138-8182-575e55131932\") " pod="opendatahub/kserve-controller-manager-69fc866d76-gbl2z"
Jun 10 00:29:48.208297 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.208268    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:48.296838 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.296798    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmg6n\" (UniqueName: \"kubernetes.io/projected/96a13513-4277-47a4-ae15-0d8a058ef33a-kube-api-access-cmg6n\") pod \"llmisvc-controller-manager-864bfd7bc9-gwl87\" (UID: \"96a13513-4277-47a4-ae15-0d8a058ef33a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gwl87"
Jun 10 00:29:48.297040 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.296864    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96a13513-4277-47a4-ae15-0d8a058ef33a-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gwl87\" (UID: \"96a13513-4277-47a4-ae15-0d8a058ef33a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gwl87"
Jun 10 00:29:48.299569 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.299532    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96a13513-4277-47a4-ae15-0d8a058ef33a-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-gwl87\" (UID: \"96a13513-4277-47a4-ae15-0d8a058ef33a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gwl87"
Jun 10 00:29:48.306561 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.306535    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmg6n\" (UniqueName: \"kubernetes.io/projected/96a13513-4277-47a4-ae15-0d8a058ef33a-kube-api-access-cmg6n\") pod \"llmisvc-controller-manager-864bfd7bc9-gwl87\" (UID: \"96a13513-4277-47a4-ae15-0d8a058ef33a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gwl87"
Jun 10 00:29:48.309252 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.309221    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:48.391125 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.391085    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-gbl2z"
Jun 10 00:29:48.434948 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.434913    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gwl87"
Jun 10 00:29:48.553539 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.553510    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-gbl2z"]
Jun 10 00:29:48.556350 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:29:48.556324    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd365e48b_22bd_4138_8182_575e55131932.slice/crio-55b50be676934192ca2d9b0cd2356a13afdfe2d85c4f078fef06014055fe57e9 WatchSource:0}: Error finding container 55b50be676934192ca2d9b0cd2356a13afdfe2d85c4f078fef06014055fe57e9: Status 404 returned error can't find the container with id 55b50be676934192ca2d9b0cd2356a13afdfe2d85c4f078fef06014055fe57e9
Jun 10 00:29:48.581083 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.581058    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-gwl87"]
Jun 10 00:29:48.583444 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:29:48.583420    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod96a13513_4277_47a4_ae15_0d8a058ef33a.slice/crio-f3e68c1d1b61d5cf7429e98ab66585664c11e1f76967a40dbe261cc6dea09b44 WatchSource:0}: Error finding container f3e68c1d1b61d5cf7429e98ab66585664c11e1f76967a40dbe261cc6dea09b44: Status 404 returned error can't find the container with id f3e68c1d1b61d5cf7429e98ab66585664c11e1f76967a40dbe261cc6dea09b44
Jun 10 00:29:48.750274 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.750239    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-gbl2z" event={"ID":"d365e48b-22bd-4138-8182-575e55131932","Type":"ContainerStarted","Data":"55b50be676934192ca2d9b0cd2356a13afdfe2d85c4f078fef06014055fe57e9"}
Jun 10 00:29:48.751403 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:48.751373    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gwl87" event={"ID":"96a13513-4277-47a4-ae15-0d8a058ef33a","Type":"ContainerStarted","Data":"f3e68c1d1b61d5cf7429e98ab66585664c11e1f76967a40dbe261cc6dea09b44"}
Jun 10 00:29:49.291788 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:49.291732    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:49.394285 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:49.394249    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:49.516228 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:49.516183    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:51.776040 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:51.775992    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-gbl2z" event={"ID":"d365e48b-22bd-4138-8182-575e55131932","Type":"ContainerStarted","Data":"82febd4fb6a01691ec086ecdfc13d4fde2e75575a00faaaf4931335577b00edc"}
Jun 10 00:29:51.776550 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:51.776147    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-gbl2z"
Jun 10 00:29:51.794110 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:51.794047    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-gbl2z" podStartSLOduration=1.080284737 podStartE2EDuration="3.794026228s" totalImagesPullingTime="2.713741491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:29:51.791205792 +0000 UTC m=+498.661981922" watchObservedRunningTime="2026-06-10 00:29:51.794026228 +0000 UTC m=+498.664802355"
Jun 10 00:29:52.784073 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:52.784042    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gwl87" event={"ID":"96a13513-4277-47a4-ae15-0d8a058ef33a","Type":"ContainerStarted","Data":"3460765e404cc61f308bae40f74106b1d6460393f49049ae62566fa225efb41e"}
Jun 10 00:29:52.784459 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:52.784122    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gwl87"
Jun 10 00:29:52.801152 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:52.801100    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gwl87" podStartSLOduration=1.3096589 podStartE2EDuration="4.801086237s" totalImagesPullingTime="3.491427337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:29:52.799079261 +0000 UTC m=+499.669855390" watchObservedRunningTime="2026-06-10 00:29:52.801086237 +0000 UTC m=+499.671862381"
Jun 10 00:29:55.735504 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:55.735472    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-6znq9"
Jun 10 00:29:55.737406 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:55.737384    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-c4rms"
Jun 10 00:29:57.949520 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:57.949481    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:58.049882 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:58.049836    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:59.045225 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:59.045182    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:29:59.976288 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:59.976253    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb"]
Jun 10 00:29:59.984963 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:59.984942    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb"
Jun 10 00:29:59.987558 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:59.987535    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 10 00:29:59.988489 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:59.988472    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-56dt5\""
Jun 10 00:29:59.988570 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:59.988474    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 10 00:29:59.991876 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:29:59.991851    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb"]
Jun 10 00:30:00.102076 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:00.102033    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7363b937-4529-4793-8f2e-254ffd321cf5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb\" (UID: \"7363b937-4529-4793-8f2e-254ffd321cf5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb"
Jun 10 00:30:00.102455 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:00.102085    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt42x\" (UniqueName: \"kubernetes.io/projected/7363b937-4529-4793-8f2e-254ffd321cf5-kube-api-access-wt42x\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb\" (UID: \"7363b937-4529-4793-8f2e-254ffd321cf5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb"
Jun 10 00:30:00.102455 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:00.102221    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7363b937-4529-4793-8f2e-254ffd321cf5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb\" (UID: \"7363b937-4529-4793-8f2e-254ffd321cf5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb"
Jun 10 00:30:00.194886 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:00.194851    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:00.203385 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:00.203353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7363b937-4529-4793-8f2e-254ffd321cf5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb\" (UID: \"7363b937-4529-4793-8f2e-254ffd321cf5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb"
Jun 10 00:30:00.203385 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:00.203389    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7363b937-4529-4793-8f2e-254ffd321cf5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb\" (UID: \"7363b937-4529-4793-8f2e-254ffd321cf5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb"
Jun 10 00:30:00.203610 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:00.203419    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt42x\" (UniqueName: \"kubernetes.io/projected/7363b937-4529-4793-8f2e-254ffd321cf5-kube-api-access-wt42x\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb\" (UID: \"7363b937-4529-4793-8f2e-254ffd321cf5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb"
Jun 10 00:30:00.203834 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:00.203809    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7363b937-4529-4793-8f2e-254ffd321cf5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb\" (UID: \"7363b937-4529-4793-8f2e-254ffd321cf5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb"
Jun 10 00:30:00.203971 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:00.203839    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7363b937-4529-4793-8f2e-254ffd321cf5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb\" (UID: \"7363b937-4529-4793-8f2e-254ffd321cf5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb"
Jun 10 00:30:00.221470 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:00.221438    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt42x\" (UniqueName: \"kubernetes.io/projected/7363b937-4529-4793-8f2e-254ffd321cf5-kube-api-access-wt42x\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb\" (UID: \"7363b937-4529-4793-8f2e-254ffd321cf5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb"
Jun 10 00:30:00.273480 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:00.273443    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:00.295477 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:00.295438    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb"
Jun 10 00:30:00.444836 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:00.444807    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb"]
Jun 10 00:30:00.447366 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:30:00.447340    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7363b937_4529_4793_8f2e_254ffd321cf5.slice/crio-0342143a0762b8ff70b879a39f5f117f5960a0fefd123eae37a7b1fe2ff9af2e WatchSource:0}: Error finding container 0342143a0762b8ff70b879a39f5f117f5960a0fefd123eae37a7b1fe2ff9af2e: Status 404 returned error can't find the container with id 0342143a0762b8ff70b879a39f5f117f5960a0fefd123eae37a7b1fe2ff9af2e
Jun 10 00:30:00.829409 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:00.829322    2560 generic.go:356] "Generic (PLEG): container finished" podID="7363b937-4529-4793-8f2e-254ffd321cf5" containerID="60fe053a32a551aa7d28e427f7c0a5975fcda9e66a7b43c9a5b645f2111bcac5" exitCode=0
Jun 10 00:30:00.829409 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:00.829364    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb" event={"ID":"7363b937-4529-4793-8f2e-254ffd321cf5","Type":"ContainerDied","Data":"60fe053a32a551aa7d28e427f7c0a5975fcda9e66a7b43c9a5b645f2111bcac5"}
Jun 10 00:30:00.829409 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:00.829399    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb" event={"ID":"7363b937-4529-4793-8f2e-254ffd321cf5","Type":"ContainerStarted","Data":"0342143a0762b8ff70b879a39f5f117f5960a0fefd123eae37a7b1fe2ff9af2e"}
Jun 10 00:30:01.910543 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:01.910501    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:01.992551 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:01.992517    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-lvv6v"]
Jun 10 00:30:01.996616 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:01.996598    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lvv6v"
Jun 10 00:30:01.999191 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:01.999160    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
Jun 10 00:30:01.999321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:01.999194    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-kms87\""
Jun 10 00:30:01.999321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:01.999160    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
Jun 10 00:30:02.011965 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:02.011893    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-lvv6v"]
Jun 10 00:30:02.126182 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:02.126137    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/ba9b61f3-4c49-4476-ba8d-6a4eb8e15e96-operator-config\") pod \"servicemesh-operator3-57f65f65fb-lvv6v\" (UID: \"ba9b61f3-4c49-4476-ba8d-6a4eb8e15e96\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lvv6v"
Jun 10 00:30:02.126360 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:02.126207    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpgg9\" (UniqueName: \"kubernetes.io/projected/ba9b61f3-4c49-4476-ba8d-6a4eb8e15e96-kube-api-access-vpgg9\") pod \"servicemesh-operator3-57f65f65fb-lvv6v\" (UID: \"ba9b61f3-4c49-4476-ba8d-6a4eb8e15e96\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lvv6v"
Jun 10 00:30:02.227564 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:02.227474    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpgg9\" (UniqueName: \"kubernetes.io/projected/ba9b61f3-4c49-4476-ba8d-6a4eb8e15e96-kube-api-access-vpgg9\") pod \"servicemesh-operator3-57f65f65fb-lvv6v\" (UID: \"ba9b61f3-4c49-4476-ba8d-6a4eb8e15e96\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lvv6v"
Jun 10 00:30:02.227721 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:02.227565    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/ba9b61f3-4c49-4476-ba8d-6a4eb8e15e96-operator-config\") pod \"servicemesh-operator3-57f65f65fb-lvv6v\" (UID: \"ba9b61f3-4c49-4476-ba8d-6a4eb8e15e96\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lvv6v"
Jun 10 00:30:02.230199 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:02.230170    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/ba9b61f3-4c49-4476-ba8d-6a4eb8e15e96-operator-config\") pod \"servicemesh-operator3-57f65f65fb-lvv6v\" (UID: \"ba9b61f3-4c49-4476-ba8d-6a4eb8e15e96\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lvv6v"
Jun 10 00:30:02.236111 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:02.236089    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpgg9\" (UniqueName: \"kubernetes.io/projected/ba9b61f3-4c49-4476-ba8d-6a4eb8e15e96-kube-api-access-vpgg9\") pod \"servicemesh-operator3-57f65f65fb-lvv6v\" (UID: \"ba9b61f3-4c49-4476-ba8d-6a4eb8e15e96\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-lvv6v"
Jun 10 00:30:02.307347 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:02.307304    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lvv6v"
Jun 10 00:30:02.453188 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:02.453161    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-lvv6v"]
Jun 10 00:30:02.455729 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:30:02.455699    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9b61f3_4c49_4476_ba8d_6a4eb8e15e96.slice/crio-3756612d6adb0ee1bfb8f0439a73001f6b2bb95e19872f25ecbbaee31e35769d WatchSource:0}: Error finding container 3756612d6adb0ee1bfb8f0439a73001f6b2bb95e19872f25ecbbaee31e35769d: Status 404 returned error can't find the container with id 3756612d6adb0ee1bfb8f0439a73001f6b2bb95e19872f25ecbbaee31e35769d
Jun 10 00:30:02.841631 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:02.841599    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lvv6v" event={"ID":"ba9b61f3-4c49-4476-ba8d-6a4eb8e15e96","Type":"ContainerStarted","Data":"3756612d6adb0ee1bfb8f0439a73001f6b2bb95e19872f25ecbbaee31e35769d"}
Jun 10 00:30:05.861929 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:05.861891    2560 generic.go:356] "Generic (PLEG): container finished" podID="7363b937-4529-4793-8f2e-254ffd321cf5" containerID="1a7f6e6ca3229f7b2c23b02a4bbf70ebfbe873f0d8b3dd97fee1309ae1cee833" exitCode=0
Jun 10 00:30:05.862320 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:05.861965    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb" event={"ID":"7363b937-4529-4793-8f2e-254ffd321cf5","Type":"ContainerDied","Data":"1a7f6e6ca3229f7b2c23b02a4bbf70ebfbe873f0d8b3dd97fee1309ae1cee833"}
Jun 10 00:30:06.869876 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:06.869830    2560 generic.go:356] "Generic (PLEG): container finished" podID="7363b937-4529-4793-8f2e-254ffd321cf5" containerID="4cb9c4cdbee3eab867aaba55ffc44efcdd914fbb81f79ba641636085989fad6c" exitCode=0
Jun 10 00:30:06.870273 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:06.869919    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb" event={"ID":"7363b937-4529-4793-8f2e-254ffd321cf5","Type":"ContainerDied","Data":"4cb9c4cdbee3eab867aaba55ffc44efcdd914fbb81f79ba641636085989fad6c"}
Jun 10 00:30:08.015159 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:08.015135    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb"
Jun 10 00:30:08.083978 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:08.083948    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7363b937-4529-4793-8f2e-254ffd321cf5-bundle\") pod \"7363b937-4529-4793-8f2e-254ffd321cf5\" (UID: \"7363b937-4529-4793-8f2e-254ffd321cf5\") "
Jun 10 00:30:08.084116 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:08.084036    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt42x\" (UniqueName: \"kubernetes.io/projected/7363b937-4529-4793-8f2e-254ffd321cf5-kube-api-access-wt42x\") pod \"7363b937-4529-4793-8f2e-254ffd321cf5\" (UID: \"7363b937-4529-4793-8f2e-254ffd321cf5\") "
Jun 10 00:30:08.084169 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:08.084117    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7363b937-4529-4793-8f2e-254ffd321cf5-util\") pod \"7363b937-4529-4793-8f2e-254ffd321cf5\" (UID: \"7363b937-4529-4793-8f2e-254ffd321cf5\") "
Jun 10 00:30:08.084883 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:08.084859    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7363b937-4529-4793-8f2e-254ffd321cf5-bundle" (OuterVolumeSpecName: "bundle") pod "7363b937-4529-4793-8f2e-254ffd321cf5" (UID: "7363b937-4529-4793-8f2e-254ffd321cf5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:30:08.086169 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:08.086148    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7363b937-4529-4793-8f2e-254ffd321cf5-kube-api-access-wt42x" (OuterVolumeSpecName: "kube-api-access-wt42x") pod "7363b937-4529-4793-8f2e-254ffd321cf5" (UID: "7363b937-4529-4793-8f2e-254ffd321cf5"). InnerVolumeSpecName "kube-api-access-wt42x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:30:08.088542 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:08.088515    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7363b937-4529-4793-8f2e-254ffd321cf5-util" (OuterVolumeSpecName: "util") pod "7363b937-4529-4793-8f2e-254ffd321cf5" (UID: "7363b937-4529-4793-8f2e-254ffd321cf5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:30:08.184935 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:08.184844    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7363b937-4529-4793-8f2e-254ffd321cf5-util\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:30:08.184935 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:08.184874    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7363b937-4529-4793-8f2e-254ffd321cf5-bundle\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:30:08.184935 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:08.184886    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt42x\" (UniqueName: \"kubernetes.io/projected/7363b937-4529-4793-8f2e-254ffd321cf5-kube-api-access-wt42x\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:30:08.884106 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:08.884070    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb" event={"ID":"7363b937-4529-4793-8f2e-254ffd321cf5","Type":"ContainerDied","Data":"0342143a0762b8ff70b879a39f5f117f5960a0fefd123eae37a7b1fe2ff9af2e"}
Jun 10 00:30:08.884255 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:08.884120    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0342143a0762b8ff70b879a39f5f117f5960a0fefd123eae37a7b1fe2ff9af2e"
Jun 10 00:30:08.884255 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:08.884082    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762alcshb"
Jun 10 00:30:12.680038 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:12.680006    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:12.731170 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:12.731134    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:12.910880 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:12.910846    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lvv6v" event={"ID":"ba9b61f3-4c49-4476-ba8d-6a4eb8e15e96","Type":"ContainerStarted","Data":"1a60b7cdece3bbfe931d08df3bbe172640d938a0a810934c7edef00235f4718d"}
Jun 10 00:30:12.911058 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:12.910987    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lvv6v"
Jun 10 00:30:12.935161 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:12.935040    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lvv6v" podStartSLOduration=2.287457327 podStartE2EDuration="11.935019547s" totalImagesPullingTime="9.64756222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:30:12.932179753 +0000 UTC m=+519.802955881" watchObservedRunningTime="2026-06-10 00:30:12.935019547 +0000 UTC m=+519.805795669"
Jun 10 00:30:13.322218 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.322178    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-9b4dc77dc-92z5t"]
Jun 10 00:30:13.322844 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.322824    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7363b937-4529-4793-8f2e-254ffd321cf5" containerName="pull"
Jun 10 00:30:13.322897 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.322849    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7363b937-4529-4793-8f2e-254ffd321cf5" containerName="pull"
Jun 10 00:30:13.322897 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.322865    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7363b937-4529-4793-8f2e-254ffd321cf5" containerName="util"
Jun 10 00:30:13.322897 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.322874    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7363b937-4529-4793-8f2e-254ffd321cf5" containerName="util"
Jun 10 00:30:13.322897 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.322894    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7363b937-4529-4793-8f2e-254ffd321cf5" containerName="extract"
Jun 10 00:30:13.323064 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.322904    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7363b937-4529-4793-8f2e-254ffd321cf5" containerName="extract"
Jun 10 00:30:13.323064 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.323019    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7363b937-4529-4793-8f2e-254ffd321cf5" containerName="extract"
Jun 10 00:30:13.326483 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.326462    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-9b4dc77dc-92z5t"
Jun 10 00:30:13.329006 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.328983    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 10 00:30:13.329122 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.329051    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rlnpq\""
Jun 10 00:30:13.333156 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.333132    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-9b4dc77dc-92z5t"]
Jun 10 00:30:13.353212 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.353188    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:13.434132 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.434090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/22a21b1f-4916-4341-9221-f80dab1a5232-redirect-config\") pod \"dashboard-redirect-9b4dc77dc-92z5t\" (UID: \"22a21b1f-4916-4341-9221-f80dab1a5232\") " pod="opendatahub/dashboard-redirect-9b4dc77dc-92z5t"
Jun 10 00:30:13.434132 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.434137    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25sg5\" (UniqueName: \"kubernetes.io/projected/22a21b1f-4916-4341-9221-f80dab1a5232-kube-api-access-25sg5\") pod \"dashboard-redirect-9b4dc77dc-92z5t\" (UID: \"22a21b1f-4916-4341-9221-f80dab1a5232\") " pod="opendatahub/dashboard-redirect-9b4dc77dc-92z5t"
Jun 10 00:30:13.535431 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.535395    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/22a21b1f-4916-4341-9221-f80dab1a5232-redirect-config\") pod \"dashboard-redirect-9b4dc77dc-92z5t\" (UID: \"22a21b1f-4916-4341-9221-f80dab1a5232\") " pod="opendatahub/dashboard-redirect-9b4dc77dc-92z5t"
Jun 10 00:30:13.535431 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.535431    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25sg5\" (UniqueName: \"kubernetes.io/projected/22a21b1f-4916-4341-9221-f80dab1a5232-kube-api-access-25sg5\") pod \"dashboard-redirect-9b4dc77dc-92z5t\" (UID: \"22a21b1f-4916-4341-9221-f80dab1a5232\") " pod="opendatahub/dashboard-redirect-9b4dc77dc-92z5t"
Jun 10 00:30:13.536259 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.536234    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/22a21b1f-4916-4341-9221-f80dab1a5232-redirect-config\") pod \"dashboard-redirect-9b4dc77dc-92z5t\" (UID: \"22a21b1f-4916-4341-9221-f80dab1a5232\") " pod="opendatahub/dashboard-redirect-9b4dc77dc-92z5t"
Jun 10 00:30:13.542808 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.542784    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25sg5\" (UniqueName: \"kubernetes.io/projected/22a21b1f-4916-4341-9221-f80dab1a5232-kube-api-access-25sg5\") pod \"dashboard-redirect-9b4dc77dc-92z5t\" (UID: \"22a21b1f-4916-4341-9221-f80dab1a5232\") " pod="opendatahub/dashboard-redirect-9b4dc77dc-92z5t"
Jun 10 00:30:13.639386 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.639302    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-9b4dc77dc-92z5t"
Jun 10 00:30:13.779331 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.779303    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-9b4dc77dc-92z5t"]
Jun 10 00:30:13.781250 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:30:13.781219    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22a21b1f_4916_4341_9221_f80dab1a5232.slice/crio-97d4b113d0ac3b8c630cdcd3f19722e16838095ebf923c8c6c63eb44b3de020f WatchSource:0}: Error finding container 97d4b113d0ac3b8c630cdcd3f19722e16838095ebf923c8c6c63eb44b3de020f: Status 404 returned error can't find the container with id 97d4b113d0ac3b8c630cdcd3f19722e16838095ebf923c8c6c63eb44b3de020f
Jun 10 00:30:13.917544 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:13.917453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-9b4dc77dc-92z5t" event={"ID":"22a21b1f-4916-4341-9221-f80dab1a5232","Type":"ContainerStarted","Data":"97d4b113d0ac3b8c630cdcd3f19722e16838095ebf923c8c6c63eb44b3de020f"}
Jun 10 00:30:16.938607 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:16.938568    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-9b4dc77dc-92z5t" event={"ID":"22a21b1f-4916-4341-9221-f80dab1a5232","Type":"ContainerStarted","Data":"c57adf37262c487d8f9b27f77f75e44d9db801c27aebcad2233e1e9f726c8042"}
Jun 10 00:30:16.953291 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:16.953240    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-9b4dc77dc-92z5t" podStartSLOduration=1.829849389 podStartE2EDuration="3.953222256s" totalImagesPullingTime="2.123372867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:30:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:30:16.952023326 +0000 UTC m=+523.822799454" watchObservedRunningTime="2026-06-10 00:30:16.953222256 +0000 UTC m=+523.823998383"
Jun 10 00:30:17.499204 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:17.499167    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:17.547344 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:17.547297    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:22.788850 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:22.788778    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-gbl2z"
Jun 10 00:30:23.791707 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:23.791675    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-gwl87"
Jun 10 00:30:23.919928 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:23.919898    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-lvv6v"
Jun 10 00:30:25.919950 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:25.919899    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:25.921572 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:25.921547    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"]
Jun 10 00:30:25.925677 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:25.925658    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:25.928176 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:25.928153    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jun 10 00:30:25.928492 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:25.928474    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jun 10 00:30:25.928549 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:25.928487    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jun 10 00:30:25.928593 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:25.928485    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-d6bm2\""
Jun 10 00:30:25.928593 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:25.928482    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 10 00:30:25.939705 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:25.938508    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"]
Jun 10 00:30:25.955788 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:25.955719    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b8e1c20-294b-4939-86aa-ba8370e2588f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:25.955788 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:25.955781    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8b8e1c20-294b-4939-86aa-ba8370e2588f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:25.956039 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:25.955819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b8e1c20-294b-4939-86aa-ba8370e2588f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:25.956039 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:25.955878    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqss4\" (UniqueName: \"kubernetes.io/projected/8b8e1c20-294b-4939-86aa-ba8370e2588f-kube-api-access-dqss4\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:25.956039 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:25.955970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b8e1c20-294b-4939-86aa-ba8370e2588f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:25.956039 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:25.956001    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8b8e1c20-294b-4939-86aa-ba8370e2588f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:25.956179 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:25.956061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8b8e1c20-294b-4939-86aa-ba8370e2588f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:26.034841 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.034804    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:26.057060 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.057023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b8e1c20-294b-4939-86aa-ba8370e2588f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:26.057248 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.057070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8b8e1c20-294b-4939-86aa-ba8370e2588f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:26.057314 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.057243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b8e1c20-294b-4939-86aa-ba8370e2588f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:26.057314 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.057301    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqss4\" (UniqueName: \"kubernetes.io/projected/8b8e1c20-294b-4939-86aa-ba8370e2588f-kube-api-access-dqss4\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:26.057424 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.057367    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b8e1c20-294b-4939-86aa-ba8370e2588f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:26.057424 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.057394    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8b8e1c20-294b-4939-86aa-ba8370e2588f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:26.058066 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.057550    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8b8e1c20-294b-4939-86aa-ba8370e2588f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:26.058195 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.058133    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8b8e1c20-294b-4939-86aa-ba8370e2588f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:26.059688 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.059656    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b8e1c20-294b-4939-86aa-ba8370e2588f-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:26.059886 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.059868    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8b8e1c20-294b-4939-86aa-ba8370e2588f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:26.060209 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.060184    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b8e1c20-294b-4939-86aa-ba8370e2588f-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:26.060400 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.060378    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8b8e1c20-294b-4939-86aa-ba8370e2588f-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:26.071229 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.071205    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b8e1c20-294b-4939-86aa-ba8370e2588f-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:26.079423 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.079397    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqss4\" (UniqueName: \"kubernetes.io/projected/8b8e1c20-294b-4939-86aa-ba8370e2588f-kube-api-access-dqss4\") pod \"istiod-openshift-gateway-75c67f8887-ghbww\" (UID: \"8b8e1c20-294b-4939-86aa-ba8370e2588f\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:26.236420 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.236339    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:26.346958 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.346914    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:26.379832 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.379809    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"]
Jun 10 00:30:26.382062 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:30:26.382039    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b8e1c20_294b_4939_86aa_ba8370e2588f.slice/crio-a2a30dca555be923c10b53041dcf1d639a7766cf39895cea3c9657d8b6742db0 WatchSource:0}: Error finding container a2a30dca555be923c10b53041dcf1d639a7766cf39895cea3c9657d8b6742db0: Status 404 returned error can't find the container with id a2a30dca555be923c10b53041dcf1d639a7766cf39895cea3c9657d8b6742db0
Jun 10 00:30:26.996819 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:26.996776    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww" event={"ID":"8b8e1c20-294b-4939-86aa-ba8370e2588f","Type":"ContainerStarted","Data":"a2a30dca555be923c10b53041dcf1d639a7766cf39895cea3c9657d8b6742db0"}
Jun 10 00:30:28.762796 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:28.762729    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jun 10 00:30:28.763099 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:28.762831    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jun 10 00:30:29.009387 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:29.009348    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww" event={"ID":"8b8e1c20-294b-4939-86aa-ba8370e2588f","Type":"ContainerStarted","Data":"6c00794d8eefc027527e38ec8370d138b8a1dcd4af178069f50d576c6d890bc4"}
Jun 10 00:30:29.009587 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:29.009482    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:29.011403 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:29.011333    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-ghbww container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jun 10 00:30:29.011403 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:29.011390    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww" podUID="8b8e1c20-294b-4939-86aa-ba8370e2588f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 10 00:30:29.028156 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:29.028100    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww" podStartSLOduration=1.649481105 podStartE2EDuration="4.028085485s" totalImagesPullingTime="2.37860438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:30:29.027157375 +0000 UTC m=+535.897933507" watchObservedRunningTime="2026-06-10 00:30:29.028085485 +0000 UTC m=+535.898861612"
Jun 10 00:30:29.580717 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:29.580665    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:29.681196 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:29.681156    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:29.895008 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:29.894920    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:30.016383 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:30.016359    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-ghbww"
Jun 10 00:30:30.091374 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:30.091333    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:30.191915 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:30.191822    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:30.293193 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:30.293160    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:38.414952 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:38.414910    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:38.513146 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:38.513104    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:38.565899 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:38.565867    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:39.782886 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:39.782853    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:39.887147 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:39.887109    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:41.016712 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:41.016673    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:41.067602 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:41.067568    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:51.091262 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:51.091212    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:51.140773 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:51.140702    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:51.191817 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:51.191780    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:30:55.115301 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.115244    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs"]
Jun 10 00:30:55.118039 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.118021    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs"
Jun 10 00:30:55.120565 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.120539    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nm97h\""
Jun 10 00:30:55.120565 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.120540    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 10 00:30:55.121531 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.121513    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 10 00:30:55.126297 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.126274    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs"]
Jun 10 00:30:55.215564 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.215530    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb"]
Jun 10 00:30:55.218452 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.218434    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb"
Jun 10 00:30:55.224326 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.224299    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba986a6b-14df-423d-8fd0-a912d3f46f81-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs\" (UID: \"ba986a6b-14df-423d-8fd0-a912d3f46f81\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs"
Jun 10 00:30:55.224483 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.224342    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba986a6b-14df-423d-8fd0-a912d3f46f81-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs\" (UID: \"ba986a6b-14df-423d-8fd0-a912d3f46f81\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs"
Jun 10 00:30:55.224483 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.224443    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm785\" (UniqueName: \"kubernetes.io/projected/ba986a6b-14df-423d-8fd0-a912d3f46f81-kube-api-access-mm785\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs\" (UID: \"ba986a6b-14df-423d-8fd0-a912d3f46f81\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs"
Jun 10 00:30:55.226477 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.226451    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb"]
Jun 10 00:30:55.325394 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.325356    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9bc31c7-1436-464f-b476-5f0ddeef15c6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb\" (UID: \"d9bc31c7-1436-464f-b476-5f0ddeef15c6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb"
Jun 10 00:30:55.325394 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.325391    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9bc31c7-1436-464f-b476-5f0ddeef15c6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb\" (UID: \"d9bc31c7-1436-464f-b476-5f0ddeef15c6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb"
Jun 10 00:30:55.325665 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.325419    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba986a6b-14df-423d-8fd0-a912d3f46f81-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs\" (UID: \"ba986a6b-14df-423d-8fd0-a912d3f46f81\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs"
Jun 10 00:30:55.325665 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.325440    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba986a6b-14df-423d-8fd0-a912d3f46f81-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs\" (UID: \"ba986a6b-14df-423d-8fd0-a912d3f46f81\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs"
Jun 10 00:30:55.325665 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.325542    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm785\" (UniqueName: \"kubernetes.io/projected/ba986a6b-14df-423d-8fd0-a912d3f46f81-kube-api-access-mm785\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs\" (UID: \"ba986a6b-14df-423d-8fd0-a912d3f46f81\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs"
Jun 10 00:30:55.325665 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.325578    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlrh7\" (UniqueName: \"kubernetes.io/projected/d9bc31c7-1436-464f-b476-5f0ddeef15c6-kube-api-access-wlrh7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb\" (UID: \"d9bc31c7-1436-464f-b476-5f0ddeef15c6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb"
Jun 10 00:30:55.325940 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.325777    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba986a6b-14df-423d-8fd0-a912d3f46f81-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs\" (UID: \"ba986a6b-14df-423d-8fd0-a912d3f46f81\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs"
Jun 10 00:30:55.325940 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.325883    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba986a6b-14df-423d-8fd0-a912d3f46f81-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs\" (UID: \"ba986a6b-14df-423d-8fd0-a912d3f46f81\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs"
Jun 10 00:30:55.333322 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.333295    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm785\" (UniqueName: \"kubernetes.io/projected/ba986a6b-14df-423d-8fd0-a912d3f46f81-kube-api-access-mm785\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs\" (UID: \"ba986a6b-14df-423d-8fd0-a912d3f46f81\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs"
Jun 10 00:30:55.426545 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.426457    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlrh7\" (UniqueName: \"kubernetes.io/projected/d9bc31c7-1436-464f-b476-5f0ddeef15c6-kube-api-access-wlrh7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb\" (UID: \"d9bc31c7-1436-464f-b476-5f0ddeef15c6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb"
Jun 10 00:30:55.426545 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.426526    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9bc31c7-1436-464f-b476-5f0ddeef15c6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb\" (UID: \"d9bc31c7-1436-464f-b476-5f0ddeef15c6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb"
Jun 10 00:30:55.426818 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.426553    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9bc31c7-1436-464f-b476-5f0ddeef15c6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb\" (UID: \"d9bc31c7-1436-464f-b476-5f0ddeef15c6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb"
Jun 10 00:30:55.426998 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.426978    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9bc31c7-1436-464f-b476-5f0ddeef15c6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb\" (UID: \"d9bc31c7-1436-464f-b476-5f0ddeef15c6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb"
Jun 10 00:30:55.427066 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.426985    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9bc31c7-1436-464f-b476-5f0ddeef15c6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb\" (UID: \"d9bc31c7-1436-464f-b476-5f0ddeef15c6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb"
Jun 10 00:30:55.428288 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.428269    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs"
Jun 10 00:30:55.434328 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.434306    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlrh7\" (UniqueName: \"kubernetes.io/projected/d9bc31c7-1436-464f-b476-5f0ddeef15c6-kube-api-access-wlrh7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb\" (UID: \"d9bc31c7-1436-464f-b476-5f0ddeef15c6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb"
Jun 10 00:30:55.446529 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.446496    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l"]
Jun 10 00:30:55.449302 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.449285    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l"
Jun 10 00:30:55.458549 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.458494    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l"]
Jun 10 00:30:55.527477 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.527447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6hc4\" (UniqueName: \"kubernetes.io/projected/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-kube-api-access-p6hc4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l\" (UID: \"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l"
Jun 10 00:30:55.527477 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.527487    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l\" (UID: \"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l"
Jun 10 00:30:55.527685 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.527535    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l\" (UID: \"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l"
Jun 10 00:30:55.528250 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.528229    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb"
Jun 10 00:30:55.571210 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.571180    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs"]
Jun 10 00:30:55.573097 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:30:55.573067    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba986a6b_14df_423d_8fd0_a912d3f46f81.slice/crio-261ec2a8c9bd9c194e65fe6508f7fdcc8f157dcb80f4ccc950abb191781d7d40 WatchSource:0}: Error finding container 261ec2a8c9bd9c194e65fe6508f7fdcc8f157dcb80f4ccc950abb191781d7d40: Status 404 returned error can't find the container with id 261ec2a8c9bd9c194e65fe6508f7fdcc8f157dcb80f4ccc950abb191781d7d40
Jun 10 00:30:55.628108 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.628076    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6hc4\" (UniqueName: \"kubernetes.io/projected/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-kube-api-access-p6hc4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l\" (UID: \"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l"
Jun 10 00:30:55.628259 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.628131    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l\" (UID: \"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l"
Jun 10 00:30:55.628259 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.628196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l\" (UID: \"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l"
Jun 10 00:30:55.628721 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.628680    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l\" (UID: \"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l"
Jun 10 00:30:55.628871 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.628851    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l\" (UID: \"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l"
Jun 10 00:30:55.636351 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.636328    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6hc4\" (UniqueName: \"kubernetes.io/projected/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-kube-api-access-p6hc4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l\" (UID: \"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l"
Jun 10 00:30:55.682703 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.682629    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb"]
Jun 10 00:30:55.687652 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:30:55.687625    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9bc31c7_1436_464f_b476_5f0ddeef15c6.slice/crio-70b7bed8a763bddfef9584180e9c9fbcf9816044b0ddc9268b67c9a02517cfc3 WatchSource:0}: Error finding container 70b7bed8a763bddfef9584180e9c9fbcf9816044b0ddc9268b67c9a02517cfc3: Status 404 returned error can't find the container with id 70b7bed8a763bddfef9584180e9c9fbcf9816044b0ddc9268b67c9a02517cfc3
Jun 10 00:30:55.762733 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.762694    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l"
Jun 10 00:30:55.853146 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.852652    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc"]
Jun 10 00:30:55.856118 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.856087    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc"
Jun 10 00:30:55.863296 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.863267    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc"]
Jun 10 00:30:55.907175 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.907152    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l"]
Jun 10 00:30:55.909378 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:30:55.909347    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa47c1a7_7fac_4dcd_8719_5dd1b7e104fc.slice/crio-f2d8af4f0b8727c72fa0e2e45baab0f64026339b80021054fcf5b028dd999eb8 WatchSource:0}: Error finding container f2d8af4f0b8727c72fa0e2e45baab0f64026339b80021054fcf5b028dd999eb8: Status 404 returned error can't find the container with id f2d8af4f0b8727c72fa0e2e45baab0f64026339b80021054fcf5b028dd999eb8
Jun 10 00:30:55.930578 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.930553    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc\" (UID: \"86c36fb2-b9d1-4754-b3d1-7a815fd977dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc"
Jun 10 00:30:55.930662 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.930600    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc\" (UID: \"86c36fb2-b9d1-4754-b3d1-7a815fd977dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc"
Jun 10 00:30:55.930720 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:55.930684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cthgk\" (UniqueName: \"kubernetes.io/projected/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-kube-api-access-cthgk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc\" (UID: \"86c36fb2-b9d1-4754-b3d1-7a815fd977dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc"
Jun 10 00:30:56.031846 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.031809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc\" (UID: \"86c36fb2-b9d1-4754-b3d1-7a815fd977dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc"
Jun 10 00:30:56.032001 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.031876    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc\" (UID: \"86c36fb2-b9d1-4754-b3d1-7a815fd977dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc"
Jun 10 00:30:56.032001 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.031951    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cthgk\" (UniqueName: \"kubernetes.io/projected/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-kube-api-access-cthgk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc\" (UID: \"86c36fb2-b9d1-4754-b3d1-7a815fd977dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc"
Jun 10 00:30:56.032198 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.032181    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc\" (UID: \"86c36fb2-b9d1-4754-b3d1-7a815fd977dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc"
Jun 10 00:30:56.032269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.032210    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc\" (UID: \"86c36fb2-b9d1-4754-b3d1-7a815fd977dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc"
Jun 10 00:30:56.039631 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.039608    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cthgk\" (UniqueName: \"kubernetes.io/projected/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-kube-api-access-cthgk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc\" (UID: \"86c36fb2-b9d1-4754-b3d1-7a815fd977dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc"
Jun 10 00:30:56.162874 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.162837    2560 generic.go:356] "Generic (PLEG): container finished" podID="fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc" containerID="0d4233b76427f89be922179b164f969e4094a45fcdddf707203e62f845b2889d" exitCode=0
Jun 10 00:30:56.163306 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.162934    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l" event={"ID":"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc","Type":"ContainerDied","Data":"0d4233b76427f89be922179b164f969e4094a45fcdddf707203e62f845b2889d"}
Jun 10 00:30:56.163306 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.162987    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l" event={"ID":"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc","Type":"ContainerStarted","Data":"f2d8af4f0b8727c72fa0e2e45baab0f64026339b80021054fcf5b028dd999eb8"}
Jun 10 00:30:56.164451 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.164421    2560 generic.go:356] "Generic (PLEG): container finished" podID="ba986a6b-14df-423d-8fd0-a912d3f46f81" containerID="c0de85019f9d8519e1d8e186582d01d2c96abcb75f88b8ae7c501b7aa5941db3" exitCode=0
Jun 10 00:30:56.164560 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.164452    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs" event={"ID":"ba986a6b-14df-423d-8fd0-a912d3f46f81","Type":"ContainerDied","Data":"c0de85019f9d8519e1d8e186582d01d2c96abcb75f88b8ae7c501b7aa5941db3"}
Jun 10 00:30:56.164560 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.164496    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs" event={"ID":"ba986a6b-14df-423d-8fd0-a912d3f46f81","Type":"ContainerStarted","Data":"261ec2a8c9bd9c194e65fe6508f7fdcc8f157dcb80f4ccc950abb191781d7d40"}
Jun 10 00:30:56.165991 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.165971    2560 generic.go:356] "Generic (PLEG): container finished" podID="d9bc31c7-1436-464f-b476-5f0ddeef15c6" containerID="5adfedcf7bb55251c1831eedf499068d5771a6e0ca14c4e0d2aaa3248bdd3939" exitCode=0
Jun 10 00:30:56.166102 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.166056    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb" event={"ID":"d9bc31c7-1436-464f-b476-5f0ddeef15c6","Type":"ContainerDied","Data":"5adfedcf7bb55251c1831eedf499068d5771a6e0ca14c4e0d2aaa3248bdd3939"}
Jun 10 00:30:56.166174 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.166102    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb" event={"ID":"d9bc31c7-1436-464f-b476-5f0ddeef15c6","Type":"ContainerStarted","Data":"70b7bed8a763bddfef9584180e9c9fbcf9816044b0ddc9268b67c9a02517cfc3"}
Jun 10 00:30:56.198105 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.198006    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc"
Jun 10 00:30:56.330394 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:56.330361    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc"]
Jun 10 00:30:56.331904 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:30:56.331882    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c36fb2_b9d1_4754_b3d1_7a815fd977dd.slice/crio-57e1180f971843b28d589ed729f80a9452ea00977f7bf4e42b1b67c30f591302 WatchSource:0}: Error finding container 57e1180f971843b28d589ed729f80a9452ea00977f7bf4e42b1b67c30f591302: Status 404 returned error can't find the container with id 57e1180f971843b28d589ed729f80a9452ea00977f7bf4e42b1b67c30f591302
Jun 10 00:30:57.175898 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:57.175864    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l" event={"ID":"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc","Type":"ContainerStarted","Data":"b1316f4229c19d98a6f6f724756a1a343254d12069c2b514ca53e2a8987e85ff"}
Jun 10 00:30:57.178191 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:57.178165    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs" event={"ID":"ba986a6b-14df-423d-8fd0-a912d3f46f81","Type":"ContainerStarted","Data":"e0e7abad13c743a8d69474287bda122d66ab55919da28e22e817f6031aba4158"}
Jun 10 00:30:57.180851 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:57.180823    2560 generic.go:356] "Generic (PLEG): container finished" podID="d9bc31c7-1436-464f-b476-5f0ddeef15c6" containerID="3432a070e1cb1c040d734d8ccd6d2741cc2f9a61c46244f86dde6f64885431c8" exitCode=0
Jun 10 00:30:57.180968 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:57.180901    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb" event={"ID":"d9bc31c7-1436-464f-b476-5f0ddeef15c6","Type":"ContainerDied","Data":"3432a070e1cb1c040d734d8ccd6d2741cc2f9a61c46244f86dde6f64885431c8"}
Jun 10 00:30:57.183196 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:57.183171    2560 generic.go:356] "Generic (PLEG): container finished" podID="86c36fb2-b9d1-4754-b3d1-7a815fd977dd" containerID="8dc5371f2afbb419d9e283d20887791689ea5258bd262204018706e080f094ac" exitCode=0
Jun 10 00:30:57.183288 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:57.183256    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc" event={"ID":"86c36fb2-b9d1-4754-b3d1-7a815fd977dd","Type":"ContainerDied","Data":"8dc5371f2afbb419d9e283d20887791689ea5258bd262204018706e080f094ac"}
Jun 10 00:30:57.183333 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:57.183301    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc" event={"ID":"86c36fb2-b9d1-4754-b3d1-7a815fd977dd","Type":"ContainerStarted","Data":"57e1180f971843b28d589ed729f80a9452ea00977f7bf4e42b1b67c30f591302"}
Jun 10 00:30:58.191691 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:58.191599    2560 generic.go:356] "Generic (PLEG): container finished" podID="fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc" containerID="b1316f4229c19d98a6f6f724756a1a343254d12069c2b514ca53e2a8987e85ff" exitCode=0
Jun 10 00:30:58.192162 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:58.191683    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l" event={"ID":"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc","Type":"ContainerDied","Data":"b1316f4229c19d98a6f6f724756a1a343254d12069c2b514ca53e2a8987e85ff"}
Jun 10 00:30:58.193566 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:58.193544    2560 generic.go:356] "Generic (PLEG): container finished" podID="ba986a6b-14df-423d-8fd0-a912d3f46f81" containerID="e0e7abad13c743a8d69474287bda122d66ab55919da28e22e817f6031aba4158" exitCode=0
Jun 10 00:30:58.193646 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:58.193609    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs" event={"ID":"ba986a6b-14df-423d-8fd0-a912d3f46f81","Type":"ContainerDied","Data":"e0e7abad13c743a8d69474287bda122d66ab55919da28e22e817f6031aba4158"}
Jun 10 00:30:58.195986 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:58.195967    2560 generic.go:356] "Generic (PLEG): container finished" podID="d9bc31c7-1436-464f-b476-5f0ddeef15c6" containerID="57438ada21a59e4c5b56431c5abefb2379e7fcbebc6d38cda0624ea591d49de1" exitCode=0
Jun 10 00:30:58.196069 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:58.196044    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb" event={"ID":"d9bc31c7-1436-464f-b476-5f0ddeef15c6","Type":"ContainerDied","Data":"57438ada21a59e4c5b56431c5abefb2379e7fcbebc6d38cda0624ea591d49de1"}
Jun 10 00:30:58.197684 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:58.197667    2560 generic.go:356] "Generic (PLEG): container finished" podID="86c36fb2-b9d1-4754-b3d1-7a815fd977dd" containerID="3f0c7175f4c61fdb23065a84f0b9936d46eec3a9a9302b17627ab5001d65412a" exitCode=0
Jun 10 00:30:58.197781 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:58.197755    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc" event={"ID":"86c36fb2-b9d1-4754-b3d1-7a815fd977dd","Type":"ContainerDied","Data":"3f0c7175f4c61fdb23065a84f0b9936d46eec3a9a9302b17627ab5001d65412a"}
Jun 10 00:30:59.205410 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:59.205377    2560 generic.go:356] "Generic (PLEG): container finished" podID="fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc" containerID="4f51d55cac3efd8ef3b9272c4dfbb913040510f470ca1995590ceb2270c77db2" exitCode=0
Jun 10 00:30:59.205891 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:59.205450    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l" event={"ID":"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc","Type":"ContainerDied","Data":"4f51d55cac3efd8ef3b9272c4dfbb913040510f470ca1995590ceb2270c77db2"}
Jun 10 00:30:59.207528 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:59.207505    2560 generic.go:356] "Generic (PLEG): container finished" podID="ba986a6b-14df-423d-8fd0-a912d3f46f81" containerID="fc28708aef68026a5f5c74735aebf66fda75e717a16237d4d57eb55e70bdaa43" exitCode=0
Jun 10 00:30:59.207621 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:59.207587    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs" event={"ID":"ba986a6b-14df-423d-8fd0-a912d3f46f81","Type":"ContainerDied","Data":"fc28708aef68026a5f5c74735aebf66fda75e717a16237d4d57eb55e70bdaa43"}
Jun 10 00:30:59.209643 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:59.209621    2560 generic.go:356] "Generic (PLEG): container finished" podID="86c36fb2-b9d1-4754-b3d1-7a815fd977dd" containerID="8ae696ec8b17b7c56b45649ee550095591521db3095641e081b028bbad0b9fc6" exitCode=0
Jun 10 00:30:59.209733 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:59.209699    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc" event={"ID":"86c36fb2-b9d1-4754-b3d1-7a815fd977dd","Type":"ContainerDied","Data":"8ae696ec8b17b7c56b45649ee550095591521db3095641e081b028bbad0b9fc6"}
Jun 10 00:30:59.350629 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:59.350604    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb"
Jun 10 00:30:59.463337 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:59.463250    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9bc31c7-1436-464f-b476-5f0ddeef15c6-bundle\") pod \"d9bc31c7-1436-464f-b476-5f0ddeef15c6\" (UID: \"d9bc31c7-1436-464f-b476-5f0ddeef15c6\") "
Jun 10 00:30:59.463483 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:59.463346    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9bc31c7-1436-464f-b476-5f0ddeef15c6-util\") pod \"d9bc31c7-1436-464f-b476-5f0ddeef15c6\" (UID: \"d9bc31c7-1436-464f-b476-5f0ddeef15c6\") "
Jun 10 00:30:59.463483 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:59.463387    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlrh7\" (UniqueName: \"kubernetes.io/projected/d9bc31c7-1436-464f-b476-5f0ddeef15c6-kube-api-access-wlrh7\") pod \"d9bc31c7-1436-464f-b476-5f0ddeef15c6\" (UID: \"d9bc31c7-1436-464f-b476-5f0ddeef15c6\") "
Jun 10 00:30:59.463844 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:59.463816    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9bc31c7-1436-464f-b476-5f0ddeef15c6-bundle" (OuterVolumeSpecName: "bundle") pod "d9bc31c7-1436-464f-b476-5f0ddeef15c6" (UID: "d9bc31c7-1436-464f-b476-5f0ddeef15c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:30:59.466270 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:59.466246    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9bc31c7-1436-464f-b476-5f0ddeef15c6-kube-api-access-wlrh7" (OuterVolumeSpecName: "kube-api-access-wlrh7") pod "d9bc31c7-1436-464f-b476-5f0ddeef15c6" (UID: "d9bc31c7-1436-464f-b476-5f0ddeef15c6"). InnerVolumeSpecName "kube-api-access-wlrh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:30:59.469811 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:59.469788    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9bc31c7-1436-464f-b476-5f0ddeef15c6-util" (OuterVolumeSpecName: "util") pod "d9bc31c7-1436-464f-b476-5f0ddeef15c6" (UID: "d9bc31c7-1436-464f-b476-5f0ddeef15c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:30:59.565142 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:59.565113    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlrh7\" (UniqueName: \"kubernetes.io/projected/d9bc31c7-1436-464f-b476-5f0ddeef15c6-kube-api-access-wlrh7\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:30:59.565142 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:59.565140    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9bc31c7-1436-464f-b476-5f0ddeef15c6-bundle\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:30:59.565142 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:30:59.565150    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9bc31c7-1436-464f-b476-5f0ddeef15c6-util\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:31:00.217648 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.217606    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb" event={"ID":"d9bc31c7-1436-464f-b476-5f0ddeef15c6","Type":"ContainerDied","Data":"70b7bed8a763bddfef9584180e9c9fbcf9816044b0ddc9268b67c9a02517cfc3"}
Jun 10 00:31:00.218058 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.217662    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70b7bed8a763bddfef9584180e9c9fbcf9816044b0ddc9268b67c9a02517cfc3"
Jun 10 00:31:00.218058 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.217854    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb"
Jun 10 00:31:00.363563 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.363536    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc"
Jun 10 00:31:00.412397 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.412371    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs"
Jun 10 00:31:00.415354 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.415335    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l"
Jun 10 00:31:00.474063 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.473972    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-util\") pod \"86c36fb2-b9d1-4754-b3d1-7a815fd977dd\" (UID: \"86c36fb2-b9d1-4754-b3d1-7a815fd977dd\") "
Jun 10 00:31:00.474063 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.474008    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-bundle\") pod \"86c36fb2-b9d1-4754-b3d1-7a815fd977dd\" (UID: \"86c36fb2-b9d1-4754-b3d1-7a815fd977dd\") "
Jun 10 00:31:00.474063 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.474066    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cthgk\" (UniqueName: \"kubernetes.io/projected/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-kube-api-access-cthgk\") pod \"86c36fb2-b9d1-4754-b3d1-7a815fd977dd\" (UID: \"86c36fb2-b9d1-4754-b3d1-7a815fd977dd\") "
Jun 10 00:31:00.474531 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.474508    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-bundle" (OuterVolumeSpecName: "bundle") pod "86c36fb2-b9d1-4754-b3d1-7a815fd977dd" (UID: "86c36fb2-b9d1-4754-b3d1-7a815fd977dd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:31:00.476269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.476246    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-kube-api-access-cthgk" (OuterVolumeSpecName: "kube-api-access-cthgk") pod "86c36fb2-b9d1-4754-b3d1-7a815fd977dd" (UID: "86c36fb2-b9d1-4754-b3d1-7a815fd977dd"). InnerVolumeSpecName "kube-api-access-cthgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:31:00.478729 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.478704    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-util" (OuterVolumeSpecName: "util") pod "86c36fb2-b9d1-4754-b3d1-7a815fd977dd" (UID: "86c36fb2-b9d1-4754-b3d1-7a815fd977dd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:31:00.574946 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.574903    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba986a6b-14df-423d-8fd0-a912d3f46f81-bundle\") pod \"ba986a6b-14df-423d-8fd0-a912d3f46f81\" (UID: \"ba986a6b-14df-423d-8fd0-a912d3f46f81\") "
Jun 10 00:31:00.574946 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.574951    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-util\") pod \"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc\" (UID: \"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc\") "
Jun 10 00:31:00.575197 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.575003    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mm785\" (UniqueName: \"kubernetes.io/projected/ba986a6b-14df-423d-8fd0-a912d3f46f81-kube-api-access-mm785\") pod \"ba986a6b-14df-423d-8fd0-a912d3f46f81\" (UID: \"ba986a6b-14df-423d-8fd0-a912d3f46f81\") "
Jun 10 00:31:00.575197 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.575028    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba986a6b-14df-423d-8fd0-a912d3f46f81-util\") pod \"ba986a6b-14df-423d-8fd0-a912d3f46f81\" (UID: \"ba986a6b-14df-423d-8fd0-a912d3f46f81\") "
Jun 10 00:31:00.575197 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.575053    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-bundle\") pod \"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc\" (UID: \"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc\") "
Jun 10 00:31:00.575197 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.575158    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6hc4\" (UniqueName: \"kubernetes.io/projected/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-kube-api-access-p6hc4\") pod \"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc\" (UID: \"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc\") "
Jun 10 00:31:00.575461 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.575441    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-util\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:31:00.575535 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.575463    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-bundle\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:31:00.575535 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.575477    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cthgk\" (UniqueName: \"kubernetes.io/projected/86c36fb2-b9d1-4754-b3d1-7a815fd977dd-kube-api-access-cthgk\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:31:00.575626 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.575579    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-bundle" (OuterVolumeSpecName: "bundle") pod "fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc" (UID: "fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:31:00.575720 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.575695    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba986a6b-14df-423d-8fd0-a912d3f46f81-bundle" (OuterVolumeSpecName: "bundle") pod "ba986a6b-14df-423d-8fd0-a912d3f46f81" (UID: "ba986a6b-14df-423d-8fd0-a912d3f46f81"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:31:00.577424 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.577400    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba986a6b-14df-423d-8fd0-a912d3f46f81-kube-api-access-mm785" (OuterVolumeSpecName: "kube-api-access-mm785") pod "ba986a6b-14df-423d-8fd0-a912d3f46f81" (UID: "ba986a6b-14df-423d-8fd0-a912d3f46f81"). InnerVolumeSpecName "kube-api-access-mm785". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:31:00.577763 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.577721    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-kube-api-access-p6hc4" (OuterVolumeSpecName: "kube-api-access-p6hc4") pod "fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc" (UID: "fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc"). InnerVolumeSpecName "kube-api-access-p6hc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:31:00.580691 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.580670    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba986a6b-14df-423d-8fd0-a912d3f46f81-util" (OuterVolumeSpecName: "util") pod "ba986a6b-14df-423d-8fd0-a912d3f46f81" (UID: "ba986a6b-14df-423d-8fd0-a912d3f46f81"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:31:00.581712 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.581692    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-util" (OuterVolumeSpecName: "util") pod "fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc" (UID: "fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:31:00.676321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.676289    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mm785\" (UniqueName: \"kubernetes.io/projected/ba986a6b-14df-423d-8fd0-a912d3f46f81-kube-api-access-mm785\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:31:00.676321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.676315    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba986a6b-14df-423d-8fd0-a912d3f46f81-util\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:31:00.676321 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.676325    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-bundle\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:31:00.676535 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.676334    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6hc4\" (UniqueName: \"kubernetes.io/projected/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-kube-api-access-p6hc4\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:31:00.676535 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.676343    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba986a6b-14df-423d-8fd0-a912d3f46f81-bundle\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:31:00.676535 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:00.676351    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc-util\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:31:01.224798 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:01.224764    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc"
Jun 10 00:31:01.224798 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:01.224769    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc" event={"ID":"86c36fb2-b9d1-4754-b3d1-7a815fd977dd","Type":"ContainerDied","Data":"57e1180f971843b28d589ed729f80a9452ea00977f7bf4e42b1b67c30f591302"}
Jun 10 00:31:01.225251 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:01.224817    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57e1180f971843b28d589ed729f80a9452ea00977f7bf4e42b1b67c30f591302"
Jun 10 00:31:01.226633 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:01.226613    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l"
Jun 10 00:31:01.226778 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:01.226615    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l" event={"ID":"fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc","Type":"ContainerDied","Data":"f2d8af4f0b8727c72fa0e2e45baab0f64026339b80021054fcf5b028dd999eb8"}
Jun 10 00:31:01.226778 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:01.226723    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2d8af4f0b8727c72fa0e2e45baab0f64026339b80021054fcf5b028dd999eb8"
Jun 10 00:31:01.228603 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:01.228577    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs"
Jun 10 00:31:01.228679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:01.228609    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs" event={"ID":"ba986a6b-14df-423d-8fd0-a912d3f46f81","Type":"ContainerDied","Data":"261ec2a8c9bd9c194e65fe6508f7fdcc8f157dcb80f4ccc950abb191781d7d40"}
Jun 10 00:31:01.228679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:01.228645    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="261ec2a8c9bd9c194e65fe6508f7fdcc8f157dcb80f4ccc950abb191781d7d40"
Jun 10 00:31:07.698903 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:07.698862    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:11.491027 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:11.490978    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:14.305788 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:14.305734    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:14.580062 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:14.579965    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:15.946482 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:15.946445    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:18.686715 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:18.686672    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:19.303627 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:19.303589    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:20.149720 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:20.149684    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:20.244754 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:20.244712    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:23.139022 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:23.138983    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:23.913085 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:23.913047    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:24.012475 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:24.012430    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:27.709133 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:27.709087    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:27.861186 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:27.861136    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:31.123653 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:31.123619    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:31.234814 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:31.234775    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:31.473874 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:31.473774    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:33.615013 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:33.614986    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v87bq_42e8ed02-5ca0-478a-9642-562b92e21674/ovn-acl-logging/0.log"
Jun 10 00:31:33.615440 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:33.614991    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v87bq_42e8ed02-5ca0-478a-9642-562b92e21674/ovn-acl-logging/0.log"
Jun 10 00:31:39.736013 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:39.735963    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:40.886722 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:40.886680    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:41.576775 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.576726    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89zdc"]
Jun 10 00:31:41.577142 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577128    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc" containerName="pull"
Jun 10 00:31:41.577142 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577142    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc" containerName="pull"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577162    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba986a6b-14df-423d-8fd0-a912d3f46f81" containerName="util"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577167    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba986a6b-14df-423d-8fd0-a912d3f46f81" containerName="util"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577175    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86c36fb2-b9d1-4754-b3d1-7a815fd977dd" containerName="pull"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577180    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="86c36fb2-b9d1-4754-b3d1-7a815fd977dd" containerName="pull"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577185    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba986a6b-14df-423d-8fd0-a912d3f46f81" containerName="extract"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577190    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba986a6b-14df-423d-8fd0-a912d3f46f81" containerName="extract"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577198    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9bc31c7-1436-464f-b476-5f0ddeef15c6" containerName="util"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577203    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9bc31c7-1436-464f-b476-5f0ddeef15c6" containerName="util"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577211    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc" containerName="util"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577215    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc" containerName="util"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577220    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9bc31c7-1436-464f-b476-5f0ddeef15c6" containerName="pull"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577225    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9bc31c7-1436-464f-b476-5f0ddeef15c6" containerName="pull"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577231    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86c36fb2-b9d1-4754-b3d1-7a815fd977dd" containerName="util"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577236    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="86c36fb2-b9d1-4754-b3d1-7a815fd977dd" containerName="util"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577241    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba986a6b-14df-423d-8fd0-a912d3f46f81" containerName="pull"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577246    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba986a6b-14df-423d-8fd0-a912d3f46f81" containerName="pull"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577255    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9bc31c7-1436-464f-b476-5f0ddeef15c6" containerName="extract"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577260    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9bc31c7-1436-464f-b476-5f0ddeef15c6" containerName="extract"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577265    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86c36fb2-b9d1-4754-b3d1-7a815fd977dd" containerName="extract"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577270    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="86c36fb2-b9d1-4754-b3d1-7a815fd977dd" containerName="extract"
Jun 10 00:31:41.577269 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577280    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc" containerName="extract"
Jun 10 00:31:41.578389 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577285    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc" containerName="extract"
Jun 10 00:31:41.578389 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577342    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9bc31c7-1436-464f-b476-5f0ddeef15c6" containerName="extract"
Jun 10 00:31:41.578389 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577352    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc" containerName="extract"
Jun 10 00:31:41.578389 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577358    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="86c36fb2-b9d1-4754-b3d1-7a815fd977dd" containerName="extract"
Jun 10 00:31:41.578389 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.577366    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba986a6b-14df-423d-8fd0-a912d3f46f81" containerName="extract"
Jun 10 00:31:41.579487 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.579464    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89zdc"
Jun 10 00:31:41.583139 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.583115    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 10 00:31:41.583453 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.583439    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-f8j82\""
Jun 10 00:31:41.583759 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.583724    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 10 00:31:41.596441 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.596408    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89zdc"]
Jun 10 00:31:41.646034 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.645983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v86sk\" (UniqueName: \"kubernetes.io/projected/bfeb9fdd-4a1b-48c5-9355-67a5d3c04abf-kube-api-access-v86sk\") pod \"limitador-operator-controller-manager-859d7b78bd-89zdc\" (UID: \"bfeb9fdd-4a1b-48c5-9355-67a5d3c04abf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89zdc"
Jun 10 00:31:41.747130 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.747083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v86sk\" (UniqueName: \"kubernetes.io/projected/bfeb9fdd-4a1b-48c5-9355-67a5d3c04abf-kube-api-access-v86sk\") pod \"limitador-operator-controller-manager-859d7b78bd-89zdc\" (UID: \"bfeb9fdd-4a1b-48c5-9355-67a5d3c04abf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89zdc"
Jun 10 00:31:41.756479 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.756447    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v86sk\" (UniqueName: \"kubernetes.io/projected/bfeb9fdd-4a1b-48c5-9355-67a5d3c04abf-kube-api-access-v86sk\") pod \"limitador-operator-controller-manager-859d7b78bd-89zdc\" (UID: \"bfeb9fdd-4a1b-48c5-9355-67a5d3c04abf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89zdc"
Jun 10 00:31:41.893345 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:41.893254    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89zdc"
Jun 10 00:31:42.038410 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:42.038384    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89zdc"]
Jun 10 00:31:42.040648 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:31:42.040605    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfeb9fdd_4a1b_48c5_9355_67a5d3c04abf.slice/crio-4c6e96acd41a55329bc9a7724a5e0d1a9cc074cdad92ffb4ec43f9e924c2af25 WatchSource:0}: Error finding container 4c6e96acd41a55329bc9a7724a5e0d1a9cc074cdad92ffb4ec43f9e924c2af25: Status 404 returned error can't find the container with id 4c6e96acd41a55329bc9a7724a5e0d1a9cc074cdad92ffb4ec43f9e924c2af25
Jun 10 00:31:42.248034 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:42.247940    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:42.350613 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:42.350575    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:42.480758 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:42.480716    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89zdc" event={"ID":"bfeb9fdd-4a1b-48c5-9355-67a5d3c04abf","Type":"ContainerStarted","Data":"4c6e96acd41a55329bc9a7724a5e0d1a9cc074cdad92ffb4ec43f9e924c2af25"}
Jun 10 00:31:44.494404 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:44.494368    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89zdc" event={"ID":"bfeb9fdd-4a1b-48c5-9355-67a5d3c04abf","Type":"ContainerStarted","Data":"19e55faf0f2f018648bb9772c169eaeecb0cfbf35ab4070a87d5e60c272072bc"}
Jun 10 00:31:44.494821 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:44.494430    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89zdc"
Jun 10 00:31:44.516993 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:44.516941    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89zdc" podStartSLOduration=1.6830960240000001 podStartE2EDuration="3.516926146s" totalImagesPullingTime="1.833830122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:31:44.515008149 +0000 UTC m=+611.385784277" watchObservedRunningTime="2026-06-10 00:31:44.516926146 +0000 UTC m=+611.387702273"
Jun 10 00:31:45.068649 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:45.068607    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:45.173366 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:45.173332    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:48.604804 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:48.604769    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:48.704931 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:48.704897    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:53.297010 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:53.296934    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:55.503690 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:55.503659    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89zdc"
Jun 10 00:31:57.436120 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:57.436085    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:31:57.536179 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:31:57.536145    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:00.029337 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:00.029299    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:00.129228 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:00.129200    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:03.235689 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:03.235647    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:03.335818 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:03.335781    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:06.642262 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:06.642225    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:06.742531 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:06.742491    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:10.338701 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:10.338659    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:10.437512 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:10.437476    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:13.875241 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:13.875207    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:15.203667 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:15.203622    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:15.313584 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:15.313547    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:25.841653 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:25.841618    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"]
Jun 10 00:32:25.844429 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:25.844405    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"
Jun 10 00:32:25.845480 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:25.845447    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:25.846665 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:25.846642    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jun 10 00:32:25.846799 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:25.846645    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nm97h\""
Jun 10 00:32:25.857516 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:25.857493    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"]
Jun 10 00:32:25.940316 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:25.940282    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55fda6ca-26c5-443c-8623-faeacae5f228-config-file\") pod \"limitador-limitador-64c94fd64f-dk2qr\" (UID: \"55fda6ca-26c5-443c-8623-faeacae5f228\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"
Jun 10 00:32:25.940488 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:25.940337    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58cxg\" (UniqueName: \"kubernetes.io/projected/55fda6ca-26c5-443c-8623-faeacae5f228-kube-api-access-58cxg\") pod \"limitador-limitador-64c94fd64f-dk2qr\" (UID: \"55fda6ca-26c5-443c-8623-faeacae5f228\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"
Jun 10 00:32:25.947382 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:25.947352    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"]
Jun 10 00:32:25.952118 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:25.952088    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:25.998203 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:25.998168    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:26.041275 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:26.041235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55fda6ca-26c5-443c-8623-faeacae5f228-config-file\") pod \"limitador-limitador-64c94fd64f-dk2qr\" (UID: \"55fda6ca-26c5-443c-8623-faeacae5f228\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"
Jun 10 00:32:26.041471 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:26.041330    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58cxg\" (UniqueName: \"kubernetes.io/projected/55fda6ca-26c5-443c-8623-faeacae5f228-kube-api-access-58cxg\") pod \"limitador-limitador-64c94fd64f-dk2qr\" (UID: \"55fda6ca-26c5-443c-8623-faeacae5f228\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"
Jun 10 00:32:26.042088 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:26.042064    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55fda6ca-26c5-443c-8623-faeacae5f228-config-file\") pod \"limitador-limitador-64c94fd64f-dk2qr\" (UID: \"55fda6ca-26c5-443c-8623-faeacae5f228\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"
Jun 10 00:32:26.049056 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:26.049026    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58cxg\" (UniqueName: \"kubernetes.io/projected/55fda6ca-26c5-443c-8623-faeacae5f228-kube-api-access-58cxg\") pod \"limitador-limitador-64c94fd64f-dk2qr\" (UID: \"55fda6ca-26c5-443c-8623-faeacae5f228\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"
Jun 10 00:32:26.154780 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:26.154641    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"
Jun 10 00:32:26.300410 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:26.300383    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"]
Jun 10 00:32:26.303061 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:32:26.303032    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55fda6ca_26c5_443c_8623_faeacae5f228.slice/crio-765e9e703b72a7deed4ecdb82acb03d1653b600a4e451b6062ed241b09500cb4 WatchSource:0}: Error finding container 765e9e703b72a7deed4ecdb82acb03d1653b600a4e451b6062ed241b09500cb4: Status 404 returned error can't find the container with id 765e9e703b72a7deed4ecdb82acb03d1653b600a4e451b6062ed241b09500cb4
Jun 10 00:32:26.664612 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:26.664576    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:26.742258 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:26.742223    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:26.746469 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:26.746439    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr" event={"ID":"55fda6ca-26c5-443c-8623-faeacae5f228","Type":"ContainerStarted","Data":"765e9e703b72a7deed4ecdb82acb03d1653b600a4e451b6062ed241b09500cb4"}
Jun 10 00:32:29.769882 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:29.769836    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr" event={"ID":"55fda6ca-26c5-443c-8623-faeacae5f228","Type":"ContainerStarted","Data":"635e9efd67ef405e2ae40bf67aeca03081be29e291957ba021bcf93d220ee5c9"}
Jun 10 00:32:29.770340 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:29.769938    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"
Jun 10 00:32:29.789805 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:29.789733    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr" podStartSLOduration=2.136085118 podStartE2EDuration="4.789718984s" totalImagesPullingTime="2.653633866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:32:29.78856117 +0000 UTC m=+656.659337297" watchObservedRunningTime="2026-06-10 00:32:29.789718984 +0000 UTC m=+656.660495111"
Jun 10 00:32:29.803697 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:29.803663    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:29.852667 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:29.852634    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:30.252819 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:30.252685    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:30.305490 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:30.305457    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:38.131328 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:38.131274    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:38.180585 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:38.180527    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:40.295494 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:40.295453    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"]
Jun 10 00:32:40.296003 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:40.295676    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr" podUID="55fda6ca-26c5-443c-8623-faeacae5f228" containerName="limitador" containerID="cri-o://635e9efd67ef405e2ae40bf67aeca03081be29e291957ba021bcf93d220ee5c9" gracePeriod=30
Jun 10 00:32:40.296452 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:40.296433    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"
Jun 10 00:32:40.841001 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:40.840968    2560 generic.go:356] "Generic (PLEG): container finished" podID="55fda6ca-26c5-443c-8623-faeacae5f228" containerID="635e9efd67ef405e2ae40bf67aeca03081be29e291957ba021bcf93d220ee5c9" exitCode=0
Jun 10 00:32:40.841147 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:40.841043    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr" event={"ID":"55fda6ca-26c5-443c-8623-faeacae5f228","Type":"ContainerDied","Data":"635e9efd67ef405e2ae40bf67aeca03081be29e291957ba021bcf93d220ee5c9"}
Jun 10 00:32:40.841147 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:40.841106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr" event={"ID":"55fda6ca-26c5-443c-8623-faeacae5f228","Type":"ContainerDied","Data":"765e9e703b72a7deed4ecdb82acb03d1653b600a4e451b6062ed241b09500cb4"}
Jun 10 00:32:40.841147 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:40.841129    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="765e9e703b72a7deed4ecdb82acb03d1653b600a4e451b6062ed241b09500cb4"
Jun 10 00:32:40.852985 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:40.852963    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"
Jun 10 00:32:40.977044 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:40.976969    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55fda6ca-26c5-443c-8623-faeacae5f228-config-file\") pod \"55fda6ca-26c5-443c-8623-faeacae5f228\" (UID: \"55fda6ca-26c5-443c-8623-faeacae5f228\") "
Jun 10 00:32:40.977184 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:40.977068    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58cxg\" (UniqueName: \"kubernetes.io/projected/55fda6ca-26c5-443c-8623-faeacae5f228-kube-api-access-58cxg\") pod \"55fda6ca-26c5-443c-8623-faeacae5f228\" (UID: \"55fda6ca-26c5-443c-8623-faeacae5f228\") "
Jun 10 00:32:40.977449 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:40.977426    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55fda6ca-26c5-443c-8623-faeacae5f228-config-file" (OuterVolumeSpecName: "config-file") pod "55fda6ca-26c5-443c-8623-faeacae5f228" (UID: "55fda6ca-26c5-443c-8623-faeacae5f228"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 00:32:40.979635 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:40.979600    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55fda6ca-26c5-443c-8623-faeacae5f228-kube-api-access-58cxg" (OuterVolumeSpecName: "kube-api-access-58cxg") pod "55fda6ca-26c5-443c-8623-faeacae5f228" (UID: "55fda6ca-26c5-443c-8623-faeacae5f228"). InnerVolumeSpecName "kube-api-access-58cxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:32:41.077988 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:41.077954    2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/55fda6ca-26c5-443c-8623-faeacae5f228-config-file\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:32:41.077988 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:41.077983    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58cxg\" (UniqueName: \"kubernetes.io/projected/55fda6ca-26c5-443c-8623-faeacae5f228-kube-api-access-58cxg\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:32:41.847491 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:41.847456    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"
Jun 10 00:32:41.863325 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:41.863292    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"]
Jun 10 00:32:41.866664 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:41.866634    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dk2qr"]
Jun 10 00:32:43.616318 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:43.616288    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55fda6ca-26c5-443c-8623-faeacae5f228" path="/var/lib/kubelet/pods/55fda6ca-26c5-443c-8623-faeacae5f228/volumes"
Jun 10 00:32:45.613756 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:45.613686    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:45.719634 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:45.719590    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:46.018554 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.018515    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-jfgx8"]
Jun 10 00:32:46.019212 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.019192    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55fda6ca-26c5-443c-8623-faeacae5f228" containerName="limitador"
Jun 10 00:32:46.019265 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.019219    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="55fda6ca-26c5-443c-8623-faeacae5f228" containerName="limitador"
Jun 10 00:32:46.019352 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.019340    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="55fda6ca-26c5-443c-8623-faeacae5f228" containerName="limitador"
Jun 10 00:32:46.023131 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.023110    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jfgx8"
Jun 10 00:32:46.025358 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.025325    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\""
Jun 10 00:32:46.025481 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.025332    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jun 10 00:32:46.025481 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.025373    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-rnxqn\""
Jun 10 00:32:46.026198 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.026181    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jun 10 00:32:46.035609 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.035584    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-jfgx8"]
Jun 10 00:32:46.050818 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.050774    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:46.125867 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.125824    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cv6j\" (UniqueName: \"kubernetes.io/projected/bdd30eb5-9133-4dd8-ba35-6f512c5ef05e-kube-api-access-6cv6j\") pod \"postgres-69fb4594cf-jfgx8\" (UID: \"bdd30eb5-9133-4dd8-ba35-6f512c5ef05e\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jfgx8"
Jun 10 00:32:46.126042 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.125999    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bdd30eb5-9133-4dd8-ba35-6f512c5ef05e-data\") pod \"postgres-69fb4594cf-jfgx8\" (UID: \"bdd30eb5-9133-4dd8-ba35-6f512c5ef05e\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jfgx8"
Jun 10 00:32:46.226660 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.226620    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bdd30eb5-9133-4dd8-ba35-6f512c5ef05e-data\") pod \"postgres-69fb4594cf-jfgx8\" (UID: \"bdd30eb5-9133-4dd8-ba35-6f512c5ef05e\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jfgx8"
Jun 10 00:32:46.226862 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.226669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cv6j\" (UniqueName: \"kubernetes.io/projected/bdd30eb5-9133-4dd8-ba35-6f512c5ef05e-kube-api-access-6cv6j\") pod \"postgres-69fb4594cf-jfgx8\" (UID: \"bdd30eb5-9133-4dd8-ba35-6f512c5ef05e\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jfgx8"
Jun 10 00:32:46.227056 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.227033    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bdd30eb5-9133-4dd8-ba35-6f512c5ef05e-data\") pod \"postgres-69fb4594cf-jfgx8\" (UID: \"bdd30eb5-9133-4dd8-ba35-6f512c5ef05e\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jfgx8"
Jun 10 00:32:46.234434 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.234409    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cv6j\" (UniqueName: \"kubernetes.io/projected/bdd30eb5-9133-4dd8-ba35-6f512c5ef05e-kube-api-access-6cv6j\") pod \"postgres-69fb4594cf-jfgx8\" (UID: \"bdd30eb5-9133-4dd8-ba35-6f512c5ef05e\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jfgx8"
Jun 10 00:32:46.334628 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.334533    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jfgx8"
Jun 10 00:32:46.467504 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.467480    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-jfgx8"]
Jun 10 00:32:46.469559 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:32:46.469529    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd30eb5_9133_4dd8_ba35_6f512c5ef05e.slice/crio-d6b901d76da83730964ca0007fbb70429e00257e3c2e0899d9c12a51ddc24199 WatchSource:0}: Error finding container d6b901d76da83730964ca0007fbb70429e00257e3c2e0899d9c12a51ddc24199: Status 404 returned error can't find the container with id d6b901d76da83730964ca0007fbb70429e00257e3c2e0899d9c12a51ddc24199
Jun 10 00:32:46.877091 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:46.877051    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jfgx8" event={"ID":"bdd30eb5-9133-4dd8-ba35-6f512c5ef05e","Type":"ContainerStarted","Data":"d6b901d76da83730964ca0007fbb70429e00257e3c2e0899d9c12a51ddc24199"}
Jun 10 00:32:49.358469 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:49.358435    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:32:49.458539 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:32:49.458498    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:33:26.118038 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:26.118000    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jfgx8" event={"ID":"bdd30eb5-9133-4dd8-ba35-6f512c5ef05e","Type":"ContainerStarted","Data":"0628198a8b2d0bf1f76db58b3d803ac7e2ee789ebbe08e2eb75cc512f7d194cd"}
Jun 10 00:33:26.118494 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:26.118085    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jfgx8"
Jun 10 00:33:26.135595 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:26.135547    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jfgx8" podStartSLOduration=1.314495838 podStartE2EDuration="40.135532883s" totalImagesPullingTime="38.821037045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:33:26.134050843 +0000 UTC m=+713.004826971" watchObservedRunningTime="2026-06-10 00:33:26.135532883 +0000 UTC m=+713.006309035"
Jun 10 00:33:32.154394 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:32.154361    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jfgx8"
Jun 10 00:33:32.454923 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:32.454822    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:33:32.557303 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:32.557263    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:33:32.697262 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:32.697225    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:33:33.462439 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.462405    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99"]
Jun 10 00:33:33.466536 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.466515    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99"
Jun 10 00:33:33.468913 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.468895    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 10 00:33:33.469007 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.468947    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-56dt5\""
Jun 10 00:33:33.469007 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.468895    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 10 00:33:33.475326 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.475293    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99"]
Jun 10 00:33:33.650247 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.650213    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzt2v\" (UniqueName: \"kubernetes.io/projected/a70605ca-bf13-4904-a02f-9889be4eb19f-kube-api-access-vzt2v\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99\" (UID: \"a70605ca-bf13-4904-a02f-9889be4eb19f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99"
Jun 10 00:33:33.650411 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.650259    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a70605ca-bf13-4904-a02f-9889be4eb19f-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99\" (UID: \"a70605ca-bf13-4904-a02f-9889be4eb19f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99"
Jun 10 00:33:33.650411 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.650296    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a70605ca-bf13-4904-a02f-9889be4eb19f-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99\" (UID: \"a70605ca-bf13-4904-a02f-9889be4eb19f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99"
Jun 10 00:33:33.751895 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.751780    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzt2v\" (UniqueName: \"kubernetes.io/projected/a70605ca-bf13-4904-a02f-9889be4eb19f-kube-api-access-vzt2v\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99\" (UID: \"a70605ca-bf13-4904-a02f-9889be4eb19f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99"
Jun 10 00:33:33.751895 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.751863    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a70605ca-bf13-4904-a02f-9889be4eb19f-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99\" (UID: \"a70605ca-bf13-4904-a02f-9889be4eb19f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99"
Jun 10 00:33:33.752152 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.751897    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a70605ca-bf13-4904-a02f-9889be4eb19f-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99\" (UID: \"a70605ca-bf13-4904-a02f-9889be4eb19f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99"
Jun 10 00:33:33.752330 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.752305    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a70605ca-bf13-4904-a02f-9889be4eb19f-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99\" (UID: \"a70605ca-bf13-4904-a02f-9889be4eb19f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99"
Jun 10 00:33:33.752382 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.752324    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a70605ca-bf13-4904-a02f-9889be4eb19f-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99\" (UID: \"a70605ca-bf13-4904-a02f-9889be4eb19f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99"
Jun 10 00:33:33.760657 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.760629    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 10 00:33:33.770598 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.770571    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 10 00:33:33.784160 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:33.784128    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzt2v\" (UniqueName: \"kubernetes.io/projected/a70605ca-bf13-4904-a02f-9889be4eb19f-kube-api-access-vzt2v\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99\" (UID: \"a70605ca-bf13-4904-a02f-9889be4eb19f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99"
Jun 10 00:33:34.080504 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:34.080462    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-56dt5\""
Jun 10 00:33:34.088374 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:34.088342    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99"
Jun 10 00:33:34.234832 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:34.234806    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99"]
Jun 10 00:33:34.236802 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:33:34.236777    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70605ca_bf13_4904_a02f_9889be4eb19f.slice/crio-a729983eb03361f027d397a2f8196b80041e2b4b437be0c9cf00aa6a4d5e8ace WatchSource:0}: Error finding container a729983eb03361f027d397a2f8196b80041e2b4b437be0c9cf00aa6a4d5e8ace: Status 404 returned error can't find the container with id a729983eb03361f027d397a2f8196b80041e2b4b437be0c9cf00aa6a4d5e8ace
Jun 10 00:33:35.173424 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:35.173328    2560 generic.go:356] "Generic (PLEG): container finished" podID="a70605ca-bf13-4904-a02f-9889be4eb19f" containerID="389518652fc87aba42507a6197a3c2f549fa25fa6a6ae140a41ed208b90256a3" exitCode=0
Jun 10 00:33:35.173908 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:35.173422    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99" event={"ID":"a70605ca-bf13-4904-a02f-9889be4eb19f","Type":"ContainerDied","Data":"389518652fc87aba42507a6197a3c2f549fa25fa6a6ae140a41ed208b90256a3"}
Jun 10 00:33:35.173908 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:35.173470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99" event={"ID":"a70605ca-bf13-4904-a02f-9889be4eb19f","Type":"ContainerStarted","Data":"a729983eb03361f027d397a2f8196b80041e2b4b437be0c9cf00aa6a4d5e8ace"}
Jun 10 00:33:35.174549 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:35.174534    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 10 00:33:36.181551 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:36.181450    2560 generic.go:356] "Generic (PLEG): container finished" podID="a70605ca-bf13-4904-a02f-9889be4eb19f" containerID="b6583517e1b5532d7616562d3994ac780f075b64c8c99368f990376bef1c8042" exitCode=0
Jun 10 00:33:36.181551 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:36.181541    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99" event={"ID":"a70605ca-bf13-4904-a02f-9889be4eb19f","Type":"ContainerDied","Data":"b6583517e1b5532d7616562d3994ac780f075b64c8c99368f990376bef1c8042"}
Jun 10 00:33:37.190078 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:37.190042    2560 generic.go:356] "Generic (PLEG): container finished" podID="a70605ca-bf13-4904-a02f-9889be4eb19f" containerID="673df88278177d2892db1f4d0aad67b18a9ac8d57de9effe5388a95606ff0ff9" exitCode=0
Jun 10 00:33:37.190474 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:37.190081    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99" event={"ID":"a70605ca-bf13-4904-a02f-9889be4eb19f","Type":"ContainerDied","Data":"673df88278177d2892db1f4d0aad67b18a9ac8d57de9effe5388a95606ff0ff9"}
Jun 10 00:33:38.337755 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:38.337711    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99"
Jun 10 00:33:38.393877 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:38.393843    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a70605ca-bf13-4904-a02f-9889be4eb19f-bundle\") pod \"a70605ca-bf13-4904-a02f-9889be4eb19f\" (UID: \"a70605ca-bf13-4904-a02f-9889be4eb19f\") "
Jun 10 00:33:38.394065 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:38.393963    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a70605ca-bf13-4904-a02f-9889be4eb19f-util\") pod \"a70605ca-bf13-4904-a02f-9889be4eb19f\" (UID: \"a70605ca-bf13-4904-a02f-9889be4eb19f\") "
Jun 10 00:33:38.394065 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:38.394014    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzt2v\" (UniqueName: \"kubernetes.io/projected/a70605ca-bf13-4904-a02f-9889be4eb19f-kube-api-access-vzt2v\") pod \"a70605ca-bf13-4904-a02f-9889be4eb19f\" (UID: \"a70605ca-bf13-4904-a02f-9889be4eb19f\") "
Jun 10 00:33:38.394444 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:38.394423    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70605ca-bf13-4904-a02f-9889be4eb19f-bundle" (OuterVolumeSpecName: "bundle") pod "a70605ca-bf13-4904-a02f-9889be4eb19f" (UID: "a70605ca-bf13-4904-a02f-9889be4eb19f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:33:38.396442 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:38.396409    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a70605ca-bf13-4904-a02f-9889be4eb19f-kube-api-access-vzt2v" (OuterVolumeSpecName: "kube-api-access-vzt2v") pod "a70605ca-bf13-4904-a02f-9889be4eb19f" (UID: "a70605ca-bf13-4904-a02f-9889be4eb19f"). InnerVolumeSpecName "kube-api-access-vzt2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:33:38.399477 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:38.399459    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70605ca-bf13-4904-a02f-9889be4eb19f-util" (OuterVolumeSpecName: "util") pod "a70605ca-bf13-4904-a02f-9889be4eb19f" (UID: "a70605ca-bf13-4904-a02f-9889be4eb19f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 00:33:38.495357 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:38.495261    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzt2v\" (UniqueName: \"kubernetes.io/projected/a70605ca-bf13-4904-a02f-9889be4eb19f-kube-api-access-vzt2v\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:33:38.495357 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:38.495295    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a70605ca-bf13-4904-a02f-9889be4eb19f-bundle\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:33:38.495357 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:38.495307    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a70605ca-bf13-4904-a02f-9889be4eb19f-util\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:33:39.204536 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:39.204506    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99"
Jun 10 00:33:39.204536 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:39.204514    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7488dn99" event={"ID":"a70605ca-bf13-4904-a02f-9889be4eb19f","Type":"ContainerDied","Data":"a729983eb03361f027d397a2f8196b80041e2b4b437be0c9cf00aa6a4d5e8ace"}
Jun 10 00:33:39.204786 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:33:39.204555    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a729983eb03361f027d397a2f8196b80041e2b4b437be0c9cf00aa6a4d5e8ace"
Jun 10 00:34:01.999117 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:01.999072    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:34:02.098354 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:02.098326    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:34:19.820681 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:19.820618    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:34:32.492065 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:32.492029    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:34:33.367955 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:33.367899    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:34:37.347039 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.347000    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:34:37.354783 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.354755    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c8df85995-49cn9"]
Jun 10 00:34:37.355161 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.355148    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70605ca-bf13-4904-a02f-9889be4eb19f" containerName="util"
Jun 10 00:34:37.355203 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.355163    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70605ca-bf13-4904-a02f-9889be4eb19f" containerName="util"
Jun 10 00:34:37.355203 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.355173    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70605ca-bf13-4904-a02f-9889be4eb19f" containerName="pull"
Jun 10 00:34:37.355203 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.355178    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70605ca-bf13-4904-a02f-9889be4eb19f" containerName="pull"
Jun 10 00:34:37.355203 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.355196    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70605ca-bf13-4904-a02f-9889be4eb19f" containerName="extract"
Jun 10 00:34:37.355203 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.355202    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70605ca-bf13-4904-a02f-9889be4eb19f" containerName="extract"
Jun 10 00:34:37.355365 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.355267    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a70605ca-bf13-4904-a02f-9889be4eb19f" containerName="extract"
Jun 10 00:34:37.357658 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.357641    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8df85995-49cn9"
Jun 10 00:34:37.361546 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.361511    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jun 10 00:34:37.361806 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.361789    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 10 00:34:37.362478 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.362462    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jkkr8\""
Jun 10 00:34:37.372076 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.372049    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c8df85995-49cn9"]
Jun 10 00:34:37.426173 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.426133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc6qt\" (UniqueName: \"kubernetes.io/projected/e7fce3ae-58ea-47fb-b4e2-96b045501a82-kube-api-access-xc6qt\") pod \"maas-controller-5c8df85995-49cn9\" (UID: \"e7fce3ae-58ea-47fb-b4e2-96b045501a82\") " pod="opendatahub/maas-controller-5c8df85995-49cn9"
Jun 10 00:34:37.426348 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.426186    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7fce3ae-58ea-47fb-b4e2-96b045501a82-webhook-cert\") pod \"maas-controller-5c8df85995-49cn9\" (UID: \"e7fce3ae-58ea-47fb-b4e2-96b045501a82\") " pod="opendatahub/maas-controller-5c8df85995-49cn9"
Jun 10 00:34:37.508637 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.508600    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:34:37.527136 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.527102    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7fce3ae-58ea-47fb-b4e2-96b045501a82-webhook-cert\") pod \"maas-controller-5c8df85995-49cn9\" (UID: \"e7fce3ae-58ea-47fb-b4e2-96b045501a82\") " pod="opendatahub/maas-controller-5c8df85995-49cn9"
Jun 10 00:34:37.527358 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.527233    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc6qt\" (UniqueName: \"kubernetes.io/projected/e7fce3ae-58ea-47fb-b4e2-96b045501a82-kube-api-access-xc6qt\") pod \"maas-controller-5c8df85995-49cn9\" (UID: \"e7fce3ae-58ea-47fb-b4e2-96b045501a82\") " pod="opendatahub/maas-controller-5c8df85995-49cn9"
Jun 10 00:34:37.529891 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.529863    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7fce3ae-58ea-47fb-b4e2-96b045501a82-webhook-cert\") pod \"maas-controller-5c8df85995-49cn9\" (UID: \"e7fce3ae-58ea-47fb-b4e2-96b045501a82\") " pod="opendatahub/maas-controller-5c8df85995-49cn9"
Jun 10 00:34:37.539485 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.539454    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc6qt\" (UniqueName: \"kubernetes.io/projected/e7fce3ae-58ea-47fb-b4e2-96b045501a82-kube-api-access-xc6qt\") pod \"maas-controller-5c8df85995-49cn9\" (UID: \"e7fce3ae-58ea-47fb-b4e2-96b045501a82\") " pod="opendatahub/maas-controller-5c8df85995-49cn9"
Jun 10 00:34:37.558351 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.558316    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6485d8bb88-cthld"]
Jun 10 00:34:37.561067 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.561046    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6485d8bb88-cthld"
Jun 10 00:34:37.570319 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.570292    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6485d8bb88-cthld"]
Jun 10 00:34:37.590817 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.590781    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:34:37.628103 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.628018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b937d539-eea9-459b-aeb5-9cdf8527d893-webhook-cert\") pod \"maas-controller-6485d8bb88-cthld\" (UID: \"b937d539-eea9-459b-aeb5-9cdf8527d893\") " pod="opendatahub/maas-controller-6485d8bb88-cthld"
Jun 10 00:34:37.628263 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.628135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-569kl\" (UniqueName: \"kubernetes.io/projected/b937d539-eea9-459b-aeb5-9cdf8527d893-kube-api-access-569kl\") pod \"maas-controller-6485d8bb88-cthld\" (UID: \"b937d539-eea9-459b-aeb5-9cdf8527d893\") " pod="opendatahub/maas-controller-6485d8bb88-cthld"
Jun 10 00:34:37.668863 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.668824    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8df85995-49cn9"
Jun 10 00:34:37.729186 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.729153    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-569kl\" (UniqueName: \"kubernetes.io/projected/b937d539-eea9-459b-aeb5-9cdf8527d893-kube-api-access-569kl\") pod \"maas-controller-6485d8bb88-cthld\" (UID: \"b937d539-eea9-459b-aeb5-9cdf8527d893\") " pod="opendatahub/maas-controller-6485d8bb88-cthld"
Jun 10 00:34:37.729345 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.729239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b937d539-eea9-459b-aeb5-9cdf8527d893-webhook-cert\") pod \"maas-controller-6485d8bb88-cthld\" (UID: \"b937d539-eea9-459b-aeb5-9cdf8527d893\") " pod="opendatahub/maas-controller-6485d8bb88-cthld"
Jun 10 00:34:37.732835 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.732805    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b937d539-eea9-459b-aeb5-9cdf8527d893-webhook-cert\") pod \"maas-controller-6485d8bb88-cthld\" (UID: \"b937d539-eea9-459b-aeb5-9cdf8527d893\") " pod="opendatahub/maas-controller-6485d8bb88-cthld"
Jun 10 00:34:37.737973 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.737915    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-569kl\" (UniqueName: \"kubernetes.io/projected/b937d539-eea9-459b-aeb5-9cdf8527d893-kube-api-access-569kl\") pod \"maas-controller-6485d8bb88-cthld\" (UID: \"b937d539-eea9-459b-aeb5-9cdf8527d893\") " pod="opendatahub/maas-controller-6485d8bb88-cthld"
Jun 10 00:34:37.812344 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.812316    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c8df85995-49cn9"]
Jun 10 00:34:37.813817 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:34:37.813785    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7fce3ae_58ea_47fb_b4e2_96b045501a82.slice/crio-3106de0db1980318c2fd9ef0571c3d132698ae6a59b456c56673e3bd54b3f4f2 WatchSource:0}: Error finding container 3106de0db1980318c2fd9ef0571c3d132698ae6a59b456c56673e3bd54b3f4f2: Status 404 returned error can't find the container with id 3106de0db1980318c2fd9ef0571c3d132698ae6a59b456c56673e3bd54b3f4f2
Jun 10 00:34:37.873434 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:37.873380    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6485d8bb88-cthld"
Jun 10 00:34:38.020463 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:38.020437    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6485d8bb88-cthld"]
Jun 10 00:34:38.022051 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:34:38.022017    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb937d539_eea9_459b_aeb5_9cdf8527d893.slice/crio-5dbe0d54c5ff859a20abb755f68e2bde6c789cc5c2714d7d43a16a2b2f119d9f WatchSource:0}: Error finding container 5dbe0d54c5ff859a20abb755f68e2bde6c789cc5c2714d7d43a16a2b2f119d9f: Status 404 returned error can't find the container with id 5dbe0d54c5ff859a20abb755f68e2bde6c789cc5c2714d7d43a16a2b2f119d9f
Jun 10 00:34:38.564259 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:38.564168    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6485d8bb88-cthld" event={"ID":"b937d539-eea9-459b-aeb5-9cdf8527d893","Type":"ContainerStarted","Data":"5dbe0d54c5ff859a20abb755f68e2bde6c789cc5c2714d7d43a16a2b2f119d9f"}
Jun 10 00:34:38.566331 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:38.566258    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8df85995-49cn9" event={"ID":"e7fce3ae-58ea-47fb-b4e2-96b045501a82","Type":"ContainerStarted","Data":"3106de0db1980318c2fd9ef0571c3d132698ae6a59b456c56673e3bd54b3f4f2"}
Jun 10 00:34:40.692284 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:40.692205    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:34:40.785091 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:40.784975    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:34:41.588821 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:41.588779    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6485d8bb88-cthld" event={"ID":"b937d539-eea9-459b-aeb5-9cdf8527d893","Type":"ContainerStarted","Data":"f84d449940fa255ecd445750b8cd33ec5ab8a86c56a5c58bf916f08d14cd42ed"}
Jun 10 00:34:41.589032 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:41.588859    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6485d8bb88-cthld"
Jun 10 00:34:41.590397 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:41.590374    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8df85995-49cn9" event={"ID":"e7fce3ae-58ea-47fb-b4e2-96b045501a82","Type":"ContainerStarted","Data":"a7bbeba1d440271d85ab9b68ca7a6b4b4a40c6e637929b3b30bb9130665186d1"}
Jun 10 00:34:41.590515 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:41.590452    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c8df85995-49cn9"
Jun 10 00:34:41.604725 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:41.604666    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6485d8bb88-cthld" podStartSLOduration=2.104093725 podStartE2EDuration="4.604648852s" totalImagesPullingTime="2.500555127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:34:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:34:41.603613482 +0000 UTC m=+788.474389611" watchObservedRunningTime="2026-06-10 00:34:41.604648852 +0000 UTC m=+788.475424980"
Jun 10 00:34:41.618135 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:41.617981    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c8df85995-49cn9" podStartSLOduration=1.916469038 podStartE2EDuration="4.617964184s" totalImagesPullingTime="2.701495146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:34:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:34:41.617489585 +0000 UTC m=+788.488265713" watchObservedRunningTime="2026-06-10 00:34:41.617964184 +0000 UTC m=+788.488740312"
Jun 10 00:34:52.603163 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:52.603075    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c8df85995-49cn9"
Jun 10 00:34:52.603603 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:52.603176    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6485d8bb88-cthld"
Jun 10 00:34:52.659103 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:52.659068    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c8df85995-49cn9"]
Jun 10 00:34:52.659819 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:52.659788    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5c8df85995-49cn9" podUID="e7fce3ae-58ea-47fb-b4e2-96b045501a82" containerName="manager" containerID="cri-o://a7bbeba1d440271d85ab9b68ca7a6b4b4a40c6e637929b3b30bb9130665186d1" gracePeriod=30
Jun 10 00:34:52.917021 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:52.917000    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8df85995-49cn9"
Jun 10 00:34:53.071237 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:53.071206    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xc6qt\" (UniqueName: \"kubernetes.io/projected/e7fce3ae-58ea-47fb-b4e2-96b045501a82-kube-api-access-xc6qt\") pod \"e7fce3ae-58ea-47fb-b4e2-96b045501a82\" (UID: \"e7fce3ae-58ea-47fb-b4e2-96b045501a82\") "
Jun 10 00:34:53.071237 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:53.071243    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7fce3ae-58ea-47fb-b4e2-96b045501a82-webhook-cert\") pod \"e7fce3ae-58ea-47fb-b4e2-96b045501a82\" (UID: \"e7fce3ae-58ea-47fb-b4e2-96b045501a82\") "
Jun 10 00:34:53.073644 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:53.073608    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7fce3ae-58ea-47fb-b4e2-96b045501a82-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e7fce3ae-58ea-47fb-b4e2-96b045501a82" (UID: "e7fce3ae-58ea-47fb-b4e2-96b045501a82"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 00:34:53.073644 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:53.073618    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7fce3ae-58ea-47fb-b4e2-96b045501a82-kube-api-access-xc6qt" (OuterVolumeSpecName: "kube-api-access-xc6qt") pod "e7fce3ae-58ea-47fb-b4e2-96b045501a82" (UID: "e7fce3ae-58ea-47fb-b4e2-96b045501a82"). InnerVolumeSpecName "kube-api-access-xc6qt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 00:34:53.172286 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:53.172195    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc6qt\" (UniqueName: \"kubernetes.io/projected/e7fce3ae-58ea-47fb-b4e2-96b045501a82-kube-api-access-xc6qt\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:34:53.172286 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:53.172229    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e7fce3ae-58ea-47fb-b4e2-96b045501a82-webhook-cert\") on node \"ip-10-0-128-167.ec2.internal\" DevicePath \"\""
Jun 10 00:34:53.666851 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:53.666817    2560 generic.go:356] "Generic (PLEG): container finished" podID="e7fce3ae-58ea-47fb-b4e2-96b045501a82" containerID="a7bbeba1d440271d85ab9b68ca7a6b4b4a40c6e637929b3b30bb9130665186d1" exitCode=0
Jun 10 00:34:53.667219 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:53.666863    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8df85995-49cn9"
Jun 10 00:34:53.667219 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:53.666906    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8df85995-49cn9" event={"ID":"e7fce3ae-58ea-47fb-b4e2-96b045501a82","Type":"ContainerDied","Data":"a7bbeba1d440271d85ab9b68ca7a6b4b4a40c6e637929b3b30bb9130665186d1"}
Jun 10 00:34:53.667219 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:53.666959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8df85995-49cn9" event={"ID":"e7fce3ae-58ea-47fb-b4e2-96b045501a82","Type":"ContainerDied","Data":"3106de0db1980318c2fd9ef0571c3d132698ae6a59b456c56673e3bd54b3f4f2"}
Jun 10 00:34:53.667219 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:53.666980    2560 scope.go:117] "RemoveContainer" containerID="a7bbeba1d440271d85ab9b68ca7a6b4b4a40c6e637929b3b30bb9130665186d1"
Jun 10 00:34:53.676559 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:53.676542    2560 scope.go:117] "RemoveContainer" containerID="a7bbeba1d440271d85ab9b68ca7a6b4b4a40c6e637929b3b30bb9130665186d1"
Jun 10 00:34:53.676876 ip-10-0-128-167 kubenswrapper[2560]: E0610 00:34:53.676846    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7bbeba1d440271d85ab9b68ca7a6b4b4a40c6e637929b3b30bb9130665186d1\": container with ID starting with a7bbeba1d440271d85ab9b68ca7a6b4b4a40c6e637929b3b30bb9130665186d1 not found: ID does not exist" containerID="a7bbeba1d440271d85ab9b68ca7a6b4b4a40c6e637929b3b30bb9130665186d1"
Jun 10 00:34:53.676974 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:53.676886    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7bbeba1d440271d85ab9b68ca7a6b4b4a40c6e637929b3b30bb9130665186d1"} err="failed to get container status \"a7bbeba1d440271d85ab9b68ca7a6b4b4a40c6e637929b3b30bb9130665186d1\": rpc error: code = NotFound desc = could not find container \"a7bbeba1d440271d85ab9b68ca7a6b4b4a40c6e637929b3b30bb9130665186d1\": container with ID starting with a7bbeba1d440271d85ab9b68ca7a6b4b4a40c6e637929b3b30bb9130665186d1 not found: ID does not exist"
Jun 10 00:34:53.683205 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:53.683179    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c8df85995-49cn9"]
Jun 10 00:34:53.688257 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:53.688234    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c8df85995-49cn9"]
Jun 10 00:34:55.615858 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:34:55.615829    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7fce3ae-58ea-47fb-b4e2-96b045501a82" path="/var/lib/kubelet/pods/e7fce3ae-58ea-47fb-b4e2-96b045501a82/volumes"
Jun 10 00:35:12.254880 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.254847    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:35:12.299353 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.299323    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-7f99f5cb5d-v7js7"]
Jun 10 00:35:12.299733 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.299721    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7fce3ae-58ea-47fb-b4e2-96b045501a82" containerName="manager"
Jun 10 00:35:12.299733 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.299749    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7fce3ae-58ea-47fb-b4e2-96b045501a82" containerName="manager"
Jun 10 00:35:12.299859 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.299840    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7fce3ae-58ea-47fb-b4e2-96b045501a82" containerName="manager"
Jun 10 00:35:12.304942 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.304923    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-v7js7"
Jun 10 00:35:12.307152 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.307130    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jun 10 00:35:12.313016 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.312797    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-7f99f5cb5d-v7js7"]
Jun 10 00:35:12.326469 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.326438    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:35:12.346115 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.346080    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnpk8\" (UniqueName: \"kubernetes.io/projected/1ae965d4-1f06-472d-9d85-19e0d30dccec-kube-api-access-cnpk8\") pod \"maas-api-7f99f5cb5d-v7js7\" (UID: \"1ae965d4-1f06-472d-9d85-19e0d30dccec\") " pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-v7js7"
Jun 10 00:35:12.346299 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.346157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ae965d4-1f06-472d-9d85-19e0d30dccec-maas-api-tls\") pod \"maas-api-7f99f5cb5d-v7js7\" (UID: \"1ae965d4-1f06-472d-9d85-19e0d30dccec\") " pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-v7js7"
Jun 10 00:35:12.447653 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.447613    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnpk8\" (UniqueName: \"kubernetes.io/projected/1ae965d4-1f06-472d-9d85-19e0d30dccec-kube-api-access-cnpk8\") pod \"maas-api-7f99f5cb5d-v7js7\" (UID: \"1ae965d4-1f06-472d-9d85-19e0d30dccec\") " pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-v7js7"
Jun 10 00:35:12.447895 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.447677    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ae965d4-1f06-472d-9d85-19e0d30dccec-maas-api-tls\") pod \"maas-api-7f99f5cb5d-v7js7\" (UID: \"1ae965d4-1f06-472d-9d85-19e0d30dccec\") " pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-v7js7"
Jun 10 00:35:12.450263 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.450238    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ae965d4-1f06-472d-9d85-19e0d30dccec-maas-api-tls\") pod \"maas-api-7f99f5cb5d-v7js7\" (UID: \"1ae965d4-1f06-472d-9d85-19e0d30dccec\") " pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-v7js7"
Jun 10 00:35:12.457260 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.457228    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnpk8\" (UniqueName: \"kubernetes.io/projected/1ae965d4-1f06-472d-9d85-19e0d30dccec-kube-api-access-cnpk8\") pod \"maas-api-7f99f5cb5d-v7js7\" (UID: \"1ae965d4-1f06-472d-9d85-19e0d30dccec\") " pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-v7js7"
Jun 10 00:35:12.616898 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.616815    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-v7js7"
Jun 10 00:35:12.689904 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.689866    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:35:12.783875 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.783846    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-7f99f5cb5d-v7js7"]
Jun 10 00:35:12.785609 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:35:12.785561    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae965d4_1f06_472d_9d85_19e0d30dccec.slice/crio-1e45e3dd81b4abb59408fd4550f5560f9fba0ba9c3c0994da2a444254ca3aeb3 WatchSource:0}: Error finding container 1e45e3dd81b4abb59408fd4550f5560f9fba0ba9c3c0994da2a444254ca3aeb3: Status 404 returned error can't find the container with id 1e45e3dd81b4abb59408fd4550f5560f9fba0ba9c3c0994da2a444254ca3aeb3
Jun 10 00:35:12.787857 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.787728    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:35:12.796523 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.796498    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-v7js7" event={"ID":"1ae965d4-1f06-472d-9d85-19e0d30dccec","Type":"ContainerStarted","Data":"1e45e3dd81b4abb59408fd4550f5560f9fba0ba9c3c0994da2a444254ca3aeb3"}
Jun 10 00:35:12.797518 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.797499    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-5mllq"]
Jun 10 00:35:12.801146 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.801126    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-5mllq"
Jun 10 00:35:12.803350 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.803311    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jun 10 00:35:12.803350 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.803311    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-s4mc9\""
Jun 10 00:35:12.807654 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.807631    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-5mllq"]
Jun 10 00:35:12.830521 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.830497    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-zbvz9"]
Jun 10 00:35:12.833355 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.833339    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-zbvz9"
Jun 10 00:35:12.846423 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.846399    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-zbvz9"]
Jun 10 00:35:12.851924 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.851898    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s4f6\" (UniqueName: \"kubernetes.io/projected/67295873-8ac3-4fc7-8b92-a06eeca1361b-kube-api-access-9s4f6\") pod \"payload-pre-processing-579785bc64-5mllq\" (UID: \"67295873-8ac3-4fc7-8b92-a06eeca1361b\") " pod="openshift-ingress/payload-pre-processing-579785bc64-5mllq"
Jun 10 00:35:12.852024 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.851941    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfpxc\" (UniqueName: \"kubernetes.io/projected/40a2a2f3-2ed4-40eb-b774-dda27453ed6b-kube-api-access-hfpxc\") pod \"payload-processing-699b6cd6c-zbvz9\" (UID: \"40a2a2f3-2ed4-40eb-b774-dda27453ed6b\") " pod="openshift-ingress/payload-processing-699b6cd6c-zbvz9"
Jun 10 00:35:12.952547 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.952462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfpxc\" (UniqueName: \"kubernetes.io/projected/40a2a2f3-2ed4-40eb-b774-dda27453ed6b-kube-api-access-hfpxc\") pod \"payload-processing-699b6cd6c-zbvz9\" (UID: \"40a2a2f3-2ed4-40eb-b774-dda27453ed6b\") " pod="openshift-ingress/payload-processing-699b6cd6c-zbvz9"
Jun 10 00:35:12.952733 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.952588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s4f6\" (UniqueName: \"kubernetes.io/projected/67295873-8ac3-4fc7-8b92-a06eeca1361b-kube-api-access-9s4f6\") pod \"payload-pre-processing-579785bc64-5mllq\" (UID: \"67295873-8ac3-4fc7-8b92-a06eeca1361b\") " pod="openshift-ingress/payload-pre-processing-579785bc64-5mllq"
Jun 10 00:35:12.960424 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.960401    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfpxc\" (UniqueName: \"kubernetes.io/projected/40a2a2f3-2ed4-40eb-b774-dda27453ed6b-kube-api-access-hfpxc\") pod \"payload-processing-699b6cd6c-zbvz9\" (UID: \"40a2a2f3-2ed4-40eb-b774-dda27453ed6b\") " pod="openshift-ingress/payload-processing-699b6cd6c-zbvz9"
Jun 10 00:35:12.960424 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:12.960416    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s4f6\" (UniqueName: \"kubernetes.io/projected/67295873-8ac3-4fc7-8b92-a06eeca1361b-kube-api-access-9s4f6\") pod \"payload-pre-processing-579785bc64-5mllq\" (UID: \"67295873-8ac3-4fc7-8b92-a06eeca1361b\") " pod="openshift-ingress/payload-pre-processing-579785bc64-5mllq"
Jun 10 00:35:13.113948 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:13.113911    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-5mllq"
Jun 10 00:35:13.143888 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:13.143854    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-zbvz9"
Jun 10 00:35:13.269250 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:13.269217    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-5mllq"]
Jun 10 00:35:13.273109 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:35:13.273080    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67295873_8ac3_4fc7_8b92_a06eeca1361b.slice/crio-6acf2de287bc310621ae7989fb0c8b84814230f4aceb02be39376996627e2338 WatchSource:0}: Error finding container 6acf2de287bc310621ae7989fb0c8b84814230f4aceb02be39376996627e2338: Status 404 returned error can't find the container with id 6acf2de287bc310621ae7989fb0c8b84814230f4aceb02be39376996627e2338
Jun 10 00:35:13.317421 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:13.317399    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-zbvz9"]
Jun 10 00:35:13.320026 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:35:13.320000    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a2a2f3_2ed4_40eb_b774_dda27453ed6b.slice/crio-e7d585311f6e9e24b47fed566594d1fc0f9c55edd8313f46721357da7b0b38bc WatchSource:0}: Error finding container e7d585311f6e9e24b47fed566594d1fc0f9c55edd8313f46721357da7b0b38bc: Status 404 returned error can't find the container with id e7d585311f6e9e24b47fed566594d1fc0f9c55edd8313f46721357da7b0b38bc
Jun 10 00:35:13.808172 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:13.808127    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-5mllq" event={"ID":"67295873-8ac3-4fc7-8b92-a06eeca1361b","Type":"ContainerStarted","Data":"6acf2de287bc310621ae7989fb0c8b84814230f4aceb02be39376996627e2338"}
Jun 10 00:35:13.810231 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:13.810193    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-zbvz9" event={"ID":"40a2a2f3-2ed4-40eb-b774-dda27453ed6b","Type":"ContainerStarted","Data":"e7d585311f6e9e24b47fed566594d1fc0f9c55edd8313f46721357da7b0b38bc"}
Jun 10 00:35:16.831348 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:16.831310    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-v7js7" event={"ID":"1ae965d4-1f06-472d-9d85-19e0d30dccec","Type":"ContainerStarted","Data":"4d282c79748e2ac41a574820eb5d8b30e53ed8ddb0e9c0043858c87b5cf94a29"}
Jun 10 00:35:16.831811 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:16.831474    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-v7js7"
Jun 10 00:35:16.832936 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:16.832906    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-5mllq" event={"ID":"67295873-8ac3-4fc7-8b92-a06eeca1361b","Type":"ContainerStarted","Data":"b40bcff5685ac72ed09d7c23db5be887c591e90c4d65596cc7b42f6718b80579"}
Jun 10 00:35:16.833024 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:16.832968    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-5mllq"
Jun 10 00:35:16.834352 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:16.834330    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-zbvz9" event={"ID":"40a2a2f3-2ed4-40eb-b774-dda27453ed6b","Type":"ContainerStarted","Data":"c7b4b0262c952f634da1300d1ec1aa25e0600aa1d4a0aa31fb8e5bfc80acd6cd"}
Jun 10 00:35:16.834456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:16.834385    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-zbvz9"
Jun 10 00:35:16.849202 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:16.849145    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-v7js7" podStartSLOduration=1.833141659 podStartE2EDuration="4.849124582s" totalImagesPullingTime="3.015982923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:16.84655623 +0000 UTC m=+823.717332356" watchObservedRunningTime="2026-06-10 00:35:16.849124582 +0000 UTC m=+823.719900779"
Jun 10 00:35:16.862479 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:16.862423    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-5mllq" podStartSLOduration=2.296615412 podStartE2EDuration="4.862404899s" totalImagesPullingTime="2.565789487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:16.859648777 +0000 UTC m=+823.730424907" watchObservedRunningTime="2026-06-10 00:35:16.862404899 +0000 UTC m=+823.733181027"
Jun 10 00:35:16.875915 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:16.875871    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-zbvz9" podStartSLOduration=2.349191543 podStartE2EDuration="4.875852028s" totalImagesPullingTime="2.526660485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:35:16.872671299 +0000 UTC m=+823.743447426" watchObservedRunningTime="2026-06-10 00:35:16.875852028 +0000 UTC m=+823.746628155"
Jun 10 00:35:22.845958 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:22.845915    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-v7js7"
Jun 10 00:35:27.842284 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:27.842249    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-5mllq"
Jun 10 00:35:27.842729 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:27.842381    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-zbvz9"
Jun 10 00:35:37.855773 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:35:37.855716    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:36:13.853339 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:13.853298    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:36:13.949984 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:13.949946    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:36:22.449714 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:22.449631    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:36:32.432572 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.432538    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"]
Jun 10 00:36:32.436601 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.436575    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.439040 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.439015    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 10 00:36:32.439162 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.439024    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t5f28\""
Jun 10 00:36:32.440127 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.439925    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jun 10 00:36:32.440265 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.440149    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 10 00:36:32.445433 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.444947    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"]
Jun 10 00:36:32.462319 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.462289    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:36:32.487565 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.487533    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7917c1ce-fcda-44b8-be25-12bef7f6846e-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.487732 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.487585    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqwns\" (UniqueName: \"kubernetes.io/projected/7917c1ce-fcda-44b8-be25-12bef7f6846e-kube-api-access-wqwns\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.487732 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.487657    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7917c1ce-fcda-44b8-be25-12bef7f6846e-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.487732 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.487688    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7917c1ce-fcda-44b8-be25-12bef7f6846e-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.487732 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.487733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7917c1ce-fcda-44b8-be25-12bef7f6846e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.487951 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.487806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7917c1ce-fcda-44b8-be25-12bef7f6846e-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.588689 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.588647    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7917c1ce-fcda-44b8-be25-12bef7f6846e-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.588905 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.588697    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqwns\" (UniqueName: \"kubernetes.io/projected/7917c1ce-fcda-44b8-be25-12bef7f6846e-kube-api-access-wqwns\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.588905 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.588757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7917c1ce-fcda-44b8-be25-12bef7f6846e-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.588905 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.588783    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7917c1ce-fcda-44b8-be25-12bef7f6846e-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.588905 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.588836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7917c1ce-fcda-44b8-be25-12bef7f6846e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.588905 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.588874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7917c1ce-fcda-44b8-be25-12bef7f6846e-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.589182 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.589168    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7917c1ce-fcda-44b8-be25-12bef7f6846e-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.589239 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.589187    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7917c1ce-fcda-44b8-be25-12bef7f6846e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.589292 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.589245    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7917c1ce-fcda-44b8-be25-12bef7f6846e-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.591332 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.591307    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7917c1ce-fcda-44b8-be25-12bef7f6846e-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.591537 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.591522    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7917c1ce-fcda-44b8-be25-12bef7f6846e-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.595703 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.595685    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqwns\" (UniqueName: \"kubernetes.io/projected/7917c1ce-fcda-44b8-be25-12bef7f6846e-kube-api-access-wqwns\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-dbx4r\" (UID: \"7917c1ce-fcda-44b8-be25-12bef7f6846e\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.749641 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.749540    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:32.896106 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:32.896075    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"]
Jun 10 00:36:32.898679 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:36:32.898652    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7917c1ce_fcda_44b8_be25_12bef7f6846e.slice/crio-6c73b27031073bef87202a1029554e86f9b94965f889a35660225b88036688d0 WatchSource:0}: Error finding container 6c73b27031073bef87202a1029554e86f9b94965f889a35660225b88036688d0: Status 404 returned error can't find the container with id 6c73b27031073bef87202a1029554e86f9b94965f889a35660225b88036688d0
Jun 10 00:36:33.318059 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:33.318026    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r" event={"ID":"7917c1ce-fcda-44b8-be25-12bef7f6846e","Type":"ContainerStarted","Data":"6c73b27031073bef87202a1029554e86f9b94965f889a35660225b88036688d0"}
Jun 10 00:36:33.675725 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:33.675638    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v87bq_42e8ed02-5ca0-478a-9642-562b92e21674/ovn-acl-logging/0.log"
Jun 10 00:36:33.676348 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:33.676323    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v87bq_42e8ed02-5ca0-478a-9642-562b92e21674/ovn-acl-logging/0.log"
Jun 10 00:36:36.342223 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:36.342123    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r" event={"ID":"7917c1ce-fcda-44b8-be25-12bef7f6846e","Type":"ContainerStarted","Data":"7066f60ef14f5fcd77206d2da1d9f4629332dc3fe9183ebee3477b8e37c2203a"}
Jun 10 00:36:38.355835 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:38.355794    2560 generic.go:356] "Generic (PLEG): container finished" podID="7917c1ce-fcda-44b8-be25-12bef7f6846e" containerID="7066f60ef14f5fcd77206d2da1d9f4629332dc3fe9183ebee3477b8e37c2203a" exitCode=0
Jun 10 00:36:38.356316 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:38.355872    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r" event={"ID":"7917c1ce-fcda-44b8-be25-12bef7f6846e","Type":"ContainerDied","Data":"7066f60ef14f5fcd77206d2da1d9f4629332dc3fe9183ebee3477b8e37c2203a"}
Jun 10 00:36:40.372625 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:40.372590    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r" event={"ID":"7917c1ce-fcda-44b8-be25-12bef7f6846e","Type":"ContainerStarted","Data":"52a11a6906ab4c9a124a7da50b00b1dbf24c0ed752fdc6d9a1f9bb5c2ddcbb99"}
Jun 10 00:36:40.392438 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:40.392381    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r" podStartSLOduration=2.563256127 podStartE2EDuration="8.39236551s" totalImagesPullingTime="4.420964291s" totalInitContainerRuntime="1.408145092s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:36:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:36:40.38889455 +0000 UTC m=+907.259670670" watchObservedRunningTime="2026-06-10 00:36:40.39236551 +0000 UTC m=+907.263141637"
Jun 10 00:36:40.614877 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:40.614836    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:36:42.749726 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:42.749678    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:42.750311 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:42.749789    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:42.762310 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:42.762285    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:43.403455 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:43.403417    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-dbx4r"
Jun 10 00:36:54.259081 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:36:54.259036    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:37:19.526681 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.526647    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"]
Jun 10 00:37:19.540258 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.540220    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"]
Jun 10 00:37:19.540410 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.540339    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.542723 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.542701    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jun 10 00:37:19.562762 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.562704    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:37:19.710497 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.710453    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f03816be-1b05-49a1-9771-ea4bf682b882-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.710713 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.710509    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f03816be-1b05-49a1-9771-ea4bf682b882-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.710713 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.710532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f03816be-1b05-49a1-9771-ea4bf682b882-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.710883 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.710708    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpp98\" (UniqueName: \"kubernetes.io/projected/f03816be-1b05-49a1-9771-ea4bf682b882-kube-api-access-cpp98\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.710883 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.710795    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f03816be-1b05-49a1-9771-ea4bf682b882-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.710883 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.710823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f03816be-1b05-49a1-9771-ea4bf682b882-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.811679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.811588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpp98\" (UniqueName: \"kubernetes.io/projected/f03816be-1b05-49a1-9771-ea4bf682b882-kube-api-access-cpp98\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.811679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.811633    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f03816be-1b05-49a1-9771-ea4bf682b882-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.811679 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.811650    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f03816be-1b05-49a1-9771-ea4bf682b882-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.811964 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.811691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f03816be-1b05-49a1-9771-ea4bf682b882-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.811964 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.811767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f03816be-1b05-49a1-9771-ea4bf682b882-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.811964 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.811801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f03816be-1b05-49a1-9771-ea4bf682b882-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.812115 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.812095    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f03816be-1b05-49a1-9771-ea4bf682b882-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.812175 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.812143    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f03816be-1b05-49a1-9771-ea4bf682b882-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.812288 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.812266    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f03816be-1b05-49a1-9771-ea4bf682b882-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.814081 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.814052    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f03816be-1b05-49a1-9771-ea4bf682b882-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.814349 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.814323    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f03816be-1b05-49a1-9771-ea4bf682b882-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.819453 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.819427    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpp98\" (UniqueName: \"kubernetes.io/projected/f03816be-1b05-49a1-9771-ea4bf682b882-kube-api-access-cpp98\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd\" (UID: \"f03816be-1b05-49a1-9771-ea4bf682b882\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.851948 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.851899    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:37:19.996363 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:19.996340    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"]
Jun 10 00:37:19.998254 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:37:19.998217    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03816be_1b05_49a1_9771_ea4bf682b882.slice/crio-b50b5aa5685495d8e63d80fde36743762743cc2d78459665adde30997b640c55 WatchSource:0}: Error finding container b50b5aa5685495d8e63d80fde36743762743cc2d78459665adde30997b640c55: Status 404 returned error can't find the container with id b50b5aa5685495d8e63d80fde36743762743cc2d78459665adde30997b640c55
Jun 10 00:37:20.636808 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:20.636773    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd" event={"ID":"f03816be-1b05-49a1-9771-ea4bf682b882","Type":"ContainerStarted","Data":"7138f7394d03fb40bef4dfa6bf43630cb5dd2158248f8c67a9d067bdc167a149"}
Jun 10 00:37:20.637213 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:20.636827    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd" event={"ID":"f03816be-1b05-49a1-9771-ea4bf682b882","Type":"ContainerStarted","Data":"b50b5aa5685495d8e63d80fde36743762743cc2d78459665adde30997b640c55"}
Jun 10 00:37:35.146792 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.146760    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"]
Jun 10 00:37:35.150645 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.150628    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.152947 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.152925    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jun 10 00:37:35.157630 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.157605    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"]
Jun 10 00:37:35.161075 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.161045    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:37:35.252811 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.252732    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7921686b-aeb9-4f70-afa2-8c30503f3f6d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.253007 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.252882    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bvvc\" (UniqueName: \"kubernetes.io/projected/7921686b-aeb9-4f70-afa2-8c30503f3f6d-kube-api-access-8bvvc\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.253007 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.252926    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7921686b-aeb9-4f70-afa2-8c30503f3f6d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.253007 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.252946    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7921686b-aeb9-4f70-afa2-8c30503f3f6d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.253007 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.252994    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7921686b-aeb9-4f70-afa2-8c30503f3f6d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.253181 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.253039    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7921686b-aeb9-4f70-afa2-8c30503f3f6d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.354176 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.354142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7921686b-aeb9-4f70-afa2-8c30503f3f6d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.354386 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.354218    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7921686b-aeb9-4f70-afa2-8c30503f3f6d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.354386 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.354294    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bvvc\" (UniqueName: \"kubernetes.io/projected/7921686b-aeb9-4f70-afa2-8c30503f3f6d-kube-api-access-8bvvc\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.354386 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.354336    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7921686b-aeb9-4f70-afa2-8c30503f3f6d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.354386 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.354357    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7921686b-aeb9-4f70-afa2-8c30503f3f6d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.354386 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.354381    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7921686b-aeb9-4f70-afa2-8c30503f3f6d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.354722 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.354689    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7921686b-aeb9-4f70-afa2-8c30503f3f6d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.354862 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.354728    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7921686b-aeb9-4f70-afa2-8c30503f3f6d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.354862 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.354775    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7921686b-aeb9-4f70-afa2-8c30503f3f6d-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.356658 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.356635    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7921686b-aeb9-4f70-afa2-8c30503f3f6d-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.357184 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.357167    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7921686b-aeb9-4f70-afa2-8c30503f3f6d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.368867 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.363126    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bvvc\" (UniqueName: \"kubernetes.io/projected/7921686b-aeb9-4f70-afa2-8c30503f3f6d-kube-api-access-8bvvc\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-vdnrv\" (UID: \"7921686b-aeb9-4f70-afa2-8c30503f3f6d\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.462037 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.461944    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"
Jun 10 00:37:35.607767 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.607723    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv"]
Jun 10 00:37:35.609539 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:37:35.609512    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7921686b_aeb9_4f70_afa2_8c30503f3f6d.slice/crio-6478e79e09f47740fa8a30d8419dadc18d73aaeeaa6b8a407ff623689fe49d8c WatchSource:0}: Error finding container 6478e79e09f47740fa8a30d8419dadc18d73aaeeaa6b8a407ff623689fe49d8c: Status 404 returned error can't find the container with id 6478e79e09f47740fa8a30d8419dadc18d73aaeeaa6b8a407ff623689fe49d8c
Jun 10 00:37:35.730994 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.730899    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv" event={"ID":"7921686b-aeb9-4f70-afa2-8c30503f3f6d","Type":"ContainerStarted","Data":"ee291fc15601fbab09ef8f249422eff469056bd569f1a804effcb6ff13751582"}
Jun 10 00:37:35.730994 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:35.730943    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-vdnrv" event={"ID":"7921686b-aeb9-4f70-afa2-8c30503f3f6d","Type":"ContainerStarted","Data":"6478e79e09f47740fa8a30d8419dadc18d73aaeeaa6b8a407ff623689fe49d8c"}
Jun 10 00:37:38.330264 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:37:38.330225    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:38:11.963889 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:38:11.963804    2560 generic.go:356] "Generic (PLEG): container finished" podID="f03816be-1b05-49a1-9771-ea4bf682b882" containerID="7138f7394d03fb40bef4dfa6bf43630cb5dd2158248f8c67a9d067bdc167a149" exitCode=0
Jun 10 00:38:11.963889 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:38:11.963871    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd" event={"ID":"f03816be-1b05-49a1-9771-ea4bf682b882","Type":"ContainerDied","Data":"7138f7394d03fb40bef4dfa6bf43630cb5dd2158248f8c67a9d067bdc167a149"}
Jun 10 00:38:12.972815 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:38:12.972781    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd" event={"ID":"f03816be-1b05-49a1-9771-ea4bf682b882","Type":"ContainerStarted","Data":"8fe27b9ad63fc88b3573cbff8d1454442e02ffdff1689ee4f83dbdea40246304"}
Jun 10 00:38:12.991887 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:38:12.991830    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd" podStartSLOduration=1.993446901 podStartE2EDuration="53.991813929s" totalImagesPullingTime="192.643068ms" totalInitContainerRuntime="51.80572396s" isStatefulPod=false podCreationTimestamp="2026-06-10 00:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:38:12.989994514 +0000 UTC m=+999.860770651" watchObservedRunningTime="2026-06-10 00:38:12.991813929 +0000 UTC m=+999.862590055"
Jun 10 00:38:19.852123 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:38:19.852086    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:38:19.852772 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:38:19.852162    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:38:19.864763 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:38:19.864720    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:38:20.029764 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:38:20.029708    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd"
Jun 10 00:38:33.676974 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:38:33.676935    2560 scope.go:117] "RemoveContainer" containerID="635e9efd67ef405e2ae40bf67aeca03081be29e291957ba021bcf93d220ee5c9"
Jun 10 00:39:31.732785 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:39:31.732699    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:39:31.795405 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:39:31.795377    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:41:03.370400 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:41:03.370318    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:41:33.730072 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:41:33.730039    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v87bq_42e8ed02-5ca0-478a-9642-562b92e21674/ovn-acl-logging/0.log"
Jun 10 00:41:33.732786 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:41:33.732763    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v87bq_42e8ed02-5ca0-478a-9642-562b92e21674/ovn-acl-logging/0.log"
Jun 10 00:43:24.056551 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:24.056511    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-vdnrv_7921686b-aeb9-4f70-afa2-8c30503f3f6d/storage-initializer/0.log"
Jun 10 00:43:30.061590 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:30.061549    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-9b4dc77dc-92z5t_22a21b1f-4916-4341-9221-f80dab1a5232/nginx/0.log"
Jun 10 00:43:30.310319 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:30.310290    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-gbl2z_d365e48b-22bd-4138-8182-575e55131932/manager/0.log"
Jun 10 00:43:30.444589 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:30.444502    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-gwl87_96a13513-4277-47a4-ae15-0d8a058ef33a/manager/0.log"
Jun 10 00:43:30.606756 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:30.606706    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6485d8bb88-cthld_b937d539-eea9-459b-aeb5-9cdf8527d893/manager/0.log"
Jun 10 00:43:30.755432 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:30.755392    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-c4rms_eaa53a61-dc48-43d5-abde-bdfa5272c5e8/server/0.log"
Jun 10 00:43:30.885916 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:30.885883    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-6znq9_72a60b55-a1e6-41c0-94aa-e92162acf129/manager/0.log"
Jun 10 00:43:31.016357 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:31.016277    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b7d59c946-4hpcc_844fed70-94d9-40db-804f-c06429168de5/copy-manifests/0.log"
Jun 10 00:43:31.036620 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:31.036589    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b7d59c946-4hpcc_844fed70-94d9-40db-804f-c06429168de5/manager/0.log"
Jun 10 00:43:32.190032 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:32.190000    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l_fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc/util/0.log"
Jun 10 00:43:32.196114 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:32.196082    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l_fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc/pull/0.log"
Jun 10 00:43:32.201848 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:32.201827    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l_fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc/extract/0.log"
Jun 10 00:43:32.317987 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:32.317960    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb_d9bc31c7-1436-464f-b476-5f0ddeef15c6/util/0.log"
Jun 10 00:43:32.323906 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:32.323879    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb_d9bc31c7-1436-464f-b476-5f0ddeef15c6/pull/0.log"
Jun 10 00:43:32.329434 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:32.329412    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb_d9bc31c7-1436-464f-b476-5f0ddeef15c6/extract/0.log"
Jun 10 00:43:32.455363 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:32.455278    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs_ba986a6b-14df-423d-8fd0-a912d3f46f81/pull/0.log"
Jun 10 00:43:32.461061 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:32.461038    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs_ba986a6b-14df-423d-8fd0-a912d3f46f81/extract/0.log"
Jun 10 00:43:32.466456 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:32.466436    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs_ba986a6b-14df-423d-8fd0-a912d3f46f81/util/0.log"
Jun 10 00:43:32.584760 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:32.584712    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc_86c36fb2-b9d1-4754-b3d1-7a815fd977dd/util/0.log"
Jun 10 00:43:32.590506 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:32.590483    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc_86c36fb2-b9d1-4754-b3d1-7a815fd977dd/pull/0.log"
Jun 10 00:43:32.596084 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:32.596053    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc_86c36fb2-b9d1-4754-b3d1-7a815fd977dd/extract/0.log"
Jun 10 00:43:33.566349 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:33.566303    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-89zdc_bfeb9fdd-4a1b-48c5-9355-67a5d3c04abf/manager/0.log"
Jun 10 00:43:34.075947 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:34.075912    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-ghbww_8b8e1c20-294b-4939-86aa-ba8370e2588f/discovery/0.log"
Jun 10 00:43:34.190671 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:34.190640    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c998fc6cc-qsp9q_30394dcf-8e22-4ba4-8cbf-fcaf87f100cd/kube-auth-proxy/0.log"
Jun 10 00:43:34.542190 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:34.542158    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-5mllq_67295873-8ac3-4fc7-8b92-a06eeca1361b/payload-pre-processing/0.log"
Jun 10 00:43:34.658523 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:34.658485    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-zbvz9_40a2a2f3-2ed4-40eb-b774-dda27453ed6b/payload-processing/0.log"
Jun 10 00:43:34.781500 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:34.781474    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f5dccfcff-pbm8v_2353b550-71e8-4fcf-aa55-a550828732ec/router/0.log"
Jun 10 00:43:35.273048 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:35.273015    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-dbx4r_7917c1ce-fcda-44b8-be25-12bef7f6846e/storage-initializer/0.log"
Jun 10 00:43:35.280465 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:35.280438    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-dbx4r_7917c1ce-fcda-44b8-be25-12bef7f6846e/main/0.log"
Jun 10 00:43:35.654469 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:35.654376    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd_f03816be-1b05-49a1-9771-ea4bf682b882/storage-initializer/0.log"
Jun 10 00:43:35.661681 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:35.661653    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-k5vbd_f03816be-1b05-49a1-9771-ea4bf682b882/main/0.log"
Jun 10 00:43:35.777060 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:35.777032    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-vdnrv_7921686b-aeb9-4f70-afa2-8c30503f3f6d/storage-initializer/0.log"
Jun 10 00:43:40.186230 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:40.186194    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:43:41.270138 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:41.270099    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log" limit=1024
Jun 10 00:43:43.045647 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:43.045606    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6lgs7_e9b93119-1e4a-45dc-8298-e6cdaaad0e06/global-pull-secret-syncer/0.log"
Jun 10 00:43:43.175397 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:43.175363    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2fgmj_3309e0e0-4f8c-4c87-ba1f-5103e69d6311/konnectivity-agent/0.log"
Jun 10 00:43:43.256941 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:43.256911    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-167.ec2.internal_f522f44fabdb60b97c5c2bd02ff0a7a2/haproxy/0.log"
Jun 10 00:43:47.710138 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:47.710107    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-lvv6v_ba9b61f3-4c49-4476-ba8d-6a4eb8e15e96/sail-operator/0.log"
Jun 10 00:43:48.060038 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:48.060009    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l_fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc/extract/0.log"
Jun 10 00:43:48.081915 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:48.081881    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l_fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc/util/0.log"
Jun 10 00:43:48.103426 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:48.103387    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mp92l_fa47c1a7-7fac-4dcd-8719-5dd1b7e104fc/pull/0.log"
Jun 10 00:43:48.129205 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:48.129182    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb_d9bc31c7-1436-464f-b476-5f0ddeef15c6/extract/0.log"
Jun 10 00:43:48.148360 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:48.148336    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb_d9bc31c7-1436-464f-b476-5f0ddeef15c6/util/0.log"
Jun 10 00:43:48.172802 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:48.172771    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xcvdb_d9bc31c7-1436-464f-b476-5f0ddeef15c6/pull/0.log"
Jun 10 00:43:48.197699 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:48.197672    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs_ba986a6b-14df-423d-8fd0-a912d3f46f81/extract/0.log"
Jun 10 00:43:48.219230 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:48.219201    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs_ba986a6b-14df-423d-8fd0-a912d3f46f81/util/0.log"
Jun 10 00:43:48.238377 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:48.238351    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73bmhvs_ba986a6b-14df-423d-8fd0-a912d3f46f81/pull/0.log"
Jun 10 00:43:48.264695 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:48.264671    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc_86c36fb2-b9d1-4754-b3d1-7a815fd977dd/extract/0.log"
Jun 10 00:43:48.284007 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:48.283984    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc_86c36fb2-b9d1-4754-b3d1-7a815fd977dd/util/0.log"
Jun 10 00:43:48.303857 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:48.303832    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1bpwvc_86c36fb2-b9d1-4754-b3d1-7a815fd977dd/pull/0.log"
Jun 10 00:43:48.603410 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:48.603376    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-89zdc_bfeb9fdd-4a1b-48c5-9355-67a5d3c04abf/manager/0.log"
Jun 10 00:43:50.118576 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.118550    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8793e6be-6504-46e1-8095-ea27cfda13df/alertmanager/0.log"
Jun 10 00:43:50.139697 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.139670    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8793e6be-6504-46e1-8095-ea27cfda13df/config-reloader/0.log"
Jun 10 00:43:50.166443 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.166409    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8793e6be-6504-46e1-8095-ea27cfda13df/kube-rbac-proxy-web/0.log"
Jun 10 00:43:50.194956 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.194930    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8793e6be-6504-46e1-8095-ea27cfda13df/kube-rbac-proxy/0.log"
Jun 10 00:43:50.221631 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.221595    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8793e6be-6504-46e1-8095-ea27cfda13df/kube-rbac-proxy-metric/0.log"
Jun 10 00:43:50.251923 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.251901    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8793e6be-6504-46e1-8095-ea27cfda13df/prom-label-proxy/0.log"
Jun 10 00:43:50.272842 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.272808    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8793e6be-6504-46e1-8095-ea27cfda13df/init-config-reloader/0.log"
Jun 10 00:43:50.331379 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.331348    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v92ft_453e7b09-69c7-424c-8f3d-ce0a046e172f/kube-state-metrics/0.log"
Jun 10 00:43:50.350380 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.350350    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v92ft_453e7b09-69c7-424c-8f3d-ce0a046e172f/kube-rbac-proxy-main/0.log"
Jun 10 00:43:50.369806 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.369693    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v92ft_453e7b09-69c7-424c-8f3d-ce0a046e172f/kube-rbac-proxy-self/0.log"
Jun 10 00:43:50.435568 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.435539    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-kzjnh_f393efef-1843-492a-ae30-21e8295ceed8/monitoring-plugin/0.log"
Jun 10 00:43:50.472465 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.472433    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9jx59_d8eb2989-c5ec-4e12-b619-c1d9dec1fa48/node-exporter/0.log"
Jun 10 00:43:50.498957 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.498926    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9jx59_d8eb2989-c5ec-4e12-b619-c1d9dec1fa48/kube-rbac-proxy/0.log"
Jun 10 00:43:50.521995 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.521975    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9jx59_d8eb2989-c5ec-4e12-b619-c1d9dec1fa48/init-textfile/0.log"
Jun 10 00:43:50.704514 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.704430    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4l2df_8d33ba09-ee5e-4fbf-877e-c27e6a946215/kube-rbac-proxy-main/0.log"
Jun 10 00:43:50.725751 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.725715    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4l2df_8d33ba09-ee5e-4fbf-877e-c27e6a946215/kube-rbac-proxy-self/0.log"
Jun 10 00:43:50.746547 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:50.746518    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4l2df_8d33ba09-ee5e-4fbf-877e-c27e6a946215/openshift-state-metrics/0.log"
Jun 10 00:43:51.004000 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:51.003975    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-9pnrp_2824e107-94db-41c1-b117-08b90a31e2ab/prometheus-operator-admission-webhook/0.log"
Jun 10 00:43:51.110100 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:51.110073    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf75bb48d-zd77x_4044affd-3609-4a6f-9180-1e6b9b84bcf5/thanos-query/0.log"
Jun 10 00:43:51.131627 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:51.131590    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf75bb48d-zd77x_4044affd-3609-4a6f-9180-1e6b9b84bcf5/kube-rbac-proxy-web/0.log"
Jun 10 00:43:51.151434 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:51.151407    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf75bb48d-zd77x_4044affd-3609-4a6f-9180-1e6b9b84bcf5/kube-rbac-proxy/0.log"
Jun 10 00:43:51.175857 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:51.175831    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf75bb48d-zd77x_4044affd-3609-4a6f-9180-1e6b9b84bcf5/prom-label-proxy/0.log"
Jun 10 00:43:51.197268 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:51.197240    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf75bb48d-zd77x_4044affd-3609-4a6f-9180-1e6b9b84bcf5/kube-rbac-proxy-rules/0.log"
Jun 10 00:43:51.217643 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:51.217616    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf75bb48d-zd77x_4044affd-3609-4a6f-9180-1e6b9b84bcf5/kube-rbac-proxy-metrics/0.log"
Jun 10 00:43:52.564650 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:52.564621    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-nv72t_6cc7f6de-2406-49f6-a738-dc124c17db96/networking-console-plugin/0.log"
Jun 10 00:43:53.438457 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.438425    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"]
Jun 10 00:43:53.442577 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.442551    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.444929 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.444905    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h66sf\"/\"openshift-service-ca.crt\""
Jun 10 00:43:53.445315 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.445283    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h66sf\"/\"kube-root-ca.crt\""
Jun 10 00:43:53.453291 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.453254    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"]
Jun 10 00:43:53.453570 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.453544    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h66sf\"/\"default-dockercfg-cn279\""
Jun 10 00:43:53.578413 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.578370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/982ef7e3-c5fe-4ad6-9b9c-eac8535de237-lib-modules\") pod \"perf-node-gather-daemonset-8n7cr\" (UID: \"982ef7e3-c5fe-4ad6-9b9c-eac8535de237\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.578413 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.578413    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpncl\" (UniqueName: \"kubernetes.io/projected/982ef7e3-c5fe-4ad6-9b9c-eac8535de237-kube-api-access-tpncl\") pod \"perf-node-gather-daemonset-8n7cr\" (UID: \"982ef7e3-c5fe-4ad6-9b9c-eac8535de237\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.578930 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.578474    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/982ef7e3-c5fe-4ad6-9b9c-eac8535de237-proc\") pod \"perf-node-gather-daemonset-8n7cr\" (UID: \"982ef7e3-c5fe-4ad6-9b9c-eac8535de237\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.578930 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.578526    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/982ef7e3-c5fe-4ad6-9b9c-eac8535de237-sys\") pod \"perf-node-gather-daemonset-8n7cr\" (UID: \"982ef7e3-c5fe-4ad6-9b9c-eac8535de237\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.578930 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.578587    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/982ef7e3-c5fe-4ad6-9b9c-eac8535de237-podres\") pod \"perf-node-gather-daemonset-8n7cr\" (UID: \"982ef7e3-c5fe-4ad6-9b9c-eac8535de237\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.680121 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.680078    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/982ef7e3-c5fe-4ad6-9b9c-eac8535de237-podres\") pod \"perf-node-gather-daemonset-8n7cr\" (UID: \"982ef7e3-c5fe-4ad6-9b9c-eac8535de237\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.680328 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.680137    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/982ef7e3-c5fe-4ad6-9b9c-eac8535de237-lib-modules\") pod \"perf-node-gather-daemonset-8n7cr\" (UID: \"982ef7e3-c5fe-4ad6-9b9c-eac8535de237\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.680328 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.680166    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpncl\" (UniqueName: \"kubernetes.io/projected/982ef7e3-c5fe-4ad6-9b9c-eac8535de237-kube-api-access-tpncl\") pod \"perf-node-gather-daemonset-8n7cr\" (UID: \"982ef7e3-c5fe-4ad6-9b9c-eac8535de237\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.680328 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.680227    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/982ef7e3-c5fe-4ad6-9b9c-eac8535de237-proc\") pod \"perf-node-gather-daemonset-8n7cr\" (UID: \"982ef7e3-c5fe-4ad6-9b9c-eac8535de237\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.680328 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.680268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/982ef7e3-c5fe-4ad6-9b9c-eac8535de237-sys\") pod \"perf-node-gather-daemonset-8n7cr\" (UID: \"982ef7e3-c5fe-4ad6-9b9c-eac8535de237\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.680328 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.680292    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/982ef7e3-c5fe-4ad6-9b9c-eac8535de237-lib-modules\") pod \"perf-node-gather-daemonset-8n7cr\" (UID: \"982ef7e3-c5fe-4ad6-9b9c-eac8535de237\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.680328 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.680291    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/982ef7e3-c5fe-4ad6-9b9c-eac8535de237-podres\") pod \"perf-node-gather-daemonset-8n7cr\" (UID: \"982ef7e3-c5fe-4ad6-9b9c-eac8535de237\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.680552 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.680345    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/982ef7e3-c5fe-4ad6-9b9c-eac8535de237-sys\") pod \"perf-node-gather-daemonset-8n7cr\" (UID: \"982ef7e3-c5fe-4ad6-9b9c-eac8535de237\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.680552 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.680349    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/982ef7e3-c5fe-4ad6-9b9c-eac8535de237-proc\") pod \"perf-node-gather-daemonset-8n7cr\" (UID: \"982ef7e3-c5fe-4ad6-9b9c-eac8535de237\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.687580 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.687550    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpncl\" (UniqueName: \"kubernetes.io/projected/982ef7e3-c5fe-4ad6-9b9c-eac8535de237-kube-api-access-tpncl\") pod \"perf-node-gather-daemonset-8n7cr\" (UID: \"982ef7e3-c5fe-4ad6-9b9c-eac8535de237\") " pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.741596 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.741492    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-jsp2v_9e106869-564a-438a-a6cd-867eb1e343b7/download-server/0.log"
Jun 10 00:43:53.757898 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.757870    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:53.903078 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:53.903052    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"]
Jun 10 00:43:53.904781 ip-10-0-128-167 kubenswrapper[2560]: W0610 00:43:53.904727    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod982ef7e3_c5fe_4ad6_9b9c_eac8535de237.slice/crio-a0678e440f85b8f866ce5792225bdfc36beee130b9eb1f7d46a2bd7dcfbe19d3 WatchSource:0}: Error finding container a0678e440f85b8f866ce5792225bdfc36beee130b9eb1f7d46a2bd7dcfbe19d3: Status 404 returned error can't find the container with id a0678e440f85b8f866ce5792225bdfc36beee130b9eb1f7d46a2bd7dcfbe19d3
Jun 10 00:43:54.126593 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:54.126559    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr" event={"ID":"982ef7e3-c5fe-4ad6-9b9c-eac8535de237","Type":"ContainerStarted","Data":"dfe38fe543da49459e6ae2b24743ddf0e94a25eea090f1f3e23e1c92eccd5222"}
Jun 10 00:43:54.126843 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:54.126620    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr" event={"ID":"982ef7e3-c5fe-4ad6-9b9c-eac8535de237","Type":"ContainerStarted","Data":"a0678e440f85b8f866ce5792225bdfc36beee130b9eb1f7d46a2bd7dcfbe19d3"}
Jun 10 00:43:54.126843 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:54.126649    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:43:54.142050 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:54.142000    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr" podStartSLOduration=1.141986054 podStartE2EDuration="1.141986054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 00:43:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 00:43:54.140328372 +0000 UTC m=+1341.011104523" watchObservedRunningTime="2026-06-10 00:43:54.141986054 +0000 UTC m=+1341.012762180"
Jun 10 00:43:55.643732 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:55.643704    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8jqf6_16e79505-9bdf-48ae-934e-33d497801737/dns/0.log"
Jun 10 00:43:55.668814 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:55.668773    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8jqf6_16e79505-9bdf-48ae-934e-33d497801737/kube-rbac-proxy/0.log"
Jun 10 00:43:55.759914 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:55.759883    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lv968_f9145353-43cf-472c-ba12-c3f093cfcccc/dns-node-resolver/0.log"
Jun 10 00:43:56.344043 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:56.344012    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6jdzv_eab4de7c-fcdc-4f58-80c0-b7607ec77386/node-ca/0.log"
Jun 10 00:43:57.358044 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:57.358010    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-ghbww_8b8e1c20-294b-4939-86aa-ba8370e2588f/discovery/0.log"
Jun 10 00:43:57.378249 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:57.378227    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c998fc6cc-qsp9q_30394dcf-8e22-4ba4-8cbf-fcaf87f100cd/kube-auth-proxy/0.log"
Jun 10 00:43:57.457206 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:57.457178    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-5mllq_67295873-8ac3-4fc7-8b92-a06eeca1361b/payload-pre-processing/0.log"
Jun 10 00:43:57.481982 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:57.481954    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-zbvz9_40a2a2f3-2ed4-40eb-b774-dda27453ed6b/payload-processing/0.log"
Jun 10 00:43:57.507661 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:57.507630    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f5dccfcff-pbm8v_2353b550-71e8-4fcf-aa55-a550828732ec/router/0.log"
Jun 10 00:43:58.143046 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:58.143014    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pbk85_a3b9ce6a-5198-4698-b05d-7137726b59d6/serve-healthcheck-canary/0.log"
Jun 10 00:43:58.719824 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:58.719797    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-njcff_b037bc7a-8ab0-4489-8c80-aa1153c7b69a/kube-rbac-proxy/0.log"
Jun 10 00:43:58.739581 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:58.739556    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-njcff_b037bc7a-8ab0-4489-8c80-aa1153c7b69a/exporter/0.log"
Jun 10 00:43:58.759076 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:43:58.759043    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-njcff_b037bc7a-8ab0-4489-8c80-aa1153c7b69a/extractor/0.log"
Jun 10 00:44:00.143158 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:00.143130    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-h66sf/perf-node-gather-daemonset-8n7cr"
Jun 10 00:44:00.954125 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:00.954091    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-9b4dc77dc-92z5t_22a21b1f-4916-4341-9221-f80dab1a5232/nginx/0.log"
Jun 10 00:44:01.001501 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:01.001472    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-gbl2z_d365e48b-22bd-4138-8182-575e55131932/manager/0.log"
Jun 10 00:44:01.039512 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:01.039480    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-gwl87_96a13513-4277-47a4-ae15-0d8a058ef33a/manager/0.log"
Jun 10 00:44:01.070775 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:01.070723    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6485d8bb88-cthld_b937d539-eea9-459b-aeb5-9cdf8527d893/manager/0.log"
Jun 10 00:44:01.088209 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:01.088185    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-c4rms_eaa53a61-dc48-43d5-abde-bdfa5272c5e8/server/0.log"
Jun 10 00:44:01.155087 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:01.155057    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-6znq9_72a60b55-a1e6-41c0-94aa-e92162acf129/manager/0.log"
Jun 10 00:44:01.226346 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:01.226255    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b7d59c946-4hpcc_844fed70-94d9-40db-804f-c06429168de5/manager/0.log"
Jun 10 00:44:01.241647 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:01.241619    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b7d59c946-4hpcc_844fed70-94d9-40db-804f-c06429168de5/copy-manifests/0.log"
Jun 10 00:44:03.018878 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:03.018844    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-v9jt6_1e178309-f0e1-4582-a8c0-ca47338282b0/openshift-lws-operator/0.log"
Jun 10 00:44:08.460921 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:08.460882    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-ghbww_8b8e1c20-294b-4939-86aa-ba8370e2588f/discovery/0.log"
Jun 10 00:44:08.471546 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:08.471514    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c998fc6cc-qsp9q_30394dcf-8e22-4ba4-8cbf-fcaf87f100cd/kube-auth-proxy/0.log"
Jun 10 00:44:08.511219 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:08.511186    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-m7drh_391f1235-4644-47de-9bfa-ce9280888777/kube-storage-version-migrator-operator/1.log"
Jun 10 00:44:08.511765 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:08.511719    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-5mllq_67295873-8ac3-4fc7-8b92-a06eeca1361b/payload-pre-processing/0.log"
Jun 10 00:44:08.513174 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:08.513156    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-m7drh_391f1235-4644-47de-9bfa-ce9280888777/kube-storage-version-migrator-operator/0.log"
Jun 10 00:44:08.527471 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:08.527442    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-zbvz9_40a2a2f3-2ed4-40eb-b774-dda27453ed6b/payload-processing/0.log"
Jun 10 00:44:08.545628 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:08.545595    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f5dccfcff-pbm8v_2353b550-71e8-4fcf-aa55-a550828732ec/router/0.log"
Jun 10 00:44:09.720802 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:09.720688    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-ghbww_8b8e1c20-294b-4939-86aa-ba8370e2588f/discovery/0.log"
Jun 10 00:44:09.729990 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:09.729965    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c998fc6cc-qsp9q_30394dcf-8e22-4ba4-8cbf-fcaf87f100cd/kube-auth-proxy/0.log"
Jun 10 00:44:09.772885 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:09.772854    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-5mllq_67295873-8ac3-4fc7-8b92-a06eeca1361b/payload-pre-processing/0.log"
Jun 10 00:44:09.787655 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:09.787627    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-zbvz9_40a2a2f3-2ed4-40eb-b774-dda27453ed6b/payload-processing/0.log"
Jun 10 00:44:09.804040 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:09.804006    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f5dccfcff-pbm8v_2353b550-71e8-4fcf-aa55-a550828732ec/router/0.log"
Jun 10 00:44:09.832192 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:09.832161    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbxcs_efa66c73-cab4-45b5-9b89-cbff0b25fc86/kube-multus-additional-cni-plugins/0.log"
Jun 10 00:44:09.859207 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:09.856443    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbxcs_efa66c73-cab4-45b5-9b89-cbff0b25fc86/egress-router-binary-copy/0.log"
Jun 10 00:44:09.876453 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:09.876427    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbxcs_efa66c73-cab4-45b5-9b89-cbff0b25fc86/cni-plugins/0.log"
Jun 10 00:44:09.896757 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:09.896715    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbxcs_efa66c73-cab4-45b5-9b89-cbff0b25fc86/bond-cni-plugin/0.log"
Jun 10 00:44:09.916909 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:09.916880    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbxcs_efa66c73-cab4-45b5-9b89-cbff0b25fc86/routeoverride-cni/0.log"
Jun 10 00:44:09.935575 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:09.935553    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbxcs_efa66c73-cab4-45b5-9b89-cbff0b25fc86/whereabouts-cni-bincopy/0.log"
Jun 10 00:44:09.961502 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:09.961473    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbxcs_efa66c73-cab4-45b5-9b89-cbff0b25fc86/whereabouts-cni/0.log"
Jun 10 00:44:10.183864 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:10.183826    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-l9pvv_c301dd86-f816-4e5e-ba88-67e9d95614bd/kube-multus/0.log"
Jun 10 00:44:10.277417 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:10.277390    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n2z9z_4d3fdb97-b961-4d04-abaf-6487c7a130f1/network-metrics-daemon/0.log"
Jun 10 00:44:10.294187 ip-10-0-128-167 kubenswrapper[2560]: I0610 00:44:10.294136    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n2z9z_4d3fdb97-b961-4d04-abaf-6487c7a130f1/kube-rbac-proxy/0.log"