Jun 10 22:56:47.529287 ip-10-0-129-238 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jun 10 22:56:47.529301 ip-10-0-129-238 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jun 10 22:56:47.529310 ip-10-0-129-238 systemd[1]: kubelet.service: Failed with result 'resources'.
Jun 10 22:56:47.529524 ip-10-0-129-238 systemd[1]: Failed to start Kubernetes Kubelet.
Jun 10 22:56:58.743819 ip-10-0-129-238 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jun 10 22:56:58.743838 ip-10-0-129-238 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1a4c7a4e6f3b47e2aca3d40af27d6da4 --
Jun 10 22:59:13.736257 ip-10-0-129-238 systemd[1]: Starting Kubernetes Kubelet...
Jun 10 22:59:14.096239 ip-10-0-129-238 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 10 22:59:14.096239 ip-10-0-129-238 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 10 22:59:14.096239 ip-10-0-129-238 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 10 22:59:14.096239 ip-10-0-129-238 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 10 22:59:14.096239 ip-10-0-129-238 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 10 22:59:14.097340 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.097246    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 10 22:59:14.102163 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102127    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 22:59:14.102163 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102157    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 22:59:14.102163 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102164    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 22:59:14.102163 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102170    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102331    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102345    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102349    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102353    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102372    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102376    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102379    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102383    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102386    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102389    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102393    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102398    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102403    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102408    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102412    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102416    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102420    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102423    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102426    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 22:59:14.102423 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102429    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102432    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102436    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102440    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102443    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102446    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102449    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102452    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102456    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102459    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102462    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102465    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102468    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102471    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102474    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102476    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102479    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102481    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102484    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102487    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102490    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 22:59:14.103019 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102493    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102496    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102499    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102502    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102504    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102507    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102510    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102513    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102516    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102518    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102521    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102524    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102529    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102532    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102536    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102539    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102542    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102545    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102548    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 22:59:14.103581 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102551    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102554    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102557    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102560    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102563    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102566    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102569    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102572    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102576    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102579    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102582    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102584    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102587    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102590    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102593    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102596    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102599    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102602    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102606    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102609    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 22:59:14.104105 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102614    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102617    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102622    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102625    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102629    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102632    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102636    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102639    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102643    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102646    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102649    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102652    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102655    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102658    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102661    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.102664    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103442    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103449    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103452    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 22:59:14.104661 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103456    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103459    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103462    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103465    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103467    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103470    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103473    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103476    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103478    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103481    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103484    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103487    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103490    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103492    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103496    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103499    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103502    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103505    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103508    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103511    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 22:59:14.105187 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103514    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103517    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103520    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103524    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103528    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103531    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103534    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103537    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103540    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103543    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103545    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103548    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103551    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103556    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103559    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103562    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103566    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103569    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103573    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 22:59:14.105731 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103576    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103579    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103582    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103585    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103588    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103591    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103594    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103598    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103606    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103609    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103612    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103615    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103619    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103622    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103624    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103627    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103630    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103633    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103636    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103638    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 22:59:14.106269 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103641    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103644    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103647    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103650    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103653    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103656    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103659    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103662    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103664    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103668    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103671    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103674    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103677    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103679    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103682    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103686    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103689    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103692    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103695    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103698    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 22:59:14.106815 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103701    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103704    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103708    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103712    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103715    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103718    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103721    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103724    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103727    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103730    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103733    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103735    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103740    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103743    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103746    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103748    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.103751    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104203    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104209    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 22:59:14.107368 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104214    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104218    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104221    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104224    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104227    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104230    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104233    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104236    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104239    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104241    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104244    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104247    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104250    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104252    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104256    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104258    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104261    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104264    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104266    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104269    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 22:59:14.107872 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104272    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104274    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104277    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104280    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104283    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104288    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104290    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104293    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104296    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104299    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104301    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104304    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104307    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104310    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104313    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104316    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104319    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104321    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104324    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104327    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 22:59:14.108464 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104330    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104332    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104335    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104338    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104340    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104343    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104346    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104349    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104353    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104356    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104359    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104362    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104364    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104367    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104369    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104372    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104375    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104381    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104384    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104386    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 22:59:14.109000 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104389    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104392    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104394    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104397    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104400    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104403    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104406    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104409    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104412    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104415    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104418    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104420    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104423    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104426    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104428    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104431    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104435    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104438    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104440    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104443    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 22:59:14.109630 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104447    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104449    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104452    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104455    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104460    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104464    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104467    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104470    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104473    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104477    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104481    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104484    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104487    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104490    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104493    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104496    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.104499    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104584    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104594    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104600    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jun 10 22:59:14.110229 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104605    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104610    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104613    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104618    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104623    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104626    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104630    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104634    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104638    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104641    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104645    2577 flags.go:64] FLAG: --cgroup-root=""
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104648    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104651    2577 flags.go:64] FLAG: --client-ca-file=""
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104659    2577 flags.go:64] FLAG: --cloud-provider="external"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104662    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104670    2577 flags.go:64] FLAG: --cluster-domain=""
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104673    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104677    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104680    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104684    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104691    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104695    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104699    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104703    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 10 22:59:14.110761 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104706    2577 flags.go:64] FLAG: --contention-profiling="false"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104709    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104712    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104715    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104718    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104723    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104727    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104730    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104733    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104736    2577 flags.go:64] FLAG: --enable-server="true"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104739    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104746    2577 flags.go:64] FLAG: --event-burst="100"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104750    2577 flags.go:64] FLAG: --event-qps="50"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104753    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104756    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104759    2577 flags.go:64] FLAG: --eviction-hard=""
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104763    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104766    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104769    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104772    2577 flags.go:64] FLAG: --eviction-soft=""
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104775    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104778    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104785    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104788    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104791    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104794    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jun 10 22:59:14.111489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104797    2577 flags.go:64] FLAG: --feature-gates=""
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104801    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104804    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104807    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104811    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104814    2577 flags.go:64] FLAG: --healthz-port="10248"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104817    2577 flags.go:64] FLAG: --help="false"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104820    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104824    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104827    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104830    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104833    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104837    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104840    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104844    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104847    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104850    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104853    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104856    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104859    2577 flags.go:64] FLAG: --kube-reserved=""
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104862    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104865    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104869    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104872    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 10 22:59:14.112247 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104874    2577 flags.go:64] FLAG: --lock-file=""
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104877    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104880    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104884    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104889    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104893    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104896    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104899    2577 flags.go:64] FLAG: --logging-format="text"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104902    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104906    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104909    2577 flags.go:64] FLAG: --manifest-url=""
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104912    2577 flags.go:64] FLAG: --manifest-url-header=""
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104916    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104920    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104941    2577 flags.go:64] FLAG: --max-pods="110"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104946    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104962    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104965    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104968    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104972    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104975    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104979    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104987    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104990    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104994    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 10 22:59:14.112939 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.104997    2577 flags.go:64] FLAG: --pod-cidr=""
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105000    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105005    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105009    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105012    2577 flags.go:64] FLAG: --pods-per-core="0"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105015    2577 flags.go:64] FLAG: --port="10250"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105019    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105022    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0db4f3ee976f47728"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105025    2577 flags.go:64] FLAG: --qos-reserved=""
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105028    2577 flags.go:64] FLAG: --read-only-port="10255"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105032    2577 flags.go:64] FLAG: --register-node="true"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105035    2577 flags.go:64] FLAG: --register-with-taints=""
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105039    2577 flags.go:64] FLAG: --registry-burst="10"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105042    2577 flags.go:64] FLAG: --registry-qps="5"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105046    2577 flags.go:64] FLAG: --reserved-cpus=""
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105049    2577 flags.go:64] FLAG: --reserved-memory=""
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105053    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105056    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105060    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105063    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105066    2577 flags.go:64] FLAG: --runonce="false"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105069    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105072    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105075    2577 flags.go:64] FLAG: --seccomp-default="false"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105078    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 10 22:59:14.113624 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105081    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105084    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105087    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105091    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105094    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105097    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105100    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105103    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105106    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105109    2577 flags.go:64] FLAG: --system-cgroups=""
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105112    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105117    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105120    2577 flags.go:64] FLAG: --tls-cert-file=""
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105123    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105128    2577 flags.go:64] FLAG: --tls-min-version=""
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105131    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105134    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105137    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105140    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105143    2577 flags.go:64] FLAG: --v="2"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105147    2577 flags.go:64] FLAG: --version="false"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105155    2577 flags.go:64] FLAG: --vmodule=""
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105159    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.105162    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105279    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 22:59:14.114306 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105283    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105288    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105291    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105294    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105297    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105300    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105303    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105305    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105308    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105311    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105315    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105318    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105321    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105323    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105326    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105329    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105331    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105335    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105337    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105340    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 22:59:14.114998 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105343    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105346    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105348    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105352    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105355    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105357    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105360    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105363    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105366    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105369    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105372    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105375    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105379    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105385    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105388    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105391    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105393    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105396    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105399    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 22:59:14.115531 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105402    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105404    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105407    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105411    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105414    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105416    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105419    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105422    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105425    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105427    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105430    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105433    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105437    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105441    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105444    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105447    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105450    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105453    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105456    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 22:59:14.116044 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105460    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105463    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105465    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105469    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105473    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105477    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105480    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105484    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105487    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105490    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105492    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105495    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105498    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105501    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105504    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105507    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105511    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105514    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105516    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105519    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 22:59:14.116598 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105522    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105525    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105528    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105531    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105534    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105537    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105539    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105542    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105545    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105548    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105551    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105554    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105556    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105559    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105562    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105565    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105567    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105570    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105573    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 22:59:14.117303 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.105577    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 22:59:14.117934 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.106069    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 10 22:59:14.117934 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.113008    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 10 22:59:14.117934 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.113123    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 10 22:59:14.117934 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.113144    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 10 22:59:14.117934 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.113151    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 10 22:59:14.117934 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113212    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 22:59:14.117934 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113218    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 22:59:14.117934 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113222    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 22:59:14.117934 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113225    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 22:59:14.117934 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113229    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 22:59:14.117934 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113232    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 22:59:14.117934 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113235    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 22:59:14.117934 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113238    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 22:59:14.117934 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113241    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 22:59:14.117934 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113245    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113248    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113253    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113256    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113260    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113263    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113266    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113269    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113271    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113275    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113277    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113280    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113283    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113286    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113290    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113293    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113295    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113298    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113303    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 22:59:14.118463 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113307    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113312    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113315    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113318    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113321    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113324    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113327    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113330    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113333    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113336    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113339    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113341    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113344    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113347    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113350    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113353    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113355    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113358    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113361    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113364    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113366    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 22:59:14.118988 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113369    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113372    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113375    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113377    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113380    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113383    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113385    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113388    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113391    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113393    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113396    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113399    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113402    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113406    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113409    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113412    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113415    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113418    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113420    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113423    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 22:59:14.119659 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113426    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113429    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113431    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113434    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113437    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113439    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113442    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113445    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113447    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113450    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113452    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113455    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113458    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113461    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113463    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113466    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113468    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113471    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113474    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113477    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 22:59:14.120572 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113479    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 22:59:14.121178 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113482    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 22:59:14.121178 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113484    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 22:59:14.121178 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113487    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 22:59:14.121178 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113490    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 22:59:14.121178 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113493    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 22:59:14.121178 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113497    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 22:59:14.121178 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113501    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 22:59:14.121178 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113504    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 22:59:14.121178 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113508    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 22:59:14.121178 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.113513    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 10 22:59:14.121178 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113632    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 22:59:14.121178 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113636    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 22:59:14.121178 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113640    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 22:59:14.121178 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113643    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113646    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113648    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113651    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113654    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113657    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113660    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113663    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113665    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113668    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113671    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113674    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113676    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113679    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113682    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113685    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113688    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113690    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113693    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113696    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 22:59:14.121787 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113699    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113702    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113705    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113708    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113710    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113714    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113716    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113719    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113721    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113724    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113727    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113730    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113732    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113735    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113738    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113742    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113746    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113749    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113753    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 22:59:14.122899 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113756    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113759    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113763    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113767    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113770    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113773    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113776    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113779    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113781    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113785    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113789    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113793    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113796    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113799    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113802    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113804    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113807    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113810    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113813    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 22:59:14.123442 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113816    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113819    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113822    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113824    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113830    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113833    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113836    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113838    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113841    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113844    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113846    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113849    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113852    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113854    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113857    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113860    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113863    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113865    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113868    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113871    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 22:59:14.124148 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113874    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113877    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113879    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113882    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113885    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113888    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113890    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113893    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113896    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113898    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113901    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113904    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113907    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113910    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113913    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113916    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113920    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 22:59:14.125011 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:14.113941    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 22:59:14.125461 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.113947    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 10 22:59:14.125461 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.114055    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 10 22:59:14.125461 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.116023    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 10 22:59:14.125461 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.117257    2577 server.go:1019] "Starting client certificate rotation"
Jun 10 22:59:14.125461 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.117384    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 10 22:59:14.125461 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.117435    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 10 22:59:14.125461 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.119508    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 10 22:59:14.125461 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.121887    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 10 22:59:14.134351 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.134330    2577 log.go:25] "Validated CRI v1 runtime API"
Jun 10 22:59:14.136837 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.136821    2577 log.go:25] "Validated CRI v1 image API"
Jun 10 22:59:14.137816 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.137799    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 10 22:59:14.142775 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.142756    2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8ffff8da-370d-40c2-a3a3-fac6a4bd7fd4:/dev/nvme0n1p4 c33ac082-4fc7-4779-81d3-8193b49aed75:/dev/nvme0n1p3]
Jun 10 22:59:14.142848 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.142775    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 10 22:59:14.148536 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.148517    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 10 22:59:14.149442 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.149330    2577 manager.go:216] Machine: {Timestamp:2026-06-10 22:59:14.148048942 +0000 UTC m=+0.305673094 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099748 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23b2fca67f818e3c782b1e01cd992a SystemUUID:ec23b2fc-a67f-818e-3c78-2b1e01cd992a BootID:1a4c7a4e-6f3b-47e2-aca3-d40af27d6da4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a2:71:f7:3e:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a2:71:f7:3e:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:5d:61:f7:ec:c9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 10 22:59:14.149442 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.149440    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 10 22:59:14.149573 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.149561    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 10 22:59:14.152954 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.152912    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 10 22:59:14.153104 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.152955    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-238.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 10 22:59:14.153604 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.153595    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jun 10 22:59:14.153639 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.153606    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jun 10 22:59:14.153639 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.153615    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 10 22:59:14.154141 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.154131    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 10 22:59:14.154993 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.154982    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 10 22:59:14.157706 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.157694    2577 state_mem.go:36] "Initialized new in-memory state store"
Jun 10 22:59:14.157826 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.157816    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 10 22:59:14.157874 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.157848    2577 kubelet.go:486] "Attempting to sync node with API server"
Jun 10 22:59:14.157874 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.157859    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 10 22:59:14.157964 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.157878    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 10 22:59:14.157964 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.157891    2577 kubelet.go:398] "Adding apiserver pod source"
Jun 10 22:59:14.157964 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.157901    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 10 22:59:14.158308 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.158295    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 10 22:59:14.158351 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.158325    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 10 22:59:14.160925 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.160901    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 10 22:59:14.162674 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.162659    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 10 22:59:14.162747 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.162692    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 10 22:59:14.164201 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.164188    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 10 22:59:14.164242 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.164208    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 10 22:59:14.164242 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.164215    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 10 22:59:14.164242 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.164220    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 10 22:59:14.164242 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.164230    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 10 22:59:14.164242 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.164237    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 10 22:59:14.164456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.164245    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 10 22:59:14.164456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.164251    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 10 22:59:14.164456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.164265    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 10 22:59:14.164456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.164271    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 10 22:59:14.164456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.164281    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 10 22:59:14.164456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.164286    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 10 22:59:14.165525 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.165509    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 10 22:59:14.165525 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.165520    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 10 22:59:14.168823 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.168786    2577 server.go:1268] "Started kubelet"
Jun 10 22:59:14.169037 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.168998    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 10 22:59:14.169181 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.169135    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 10 22:59:14.169224 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.169203    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 10 22:59:14.170083 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.170049    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 10 22:59:14.170083 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.170068    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-238.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 10 22:59:14.170251 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.170063    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 10 22:59:14.170292 ip-10-0-129-238 systemd[1]: Started Kubernetes Kubelet.
Jun 10 22:59:14.170839 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.170746    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 10 22:59:14.174061 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.174045    2577 server.go:310] "Adding debug handlers to kubelet server"
Jun 10 22:59:14.174327 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.174307    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8g2ws"
Jun 10 22:59:14.176781 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.176759    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 10 22:59:14.177582 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.176682    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-238.ec2.internal.18b7da70742f23e9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-238.ec2.internal,UID:ip-10-0-129-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-238.ec2.internal,},FirstTimestamp:2026-06-10 22:59:14.168759273 +0000 UTC m=+0.326383424,LastTimestamp:2026-06-10 22:59:14.168759273 +0000 UTC m=+0.326383424,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-238.ec2.internal,}"
Jun 10 22:59:14.178109 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.178094    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 10 22:59:14.178172 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.178107    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 10 22:59:14.178238 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.178190    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-238.ec2.internal\" not found"
Jun 10 22:59:14.178711 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.178686    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 10 22:59:14.178711 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.178682    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 10 22:59:14.178711 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.178708    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 10 22:59:14.178905 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.178833    2577 reconstruct.go:97] "Volume reconstruction finished"
Jun 10 22:59:14.178905 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.178841    2577 reconciler.go:29] "Reconciler: start to sync state"
Jun 10 22:59:14.178905 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.178849    2577 factory.go:55] Registering systemd factory
Jun 10 22:59:14.178905 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.178866    2577 factory.go:223] Registration of the systemd container factory successfully
Jun 10 22:59:14.179113 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.179094    2577 factory.go:153] Registering CRI-O factory
Jun 10 22:59:14.179206 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.179131    2577 factory.go:223] Registration of the crio container factory successfully
Jun 10 22:59:14.179206 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.179191    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 10 22:59:14.179321 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.179239    2577 factory.go:103] Registering Raw factory
Jun 10 22:59:14.179321 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.179257    2577 manager.go:1196] Started watching for new ooms in manager
Jun 10 22:59:14.179655 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.179641    2577 manager.go:349] Starting recovery of all containers
Jun 10 22:59:14.182736 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.182716    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8g2ws"
Jun 10 22:59:14.187541 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.187494    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 10 22:59:14.189228 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.189209    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 22:59:14.191693 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.191669    2577 manager.go:354] Recovery completed
Jun 10 22:59:14.192899 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.192879    2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-238.ec2.internal\" not found" node="ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.196838 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.196823    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 22:59:14.199016 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.199000    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 22:59:14.199093 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.199028    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 22:59:14.199093 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.199039    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasSufficientPID"
Jun 10 22:59:14.199558 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.199546    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 10 22:59:14.199558 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.199557    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 10 22:59:14.199688 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.199572    2577 state_mem.go:36] "Initialized new in-memory state store"
Jun 10 22:59:14.199688 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.199609    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 22:59:14.200385 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.200370    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 22:59:14.200435 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.200406    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 22:59:14.200435 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.200416    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasSufficientPID"
Jun 10 22:59:14.200618 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.200606    2577 policy_none.go:49] "None policy: Start"
Jun 10 22:59:14.200655 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.200622    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 10 22:59:14.200655 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.200633    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 10 22:59:14.201486 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.201474    2577 policy_none.go:47] "Start"
Jun 10 22:59:14.237456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.237444    2577 manager.go:337] "Starting Device Plugin manager"
Jun 10 22:59:14.254078 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.237489    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 10 22:59:14.254078 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.237499    2577 server.go:87] "Starting device plugin registration server"
Jun 10 22:59:14.254078 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.237716    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 10 22:59:14.254078 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.237725    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 10 22:59:14.254078 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.237816    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 10 22:59:14.254078 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.237910    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 10 22:59:14.254078 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.237920    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 10 22:59:14.254078 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.238658    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 10 22:59:14.254078 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.238695    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-238.ec2.internal\" not found"
Jun 10 22:59:14.254078 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.250554    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 10 22:59:14.254078 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.250592    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 10 22:59:14.254078 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.250610    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 10 22:59:14.254078 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.250676    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 10 22:59:14.254078 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.252954    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 22:59:14.338276 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.338243    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 22:59:14.340168 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.339409    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 22:59:14.340168 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.339440    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 22:59:14.340168 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.339457    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasSufficientPID"
Jun 10 22:59:14.340168 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.339487    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.346050 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.346035    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.346115 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.346057    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-238.ec2.internal\": node \"ip-10-0-129-238.ec2.internal\" not found"
Jun 10 22:59:14.351230 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.351205    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-238.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal"]
Jun 10 22:59:14.351350 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.351259    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 22:59:14.352893 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.352878    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 22:59:14.352994 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.352911    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 22:59:14.352994 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.352927    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasSufficientPID"
Jun 10 22:59:14.355352 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.355337    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 22:59:14.355493 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.355477    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.355544 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.355508    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 22:59:14.355986 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.355965    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 22:59:14.355986 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.355969    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 22:59:14.355986 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.355986    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 22:59:14.356119 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.355998    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 22:59:14.356119 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.356000    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasSufficientPID"
Jun 10 22:59:14.356119 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.356009    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasSufficientPID"
Jun 10 22:59:14.358357 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.358340    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.358443 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.358367    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 22:59:14.358992 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.358976    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 22:59:14.359045 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.359009    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 22:59:14.359045 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.359024    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeHasSufficientPID"
Jun 10 22:59:14.360121 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.360105    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-238.ec2.internal\" not found"
Jun 10 22:59:14.392171 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.392154    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-238.ec2.internal\" not found" node="ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.396519 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.396504    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-238.ec2.internal\" not found" node="ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.461063 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.461041    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-238.ec2.internal\" not found"
Jun 10 22:59:14.480426 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.480410    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4905a97957f0b6e1e96afb558749aa2f-config\") pod \"kube-apiserver-proxy-ip-10-0-129-238.ec2.internal\" (UID: \"4905a97957f0b6e1e96afb558749aa2f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.480500 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.480432    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1a92010168dfc2481af23b31187210e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal\" (UID: \"a1a92010168dfc2481af23b31187210e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.480500 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.480449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1a92010168dfc2481af23b31187210e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal\" (UID: \"a1a92010168dfc2481af23b31187210e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.561774 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.561749    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-238.ec2.internal\" not found"
Jun 10 22:59:14.581113 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.581090    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4905a97957f0b6e1e96afb558749aa2f-config\") pod \"kube-apiserver-proxy-ip-10-0-129-238.ec2.internal\" (UID: \"4905a97957f0b6e1e96afb558749aa2f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.581162 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.581122    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4905a97957f0b6e1e96afb558749aa2f-config\") pod \"kube-apiserver-proxy-ip-10-0-129-238.ec2.internal\" (UID: \"4905a97957f0b6e1e96afb558749aa2f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.581162 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.581158    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1a92010168dfc2481af23b31187210e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal\" (UID: \"a1a92010168dfc2481af23b31187210e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.581238 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.581184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1a92010168dfc2481af23b31187210e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal\" (UID: \"a1a92010168dfc2481af23b31187210e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.581238 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.581218    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1a92010168dfc2481af23b31187210e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal\" (UID: \"a1a92010168dfc2481af23b31187210e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.581310 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.581244    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1a92010168dfc2481af23b31187210e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal\" (UID: \"a1a92010168dfc2481af23b31187210e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.662554 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.662479    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-238.ec2.internal\" not found"
Jun 10 22:59:14.699007 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.698986    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.703876 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:14.703522    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal"
Jun 10 22:59:14.763023 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.762998    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-238.ec2.internal\" not found"
Jun 10 22:59:14.863464 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.863438    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-238.ec2.internal\" not found"
Jun 10 22:59:14.964011 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:14.963951    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-238.ec2.internal\" not found"
Jun 10 22:59:15.064547 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:15.064520    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-238.ec2.internal\" not found"
Jun 10 22:59:15.117067 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:15.117041    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 10 22:59:15.117653 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:15.117196    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 10 22:59:15.117653 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:15.117227    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 10 22:59:15.165580 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:15.165548    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-238.ec2.internal\" not found"
Jun 10 22:59:15.185701 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:15.185664    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 22:54:14 +0000 UTC" deadline="2027-12-27 10:48:41.786328169 +0000 UTC"
Jun 10 22:59:15.185701 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:15.185693    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13547h49m26.600638502s"
Jun 10 22:59:15.263910 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:15.263682    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a92010168dfc2481af23b31187210e.slice/crio-bcacd825b8b8bb5eccb32fb1e722ab8531d3cea11bd0721a8e32d598dcddec13 WatchSource:0}: Error finding container bcacd825b8b8bb5eccb32fb1e722ab8531d3cea11bd0721a8e32d598dcddec13: Status 404 returned error can't find the container with id bcacd825b8b8bb5eccb32fb1e722ab8531d3cea11bd0721a8e32d598dcddec13
Jun 10 22:59:15.264939 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:15.264664    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4905a97957f0b6e1e96afb558749aa2f.slice/crio-4cd56e2cd41946c3ff90a47cfacb8a65e9b3be6da99c1b8635cf8463b184f6f3 WatchSource:0}: Error finding container 4cd56e2cd41946c3ff90a47cfacb8a65e9b3be6da99c1b8635cf8463b184f6f3: Status 404 returned error can't find the container with id 4cd56e2cd41946c3ff90a47cfacb8a65e9b3be6da99c1b8635cf8463b184f6f3
Jun 10 22:59:15.265805 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:15.265778    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-238.ec2.internal\" not found"
Jun 10 22:59:15.269524 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:15.269507    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 10 22:59:15.366420 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:15.366368    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-238.ec2.internal\" not found"
Jun 10 22:59:15.466927 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:15.466889    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-238.ec2.internal\" not found"
Jun 10 22:59:15.567440 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:15.567355    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-238.ec2.internal\" not found"
Jun 10 22:59:15.590026 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:15.590005    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 22:59:15.603293 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:15.603272    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 22:59:15.678398 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:15.678370    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-238.ec2.internal"
Jun 10 22:59:15.686357 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:15.686333    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 10 22:59:15.687650 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:15.687629    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal"
Jun 10 22:59:15.698154 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:15.698132    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 10 22:59:16.159439 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.159394    2577 apiserver.go:52] "Watching apiserver"
Jun 10 22:59:16.165439 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.165412    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 10 22:59:16.165780 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.165752    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-66kn9","openshift-ovn-kubernetes/ovnkube-node-kknpk","kube-system/global-pull-secret-syncer-wp785","kube-system/konnectivity-agent-7zpbf","openshift-cluster-node-tuning-operator/tuned-k64f6","openshift-image-registry/node-ca-klpjf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal","openshift-multus/multus-2hrj6","openshift-multus/multus-additional-cni-plugins-8ddnh","openshift-network-diagnostics/network-check-target-r4m9t","kube-system/kube-apiserver-proxy-ip-10-0-129-238.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg","openshift-dns/node-resolver-pm4l7","openshift-multus/network-metrics-daemon-fjp6x"]
Jun 10 22:59:16.168460 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.168440    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:16.168563 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.168516    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:16.170542 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.170523    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pm4l7"
Jun 10 22:59:16.172409 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.172315    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 10 22:59:16.172409 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.172354    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kdlbr\""
Jun 10 22:59:16.172583 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.172492    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 10 22:59:16.172831 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.172812    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:16.172934 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.172906    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:16.174934 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.174918    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7zpbf"
Jun 10 22:59:16.176703 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.176676    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 10 22:59:16.176970 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.176820    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vlgzx\""
Jun 10 22:59:16.176970 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.176896    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 10 22:59:16.177865 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.177838    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.178822 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.178788    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 10 22:59:16.179677 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.179658    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 10 22:59:16.179759 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.179677    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 10 22:59:16.179759 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.179664    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2blx8\""
Jun 10 22:59:16.180038 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.180020    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-klpjf"
Jun 10 22:59:16.181958 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.181941    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 10 22:59:16.182111 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.182095    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 10 22:59:16.182368 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.182349    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ss89m\""
Jun 10 22:59:16.182455 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.182416    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.182518 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.182357    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 10 22:59:16.184910 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.184823    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:16.184999 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.184911    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:16.185584 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.185554    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 10 22:59:16.185669 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.185599    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 10 22:59:16.186543 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.186526    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 10 22:59:16.186626 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.186605    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 10 22:59:16.186710 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.186667    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 10 22:59:16.186766 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.186735    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-j7jc4\""
Jun 10 22:59:16.187374 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.187357    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.189301 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.189282    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 10 22:59:16.189525 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.189510    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 10 22:59:16.189989 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.189903    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 10 22:59:16.190089 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.190058    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-66kn9"
Jun 10 22:59:16.191124 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191103    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hcfgz\""
Jun 10 22:59:16.191216 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191145    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/da6cc932-e39a-4812-bb40-eaa50d9cffc3-kubelet-config\") pod \"global-pull-secret-syncer-wp785\" (UID: \"da6cc932-e39a-4812-bb40-eaa50d9cffc3\") " pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:16.191216 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-run\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.191311 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191214    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-lib-modules\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.191311 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191244    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fad7168-329e-4592-b5cb-8ff587c89170-host\") pod \"node-ca-klpjf\" (UID: \"2fad7168-329e-4592-b5cb-8ff587c89170\") " pod="openshift-image-registry/node-ca-klpjf"
Jun 10 22:59:16.191311 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191272    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbdd8a79-2cc9-4647-9bc0-011d06190661-tmp\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.191311 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191302    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-kubernetes\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.191497 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191324    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-var-lib-kubelet\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.191497 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl4zm\" (UniqueName: \"kubernetes.io/projected/fbdd8a79-2cc9-4647-9bc0-011d06190661-kube-api-access-wl4zm\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.191497 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191377    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe618dc0-9887-4d65-b68a-afdb1ce1365e-tmp-dir\") pod \"node-resolver-pm4l7\" (UID: \"fe618dc0-9887-4d65-b68a-afdb1ce1365e\") " pod="openshift-dns/node-resolver-pm4l7"
Jun 10 22:59:16.191497 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191410    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 10 22:59:16.191497 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191412    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-sysctl-conf\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.191732 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191526    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-sys\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.191732 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191565    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-host\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.191732 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191601    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fe618dc0-9887-4d65-b68a-afdb1ce1365e-hosts-file\") pod \"node-resolver-pm4l7\" (UID: \"fe618dc0-9887-4d65-b68a-afdb1ce1365e\") " pod="openshift-dns/node-resolver-pm4l7"
Jun 10 22:59:16.191879 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191820    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/da6cc932-e39a-4812-bb40-eaa50d9cffc3-dbus\") pod \"global-pull-secret-syncer-wp785\" (UID: \"da6cc932-e39a-4812-bb40-eaa50d9cffc3\") " pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:16.191931 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79d6d16a-a58d-4ecc-822c-da7ef30808d3-konnectivity-ca\") pod \"konnectivity-agent-7zpbf\" (UID: \"79d6d16a-a58d-4ecc-822c-da7ef30808d3\") " pod="kube-system/konnectivity-agent-7zpbf"
Jun 10 22:59:16.191979 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191929    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-sysctl-d\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.191979 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191961    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-systemd\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.192067 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.191987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt6wk\" (UniqueName: \"kubernetes.io/projected/fe618dc0-9887-4d65-b68a-afdb1ce1365e-kube-api-access-zt6wk\") pod \"node-resolver-pm4l7\" (UID: \"fe618dc0-9887-4d65-b68a-afdb1ce1365e\") " pod="openshift-dns/node-resolver-pm4l7"
Jun 10 22:59:16.192067 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.192021    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-sysconfig\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.192067 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.192058    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-tuned\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.192191 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.192090    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4gnc\" (UniqueName: \"kubernetes.io/projected/2fad7168-329e-4592-b5cb-8ff587c89170-kube-api-access-f4gnc\") pod \"node-ca-klpjf\" (UID: \"2fad7168-329e-4592-b5cb-8ff587c89170\") " pod="openshift-image-registry/node-ca-klpjf"
Jun 10 22:59:16.192191 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.192123    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret\") pod \"global-pull-secret-syncer-wp785\" (UID: \"da6cc932-e39a-4812-bb40-eaa50d9cffc3\") " pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:16.192191 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.192148    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-modprobe-d\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.192191 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.192177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79d6d16a-a58d-4ecc-822c-da7ef30808d3-agent-certs\") pod \"konnectivity-agent-7zpbf\" (UID: \"79d6d16a-a58d-4ecc-822c-da7ef30808d3\") " pod="kube-system/konnectivity-agent-7zpbf"
Jun 10 22:59:16.192362 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.192205    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2fad7168-329e-4592-b5cb-8ff587c89170-serviceca\") pod \"node-ca-klpjf\" (UID: \"2fad7168-329e-4592-b5cb-8ff587c89170\") " pod="openshift-image-registry/node-ca-klpjf"
Jun 10 22:59:16.192362 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.192236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j842\" (UniqueName: \"kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842\") pod \"network-check-target-r4m9t\" (UID: \"38af1105-bec2-4a3c-b858-d21151d7496b\") " pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:16.193738 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.193593    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 10 22:59:16.193738 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.193713    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 10 22:59:16.193935 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.193903    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 10 22:59:16.194012 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.193954    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.194571 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.194542    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 10 22:59:16.194663 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.194618    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 10 22:59:16.194830 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.194809    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sp28j\""
Jun 10 22:59:16.196426 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.196407    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 10 22:59:16.196571 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.196553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.196884 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.196864    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 10 22:59:16.197036 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.197013    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bwgq7\""
Jun 10 22:59:16.198150 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.198135    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 10 22:59:16.198565 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.198549    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 10 22:59:16.198926 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.198911    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 10 22:59:16.199067 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.198916    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pkjnd\""
Jun 10 22:59:16.203427 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.203408    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 22:59:16.216830 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.216811    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vddlr"
Jun 10 22:59:16.224268 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.224250    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vddlr"
Jun 10 22:59:16.255151 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.255100    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal" event={"ID":"a1a92010168dfc2481af23b31187210e","Type":"ContainerStarted","Data":"bcacd825b8b8bb5eccb32fb1e722ab8531d3cea11bd0721a8e32d598dcddec13"}
Jun 10 22:59:16.256466 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.256440    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-238.ec2.internal" event={"ID":"4905a97957f0b6e1e96afb558749aa2f","Type":"ContainerStarted","Data":"4cd56e2cd41946c3ff90a47cfacb8a65e9b3be6da99c1b8635cf8463b184f6f3"}
Jun 10 22:59:16.279570 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.279551    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 10 22:59:16.292539 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.292454    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-var-lib-kubelet\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.292647 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.292555    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-var-lib-kubelet\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.292647 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.292602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl4zm\" (UniqueName: \"kubernetes.io/projected/fbdd8a79-2cc9-4647-9bc0-011d06190661-kube-api-access-wl4zm\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.292647 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.292641    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-os-release\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.292804 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.292660    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.292804 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.292683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-log-socket\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.292804 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.292708    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.292804 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.292731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8eeae4f-82f1-4943-a69e-35e48a56a277-host-slash\") pod \"iptables-alerter-66kn9\" (UID: \"c8eeae4f-82f1-4943-a69e-35e48a56a277\") " pod="openshift-network-operator/iptables-alerter-66kn9"
Jun 10 22:59:16.292804 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.292773    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-cni-bin\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.293070 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.292818    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.293070 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.292884    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-sysctl-conf\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.293070 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.292918    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-host\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.293070 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.292961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fe618dc0-9887-4d65-b68a-afdb1ce1365e-hosts-file\") pod \"node-resolver-pm4l7\" (UID: \"fe618dc0-9887-4d65-b68a-afdb1ce1365e\") " pod="openshift-dns/node-resolver-pm4l7"
Jun 10 22:59:16.293070 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.292988    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-host\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.293070 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293009    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.293070 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293041    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wprg5\" (UniqueName: \"kubernetes.io/projected/4425be81-8f51-4c34-8d00-7a454584e0bf-kube-api-access-wprg5\") pod \"network-metrics-daemon-fjp6x\" (UID: \"4425be81-8f51-4c34-8d00-7a454584e0bf\") " pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:16.293070 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293066    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fe618dc0-9887-4d65-b68a-afdb1ce1365e-hosts-file\") pod \"node-resolver-pm4l7\" (UID: \"fe618dc0-9887-4d65-b68a-afdb1ce1365e\") " pod="openshift-dns/node-resolver-pm4l7"
Jun 10 22:59:16.293364 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293070    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-multus-cni-dir\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.293364 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293110    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-sysctl-conf\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.293364 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/da6cc932-e39a-4812-bb40-eaa50d9cffc3-dbus\") pod \"global-pull-secret-syncer-wp785\" (UID: \"da6cc932-e39a-4812-bb40-eaa50d9cffc3\") " pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:16.293364 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293141    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79d6d16a-a58d-4ecc-822c-da7ef30808d3-konnectivity-ca\") pod \"konnectivity-agent-7zpbf\" (UID: \"79d6d16a-a58d-4ecc-822c-da7ef30808d3\") " pod="kube-system/konnectivity-agent-7zpbf"
Jun 10 22:59:16.293364 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293169    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scn6q\" (UniqueName: \"kubernetes.io/projected/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-kube-api-access-scn6q\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.293364 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293194    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-run-systemd\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.293364 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293215    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-system-cni-dir\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.293364 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293220    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/da6cc932-e39a-4812-bb40-eaa50d9cffc3-dbus\") pod \"global-pull-secret-syncer-wp785\" (UID: \"da6cc932-e39a-4812-bb40-eaa50d9cffc3\") " pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:16.293364 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293240    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-tuned\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.293364 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293262    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4gnc\" (UniqueName: \"kubernetes.io/projected/2fad7168-329e-4592-b5cb-8ff587c89170-kube-api-access-f4gnc\") pod \"node-ca-klpjf\" (UID: \"2fad7168-329e-4592-b5cb-8ff587c89170\") " pod="openshift-image-registry/node-ca-klpjf"
Jun 10 22:59:16.293364 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293292    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ab10782-c80c-4c40-8534-2e087ac816f0-ovn-node-metrics-cert\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.293364 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293319    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-var-lib-cni-multus\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.293364 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293355    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-sys-fs\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.293841 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-systemd-units\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.293841 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293420    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-run-openvswitch\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.293841 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5ab10782-c80c-4c40-8534-2e087ac816f0-ovnkube-script-lib\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.293841 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293477    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-hostroot\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.293841 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293498    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/49dd3977-df64-419b-b61b-160c02078017-multus-daemon-config\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.293841 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293520    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.293841 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79d6d16a-a58d-4ecc-822c-da7ef30808d3-agent-certs\") pod \"konnectivity-agent-7zpbf\" (UID: \"79d6d16a-a58d-4ecc-822c-da7ef30808d3\") " pod="kube-system/konnectivity-agent-7zpbf"
Jun 10 22:59:16.293841 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293611    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j842\" (UniqueName: \"kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842\") pod \"network-check-target-r4m9t\" (UID: \"38af1105-bec2-4a3c-b858-d21151d7496b\") " pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:16.293841 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293639    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-cni-netd\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.293841 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293665    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tqtq\" (UniqueName: \"kubernetes.io/projected/c8eeae4f-82f1-4943-a69e-35e48a56a277-kube-api-access-4tqtq\") pod \"iptables-alerter-66kn9\" (UID: \"c8eeae4f-82f1-4943-a69e-35e48a56a277\") " pod="openshift-network-operator/iptables-alerter-66kn9"
Jun 10 22:59:16.293841 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293692    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-var-lib-cni-bin\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.293841 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293718    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/da6cc932-e39a-4812-bb40-eaa50d9cffc3-kubelet-config\") pod \"global-pull-secret-syncer-wp785\" (UID: \"da6cc932-e39a-4812-bb40-eaa50d9cffc3\") " pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:16.293841 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293741    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-run\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.293841 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293752    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293891    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-lib-modules\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293667    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79d6d16a-a58d-4ecc-822c-da7ef30808d3-konnectivity-ca\") pod \"konnectivity-agent-7zpbf\" (UID: \"79d6d16a-a58d-4ecc-822c-da7ef30808d3\") " pod="kube-system/konnectivity-agent-7zpbf"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-lib-modules\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293982    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-run\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.293988    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/da6cc932-e39a-4812-bb40-eaa50d9cffc3-kubelet-config\") pod \"global-pull-secret-syncer-wp785\" (UID: \"da6cc932-e39a-4812-bb40-eaa50d9cffc3\") " pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fad7168-329e-4592-b5cb-8ff587c89170-host\") pod \"node-ca-klpjf\" (UID: \"2fad7168-329e-4592-b5cb-8ff587c89170\") " pod="openshift-image-registry/node-ca-klpjf"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294040    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gr6c\" (UniqueName: \"kubernetes.io/projected/5ab10782-c80c-4c40-8534-2e087ac816f0-kube-api-access-9gr6c\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294121    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-cnibin\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294151    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-multus-socket-dir-parent\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294166    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fad7168-329e-4592-b5cb-8ff587c89170-host\") pod \"node-ca-klpjf\" (UID: \"2fad7168-329e-4592-b5cb-8ff587c89170\") " pod="openshift-image-registry/node-ca-klpjf"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-run-k8s-cni-cncf-io\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294201    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-kubelet\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-run-ovn\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294248    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-socket-dir\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294269    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-device-dir\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.294456 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe618dc0-9887-4d65-b68a-afdb1ce1365e-tmp-dir\") pod \"node-resolver-pm4l7\" (UID: \"fe618dc0-9887-4d65-b68a-afdb1ce1365e\") " pod="openshift-dns/node-resolver-pm4l7"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-sys\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294345    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-etc-kubernetes\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294370    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-sysctl-d\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-systemd\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294409    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-sys\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294414    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt6wk\" (UniqueName: \"kubernetes.io/projected/fe618dc0-9887-4d65-b68a-afdb1ce1365e-kube-api-access-zt6wk\") pod \"node-resolver-pm4l7\" (UID: \"fe618dc0-9887-4d65-b68a-afdb1ce1365e\") " pod="openshift-dns/node-resolver-pm4l7"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294456    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-var-lib-openvswitch\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-etc-openvswitch\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294498    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs\") pod \"network-metrics-daemon-fjp6x\" (UID: \"4425be81-8f51-4c34-8d00-7a454584e0bf\") " pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294474    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-systemd\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-sysconfig\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49dd3977-df64-419b-b61b-160c02078017-cni-binary-copy\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294577    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-run-netns\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294607    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-run-multus-certs\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294609    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-sysconfig\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294637    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22g62\" (UniqueName: \"kubernetes.io/projected/49dd3977-df64-419b-b61b-160c02078017-kube-api-access-22g62\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.295274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294665    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294673    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe618dc0-9887-4d65-b68a-afdb1ce1365e-tmp-dir\") pod \"node-resolver-pm4l7\" (UID: \"fe618dc0-9887-4d65-b68a-afdb1ce1365e\") " pod="openshift-dns/node-resolver-pm4l7"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294693    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret\") pod \"global-pull-secret-syncer-wp785\" (UID: \"da6cc932-e39a-4812-bb40-eaa50d9cffc3\") " pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294723    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-modprobe-d\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294729    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-sysctl-d\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-system-cni-dir\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294879    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-run-netns\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294906    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5ab10782-c80c-4c40-8534-2e087ac816f0-env-overrides\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.294969    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c8eeae4f-82f1-4943-a69e-35e48a56a277-iptables-alerter-script\") pod \"iptables-alerter-66kn9\" (UID: \"c8eeae4f-82f1-4943-a69e-35e48a56a277\") " pod="openshift-network-operator/iptables-alerter-66kn9"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.295001    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2fad7168-329e-4592-b5cb-8ff587c89170-serviceca\") pod \"node-ca-klpjf\" (UID: \"2fad7168-329e-4592-b5cb-8ff587c89170\") " pod="openshift-image-registry/node-ca-klpjf"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.295025    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-cnibin\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.295048    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-modprobe-d\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.295063    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-slash\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.295181    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-os-release\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.295214    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-registration-dir\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.295250    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-node-log\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.295275    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-var-lib-kubelet\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.296027 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.295303    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfg9w\" (UniqueName: \"kubernetes.io/projected/53db5d28-63f6-4d4f-af42-7758dccad5aa-kube-api-access-rfg9w\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.296791 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.295330    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbdd8a79-2cc9-4647-9bc0-011d06190661-tmp\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.296791 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.295364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.296791 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.295402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5ab10782-c80c-4c40-8534-2e087ac816f0-ovnkube-config\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.296791 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.295425    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-multus-conf-dir\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.296791 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.295452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-kubernetes\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.296791 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.295481    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2fad7168-329e-4592-b5cb-8ff587c89170-serviceca\") pod \"node-ca-klpjf\" (UID: \"2fad7168-329e-4592-b5cb-8ff587c89170\") " pod="openshift-image-registry/node-ca-klpjf"
Jun 10 22:59:16.296791 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.295558    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-kubernetes\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.296791 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.295602    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 22:59:16.296791 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.295698    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret podName:da6cc932-e39a-4812-bb40-eaa50d9cffc3 nodeName:}" failed. No retries permitted until 2026-06-10 22:59:16.795678809 +0000 UTC m=+2.953302945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret") pod "global-pull-secret-syncer-wp785" (UID: "da6cc932-e39a-4812-bb40-eaa50d9cffc3") : object "kube-system"/"original-pull-secret" not registered
Jun 10 22:59:16.297260 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.297240    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbdd8a79-2cc9-4647-9bc0-011d06190661-etc-tuned\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.297427 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.297409    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79d6d16a-a58d-4ecc-822c-da7ef30808d3-agent-certs\") pod \"konnectivity-agent-7zpbf\" (UID: \"79d6d16a-a58d-4ecc-822c-da7ef30808d3\") " pod="kube-system/konnectivity-agent-7zpbf"
Jun 10 22:59:16.297664 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.297636    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbdd8a79-2cc9-4647-9bc0-011d06190661-tmp\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.298414 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.298377    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 22:59:16.298414 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.298403    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 22:59:16.298414 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.298417    2577 projected.go:196] Error preparing data for projected volume kube-api-access-6j842 for pod openshift-network-diagnostics/network-check-target-r4m9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 22:59:16.298635 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.298486    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842 podName:38af1105-bec2-4a3c-b858-d21151d7496b nodeName:}" failed. No retries permitted until 2026-06-10 22:59:16.79846628 +0000 UTC m=+2.956090436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6j842" (UniqueName: "kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842") pod "network-check-target-r4m9t" (UID: "38af1105-bec2-4a3c-b858-d21151d7496b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 22:59:16.300499 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.300468    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4gnc\" (UniqueName: \"kubernetes.io/projected/2fad7168-329e-4592-b5cb-8ff587c89170-kube-api-access-f4gnc\") pod \"node-ca-klpjf\" (UID: \"2fad7168-329e-4592-b5cb-8ff587c89170\") " pod="openshift-image-registry/node-ca-klpjf"
Jun 10 22:59:16.300645 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.300624    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl4zm\" (UniqueName: \"kubernetes.io/projected/fbdd8a79-2cc9-4647-9bc0-011d06190661-kube-api-access-wl4zm\") pod \"tuned-k64f6\" (UID: \"fbdd8a79-2cc9-4647-9bc0-011d06190661\") " pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.304218 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.304000    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt6wk\" (UniqueName: \"kubernetes.io/projected/fe618dc0-9887-4d65-b68a-afdb1ce1365e-kube-api-access-zt6wk\") pod \"node-resolver-pm4l7\" (UID: \"fe618dc0-9887-4d65-b68a-afdb1ce1365e\") " pod="openshift-dns/node-resolver-pm4l7"
Jun 10 22:59:16.396502 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396470    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-os-release\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.396502 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396503    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.396706 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-log-socket\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.396706 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.396706 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8eeae4f-82f1-4943-a69e-35e48a56a277-host-slash\") pod \"iptables-alerter-66kn9\" (UID: \"c8eeae4f-82f1-4943-a69e-35e48a56a277\") " pod="openshift-network-operator/iptables-alerter-66kn9"
Jun 10 22:59:16.396706 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-cni-bin\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.396706 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396620    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.396706 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396624    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-os-release\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.396706 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.396706 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396663    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wprg5\" (UniqueName: \"kubernetes.io/projected/4425be81-8f51-4c34-8d00-7a454584e0bf-kube-api-access-wprg5\") pod \"network-metrics-daemon-fjp6x\" (UID: \"4425be81-8f51-4c34-8d00-7a454584e0bf\") " pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:16.396706 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396667    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.396706 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396678    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-multus-cni-dir\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.396706 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scn6q\" (UniqueName: \"kubernetes.io/projected/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-kube-api-access-scn6q\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396716    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-run-systemd\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-system-cni-dir\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396758    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ab10782-c80c-4c40-8534-2e087ac816f0-ovn-node-metrics-cert\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396777    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-var-lib-cni-multus\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396800    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-sys-fs\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396815    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-systemd-units\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396841    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-run-openvswitch\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396862    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-log-socket\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5ab10782-c80c-4c40-8534-2e087ac816f0-ovnkube-script-lib\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-hostroot\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396906    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8eeae4f-82f1-4943-a69e-35e48a56a277-host-slash\") pod \"iptables-alerter-66kn9\" (UID: \"c8eeae4f-82f1-4943-a69e-35e48a56a277\") " pod="openshift-network-operator/iptables-alerter-66kn9"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396911    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/49dd3977-df64-419b-b61b-160c02078017-multus-daemon-config\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396929    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-cni-bin\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.396975    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-cni-netd\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.397147 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397002    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tqtq\" (UniqueName: \"kubernetes.io/projected/c8eeae4f-82f1-4943-a69e-35e48a56a277-kube-api-access-4tqtq\") pod \"iptables-alerter-66kn9\" (UID: \"c8eeae4f-82f1-4943-a69e-35e48a56a277\") " pod="openshift-network-operator/iptables-alerter-66kn9"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397026    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-var-lib-cni-bin\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397034    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-run-openvswitch\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397033    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-systemd-units\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gr6c\" (UniqueName: \"kubernetes.io/projected/5ab10782-c80c-4c40-8534-2e087ac816f0-kube-api-access-9gr6c\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397100    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-cnibin\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397149    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-multus-socket-dir-parent\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397121    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-multus-cni-dir\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397175    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-run-k8s-cni-cncf-io\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397195    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-cni-netd\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397201    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-kubelet\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397248    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-kubelet\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397290    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-run-systemd\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397343    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-system-cni-dir\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397002    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-etc-selinux\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397469    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-run-ovn\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-socket-dir\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.397915 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397500    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-hostroot\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397513    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-device-dir\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397573    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-device-dir\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397613    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-socket-dir\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397615    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397615    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5ab10782-c80c-4c40-8534-2e087ac816f0-ovnkube-script-lib\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397072    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-var-lib-cni-bin\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397688    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-sys-fs\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397691    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-var-lib-cni-multus\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397729    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-etc-kubernetes\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397755    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-multus-socket-dir-parent\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397790    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-run-ovn\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397796    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-cnibin\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397833    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-etc-kubernetes\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397901    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-run-k8s-cni-cncf-io\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-var-lib-openvswitch\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.398786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.397980    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-etc-openvswitch\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398031    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-var-lib-openvswitch\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398083    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-etc-openvswitch\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs\") pod \"network-metrics-daemon-fjp6x\" (UID: \"4425be81-8f51-4c34-8d00-7a454584e0bf\") " pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49dd3977-df64-419b-b61b-160c02078017-cni-binary-copy\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-run-netns\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398192    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-run-multus-certs\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398198    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.398215    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398168    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/49dd3977-df64-419b-b61b-160c02078017-multus-daemon-config\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398242    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-run-netns\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398256    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-run-multus-certs\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.398273    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs podName:4425be81-8f51-4c34-8d00-7a454584e0bf nodeName:}" failed. No retries permitted until 2026-06-10 22:59:16.898253848 +0000 UTC m=+3.055878007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs") pod "network-metrics-daemon-fjp6x" (UID: "4425be81-8f51-4c34-8d00-7a454584e0bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398218    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22g62\" (UniqueName: \"kubernetes.io/projected/49dd3977-df64-419b-b61b-160c02078017-kube-api-access-22g62\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398310    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398342    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-system-cni-dir\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-run-netns\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.399470 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398378    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5ab10782-c80c-4c40-8534-2e087ac816f0-env-overrides\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398415    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398425    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-system-cni-dir\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c8eeae4f-82f1-4943-a69e-35e48a56a277-iptables-alerter-script\") pod \"iptables-alerter-66kn9\" (UID: \"c8eeae4f-82f1-4943-a69e-35e48a56a277\") " pod="openshift-network-operator/iptables-alerter-66kn9"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398474    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-cnibin\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398473    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-run-netns\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-slash\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-os-release\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398521    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-cnibin\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398563    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-registration-dir\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398564    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49dd3977-df64-419b-b61b-160c02078017-cni-binary-copy\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398574    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-host-slash\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-node-log\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398608    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-var-lib-kubelet\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398613    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-os-release\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398621    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53db5d28-63f6-4d4f-af42-7758dccad5aa-registration-dir\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfg9w\" (UniqueName: \"kubernetes.io/projected/53db5d28-63f6-4d4f-af42-7758dccad5aa-kube-api-access-rfg9w\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.400082 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.400647 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398662    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-host-var-lib-kubelet\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.400647 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398659    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5ab10782-c80c-4c40-8534-2e087ac816f0-node-log\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.400647 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398682    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5ab10782-c80c-4c40-8534-2e087ac816f0-ovnkube-config\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.400647 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-multus-conf-dir\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.400647 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398775    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49dd3977-df64-419b-b61b-160c02078017-multus-conf-dir\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.400647 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.398790    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5ab10782-c80c-4c40-8534-2e087ac816f0-env-overrides\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.400647 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.399005    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c8eeae4f-82f1-4943-a69e-35e48a56a277-iptables-alerter-script\") pod \"iptables-alerter-66kn9\" (UID: \"c8eeae4f-82f1-4943-a69e-35e48a56a277\") " pod="openshift-network-operator/iptables-alerter-66kn9"
Jun 10 22:59:16.400647 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.399157    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-cni-binary-copy\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.400647 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.399157    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5ab10782-c80c-4c40-8534-2e087ac816f0-ovnkube-config\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.400647 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.400008    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ab10782-c80c-4c40-8534-2e087ac816f0-ovn-node-metrics-cert\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.408627 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.408567    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tqtq\" (UniqueName: \"kubernetes.io/projected/c8eeae4f-82f1-4943-a69e-35e48a56a277-kube-api-access-4tqtq\") pod \"iptables-alerter-66kn9\" (UID: \"c8eeae4f-82f1-4943-a69e-35e48a56a277\") " pod="openshift-network-operator/iptables-alerter-66kn9"
Jun 10 22:59:16.408908 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.408842    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gr6c\" (UniqueName: \"kubernetes.io/projected/5ab10782-c80c-4c40-8534-2e087ac816f0-kube-api-access-9gr6c\") pod \"ovnkube-node-kknpk\" (UID: \"5ab10782-c80c-4c40-8534-2e087ac816f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.409020 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.408998    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22g62\" (UniqueName: \"kubernetes.io/projected/49dd3977-df64-419b-b61b-160c02078017-kube-api-access-22g62\") pod \"multus-2hrj6\" (UID: \"49dd3977-df64-419b-b61b-160c02078017\") " pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.409781 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.409694    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wprg5\" (UniqueName: \"kubernetes.io/projected/4425be81-8f51-4c34-8d00-7a454584e0bf-kube-api-access-wprg5\") pod \"network-metrics-daemon-fjp6x\" (UID: \"4425be81-8f51-4c34-8d00-7a454584e0bf\") " pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:16.410931 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.410909    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scn6q\" (UniqueName: \"kubernetes.io/projected/8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd-kube-api-access-scn6q\") pod \"multus-additional-cni-plugins-8ddnh\" (UID: \"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd\") " pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.411026 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.410983    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfg9w\" (UniqueName: \"kubernetes.io/projected/53db5d28-63f6-4d4f-af42-7758dccad5aa-kube-api-access-rfg9w\") pod \"aws-ebs-csi-driver-node-5sjcg\" (UID: \"53db5d28-63f6-4d4f-af42-7758dccad5aa\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.455786 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.455759    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 22:59:16.482238 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.482214    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pm4l7"
Jun 10 22:59:16.490274 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.490256    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7zpbf"
Jun 10 22:59:16.501301 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.501284    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k64f6"
Jun 10 22:59:16.505922 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.505903    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-klpjf"
Jun 10 22:59:16.513614 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.513598    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8ddnh"
Jun 10 22:59:16.520810 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.520792    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:16.527802 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.527785    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-66kn9"
Jun 10 22:59:16.533305 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.533285    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2hrj6"
Jun 10 22:59:16.538975 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.538956    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg"
Jun 10 22:59:16.801735 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.801667    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret\") pod \"global-pull-secret-syncer-wp785\" (UID: \"da6cc932-e39a-4812-bb40-eaa50d9cffc3\") " pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:16.801866 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.801752    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j842\" (UniqueName: \"kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842\") pod \"network-check-target-r4m9t\" (UID: \"38af1105-bec2-4a3c-b858-d21151d7496b\") " pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:16.801866 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.801802    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 22:59:16.801966 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.801878    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 22:59:16.801966 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.801886    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret podName:da6cc932-e39a-4812-bb40-eaa50d9cffc3 nodeName:}" failed. No retries permitted until 2026-06-10 22:59:17.801842342 +0000 UTC m=+3.959466482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret") pod "global-pull-secret-syncer-wp785" (UID: "da6cc932-e39a-4812-bb40-eaa50d9cffc3") : object "kube-system"/"original-pull-secret" not registered
Jun 10 22:59:16.801966 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.801899    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 22:59:16.801966 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.801912    2577 projected.go:196] Error preparing data for projected volume kube-api-access-6j842 for pod openshift-network-diagnostics/network-check-target-r4m9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 22:59:16.801966 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.801954    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842 podName:38af1105-bec2-4a3c-b858-d21151d7496b nodeName:}" failed. No retries permitted until 2026-06-10 22:59:17.801943164 +0000 UTC m=+3.959567299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6j842" (UniqueName: "kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842") pod "network-check-target-r4m9t" (UID: "38af1105-bec2-4a3c-b858-d21151d7496b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 22:59:16.902900 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:16.902872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs\") pod \"network-metrics-daemon-fjp6x\" (UID: \"4425be81-8f51-4c34-8d00-7a454584e0bf\") " pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:16.903060 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.903032    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 22:59:16.903138 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:16.903101    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs podName:4425be81-8f51-4c34-8d00-7a454584e0bf nodeName:}" failed. No retries permitted until 2026-06-10 22:59:17.903081617 +0000 UTC m=+4.060705752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs") pod "network-metrics-daemon-fjp6x" (UID: "4425be81-8f51-4c34-8d00-7a454584e0bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 22:59:17.159918 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:17.159889    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8eeae4f_82f1_4943_a69e_35e48a56a277.slice/crio-d8864a7e5f6f23fc646c383aa24b221a5d18feeac860200124f0adb866887820 WatchSource:0}: Error finding container d8864a7e5f6f23fc646c383aa24b221a5d18feeac860200124f0adb866887820: Status 404 returned error can't find the container with id d8864a7e5f6f23fc646c383aa24b221a5d18feeac860200124f0adb866887820
Jun 10 22:59:17.161114 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:17.161087    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fad7168_329e_4592_b5cb_8ff587c89170.slice/crio-8ed05301a7f1fa72e0e2c5140a775452f19ecfc354d80b738538d4ab7085ea5b WatchSource:0}: Error finding container 8ed05301a7f1fa72e0e2c5140a775452f19ecfc354d80b738538d4ab7085ea5b: Status 404 returned error can't find the container with id 8ed05301a7f1fa72e0e2c5140a775452f19ecfc354d80b738538d4ab7085ea5b
Jun 10 22:59:17.164395 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:17.164376    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab10782_c80c_4c40_8534_2e087ac816f0.slice/crio-9f192d492a738a8b4497e13bdf80eb74f0e0b6ccde7341da2a5712d9d09d64ea WatchSource:0}: Error finding container 9f192d492a738a8b4497e13bdf80eb74f0e0b6ccde7341da2a5712d9d09d64ea: Status 404 returned error can't find the container with id 9f192d492a738a8b4497e13bdf80eb74f0e0b6ccde7341da2a5712d9d09d64ea
Jun 10 22:59:17.165999 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:17.165978    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d6d16a_a58d_4ecc_822c_da7ef30808d3.slice/crio-aa1ca6c3274c37e920f03163f0dba06a8936cca708035eeddc77bdb6a059581c WatchSource:0}: Error finding container aa1ca6c3274c37e920f03163f0dba06a8936cca708035eeddc77bdb6a059581c: Status 404 returned error can't find the container with id aa1ca6c3274c37e920f03163f0dba06a8936cca708035eeddc77bdb6a059581c
Jun 10 22:59:17.166807 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:17.166772    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53db5d28_63f6_4d4f_af42_7758dccad5aa.slice/crio-535a29f594ae50d6138cfa7db402f142fe4d7bb882a2e4a0e22c21b72cc4c2a9 WatchSource:0}: Error finding container 535a29f594ae50d6138cfa7db402f142fe4d7bb882a2e4a0e22c21b72cc4c2a9: Status 404 returned error can't find the container with id 535a29f594ae50d6138cfa7db402f142fe4d7bb882a2e4a0e22c21b72cc4c2a9
Jun 10 22:59:17.168414 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:17.168393    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe618dc0_9887_4d65_b68a_afdb1ce1365e.slice/crio-5b5c3d81dda9f6f4b6ab7b094f6823aef4933a14847a27ff3843ae1a2f128141 WatchSource:0}: Error finding container 5b5c3d81dda9f6f4b6ab7b094f6823aef4933a14847a27ff3843ae1a2f128141: Status 404 returned error can't find the container with id 5b5c3d81dda9f6f4b6ab7b094f6823aef4933a14847a27ff3843ae1a2f128141
Jun 10 22:59:17.169786 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:17.169765    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa3aad2_0571_4ab9_b5cf_8f5cd68172bd.slice/crio-0081a339e362f90f618554e083c3cb8ce188e83d314cfed1db723361047645ec WatchSource:0}: Error finding container 0081a339e362f90f618554e083c3cb8ce188e83d314cfed1db723361047645ec: Status 404 returned error can't find the container with id 0081a339e362f90f618554e083c3cb8ce188e83d314cfed1db723361047645ec
Jun 10 22:59:17.170723 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:17.170679    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbdd8a79_2cc9_4647_9bc0_011d06190661.slice/crio-5c651ddcaa06512da7caae687fd3fe37616aa23275ba8f2ff500ea62a74fedb3 WatchSource:0}: Error finding container 5c651ddcaa06512da7caae687fd3fe37616aa23275ba8f2ff500ea62a74fedb3: Status 404 returned error can't find the container with id 5c651ddcaa06512da7caae687fd3fe37616aa23275ba8f2ff500ea62a74fedb3
Jun 10 22:59:17.228595 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:17.228548    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 22:54:16 +0000 UTC" deadline="2027-11-15 07:16:53.174599594 +0000 UTC"
Jun 10 22:59:17.228595 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:17.228594    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12536h17m35.946009355s"
Jun 10 22:59:17.259831 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:17.259799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k64f6" event={"ID":"fbdd8a79-2cc9-4647-9bc0-011d06190661","Type":"ContainerStarted","Data":"5c651ddcaa06512da7caae687fd3fe37616aa23275ba8f2ff500ea62a74fedb3"}
Jun 10 22:59:17.260899 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:17.260871    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pm4l7" event={"ID":"fe618dc0-9887-4d65-b68a-afdb1ce1365e","Type":"ContainerStarted","Data":"5b5c3d81dda9f6f4b6ab7b094f6823aef4933a14847a27ff3843ae1a2f128141"}
Jun 10 22:59:17.262008 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:17.261983    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7zpbf" event={"ID":"79d6d16a-a58d-4ecc-822c-da7ef30808d3","Type":"ContainerStarted","Data":"aa1ca6c3274c37e920f03163f0dba06a8936cca708035eeddc77bdb6a059581c"}
Jun 10 22:59:17.263231 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:17.263205    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-klpjf" event={"ID":"2fad7168-329e-4592-b5cb-8ff587c89170","Type":"ContainerStarted","Data":"8ed05301a7f1fa72e0e2c5140a775452f19ecfc354d80b738538d4ab7085ea5b"}
Jun 10 22:59:17.266165 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:17.266144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8ddnh" event={"ID":"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd","Type":"ContainerStarted","Data":"0081a339e362f90f618554e083c3cb8ce188e83d314cfed1db723361047645ec"}
Jun 10 22:59:17.267279 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:17.267252    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg" event={"ID":"53db5d28-63f6-4d4f-af42-7758dccad5aa","Type":"ContainerStarted","Data":"535a29f594ae50d6138cfa7db402f142fe4d7bb882a2e4a0e22c21b72cc4c2a9"}
Jun 10 22:59:17.268413 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:17.268394    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk" event={"ID":"5ab10782-c80c-4c40-8534-2e087ac816f0","Type":"ContainerStarted","Data":"9f192d492a738a8b4497e13bdf80eb74f0e0b6ccde7341da2a5712d9d09d64ea"}
Jun 10 22:59:17.269558 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:17.269523    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-66kn9" event={"ID":"c8eeae4f-82f1-4943-a69e-35e48a56a277","Type":"ContainerStarted","Data":"d8864a7e5f6f23fc646c383aa24b221a5d18feeac860200124f0adb866887820"}
Jun 10 22:59:17.270534 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:17.270506    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2hrj6" event={"ID":"49dd3977-df64-419b-b61b-160c02078017","Type":"ContainerStarted","Data":"0b89cacfdfc5a69dba9f7f86787aa527edd33739ec2cdca89f040dd093f22b5b"}
Jun 10 22:59:17.809105 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:17.809020    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j842\" (UniqueName: \"kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842\") pod \"network-check-target-r4m9t\" (UID: \"38af1105-bec2-4a3c-b858-d21151d7496b\") " pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:17.809276 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:17.809105    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret\") pod \"global-pull-secret-syncer-wp785\" (UID: \"da6cc932-e39a-4812-bb40-eaa50d9cffc3\") " pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:17.809374 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:17.809355    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 22:59:17.809431 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:17.809382    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 22:59:17.809431 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:17.809395    2577 projected.go:196] Error preparing data for projected volume kube-api-access-6j842 for pod openshift-network-diagnostics/network-check-target-r4m9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 22:59:17.809531 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:17.809454    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842 podName:38af1105-bec2-4a3c-b858-d21151d7496b nodeName:}" failed. No retries permitted until 2026-06-10 22:59:19.809435122 +0000 UTC m=+5.967059272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6j842" (UniqueName: "kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842") pod "network-check-target-r4m9t" (UID: "38af1105-bec2-4a3c-b858-d21151d7496b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 22:59:17.809871 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:17.809829    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 22:59:17.809970 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:17.809895    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret podName:da6cc932-e39a-4812-bb40-eaa50d9cffc3 nodeName:}" failed. No retries permitted until 2026-06-10 22:59:19.80988114 +0000 UTC m=+5.967505281 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret") pod "global-pull-secret-syncer-wp785" (UID: "da6cc932-e39a-4812-bb40-eaa50d9cffc3") : object "kube-system"/"original-pull-secret" not registered
Jun 10 22:59:17.910234 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:17.909655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs\") pod \"network-metrics-daemon-fjp6x\" (UID: \"4425be81-8f51-4c34-8d00-7a454584e0bf\") " pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:17.910234 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:17.909821    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 22:59:17.910234 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:17.909906    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs podName:4425be81-8f51-4c34-8d00-7a454584e0bf nodeName:}" failed. No retries permitted until 2026-06-10 22:59:19.909883877 +0000 UTC m=+6.067508016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs") pod "network-metrics-daemon-fjp6x" (UID: "4425be81-8f51-4c34-8d00-7a454584e0bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 22:59:18.229050 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:18.229006    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 22:54:16 +0000 UTC" deadline="2028-01-11 07:42:46.524426374 +0000 UTC"
Jun 10 22:59:18.229050 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:18.229047    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13904h43m28.295383767s"
Jun 10 22:59:18.254366 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:18.253562    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:18.254366 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:18.253688    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:18.254366 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:18.254081    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:18.254366 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:18.254176    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:18.254366 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:18.254239    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:18.254366 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:18.254318    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:18.282580 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:18.282548    2577 generic.go:356] "Generic (PLEG): container finished" podID="a1a92010168dfc2481af23b31187210e" containerID="b7447b4337647191c6caf1b4335b9254e4fa734df928dd1662ed88299c079325" exitCode=0
Jun 10 22:59:18.282741 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:18.282638    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal" event={"ID":"a1a92010168dfc2481af23b31187210e","Type":"ContainerDied","Data":"b7447b4337647191c6caf1b4335b9254e4fa734df928dd1662ed88299c079325"}
Jun 10 22:59:18.292989 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:18.292937    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-238.ec2.internal" event={"ID":"4905a97957f0b6e1e96afb558749aa2f","Type":"ContainerStarted","Data":"1314fa0805197c5359158dccd7af7dc2cc41f19c06b4f4ff5f25fdbdb7c36d38"}
Jun 10 22:59:19.307233 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:19.307193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal" event={"ID":"a1a92010168dfc2481af23b31187210e","Type":"ContainerStarted","Data":"817a6a4e637e5d79d20a4ec5679a84c09be57b52c36ce2e78afd8c9d135ced90"}
Jun 10 22:59:19.327337 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:19.327272    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-238.ec2.internal" podStartSLOduration=4.327254412 podStartE2EDuration="4.327254412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 22:59:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 22:59:18.315979638 +0000 UTC m=+4.473603798" watchObservedRunningTime="2026-06-10 22:59:19.327254412 +0000 UTC m=+5.484878571"
Jun 10 22:59:19.833670 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:19.833633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret\") pod \"global-pull-secret-syncer-wp785\" (UID: \"da6cc932-e39a-4812-bb40-eaa50d9cffc3\") " pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:19.833874 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:19.833712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j842\" (UniqueName: \"kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842\") pod \"network-check-target-r4m9t\" (UID: \"38af1105-bec2-4a3c-b858-d21151d7496b\") " pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:19.833951 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:19.833878    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 22:59:19.833951 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:19.833895    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 22:59:19.833951 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:19.833908    2577 projected.go:196] Error preparing data for projected volume kube-api-access-6j842 for pod openshift-network-diagnostics/network-check-target-r4m9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 22:59:19.834105 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:19.833965    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842 podName:38af1105-bec2-4a3c-b858-d21151d7496b nodeName:}" failed. No retries permitted until 2026-06-10 22:59:23.833947707 +0000 UTC m=+9.991571846 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6j842" (UniqueName: "kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842") pod "network-check-target-r4m9t" (UID: "38af1105-bec2-4a3c-b858-d21151d7496b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 22:59:19.834398 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:19.834372    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 22:59:19.834469 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:19.834434    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret podName:da6cc932-e39a-4812-bb40-eaa50d9cffc3 nodeName:}" failed. No retries permitted until 2026-06-10 22:59:23.834416882 +0000 UTC m=+9.992041021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret") pod "global-pull-secret-syncer-wp785" (UID: "da6cc932-e39a-4812-bb40-eaa50d9cffc3") : object "kube-system"/"original-pull-secret" not registered
Jun 10 22:59:19.934593 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:19.934558    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs\") pod \"network-metrics-daemon-fjp6x\" (UID: \"4425be81-8f51-4c34-8d00-7a454584e0bf\") " pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:19.934771 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:19.934760    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 22:59:19.934830 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:19.934824    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs podName:4425be81-8f51-4c34-8d00-7a454584e0bf nodeName:}" failed. No retries permitted until 2026-06-10 22:59:23.934804805 +0000 UTC m=+10.092428944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs") pod "network-metrics-daemon-fjp6x" (UID: "4425be81-8f51-4c34-8d00-7a454584e0bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 22:59:20.252184 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:20.251432    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:20.252184 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:20.251566    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:20.252184 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:20.251974    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:20.252184 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:20.252083    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:20.252184 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:20.252150    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:20.252554 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:20.252222    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:22.251875 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:22.251507    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:22.251875 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:22.251642    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:22.252378 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:22.252032    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:22.252378 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:22.252136    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:22.252378 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:22.252269    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:22.252523 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:22.252380    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:23.867512 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:23.867137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j842\" (UniqueName: \"kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842\") pod \"network-check-target-r4m9t\" (UID: \"38af1105-bec2-4a3c-b858-d21151d7496b\") " pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:23.867512 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:23.867203    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret\") pod \"global-pull-secret-syncer-wp785\" (UID: \"da6cc932-e39a-4812-bb40-eaa50d9cffc3\") " pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:23.867512 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:23.867317    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 22:59:23.867512 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:23.867342    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 22:59:23.867512 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:23.867367    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 22:59:23.867512 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:23.867381    2577 projected.go:196] Error preparing data for projected volume kube-api-access-6j842 for pod openshift-network-diagnostics/network-check-target-r4m9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 22:59:23.867512 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:23.867385    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret podName:da6cc932-e39a-4812-bb40-eaa50d9cffc3 nodeName:}" failed. No retries permitted until 2026-06-10 22:59:31.867366003 +0000 UTC m=+18.024990142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret") pod "global-pull-secret-syncer-wp785" (UID: "da6cc932-e39a-4812-bb40-eaa50d9cffc3") : object "kube-system"/"original-pull-secret" not registered
Jun 10 22:59:23.867512 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:23.867434    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842 podName:38af1105-bec2-4a3c-b858-d21151d7496b nodeName:}" failed. No retries permitted until 2026-06-10 22:59:31.867417428 +0000 UTC m=+18.025041578 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6j842" (UniqueName: "kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842") pod "network-check-target-r4m9t" (UID: "38af1105-bec2-4a3c-b858-d21151d7496b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 22:59:23.968201 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:23.968166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs\") pod \"network-metrics-daemon-fjp6x\" (UID: \"4425be81-8f51-4c34-8d00-7a454584e0bf\") " pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:23.968376 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:23.968359    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 22:59:23.968456 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:23.968424    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs podName:4425be81-8f51-4c34-8d00-7a454584e0bf nodeName:}" failed. No retries permitted until 2026-06-10 22:59:31.968405857 +0000 UTC m=+18.126030013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs") pod "network-metrics-daemon-fjp6x" (UID: "4425be81-8f51-4c34-8d00-7a454584e0bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 22:59:24.255016 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:24.254951    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:24.255140 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:24.255061    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:24.255468 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:24.255448    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:24.255592 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:24.255570    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:24.255687 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:24.255666    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:24.255974 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:24.255952    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:26.251724 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:26.251107    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:26.251724 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:26.251111    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:26.251724 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:26.251241    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:26.251724 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:26.251334    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:26.251724 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:26.251123    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:26.251724 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:26.251445    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:28.251969 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:28.251711    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:28.252437 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:28.251730    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:28.252437 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:28.252075    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:28.252437 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:28.251805    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:28.252437 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:28.252161    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:28.252437 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:28.252242    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:30.250936 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:30.250839    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:30.250936 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:30.250873    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:30.250936 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:30.250895    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:30.251492 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:30.250988    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:30.251492 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:30.251087    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:30.251492 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:30.251170    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:31.935380 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:31.935338    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j842\" (UniqueName: \"kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842\") pod \"network-check-target-r4m9t\" (UID: \"38af1105-bec2-4a3c-b858-d21151d7496b\") " pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:31.935794 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:31.935420    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret\") pod \"global-pull-secret-syncer-wp785\" (UID: \"da6cc932-e39a-4812-bb40-eaa50d9cffc3\") " pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:31.935794 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:31.935478    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 22:59:31.935794 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:31.935500    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 22:59:31.935794 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:31.935510    2577 projected.go:196] Error preparing data for projected volume kube-api-access-6j842 for pod openshift-network-diagnostics/network-check-target-r4m9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 22:59:31.935794 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:31.935558    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 22:59:31.935794 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:31.935566    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842 podName:38af1105-bec2-4a3c-b858-d21151d7496b nodeName:}" failed. No retries permitted until 2026-06-10 22:59:47.935549938 +0000 UTC m=+34.093174091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6j842" (UniqueName: "kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842") pod "network-check-target-r4m9t" (UID: "38af1105-bec2-4a3c-b858-d21151d7496b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 22:59:31.935794 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:31.935616    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret podName:da6cc932-e39a-4812-bb40-eaa50d9cffc3 nodeName:}" failed. No retries permitted until 2026-06-10 22:59:47.935599802 +0000 UTC m=+34.093223942 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret") pod "global-pull-secret-syncer-wp785" (UID: "da6cc932-e39a-4812-bb40-eaa50d9cffc3") : object "kube-system"/"original-pull-secret" not registered
Jun 10 22:59:32.035844 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:32.035807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs\") pod \"network-metrics-daemon-fjp6x\" (UID: \"4425be81-8f51-4c34-8d00-7a454584e0bf\") " pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:32.036021 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:32.035950    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 22:59:32.036021 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:32.036012    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs podName:4425be81-8f51-4c34-8d00-7a454584e0bf nodeName:}" failed. No retries permitted until 2026-06-10 22:59:48.035995212 +0000 UTC m=+34.193619348 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs") pod "network-metrics-daemon-fjp6x" (UID: "4425be81-8f51-4c34-8d00-7a454584e0bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 22:59:32.251841 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:32.251760    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:32.252113 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:32.251773    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:32.252113 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:32.251900    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:32.252113 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:32.251773    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:32.252113 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:32.251988    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:32.252113 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:32.252065    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:34.252597 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:34.252557    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:34.253053 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:34.252663    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:34.253053 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:34.252680    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:34.253053 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:34.252706    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:34.253053 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:34.252754    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:34.253053 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:34.252834    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:36.251607 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.251352    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:36.252539 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.251348    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:36.252539 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:36.251701    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:36.252539 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.251417    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:36.252539 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:36.251755    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:36.252539 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:36.251821    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:36.336570 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.336360    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2hrj6" event={"ID":"49dd3977-df64-419b-b61b-160c02078017","Type":"ContainerStarted","Data":"e67e71725b478b963e96fe815f3e0d325bbf3564f6e5a81cb5a11964786598b9"}
Jun 10 22:59:36.338242 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.338194    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k64f6" event={"ID":"fbdd8a79-2cc9-4647-9bc0-011d06190661","Type":"ContainerStarted","Data":"8e769e8bac3a081b5b28572a3cccba08a814deba70f17854f7e5099459fd2184"}
Jun 10 22:59:36.345208 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.344666    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pm4l7" event={"ID":"fe618dc0-9887-4d65-b68a-afdb1ce1365e","Type":"ContainerStarted","Data":"aeafb1c2d008391854d4b3d40b745a1c2ba3bbb8f35d38a001113d568ca5fdd6"}
Jun 10 22:59:36.346739 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.346718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7zpbf" event={"ID":"79d6d16a-a58d-4ecc-822c-da7ef30808d3","Type":"ContainerStarted","Data":"1c09f8739cfd2edb2353f78fea50692539d30d71c67be7d075411b141397421c"}
Jun 10 22:59:36.348192 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.348167    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-klpjf" event={"ID":"2fad7168-329e-4592-b5cb-8ff587c89170","Type":"ContainerStarted","Data":"78509aa500bcfb55f4973d967b732fd56069cae578a3d68a63c275ab696e5610"}
Jun 10 22:59:36.349986 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.349894    2577 generic.go:356] "Generic (PLEG): container finished" podID="8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd" containerID="0d83f03d649c640d502e6d7c5f9c0c9d08f895bb6d94cfd450e50b58ac45dbd5" exitCode=0
Jun 10 22:59:36.349986 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.349959    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8ddnh" event={"ID":"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd","Type":"ContainerDied","Data":"0d83f03d649c640d502e6d7c5f9c0c9d08f895bb6d94cfd450e50b58ac45dbd5"}
Jun 10 22:59:36.351630 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.351550    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg" event={"ID":"53db5d28-63f6-4d4f-af42-7758dccad5aa","Type":"ContainerStarted","Data":"e096e2632c720e5dc9d213f4ca6eec718f455654dcabfe120a34843252c9d151"}
Jun 10 22:59:36.355289 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.355248    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-238.ec2.internal" podStartSLOduration=21.355232021 podStartE2EDuration="21.355232021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 22:59:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 22:59:19.328499489 +0000 UTC m=+5.486123648" watchObservedRunningTime="2026-06-10 22:59:36.355232021 +0000 UTC m=+22.512856179"
Jun 10 22:59:36.355612 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.355579    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 22:59:36.355952 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.355931    2577 generic.go:356] "Generic (PLEG): container finished" podID="5ab10782-c80c-4c40-8534-2e087ac816f0" containerID="aed36b9cde40293537e15e6a66ac22d0c989790d9077bf52eb18eb7375be77fb" exitCode=1
Jun 10 22:59:36.356050 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.355960    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk" event={"ID":"5ab10782-c80c-4c40-8534-2e087ac816f0","Type":"ContainerStarted","Data":"cd708b1a0224362aa2d021908ba6f04c79439946285eabead78e1edca0a11a8e"}
Jun 10 22:59:36.356050 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.356017    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk" event={"ID":"5ab10782-c80c-4c40-8534-2e087ac816f0","Type":"ContainerStarted","Data":"6beb89cb20afce07db5f305777995585e0779718b1627a95e65b039e41989ebb"}
Jun 10 22:59:36.356167 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.356052    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk" event={"ID":"5ab10782-c80c-4c40-8534-2e087ac816f0","Type":"ContainerStarted","Data":"10bca752d32be95b00831342e0a6b221bb4cc99e4fbd280d69b7beaad13d2ff4"}
Jun 10 22:59:36.356167 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.356079    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk" event={"ID":"5ab10782-c80c-4c40-8534-2e087ac816f0","Type":"ContainerDied","Data":"aed36b9cde40293537e15e6a66ac22d0c989790d9077bf52eb18eb7375be77fb"}
Jun 10 22:59:36.356167 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.356120    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk" event={"ID":"5ab10782-c80c-4c40-8534-2e087ac816f0","Type":"ContainerStarted","Data":"41450962c3f2c30f168e5b6dcfd3761debd332acff247d8e69959396bb48d91b"}
Jun 10 22:59:36.375644 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.375577    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2hrj6" podStartSLOduration=3.805386354 podStartE2EDuration="22.375558275s" totalImagesPullingTime="18.570171921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 22:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 22:59:36.355553656 +0000 UTC m=+22.513177825" watchObservedRunningTime="2026-06-10 22:59:36.375558275 +0000 UTC m=+22.533182454"
Jun 10 22:59:36.392968 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.392923    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pm4l7" podStartSLOduration=3.881365601 podStartE2EDuration="22.392905499s" totalImagesPullingTime="18.511539898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 22:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 22:59:36.392881113 +0000 UTC m=+22.550505270" watchObservedRunningTime="2026-06-10 22:59:36.392905499 +0000 UTC m=+22.550529658"
Jun 10 22:59:36.422332 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.422282    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7zpbf" podStartSLOduration=8.553863602 podStartE2EDuration="22.422264149s" totalImagesPullingTime="13.868400547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 22:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 22:59:36.406980229 +0000 UTC m=+22.564604397" watchObservedRunningTime="2026-06-10 22:59:36.422264149 +0000 UTC m=+22.579888308"
Jun 10 22:59:36.422453 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:36.422381    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k64f6" podStartSLOduration=3.861794061 podStartE2EDuration="22.422374588s" totalImagesPullingTime="18.560580527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 22:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 22:59:36.422226226 +0000 UTC m=+22.579850386" watchObservedRunningTime="2026-06-10 22:59:36.422374588 +0000 UTC m=+22.579998751"
Jun 10 22:59:37.183501 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:37.183351    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 10 22:59:37.250537 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:37.250438    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T22:59:37.183489543Z","UUID":"f6ecbd06-91d4-42c9-b02e-9c37a1c39ba1","Handler":null,"Name":"","Endpoint":""}
Jun 10 22:59:37.252521 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:37.252499    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 10 22:59:37.252984 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:37.252555    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 10 22:59:37.360643 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:37.360609    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg" event={"ID":"53db5d28-63f6-4d4f-af42-7758dccad5aa","Type":"ContainerStarted","Data":"c97b62f25e619c2b616fc4d89f7743e1258150e6254ccede3d08d146cc9b8209"}
Jun 10 22:59:37.363975 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:37.363949    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 22:59:37.364366 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:37.364342    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk" event={"ID":"5ab10782-c80c-4c40-8534-2e087ac816f0","Type":"ContainerStarted","Data":"e081e058454e102c7972458bff39165e9765b2523319e6bf5fc91f65299c6fc9"}
Jun 10 22:59:37.365889 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:37.365817    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-66kn9" event={"ID":"c8eeae4f-82f1-4943-a69e-35e48a56a277","Type":"ContainerStarted","Data":"f8ab39ece3bde00de89279502a6b5c270a21635a50d3d884a5e30b301e456992"}
Jun 10 22:59:37.379250 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:37.379213    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-klpjf" podStartSLOduration=4.860025455 podStartE2EDuration="23.379197938s" totalImagesPullingTime="18.519172483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 22:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 22:59:36.437607122 +0000 UTC m=+22.595231280" watchObservedRunningTime="2026-06-10 22:59:37.379197938 +0000 UTC m=+23.536822095"
Jun 10 22:59:37.379643 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:37.379613    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-66kn9" podStartSLOduration=4.805355787 podStartE2EDuration="23.379606826s" totalImagesPullingTime="18.574251039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 22:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 22:59:37.379085547 +0000 UTC m=+23.536709706" watchObservedRunningTime="2026-06-10 22:59:37.379606826 +0000 UTC m=+23.537230981"
Jun 10 22:59:38.251180 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:38.251148    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:38.251316 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:38.251160    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:38.251316 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:38.251274    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:38.251316 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:38.251287    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:38.251478 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:38.251382    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:38.251540 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:38.251476    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:38.370297 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:38.370222    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg" event={"ID":"53db5d28-63f6-4d4f-af42-7758dccad5aa","Type":"ContainerStarted","Data":"ea90ed9435b422bb4cfafbfa8bc88d8944ff5ada05df8df2b2339d45ea83aa39"}
Jun 10 22:59:38.386962 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:38.386923    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sjcg" podStartSLOduration=3.7428773509999997 podStartE2EDuration="24.386908714s" totalImagesPullingTime="20.644031363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 22:59:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 22:59:38.386125729 +0000 UTC m=+24.543749888" watchObservedRunningTime="2026-06-10 22:59:38.386908714 +0000 UTC m=+24.544532906"
Jun 10 22:59:39.376901 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:39.376844    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 22:59:39.377424 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:39.377290    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk" event={"ID":"5ab10782-c80c-4c40-8534-2e087ac816f0","Type":"ContainerStarted","Data":"5ed4aff5637919898134afb823687b3d08f679272077ccf553eac912544efc75"}
Jun 10 22:59:40.251645 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:40.251609    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:40.251645 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:40.251636    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:40.251877 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:40.251726    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:40.251877 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:40.251805    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:40.251877 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:40.251825    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:40.251993 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:40.251920    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:40.715037 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:40.714877    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7zpbf"
Jun 10 22:59:40.715627 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:40.715606    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7zpbf"
Jun 10 22:59:41.383044 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:41.383012    2577 generic.go:356] "Generic (PLEG): container finished" podID="8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd" containerID="a9f2a384338609d99adf69b11a6deb4fd354aa1ba3f038a0922d2a11e6e948cb" exitCode=0
Jun 10 22:59:41.383241 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:41.383098    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8ddnh" event={"ID":"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd","Type":"ContainerDied","Data":"a9f2a384338609d99adf69b11a6deb4fd354aa1ba3f038a0922d2a11e6e948cb"}
Jun 10 22:59:41.386696 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:41.386674    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 22:59:41.387171 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:41.387131    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk" event={"ID":"5ab10782-c80c-4c40-8534-2e087ac816f0","Type":"ContainerStarted","Data":"21c827aa8a02699aa457367b838c6bb010baba2c71a702c3462ba2c3bb76397e"}
Jun 10 22:59:41.387521 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:41.387507    2577 scope.go:117] "RemoveContainer" containerID="aed36b9cde40293537e15e6a66ac22d0c989790d9077bf52eb18eb7375be77fb"
Jun 10 22:59:42.251906 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.251718    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:42.252260 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:42.251961    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:42.252260 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.251787    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:42.252260 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:42.252042    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:42.252260 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.251727    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:42.252260 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:42.252102    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:42.391177 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.391148    2577 generic.go:356] "Generic (PLEG): container finished" podID="8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd" containerID="fa08c59524208af6320641aea5cc4e7c7c2a0a70728c43b573872ecfc2eccd99" exitCode=0
Jun 10 22:59:42.391312 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.391229    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8ddnh" event={"ID":"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd","Type":"ContainerDied","Data":"fa08c59524208af6320641aea5cc4e7c7c2a0a70728c43b573872ecfc2eccd99"}
Jun 10 22:59:42.395221 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.395204    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 22:59:42.395613 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.395587    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk" event={"ID":"5ab10782-c80c-4c40-8534-2e087ac816f0","Type":"ContainerStarted","Data":"7a28f20812652f8938bfe53d97a8d54f5994ca72fbc37e786f54fb4a83029e24"}
Jun 10 22:59:42.395864 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.395830    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:42.395944 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.395916    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:42.395995 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.395964    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:42.409947 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.409924    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:42.410385 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.410371    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 22:59:42.434936 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.434899    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk" podStartSLOduration=9.802652001 podStartE2EDuration="28.434886065s" totalImagesPullingTime="18.632234064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 22:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 22:59:42.434331961 +0000 UTC m=+28.591956121" watchObservedRunningTime="2026-06-10 22:59:42.434886065 +0000 UTC m=+28.592510221"
Jun 10 22:59:42.587659 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.587628    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wp785"]
Jun 10 22:59:42.587757 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.587736    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:42.587876 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:42.587837    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:42.590823 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.590799    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r4m9t"]
Jun 10 22:59:42.590938 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.590907    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:42.591031 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:42.590995    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:42.591471 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.591442    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fjp6x"]
Jun 10 22:59:42.591555 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:42.591543    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:42.591663 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:42.591645    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:43.400502 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:43.400478    2577 generic.go:356] "Generic (PLEG): container finished" podID="8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd" containerID="ba3e2b6f9df19eafecbe0ce56d43a5801cd2106b0b524d89ba6bba5dd68c1153" exitCode=0
Jun 10 22:59:43.401150 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:43.400562    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8ddnh" event={"ID":"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd","Type":"ContainerDied","Data":"ba3e2b6f9df19eafecbe0ce56d43a5801cd2106b0b524d89ba6bba5dd68c1153"}
Jun 10 22:59:44.251871 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:44.251825    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:44.252052 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:44.251931    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:44.252052 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:44.251977    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:44.252156 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:44.252065    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:44.252156 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:44.252099    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:44.252245 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:44.252173    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:46.118917 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:46.118885    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7zpbf"
Jun 10 22:59:46.119635 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:46.119026    2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 10 22:59:46.119697 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:46.119640    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7zpbf"
Jun 10 22:59:46.251068 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:46.250808    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:46.251217 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:46.250827    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:46.251217 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:46.251175    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:46.251316 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:46.250870    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:46.251316 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:46.251284    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:46.251447 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:46.251394    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:47.670481 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:47.670450    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 22:59:47.751898 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:47.751841    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 22:59:47.967323 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:47.967294    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret\") pod \"global-pull-secret-syncer-wp785\" (UID: \"da6cc932-e39a-4812-bb40-eaa50d9cffc3\") " pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:47.967489 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:47.967339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j842\" (UniqueName: \"kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842\") pod \"network-check-target-r4m9t\" (UID: \"38af1105-bec2-4a3c-b858-d21151d7496b\") " pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:47.967489 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:47.967438    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 22:59:47.967563 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:47.967488    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 22:59:47.967563 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:47.967496    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret podName:da6cc932-e39a-4812-bb40-eaa50d9cffc3 nodeName:}" failed. No retries permitted until 2026-06-10 23:00:19.967481095 +0000 UTC m=+66.125105231 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret") pod "global-pull-secret-syncer-wp785" (UID: "da6cc932-e39a-4812-bb40-eaa50d9cffc3") : object "kube-system"/"original-pull-secret" not registered
Jun 10 22:59:47.967563 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:47.967500    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 22:59:47.967563 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:47.967510    2577 projected.go:196] Error preparing data for projected volume kube-api-access-6j842 for pod openshift-network-diagnostics/network-check-target-r4m9t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 22:59:47.967563 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:47.967542    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842 podName:38af1105-bec2-4a3c-b858-d21151d7496b nodeName:}" failed. No retries permitted until 2026-06-10 23:00:19.967532874 +0000 UTC m=+66.125157010 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6j842" (UniqueName: "kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842") pod "network-check-target-r4m9t" (UID: "38af1105-bec2-4a3c-b858-d21151d7496b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 22:59:48.068263 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.068236    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs\") pod \"network-metrics-daemon-fjp6x\" (UID: \"4425be81-8f51-4c34-8d00-7a454584e0bf\") " pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:48.068441 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:48.068360    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 22:59:48.068441 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:48.068423    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs podName:4425be81-8f51-4c34-8d00-7a454584e0bf nodeName:}" failed. No retries permitted until 2026-06-10 23:00:20.068402894 +0000 UTC m=+66.226027045 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs") pod "network-metrics-daemon-fjp6x" (UID: "4425be81-8f51-4c34-8d00-7a454584e0bf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 22:59:48.251669 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.251598    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:48.251823 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.251598    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:48.251823 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:48.251692    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wp785" podUID="da6cc932-e39a-4812-bb40-eaa50d9cffc3"
Jun 10 22:59:48.251823 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.251711    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:48.251823 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:48.251800    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m9t" podUID="38af1105-bec2-4a3c-b858-d21151d7496b"
Jun 10 22:59:48.252002 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:48.251908    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 22:59:48.414168 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.414143    2577 generic.go:356] "Generic (PLEG): container finished" podID="8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd" containerID="a4ed61b278b1576cd377ef89bbe70ad5d4100cb9dfc22fedf58204bf9e1d53c3" exitCode=0
Jun 10 22:59:48.414270 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.414208    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8ddnh" event={"ID":"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd","Type":"ContainerDied","Data":"a4ed61b278b1576cd377ef89bbe70ad5d4100cb9dfc22fedf58204bf9e1d53c3"}
Jun 10 22:59:48.722706 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.722686    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-238.ec2.internal" event="NodeReady"
Jun 10 22:59:48.723091 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.722801    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 10 22:59:48.767977 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.767903    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m8jw6"]
Jun 10 22:59:48.773154 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.773130    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vddps"]
Jun 10 22:59:48.773297 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.773260    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m8jw6"
Jun 10 22:59:48.775053 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.775024    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 10 22:59:48.775163 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.775121    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 10 22:59:48.775163 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.775142    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8g4j7\""
Jun 10 22:59:48.785317 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.785298    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m8jw6"]
Jun 10 22:59:48.785421 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.785329    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vddps"]
Jun 10 22:59:48.785421 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.785401    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vddps"
Jun 10 22:59:48.787318 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.787297    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l798f\""
Jun 10 22:59:48.787427 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.787346    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 10 22:59:48.787563 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.787549    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 10 22:59:48.794965 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.791843    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 10 22:59:48.870948 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.870892    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 22:59:48.875833 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.875809    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 22:59:48.875957 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.875835    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3dafdac3-c9a8-4928-99dd-92a008b6bc5f-cert\") pod \"ingress-canary-vddps\" (UID: \"3dafdac3-c9a8-4928-99dd-92a008b6bc5f\") " pod="openshift-ingress-canary/ingress-canary-vddps"
Jun 10 22:59:48.875957 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.875873    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/175518a2-4b83-4a85-97f8-422c8a203700-config-volume\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 22:59:48.875957 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.875897    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssn2f\" (UniqueName: \"kubernetes.io/projected/3dafdac3-c9a8-4928-99dd-92a008b6bc5f-kube-api-access-ssn2f\") pod \"ingress-canary-vddps\" (UID: \"3dafdac3-c9a8-4928-99dd-92a008b6bc5f\") " pod="openshift-ingress-canary/ingress-canary-vddps"
Jun 10 22:59:48.875957 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.875936    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bktj2\" (UniqueName: \"kubernetes.io/projected/175518a2-4b83-4a85-97f8-422c8a203700-kube-api-access-bktj2\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 22:59:48.876089 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.875969    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/175518a2-4b83-4a85-97f8-422c8a203700-tmp-dir\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 22:59:48.923560 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.923534    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 22:59:48.976636 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.976606    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bktj2\" (UniqueName: \"kubernetes.io/projected/175518a2-4b83-4a85-97f8-422c8a203700-kube-api-access-bktj2\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 22:59:48.976811 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.976649    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/175518a2-4b83-4a85-97f8-422c8a203700-tmp-dir\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 22:59:48.976811 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.976690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 22:59:48.976811 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.976705    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3dafdac3-c9a8-4928-99dd-92a008b6bc5f-cert\") pod \"ingress-canary-vddps\" (UID: \"3dafdac3-c9a8-4928-99dd-92a008b6bc5f\") " pod="openshift-ingress-canary/ingress-canary-vddps"
Jun 10 22:59:48.976811 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.976728    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/175518a2-4b83-4a85-97f8-422c8a203700-config-volume\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 22:59:48.976811 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.976752    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssn2f\" (UniqueName: \"kubernetes.io/projected/3dafdac3-c9a8-4928-99dd-92a008b6bc5f-kube-api-access-ssn2f\") pod \"ingress-canary-vddps\" (UID: \"3dafdac3-c9a8-4928-99dd-92a008b6bc5f\") " pod="openshift-ingress-canary/ingress-canary-vddps"
Jun 10 22:59:48.977044 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:48.976810    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 22:59:48.977044 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:48.976890    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls podName:175518a2-4b83-4a85-97f8-422c8a203700 nodeName:}" failed. No retries permitted until 2026-06-10 22:59:49.476872023 +0000 UTC m=+35.634496174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls") pod "dns-default-m8jw6" (UID: "175518a2-4b83-4a85-97f8-422c8a203700") : secret "dns-default-metrics-tls" not found
Jun 10 22:59:48.977121 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.977076    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/175518a2-4b83-4a85-97f8-422c8a203700-tmp-dir\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 22:59:48.977360 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.977341    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/175518a2-4b83-4a85-97f8-422c8a203700-config-volume\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 22:59:48.980980 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.980962    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3dafdac3-c9a8-4928-99dd-92a008b6bc5f-cert\") pod \"ingress-canary-vddps\" (UID: \"3dafdac3-c9a8-4928-99dd-92a008b6bc5f\") " pod="openshift-ingress-canary/ingress-canary-vddps"
Jun 10 22:59:48.986353 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.986330    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bktj2\" (UniqueName: \"kubernetes.io/projected/175518a2-4b83-4a85-97f8-422c8a203700-kube-api-access-bktj2\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 22:59:48.986763 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:48.986745    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssn2f\" (UniqueName: \"kubernetes.io/projected/3dafdac3-c9a8-4928-99dd-92a008b6bc5f-kube-api-access-ssn2f\") pod \"ingress-canary-vddps\" (UID: \"3dafdac3-c9a8-4928-99dd-92a008b6bc5f\") " pod="openshift-ingress-canary/ingress-canary-vddps"
Jun 10 22:59:49.099955 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:49.099932    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vddps"
Jun 10 22:59:49.285928 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:49.285905    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vddps"]
Jun 10 22:59:49.289337 ip-10-0-129-238 kubenswrapper[2577]: W0610 22:59:49.289314    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dafdac3_c9a8_4928_99dd_92a008b6bc5f.slice/crio-11d935a02d32cfb07d62934f82ca58158da5acba89a6a6d4bb8e0038cad88ed4 WatchSource:0}: Error finding container 11d935a02d32cfb07d62934f82ca58158da5acba89a6a6d4bb8e0038cad88ed4: Status 404 returned error can't find the container with id 11d935a02d32cfb07d62934f82ca58158da5acba89a6a6d4bb8e0038cad88ed4
Jun 10 22:59:49.419769 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:49.419711    2577 generic.go:356] "Generic (PLEG): container finished" podID="8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd" containerID="81a6da3872d1da41127f4d9bee5272669db13bba59170846ca9b9277e53ee723" exitCode=0
Jun 10 22:59:49.419898 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:49.419804    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8ddnh" event={"ID":"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd","Type":"ContainerDied","Data":"81a6da3872d1da41127f4d9bee5272669db13bba59170846ca9b9277e53ee723"}
Jun 10 22:59:49.420944 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:49.420919    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vddps" event={"ID":"3dafdac3-c9a8-4928-99dd-92a008b6bc5f","Type":"ContainerStarted","Data":"11d935a02d32cfb07d62934f82ca58158da5acba89a6a6d4bb8e0038cad88ed4"}
Jun 10 22:59:49.481266 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:49.481070    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 22:59:49.481388 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:49.481166    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 22:59:49.481388 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:49.481384    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls podName:175518a2-4b83-4a85-97f8-422c8a203700 nodeName:}" failed. No retries permitted until 2026-06-10 22:59:50.4813517 +0000 UTC m=+36.638975855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls") pod "dns-default-m8jw6" (UID: "175518a2-4b83-4a85-97f8-422c8a203700") : secret "dns-default-metrics-tls" not found
Jun 10 22:59:50.250822 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:50.250790    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 22:59:50.251407 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:50.250794    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 22:59:50.251407 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:50.250802    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 22:59:50.253202 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:50.253182    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 10 22:59:50.253327 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:50.253181    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 10 22:59:50.253327 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:50.253184    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mpwg8\""
Jun 10 22:59:50.253779 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:50.253753    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 10 22:59:50.253905 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:50.253784    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 10 22:59:50.253905 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:50.253759    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gj5t4\""
Jun 10 22:59:50.426705 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:50.426671    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8ddnh" event={"ID":"8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd","Type":"ContainerStarted","Data":"43c8931dfb66fa8681364e72eeb785f44f0206b9fdc3f55bca76703161ff68e0"}
Jun 10 22:59:50.446432 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:50.446385    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8ddnh" podStartSLOduration=8.324834591 podStartE2EDuration="36.446371353s" totalImagesPullingTime="28.121536762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 22:59:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 22:59:50.445824459 +0000 UTC m=+36.603448627" watchObservedRunningTime="2026-06-10 22:59:50.446371353 +0000 UTC m=+36.603995508"
Jun 10 22:59:50.489208 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:50.489175    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 22:59:50.489352 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:50.489314    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 22:59:50.489400 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:50.489382    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls podName:175518a2-4b83-4a85-97f8-422c8a203700 nodeName:}" failed. No retries permitted until 2026-06-10 22:59:52.489363175 +0000 UTC m=+38.646987325 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls") pod "dns-default-m8jw6" (UID: "175518a2-4b83-4a85-97f8-422c8a203700") : secret "dns-default-metrics-tls" not found
Jun 10 22:59:50.567042 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:50.566955    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 22:59:50.666941 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:50.666900    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 22:59:51.567690 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:51.567651    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 22:59:51.667349 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:51.667250    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 22:59:51.810953 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:51.810898    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 22:59:52.431291 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:52.431222    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vddps" event={"ID":"3dafdac3-c9a8-4928-99dd-92a008b6bc5f","Type":"ContainerStarted","Data":"2b5d4da7167f5444ece3f3a910ae3626ac2dd47a7fbe378457756ecfe802ba25"}
Jun 10 22:59:52.446975 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:52.446934    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vddps" podStartSLOduration=2.349228444 podStartE2EDuration="4.446917063s" totalImagesPullingTime="2.097688619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 22:59:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 22:59:52.446325807 +0000 UTC m=+38.603949964" watchObservedRunningTime="2026-06-10 22:59:52.446917063 +0000 UTC m=+38.604541223"
Jun 10 22:59:52.455633 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:52.455605    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 22:59:52.506686 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:52.506663    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 22:59:52.506821 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:52.506803    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 22:59:52.506909 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:52.506882    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls podName:175518a2-4b83-4a85-97f8-422c8a203700 nodeName:}" failed. No retries permitted until 2026-06-10 22:59:56.506863457 +0000 UTC m=+42.664487595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls") pod "dns-default-m8jw6" (UID: "175518a2-4b83-4a85-97f8-422c8a203700") : secret "dns-default-metrics-tls" not found
Jun 10 22:59:52.536738 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:52.536713    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 22:59:52.637580 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:52.637558    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 22:59:53.512191 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:53.512152    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 22:59:53.587782 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:53.587751    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 22:59:53.655261 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:53.655227    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 22:59:56.533189 ip-10-0-129-238 kubenswrapper[2577]: I0610 22:59:56.533152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 22:59:56.533558 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:56.533268    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 22:59:56.533558 ip-10-0-129-238 kubenswrapper[2577]: E0610 22:59:56.533320    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls podName:175518a2-4b83-4a85-97f8-422c8a203700 nodeName:}" failed. No retries permitted until 2026-06-10 23:00:04.533305149 +0000 UTC m=+50.690929285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls") pod "dns-default-m8jw6" (UID: "175518a2-4b83-4a85-97f8-422c8a203700") : secret "dns-default-metrics-tls" not found
Jun 10 23:00:02.381838 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:02.381803    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:00:02.433547 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:02.433518    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:00:04.586170 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:04.586136    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 23:00:04.586541 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:00:04.586249    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 23:00:04.586541 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:00:04.586313    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls podName:175518a2-4b83-4a85-97f8-422c8a203700 nodeName:}" failed. No retries permitted until 2026-06-10 23:00:20.586294558 +0000 UTC m=+66.743918695 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls") pod "dns-default-m8jw6" (UID: "175518a2-4b83-4a85-97f8-422c8a203700") : secret "dns-default-metrics-tls" not found
Jun 10 23:00:04.770601 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:04.770565    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:00:04.821301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:04.821269    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:00:07.586595 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:07.586561    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:00:07.639515 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:07.639491    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:00:08.973964 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:08.973922    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:00:09.031991 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:09.031959    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:00:14.413862 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:14.413821    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kknpk"
Jun 10 23:00:14.554264 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:14.554226    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:00:14.657298 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:14.657266    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:00:14.755659 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:14.755573    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:00:14.805243 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:14.805222    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:00:19.988722 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:19.988686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j842\" (UniqueName: \"kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842\") pod \"network-check-target-r4m9t\" (UID: \"38af1105-bec2-4a3c-b858-d21151d7496b\") " pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 23:00:19.989099 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:19.988738    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret\") pod \"global-pull-secret-syncer-wp785\" (UID: \"da6cc932-e39a-4812-bb40-eaa50d9cffc3\") " pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 23:00:19.990980 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:19.990959    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 10 23:00:19.991051 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:19.991036    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 10 23:00:20.001309 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.001292    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 10 23:00:20.002677 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.002660    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/da6cc932-e39a-4812-bb40-eaa50d9cffc3-original-pull-secret\") pod \"global-pull-secret-syncer-wp785\" (UID: \"da6cc932-e39a-4812-bb40-eaa50d9cffc3\") " pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 23:00:20.011812 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.011795    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j842\" (UniqueName: \"kubernetes.io/projected/38af1105-bec2-4a3c-b858-d21151d7496b-kube-api-access-6j842\") pod \"network-check-target-r4m9t\" (UID: \"38af1105-bec2-4a3c-b858-d21151d7496b\") " pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 23:00:20.090008 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.089984    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs\") pod \"network-metrics-daemon-fjp6x\" (UID: \"4425be81-8f51-4c34-8d00-7a454584e0bf\") " pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 23:00:20.092204 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.092189    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 10 23:00:20.100770 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:00:20.100755    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 10 23:00:20.100820 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:00:20.100803    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs podName:4425be81-8f51-4c34-8d00-7a454584e0bf nodeName:}" failed. No retries permitted until 2026-06-10 23:01:24.100789359 +0000 UTC m=+130.258413495 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs") pod "network-metrics-daemon-fjp6x" (UID: "4425be81-8f51-4c34-8d00-7a454584e0bf") : secret "metrics-daemon-secret" not found
Jun 10 23:00:20.263034 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.262969    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mpwg8\""
Jun 10 23:00:20.270834 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.270819    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 23:00:20.270935 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.270922    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wp785"
Jun 10 23:00:20.417383 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.417355    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wp785"]
Jun 10 23:00:20.420702 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:00:20.420673    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6cc932_e39a_4812_bb40_eaa50d9cffc3.slice/crio-c92d8d9e23fcbeab39578f1ded9771abb4c58033668556513b559cc992b88518 WatchSource:0}: Error finding container c92d8d9e23fcbeab39578f1ded9771abb4c58033668556513b559cc992b88518: Status 404 returned error can't find the container with id c92d8d9e23fcbeab39578f1ded9771abb4c58033668556513b559cc992b88518
Jun 10 23:00:20.428636 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.428613    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r4m9t"]
Jun 10 23:00:20.431332 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:00:20.431310    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38af1105_bec2_4a3c_b858_d21151d7496b.slice/crio-8d77077da6c6721df4e9005fd87e7b275ec2a24bfe6e4e4c87b3152752ceab1c WatchSource:0}: Error finding container 8d77077da6c6721df4e9005fd87e7b275ec2a24bfe6e4e4c87b3152752ceab1c: Status 404 returned error can't find the container with id 8d77077da6c6721df4e9005fd87e7b275ec2a24bfe6e4e4c87b3152752ceab1c
Jun 10 23:00:20.496339 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.496304    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wp785" event={"ID":"da6cc932-e39a-4812-bb40-eaa50d9cffc3","Type":"ContainerStarted","Data":"c92d8d9e23fcbeab39578f1ded9771abb4c58033668556513b559cc992b88518"}
Jun 10 23:00:20.497305 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.497277    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r4m9t" event={"ID":"38af1105-bec2-4a3c-b858-d21151d7496b","Type":"ContainerStarted","Data":"8d77077da6c6721df4e9005fd87e7b275ec2a24bfe6e4e4c87b3152752ceab1c"}
Jun 10 23:00:20.594194 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.594120    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 23:00:20.594307 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:00:20.594225    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 23:00:20.594307 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:00:20.594275    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls podName:175518a2-4b83-4a85-97f8-422c8a203700 nodeName:}" failed. No retries permitted until 2026-06-10 23:00:52.594260892 +0000 UTC m=+98.751885029 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls") pod "dns-default-m8jw6" (UID: "175518a2-4b83-4a85-97f8-422c8a203700") : secret "dns-default-metrics-tls" not found
Jun 10 23:00:20.959159 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.959131    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5654978996-k5smc"]
Jun 10 23:00:20.960782 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.960760    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5654978996-k5smc"
Jun 10 23:00:20.962777 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.962755    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 10 23:00:20.963766 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.963543    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jun 10 23:00:20.963766 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.963556    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 10 23:00:20.963766 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.963599    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 10 23:00:20.963766 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.963545    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6r6lp\""
Jun 10 23:00:20.968950 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.968359    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5654978996-k5smc"]
Jun 10 23:00:20.996544 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.996522    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc14d005-6799-420e-be2d-82be8a3d4150-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5654978996-k5smc\" (UID: \"bc14d005-6799-420e-be2d-82be8a3d4150\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5654978996-k5smc"
Jun 10 23:00:20.996930 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:20.996555    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj847\" (UniqueName: \"kubernetes.io/projected/bc14d005-6799-420e-be2d-82be8a3d4150-kube-api-access-sj847\") pod \"managed-serviceaccount-addon-agent-5654978996-k5smc\" (UID: \"bc14d005-6799-420e-be2d-82be8a3d4150\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5654978996-k5smc"
Jun 10 23:00:21.097423 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:21.097391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc14d005-6799-420e-be2d-82be8a3d4150-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5654978996-k5smc\" (UID: \"bc14d005-6799-420e-be2d-82be8a3d4150\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5654978996-k5smc"
Jun 10 23:00:21.097580 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:21.097445    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj847\" (UniqueName: \"kubernetes.io/projected/bc14d005-6799-420e-be2d-82be8a3d4150-kube-api-access-sj847\") pod \"managed-serviceaccount-addon-agent-5654978996-k5smc\" (UID: \"bc14d005-6799-420e-be2d-82be8a3d4150\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5654978996-k5smc"
Jun 10 23:00:21.100463 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:21.100431    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bc14d005-6799-420e-be2d-82be8a3d4150-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5654978996-k5smc\" (UID: \"bc14d005-6799-420e-be2d-82be8a3d4150\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5654978996-k5smc"
Jun 10 23:00:21.105719 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:21.105670    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj847\" (UniqueName: \"kubernetes.io/projected/bc14d005-6799-420e-be2d-82be8a3d4150-kube-api-access-sj847\") pod \"managed-serviceaccount-addon-agent-5654978996-k5smc\" (UID: \"bc14d005-6799-420e-be2d-82be8a3d4150\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5654978996-k5smc"
Jun 10 23:00:21.279098 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:21.279003    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5654978996-k5smc"
Jun 10 23:00:21.420415 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:21.420353    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5654978996-k5smc"]
Jun 10 23:00:21.424393 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:00:21.424357    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc14d005_6799_420e_be2d_82be8a3d4150.slice/crio-8c236c971eb7cf806f9dc38157b10245f95636b3142183f8ea36128b285a1752 WatchSource:0}: Error finding container 8c236c971eb7cf806f9dc38157b10245f95636b3142183f8ea36128b285a1752: Status 404 returned error can't find the container with id 8c236c971eb7cf806f9dc38157b10245f95636b3142183f8ea36128b285a1752
Jun 10 23:00:21.501996 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:21.501963    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5654978996-k5smc" event={"ID":"bc14d005-6799-420e-be2d-82be8a3d4150","Type":"ContainerStarted","Data":"8c236c971eb7cf806f9dc38157b10245f95636b3142183f8ea36128b285a1752"}
Jun 10 23:00:25.515411 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:25.515370    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r4m9t" event={"ID":"38af1105-bec2-4a3c-b858-d21151d7496b","Type":"ContainerStarted","Data":"40865af772bf9cf8ae982d528d3288fa34bec4268b11d86e77e6346c24045064"}
Jun 10 23:00:25.515903 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:25.515467    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 23:00:25.516924 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:25.516896    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wp785" event={"ID":"da6cc932-e39a-4812-bb40-eaa50d9cffc3","Type":"ContainerStarted","Data":"0d8da3b77ac77d523a31b868342b8dd46480a2ffeda50eaff71bec450e872a44"}
Jun 10 23:00:25.530891 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:25.530835    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r4m9t" podStartSLOduration=66.970380085 podStartE2EDuration="1m11.530822576s" totalImagesPullingTime="4.560442491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 22:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:00:25.529826843 +0000 UTC m=+71.687451002" watchObservedRunningTime="2026-06-10 23:00:25.530822576 +0000 UTC m=+71.688446734"
Jun 10 23:00:25.543533 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:25.543491    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wp785" podStartSLOduration=66.967164526 podStartE2EDuration="1m11.543475378s" totalImagesPullingTime="4.576310852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 22:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:00:25.543364017 +0000 UTC m=+71.700988179" watchObservedRunningTime="2026-06-10 23:00:25.543475378 +0000 UTC m=+71.701099533"
Jun 10 23:00:27.524024 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:27.523985    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5654978996-k5smc" event={"ID":"bc14d005-6799-420e-be2d-82be8a3d4150","Type":"ContainerStarted","Data":"ed1a24b7c0b1282d9f1b2d85deff0481233292a9f1c029747e32f595800e1f41"}
Jun 10 23:00:27.538607 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:27.538559    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5654978996-k5smc" podStartSLOduration=2.277945375 podStartE2EDuration="7.538543248s" totalImagesPullingTime="5.260597873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:00:27.538090234 +0000 UTC m=+73.695714393" watchObservedRunningTime="2026-06-10 23:00:27.538543248 +0000 UTC m=+73.696167406"
Jun 10 23:00:31.549808 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:31.549689    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:00:31.607178 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:31.607151    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:00:52.605362 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:52.605333    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 23:00:52.605808 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:00:52.605498    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 23:00:52.605808 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:00:52.605625    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls podName:175518a2-4b83-4a85-97f8-422c8a203700 nodeName:}" failed. No retries permitted until 2026-06-10 23:01:56.605600495 +0000 UTC m=+162.763224635 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls") pod "dns-default-m8jw6" (UID: "175518a2-4b83-4a85-97f8-422c8a203700") : secret "dns-default-metrics-tls" not found
Jun 10 23:00:56.522371 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:00:56.522340    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r4m9t"
Jun 10 23:01:24.111512 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:01:24.111464    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs\") pod \"network-metrics-daemon-fjp6x\" (UID: \"4425be81-8f51-4c34-8d00-7a454584e0bf\") " pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 23:01:24.111971 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:01:24.111584    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 10 23:01:24.111971 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:01:24.111657    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs podName:4425be81-8f51-4c34-8d00-7a454584e0bf nodeName:}" failed. No retries permitted until 2026-06-10 23:03:26.111634002 +0000 UTC m=+252.269258138 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs") pod "network-metrics-daemon-fjp6x" (UID: "4425be81-8f51-4c34-8d00-7a454584e0bf") : secret "metrics-daemon-secret" not found
Jun 10 23:01:51.783540 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:01:51.783492    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-m8jw6" podUID="175518a2-4b83-4a85-97f8-422c8a203700"
Jun 10 23:01:52.721301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:01:52.721273    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m8jw6"
Jun 10 23:01:53.266581 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:01:53.266546    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fjp6x" podUID="4425be81-8f51-4c34-8d00-7a454584e0bf"
Jun 10 23:01:56.621182 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:01:56.621150    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 23:01:56.621541 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:01:56.621255    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 23:01:56.621541 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:01:56.621314    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls podName:175518a2-4b83-4a85-97f8-422c8a203700 nodeName:}" failed. No retries permitted until 2026-06-10 23:03:58.621300382 +0000 UTC m=+284.778924518 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls") pod "dns-default-m8jw6" (UID: "175518a2-4b83-4a85-97f8-422c8a203700") : secret "dns-default-metrics-tls" not found
Jun 10 23:02:07.251694 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:07.251635    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 23:02:27.806770 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:27.806739    2577 generic.go:356] "Generic (PLEG): container finished" podID="bc14d005-6799-420e-be2d-82be8a3d4150" containerID="ed1a24b7c0b1282d9f1b2d85deff0481233292a9f1c029747e32f595800e1f41" exitCode=255
Jun 10 23:02:27.807149 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:27.806805    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5654978996-k5smc" event={"ID":"bc14d005-6799-420e-be2d-82be8a3d4150","Type":"ContainerDied","Data":"ed1a24b7c0b1282d9f1b2d85deff0481233292a9f1c029747e32f595800e1f41"}
Jun 10 23:02:27.812430 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:27.812411    2577 scope.go:117] "RemoveContainer" containerID="ed1a24b7c0b1282d9f1b2d85deff0481233292a9f1c029747e32f595800e1f41"
Jun 10 23:02:28.811156 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:28.811119    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5654978996-k5smc" event={"ID":"bc14d005-6799-420e-be2d-82be8a3d4150","Type":"ContainerStarted","Data":"a24eaef95e7be9538fb72d13f5c5d29f7388a514b92401f961be2d2d16b3da29"}
Jun 10 23:02:36.553866 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:36.553819    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:39.640732 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.640702    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf"]
Jun 10 23:02:39.643445 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.643429    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf"
Jun 10 23:02:39.645719 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.645695    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-b6wcp\""
Jun 10 23:02:39.645872 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.645738    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jun 10 23:02:39.646221 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.646199    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jun 10 23:02:39.646325 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.646232    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jun 10 23:02:39.646325 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.646300    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jun 10 23:02:39.647136 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.647112    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-t4456"]
Jun 10 23:02:39.649729 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.649709    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67"]
Jun 10 23:02:39.649844 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.649828    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-t4456"
Jun 10 23:02:39.651734 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.651717    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-k9fz2\""
Jun 10 23:02:39.652278 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.652255    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jun 10 23:02:39.653558 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.652745    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jun 10 23:02:39.656667 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.654686    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-5qb7f"]
Jun 10 23:02:39.656776 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.656757    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67"
Jun 10 23:02:39.659252 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.658937    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-btlml\""
Jun 10 23:02:39.659252 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.659060    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jun 10 23:02:39.659252 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.659150    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jun 10 23:02:39.659737 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.659698    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jun 10 23:02:39.660103 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.659871    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jun 10 23:02:39.661532 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.661508    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-848d66fc84-drnlx"]
Jun 10 23:02:39.661649 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.661631    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:02:39.664378 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.664360    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf"]
Jun 10 23:02:39.664525 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.664504    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-t4456"]
Jun 10 23:02:39.664627 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.664592    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.666041 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.664812    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jun 10 23:02:39.666041 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.664873    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2st9q\""
Jun 10 23:02:39.666041 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.665863    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jun 10 23:02:39.666041 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.665882    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jun 10 23:02:39.666041 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.665907    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jun 10 23:02:39.666534 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.666514    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67"]
Jun 10 23:02:39.666972 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.666954    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 10 23:02:39.667532 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.667283    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 10 23:02:39.667532 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.667524    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-5qb7f"]
Jun 10 23:02:39.667762 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.667742    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 10 23:02:39.668115 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.668097    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kq2ln\""
Jun 10 23:02:39.670495 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.670477    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jun 10 23:02:39.673371 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.673347    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-848d66fc84-drnlx"]
Jun 10 23:02:39.673472 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.673441    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 10 23:02:39.700619 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700595    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pzjj\" (UniqueName: \"kubernetes.io/projected/07475e5a-8bce-440d-8eed-aac7af4f3ff6-kube-api-access-4pzjj\") pod \"volume-data-source-validator-78dd696465-t4456\" (UID: \"07475e5a-8bce-440d-8eed-aac7af4f3ff6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-t4456"
Jun 10 23:02:39.700704 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700621    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee19c560-59e2-4020-a607-914123d4d186-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gdxgf\" (UID: \"ee19c560-59e2-4020-a607-914123d4d186\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf"
Jun 10 23:02:39.700704 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7538d367-44aa-4cee-b50b-d4be3e02b611-ca-trust-extracted\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.700704 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700667    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-certificates\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.700704 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnc9x\" (UniqueName: \"kubernetes.io/projected/55d4eb1d-6ab4-4236-b4e9-4462da21f72f-kube-api-access-tnc9x\") pod \"service-ca-operator-6bc5ff68f5-9hh67\" (UID: \"55d4eb1d-6ab4-4236-b4e9-4462da21f72f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67"
Jun 10 23:02:39.700704 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7538d367-44aa-4cee-b50b-d4be3e02b611-installation-pull-secrets\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.700878 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-bound-sa-token\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.700878 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700770    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvvtf\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-kube-api-access-zvvtf\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.700878 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700797    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55d4eb1d-6ab4-4236-b4e9-4462da21f72f-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-9hh67\" (UID: \"55d4eb1d-6ab4-4236-b4e9-4462da21f72f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67"
Jun 10 23:02:39.700878 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700818    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7538d367-44aa-4cee-b50b-d4be3e02b611-trusted-ca\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.700878 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700834    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55d4eb1d-6ab4-4236-b4e9-4462da21f72f-config\") pod \"service-ca-operator-6bc5ff68f5-9hh67\" (UID: \"55d4eb1d-6ab4-4236-b4e9-4462da21f72f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67"
Jun 10 23:02:39.700878 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700866    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxjmk\" (UniqueName: \"kubernetes.io/projected/ee19c560-59e2-4020-a607-914123d4d186-kube-api-access-jxjmk\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gdxgf\" (UID: \"ee19c560-59e2-4020-a607-914123d4d186\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf"
Jun 10 23:02:39.701060 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700887    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d6c4d0e-573d-4aae-811e-9c387a814d46-config\") pod \"console-operator-668fdbf85c-5qb7f\" (UID: \"9d6c4d0e-573d-4aae-811e-9c387a814d46\") " pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:02:39.701060 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700910    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d6c4d0e-573d-4aae-811e-9c387a814d46-trusted-ca\") pod \"console-operator-668fdbf85c-5qb7f\" (UID: \"9d6c4d0e-573d-4aae-811e-9c387a814d46\") " pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:02:39.701060 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700960    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d6c4d0e-573d-4aae-811e-9c387a814d46-serving-cert\") pod \"console-operator-668fdbf85c-5qb7f\" (UID: \"9d6c4d0e-573d-4aae-811e-9c387a814d46\") " pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:02:39.701060 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700974    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.701060 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.700990    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee19c560-59e2-4020-a607-914123d4d186-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gdxgf\" (UID: \"ee19c560-59e2-4020-a607-914123d4d186\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf"
Jun 10 23:02:39.701060 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.701007    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zvp6\" (UniqueName: \"kubernetes.io/projected/9d6c4d0e-573d-4aae-811e-9c387a814d46-kube-api-access-2zvp6\") pod \"console-operator-668fdbf85c-5qb7f\" (UID: \"9d6c4d0e-573d-4aae-811e-9c387a814d46\") " pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:02:39.701060 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.701025    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7538d367-44aa-4cee-b50b-d4be3e02b611-image-registry-private-configuration\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.801960 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.801934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pzjj\" (UniqueName: \"kubernetes.io/projected/07475e5a-8bce-440d-8eed-aac7af4f3ff6-kube-api-access-4pzjj\") pod \"volume-data-source-validator-78dd696465-t4456\" (UID: \"07475e5a-8bce-440d-8eed-aac7af4f3ff6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-t4456"
Jun 10 23:02:39.802085 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.801976    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee19c560-59e2-4020-a607-914123d4d186-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gdxgf\" (UID: \"ee19c560-59e2-4020-a607-914123d4d186\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf"
Jun 10 23:02:39.802085 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7538d367-44aa-4cee-b50b-d4be3e02b611-ca-trust-extracted\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.802085 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-certificates\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.802085 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802047    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnc9x\" (UniqueName: \"kubernetes.io/projected/55d4eb1d-6ab4-4236-b4e9-4462da21f72f-kube-api-access-tnc9x\") pod \"service-ca-operator-6bc5ff68f5-9hh67\" (UID: \"55d4eb1d-6ab4-4236-b4e9-4462da21f72f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67"
Jun 10 23:02:39.802085 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802065    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7538d367-44aa-4cee-b50b-d4be3e02b611-installation-pull-secrets\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.802301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-bound-sa-token\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.802301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802107    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvtf\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-kube-api-access-zvvtf\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.802301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802131    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55d4eb1d-6ab4-4236-b4e9-4462da21f72f-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-9hh67\" (UID: \"55d4eb1d-6ab4-4236-b4e9-4462da21f72f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67"
Jun 10 23:02:39.802301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802157    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7538d367-44aa-4cee-b50b-d4be3e02b611-trusted-ca\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.802301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802183    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55d4eb1d-6ab4-4236-b4e9-4462da21f72f-config\") pod \"service-ca-operator-6bc5ff68f5-9hh67\" (UID: \"55d4eb1d-6ab4-4236-b4e9-4462da21f72f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67"
Jun 10 23:02:39.802301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802204    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxjmk\" (UniqueName: \"kubernetes.io/projected/ee19c560-59e2-4020-a607-914123d4d186-kube-api-access-jxjmk\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gdxgf\" (UID: \"ee19c560-59e2-4020-a607-914123d4d186\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf"
Jun 10 23:02:39.802301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802221    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d6c4d0e-573d-4aae-811e-9c387a814d46-config\") pod \"console-operator-668fdbf85c-5qb7f\" (UID: \"9d6c4d0e-573d-4aae-811e-9c387a814d46\") " pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:02:39.802301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802236    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d6c4d0e-573d-4aae-811e-9c387a814d46-trusted-ca\") pod \"console-operator-668fdbf85c-5qb7f\" (UID: \"9d6c4d0e-573d-4aae-811e-9c387a814d46\") " pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:02:39.802301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d6c4d0e-573d-4aae-811e-9c387a814d46-serving-cert\") pod \"console-operator-668fdbf85c-5qb7f\" (UID: \"9d6c4d0e-573d-4aae-811e-9c387a814d46\") " pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:02:39.802301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802277    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.802301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee19c560-59e2-4020-a607-914123d4d186-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gdxgf\" (UID: \"ee19c560-59e2-4020-a607-914123d4d186\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf"
Jun 10 23:02:39.802740 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802316    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zvp6\" (UniqueName: \"kubernetes.io/projected/9d6c4d0e-573d-4aae-811e-9c387a814d46-kube-api-access-2zvp6\") pod \"console-operator-668fdbf85c-5qb7f\" (UID: \"9d6c4d0e-573d-4aae-811e-9c387a814d46\") " pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:02:39.802740 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802338    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7538d367-44aa-4cee-b50b-d4be3e02b611-image-registry-private-configuration\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.802740 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:39.802547    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 10 23:02:39.802740 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:39.802569    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848d66fc84-drnlx: secret "image-registry-tls" not found
Jun 10 23:02:39.802740 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:39.802628    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls podName:7538d367-44aa-4cee-b50b-d4be3e02b611 nodeName:}" failed. No retries permitted until 2026-06-10 23:02:40.302607232 +0000 UTC m=+206.460231381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls") pod "image-registry-848d66fc84-drnlx" (UID: "7538d367-44aa-4cee-b50b-d4be3e02b611") : secret "image-registry-tls" not found
Jun 10 23:02:39.802740 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.802714    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7538d367-44aa-4cee-b50b-d4be3e02b611-ca-trust-extracted\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.803217 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.803193    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-certificates\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.803648 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.803621    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55d4eb1d-6ab4-4236-b4e9-4462da21f72f-config\") pod \"service-ca-operator-6bc5ff68f5-9hh67\" (UID: \"55d4eb1d-6ab4-4236-b4e9-4462da21f72f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67"
Jun 10 23:02:39.803734 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.803667    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d6c4d0e-573d-4aae-811e-9c387a814d46-trusted-ca\") pod \"console-operator-668fdbf85c-5qb7f\" (UID: \"9d6c4d0e-573d-4aae-811e-9c387a814d46\") " pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:02:39.803797 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.803749    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee19c560-59e2-4020-a607-914123d4d186-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gdxgf\" (UID: \"ee19c560-59e2-4020-a607-914123d4d186\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf"
Jun 10 23:02:39.804328 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.804302    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d6c4d0e-573d-4aae-811e-9c387a814d46-config\") pod \"console-operator-668fdbf85c-5qb7f\" (UID: \"9d6c4d0e-573d-4aae-811e-9c387a814d46\") " pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:02:39.804414 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.804383    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7538d367-44aa-4cee-b50b-d4be3e02b611-trusted-ca\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.804879 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.804836    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee19c560-59e2-4020-a607-914123d4d186-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gdxgf\" (UID: \"ee19c560-59e2-4020-a607-914123d4d186\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf"
Jun 10 23:02:39.804988 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.804971    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d6c4d0e-573d-4aae-811e-9c387a814d46-serving-cert\") pod \"console-operator-668fdbf85c-5qb7f\" (UID: \"9d6c4d0e-573d-4aae-811e-9c387a814d46\") " pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:02:39.805100 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.805069    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7538d367-44aa-4cee-b50b-d4be3e02b611-image-registry-private-configuration\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.805489 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.805466    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7538d367-44aa-4cee-b50b-d4be3e02b611-installation-pull-secrets\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.805732 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.805713    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55d4eb1d-6ab4-4236-b4e9-4462da21f72f-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-9hh67\" (UID: \"55d4eb1d-6ab4-4236-b4e9-4462da21f72f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67"
Jun 10 23:02:39.811297 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.811240    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pzjj\" (UniqueName: \"kubernetes.io/projected/07475e5a-8bce-440d-8eed-aac7af4f3ff6-kube-api-access-4pzjj\") pod \"volume-data-source-validator-78dd696465-t4456\" (UID: \"07475e5a-8bce-440d-8eed-aac7af4f3ff6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-t4456"
Jun 10 23:02:39.811382 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.811307    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvvtf\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-kube-api-access-zvvtf\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.811583 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.811562    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-bound-sa-token\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:39.811688 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.811673    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxjmk\" (UniqueName: \"kubernetes.io/projected/ee19c560-59e2-4020-a607-914123d4d186-kube-api-access-jxjmk\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-gdxgf\" (UID: \"ee19c560-59e2-4020-a607-914123d4d186\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf"
Jun 10 23:02:39.812151 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.812131    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zvp6\" (UniqueName: \"kubernetes.io/projected/9d6c4d0e-573d-4aae-811e-9c387a814d46-kube-api-access-2zvp6\") pod \"console-operator-668fdbf85c-5qb7f\" (UID: \"9d6c4d0e-573d-4aae-811e-9c387a814d46\") " pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:02:39.813082 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.813063    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnc9x\" (UniqueName: \"kubernetes.io/projected/55d4eb1d-6ab4-4236-b4e9-4462da21f72f-kube-api-access-tnc9x\") pod \"service-ca-operator-6bc5ff68f5-9hh67\" (UID: \"55d4eb1d-6ab4-4236-b4e9-4462da21f72f\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67"
Jun 10 23:02:39.871520 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.871495    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:39.926945 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.926890    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:39.953931 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.953912    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf"
Jun 10 23:02:39.962870 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.962828    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-t4456"
Jun 10 23:02:39.971701 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.971681    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67"
Jun 10 23:02:39.977663 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:39.977630    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:02:40.106826 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:40.106798    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf"]
Jun 10 23:02:40.116041 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:02:40.115988    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee19c560_59e2_4020_a607_914123d4d186.slice/crio-4172d4813d1cdf8ab86a07d5e82a269de3f3caedd2cde3a41c49812092f95fb8 WatchSource:0}: Error finding container 4172d4813d1cdf8ab86a07d5e82a269de3f3caedd2cde3a41c49812092f95fb8: Status 404 returned error can't find the container with id 4172d4813d1cdf8ab86a07d5e82a269de3f3caedd2cde3a41c49812092f95fb8
Jun 10 23:02:40.119383 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:40.119361    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-t4456"]
Jun 10 23:02:40.122473 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:02:40.122440    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07475e5a_8bce_440d_8eed_aac7af4f3ff6.slice/crio-6e43e64c6752a99fd215b603578251f18be47f0b44549e86ccee381b4af5b798 WatchSource:0}: Error finding container 6e43e64c6752a99fd215b603578251f18be47f0b44549e86ccee381b4af5b798: Status 404 returned error can't find the container with id 6e43e64c6752a99fd215b603578251f18be47f0b44549e86ccee381b4af5b798
Jun 10 23:02:40.307005 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:40.306930    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:40.307156 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:40.307092    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 10 23:02:40.307156 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:40.307113    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848d66fc84-drnlx: secret "image-registry-tls" not found
Jun 10 23:02:40.307269 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:40.307174    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls podName:7538d367-44aa-4cee-b50b-d4be3e02b611 nodeName:}" failed. No retries permitted until 2026-06-10 23:02:41.307155602 +0000 UTC m=+207.464779740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls") pod "image-registry-848d66fc84-drnlx" (UID: "7538d367-44aa-4cee-b50b-d4be3e02b611") : secret "image-registry-tls" not found
Jun 10 23:02:40.345564 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:40.345534    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67"]
Jun 10 23:02:40.348456 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:40.348432    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-5qb7f"]
Jun 10 23:02:40.348868 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:02:40.348825    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d4eb1d_6ab4_4236_b4e9_4462da21f72f.slice/crio-27c8b27d32a53b16f1fd136f969d895fd78bef532e7d33e0b84980a4ce29b59f WatchSource:0}: Error finding container 27c8b27d32a53b16f1fd136f969d895fd78bef532e7d33e0b84980a4ce29b59f: Status 404 returned error can't find the container with id 27c8b27d32a53b16f1fd136f969d895fd78bef532e7d33e0b84980a4ce29b59f
Jun 10 23:02:40.351245 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:02:40.351189    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d6c4d0e_573d_4aae_811e_9c387a814d46.slice/crio-b71d751bca729ce1fcbe866df6d92379e2e546bba1e111623a2f6a27659ac8aa WatchSource:0}: Error finding container b71d751bca729ce1fcbe866df6d92379e2e546bba1e111623a2f6a27659ac8aa: Status 404 returned error can't find the container with id b71d751bca729ce1fcbe866df6d92379e2e546bba1e111623a2f6a27659ac8aa
Jun 10 23:02:40.849498 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:40.849407    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-t4456" event={"ID":"07475e5a-8bce-440d-8eed-aac7af4f3ff6","Type":"ContainerStarted","Data":"6e43e64c6752a99fd215b603578251f18be47f0b44549e86ccee381b4af5b798"}
Jun 10 23:02:40.851026 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:40.850988    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf" event={"ID":"ee19c560-59e2-4020-a607-914123d4d186","Type":"ContainerStarted","Data":"4172d4813d1cdf8ab86a07d5e82a269de3f3caedd2cde3a41c49812092f95fb8"}
Jun 10 23:02:40.853591 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:40.853511    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f" event={"ID":"9d6c4d0e-573d-4aae-811e-9c387a814d46","Type":"ContainerStarted","Data":"b71d751bca729ce1fcbe866df6d92379e2e546bba1e111623a2f6a27659ac8aa"}
Jun 10 23:02:40.855305 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:40.855278    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67" event={"ID":"55d4eb1d-6ab4-4236-b4e9-4462da21f72f","Type":"ContainerStarted","Data":"27c8b27d32a53b16f1fd136f969d895fd78bef532e7d33e0b84980a4ce29b59f"}
Jun 10 23:02:41.314681 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:41.314649    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:41.315035 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:41.314800    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 10 23:02:41.315035 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:41.314824    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848d66fc84-drnlx: secret "image-registry-tls" not found
Jun 10 23:02:41.315035 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:41.314902    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls podName:7538d367-44aa-4cee-b50b-d4be3e02b611 nodeName:}" failed. No retries permitted until 2026-06-10 23:02:43.314881729 +0000 UTC m=+209.472505881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls") pod "image-registry-848d66fc84-drnlx" (UID: "7538d367-44aa-4cee-b50b-d4be3e02b611") : secret "image-registry-tls" not found
Jun 10 23:02:41.860622 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:41.860486    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-t4456" event={"ID":"07475e5a-8bce-440d-8eed-aac7af4f3ff6","Type":"ContainerStarted","Data":"c624c6e45a1d6a4bce192fecca85028b3316fb5cf9bce90f6592b734d584f96c"}
Jun 10 23:02:41.876962 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:41.876894    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-t4456" podStartSLOduration=1.7421571390000001 podStartE2EDuration="2.876874032s" totalImagesPullingTime="1.134716893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:02:41.875313328 +0000 UTC m=+208.032937486" watchObservedRunningTime="2026-06-10 23:02:41.876874032 +0000 UTC m=+208.034498190"
Jun 10 23:02:41.950739 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:41.950650    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:43.333455 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:43.333369    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:43.333868 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:43.333536    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 10 23:02:43.333868 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:43.333561    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848d66fc84-drnlx: secret "image-registry-tls" not found
Jun 10 23:02:43.333868 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:43.333624    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls podName:7538d367-44aa-4cee-b50b-d4be3e02b611 nodeName:}" failed. No retries permitted until 2026-06-10 23:02:47.333605908 +0000 UTC m=+213.491230047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls") pod "image-registry-848d66fc84-drnlx" (UID: "7538d367-44aa-4cee-b50b-d4be3e02b611") : secret "image-registry-tls" not found
Jun 10 23:02:43.334450 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:43.334412    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:43.435417 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:43.435384    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:43.867864 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:43.867834    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/0.log"
Jun 10 23:02:43.868034 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:43.867884    2577 generic.go:356] "Generic (PLEG): container finished" podID="9d6c4d0e-573d-4aae-811e-9c387a814d46" containerID="cdeb7ee13197032d0c8728bb29a471dcad44d40427b27af70317429f288d98ac" exitCode=255
Jun 10 23:02:43.868034 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:43.867947    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f" event={"ID":"9d6c4d0e-573d-4aae-811e-9c387a814d46","Type":"ContainerDied","Data":"cdeb7ee13197032d0c8728bb29a471dcad44d40427b27af70317429f288d98ac"}
Jun 10 23:02:43.868166 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:43.868152    2577 scope.go:117] "RemoveContainer" containerID="cdeb7ee13197032d0c8728bb29a471dcad44d40427b27af70317429f288d98ac"
Jun 10 23:02:43.869624 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:43.869599    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67" event={"ID":"55d4eb1d-6ab4-4236-b4e9-4462da21f72f","Type":"ContainerStarted","Data":"162b1fc3e5ee84bf3dff3131521485abf9dc55a45499b71c89fc30bfaa420a12"}
Jun 10 23:02:43.871231 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:43.871202    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf" event={"ID":"ee19c560-59e2-4020-a607-914123d4d186","Type":"ContainerStarted","Data":"dd2454790d2fe0e65e4e653ee1ae65f7930e3e8cec1b4ff856f0cf2b476aab2c"}
Jun 10 23:02:43.896269 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:43.896226    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67" podStartSLOduration=2.250739805 podStartE2EDuration="4.896210938s" totalImagesPullingTime="2.645471133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:02:43.895500882 +0000 UTC m=+210.053125033" watchObservedRunningTime="2026-06-10 23:02:43.896210938 +0000 UTC m=+210.053835096"
Jun 10 23:02:44.165187 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.165077    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf" podStartSLOduration=2.292923082 podStartE2EDuration="5.165056135s" totalImagesPullingTime="2.872133053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:02:43.908996583 +0000 UTC m=+210.066620741" watchObservedRunningTime="2026-06-10 23:02:44.165056135 +0000 UTC m=+210.322680300"
Jun 10 23:02:44.166012 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.165982    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-84xww"]
Jun 10 23:02:44.166208 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.166183    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:44.168878 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.168861    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-84xww"
Jun 10 23:02:44.171055 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.171034    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jun 10 23:02:44.171055 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.171042    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6mmkr\""
Jun 10 23:02:44.171225 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.171180    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jun 10 23:02:44.176172 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.176119    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-84xww"]
Jun 10 23:02:44.240606 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.240568    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnl68\" (UniqueName: \"kubernetes.io/projected/1825ab36-4f9b-41e9-a177-092d5ee68655-kube-api-access-cnl68\") pod \"migrator-955ffdf5f-84xww\" (UID: \"1825ab36-4f9b-41e9-a177-092d5ee68655\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-84xww"
Jun 10 23:02:44.257521 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.254546    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:44.341940 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.341905    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnl68\" (UniqueName: \"kubernetes.io/projected/1825ab36-4f9b-41e9-a177-092d5ee68655-kube-api-access-cnl68\") pod \"migrator-955ffdf5f-84xww\" (UID: \"1825ab36-4f9b-41e9-a177-092d5ee68655\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-84xww"
Jun 10 23:02:44.349081 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.349053    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnl68\" (UniqueName: \"kubernetes.io/projected/1825ab36-4f9b-41e9-a177-092d5ee68655-kube-api-access-cnl68\") pod \"migrator-955ffdf5f-84xww\" (UID: \"1825ab36-4f9b-41e9-a177-092d5ee68655\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-84xww"
Jun 10 23:02:44.354427 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.354405    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:44.407829 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.407801    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:44.478377 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.478304    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-84xww"
Jun 10 23:02:44.594731 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.594699    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-84xww"]
Jun 10 23:02:44.597665 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:02:44.597639    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1825ab36_4f9b_41e9_a177_092d5ee68655.slice/crio-e51bbacfc8e4e7be5b6b14e53f84824ef4ca3f81331b212ae7f387e4d5020696 WatchSource:0}: Error finding container e51bbacfc8e4e7be5b6b14e53f84824ef4ca3f81331b212ae7f387e4d5020696: Status 404 returned error can't find the container with id e51bbacfc8e4e7be5b6b14e53f84824ef4ca3f81331b212ae7f387e4d5020696
Jun 10 23:02:44.813251 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.813177    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:44.871605 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.871562    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:44.874723 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.874694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-84xww" event={"ID":"1825ab36-4f9b-41e9-a177-092d5ee68655","Type":"ContainerStarted","Data":"e51bbacfc8e4e7be5b6b14e53f84824ef4ca3f81331b212ae7f387e4d5020696"}
Jun 10 23:02:44.876124 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.876104    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/1.log"
Jun 10 23:02:44.876451 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.876438    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/0.log"
Jun 10 23:02:44.876514 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.876471    2577 generic.go:356] "Generic (PLEG): container finished" podID="9d6c4d0e-573d-4aae-811e-9c387a814d46" containerID="4df253820b367b48e56abebfbe53c4b89528116b57b27347b1e3303dfba1fc9f" exitCode=255
Jun 10 23:02:44.876555 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.876540    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f" event={"ID":"9d6c4d0e-573d-4aae-811e-9c387a814d46","Type":"ContainerDied","Data":"4df253820b367b48e56abebfbe53c4b89528116b57b27347b1e3303dfba1fc9f"}
Jun 10 23:02:44.876604 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.876578    2577 scope.go:117] "RemoveContainer" containerID="cdeb7ee13197032d0c8728bb29a471dcad44d40427b27af70317429f288d98ac"
Jun 10 23:02:44.876781 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:44.876762    2577 scope.go:117] "RemoveContainer" containerID="4df253820b367b48e56abebfbe53c4b89528116b57b27347b1e3303dfba1fc9f"
Jun 10 23:02:44.876989 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:44.876966    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-5qb7f_openshift-console-operator(9d6c4d0e-573d-4aae-811e-9c387a814d46)\"" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f" podUID="9d6c4d0e-573d-4aae-811e-9c387a814d46"
Jun 10 23:02:45.091817 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:45.091742    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:45.190138 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:45.190110    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:45.444493 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:45.444457    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pm4l7_fe618dc0-9887-4d65-b68a-afdb1ce1365e/dns-node-resolver/0.log"
Jun 10 23:02:45.880921 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:45.880887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-84xww" event={"ID":"1825ab36-4f9b-41e9-a177-092d5ee68655","Type":"ContainerStarted","Data":"dc1b2e7d708ec9c9418ae939562c7c119174a149d277aaa9e4d58d0a030a0bb5"}
Jun 10 23:02:45.881127 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:45.880953    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-84xww" event={"ID":"1825ab36-4f9b-41e9-a177-092d5ee68655","Type":"ContainerStarted","Data":"8f8257f14e524fa97d0bd08c46f928e903037500bae720be434ba9c918c20a21"}
Jun 10 23:02:45.882348 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:45.882325    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/1.log"
Jun 10 23:02:45.882611 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:45.882597    2577 scope.go:117] "RemoveContainer" containerID="4df253820b367b48e56abebfbe53c4b89528116b57b27347b1e3303dfba1fc9f"
Jun 10 23:02:45.882744 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:45.882728    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-5qb7f_openshift-console-operator(9d6c4d0e-573d-4aae-811e-9c387a814d46)\"" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f" podUID="9d6c4d0e-573d-4aae-811e-9c387a814d46"
Jun 10 23:02:45.897163 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:45.897124    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-84xww" podStartSLOduration=0.966065005 podStartE2EDuration="1.897112887s" totalImagesPullingTime="931.047882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:02:45.896202055 +0000 UTC m=+212.053826223" watchObservedRunningTime="2026-06-10 23:02:45.897112887 +0000 UTC m=+212.054737045"
Jun 10 23:02:45.986836 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:45.986812    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:46.039596 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:46.039572    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:46.244564 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:46.244491    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-klpjf_2fad7168-329e-4592-b5cb-8ff587c89170/node-ca/0.log"
Jun 10 23:02:46.723535 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:46.723502    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:46.825361 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:46.825332    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:47.245440 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:47.245411    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vddps_3dafdac3-c9a8-4928-99dd-92a008b6bc5f/serve-healthcheck-canary/0.log"
Jun 10 23:02:47.367385 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:47.367355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:47.367518 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:47.367469    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 10 23:02:47.367518 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:47.367481    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-848d66fc84-drnlx: secret "image-registry-tls" not found
Jun 10 23:02:47.367593 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:47.367527    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls podName:7538d367-44aa-4cee-b50b-d4be3e02b611 nodeName:}" failed. No retries permitted until 2026-06-10 23:02:55.367515222 +0000 UTC m=+221.525139358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls") pod "image-registry-848d66fc84-drnlx" (UID: "7538d367-44aa-4cee-b50b-d4be3e02b611") : secret "image-registry-tls" not found
Jun 10 23:02:47.641229 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:47.641199    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:49.978364 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:49.978339    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:02:49.978732 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:49.978382    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:02:49.978732 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:49.978674    2577 scope.go:117] "RemoveContainer" containerID="4df253820b367b48e56abebfbe53c4b89528116b57b27347b1e3303dfba1fc9f"
Jun 10 23:02:49.978824 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:02:49.978805    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-5qb7f_openshift-console-operator(9d6c4d0e-573d-4aae-811e-9c387a814d46)\"" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f" podUID="9d6c4d0e-573d-4aae-811e-9c387a814d46"
Jun 10 23:02:50.395797 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:50.395763    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:50.566906 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:50.566878    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:50.744478 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:50.744406    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:50.817233 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:50.817210    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:50.886053 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:50.886024    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:50.999992 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:50.999926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:51.126015 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:51.125982    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:51.283105 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:51.283039    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:52.461819 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:52.461740    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:52.661914 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:52.661888    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:52.874925 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:52.874898    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:53.074236 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:53.074205    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:53.267664 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:53.267587    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:53.875705 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:53.875672    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:54.325396 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:54.325317    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:54.459010 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:54.458980    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:54.515774 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:54.515748    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:54.660483 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:54.660452    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:54.865649 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:54.865619    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:55.064525 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:55.064442    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:55.266802 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:55.266773    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:55.424886 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:55.424836    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:55.427259 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:55.427237    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls\") pod \"image-registry-848d66fc84-drnlx\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") " pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:55.582683 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:55.582651    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:55.703343 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:55.703282    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-848d66fc84-drnlx"]
Jun 10 23:02:55.707233 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:02:55.707209    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7538d367_44aa_4cee_b50b_d4be3e02b611.slice/crio-97077045f7b16c6434d5f5955e79854e423250293e970601134e3940418e159f WatchSource:0}: Error finding container 97077045f7b16c6434d5f5955e79854e423250293e970601134e3940418e159f: Status 404 returned error can't find the container with id 97077045f7b16c6434d5f5955e79854e423250293e970601134e3940418e159f
Jun 10 23:02:55.916317 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:55.916277    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-848d66fc84-drnlx" event={"ID":"7538d367-44aa-4cee-b50b-d4be3e02b611","Type":"ContainerStarted","Data":"ca0fd65694b5987361264d5fd2641fa8a80cfdc0889f553a84790ee33e13f80e"}
Jun 10 23:02:55.916480 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:55.916327    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-848d66fc84-drnlx" event={"ID":"7538d367-44aa-4cee-b50b-d4be3e02b611","Type":"ContainerStarted","Data":"97077045f7b16c6434d5f5955e79854e423250293e970601134e3940418e159f"}
Jun 10 23:02:55.916480 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:55.916355    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:02:55.934953 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:55.934910    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-848d66fc84-drnlx" podStartSLOduration=16.934895358 podStartE2EDuration="16.934895358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:02:55.934222675 +0000 UTC m=+222.091846833" watchObservedRunningTime="2026-06-10 23:02:55.934895358 +0000 UTC m=+222.092519515"
Jun 10 23:02:56.380563 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:56.380529    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:56.480828 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:56.480783    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:56.669129 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:56.669056    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:56.868302 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:56.868269    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:57.063516 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:57.063436    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:57.250053 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:57.250023    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:57.352125 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:57.352097    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:58.260584 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:58.260556    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:58.458306 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:58.458278    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:58.862641 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:58.862611    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:59.067257 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:59.067228    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:02:59.664272 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:02:59.664238    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:00.063263 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:00.063183    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:00.266693 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:00.266664    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:00.463139 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:00.463112    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:01.064777 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:01.064744    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:01.261473 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:01.261439    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:02.383402 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:02.383368    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:02.485181 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:02.485153    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:02.643530 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:02.643441    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:02.701351 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:02.701320    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:04.252588 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:04.252561    2577 scope.go:117] "RemoveContainer" containerID="4df253820b367b48e56abebfbe53c4b89528116b57b27347b1e3303dfba1fc9f"
Jun 10 23:03:04.945017 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:04.944992    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:03:04.945365 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:04.945351    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/1.log"
Jun 10 23:03:04.945407 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:04.945383    2577 generic.go:356] "Generic (PLEG): container finished" podID="9d6c4d0e-573d-4aae-811e-9c387a814d46" containerID="c006586849c7a084f927da37e3bfa41e516cde98c2781b3fb879ff37bfbe1176" exitCode=255
Jun 10 23:03:04.945452 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:04.945439    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f" event={"ID":"9d6c4d0e-573d-4aae-811e-9c387a814d46","Type":"ContainerDied","Data":"c006586849c7a084f927da37e3bfa41e516cde98c2781b3fb879ff37bfbe1176"}
Jun 10 23:03:04.945498 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:04.945485    2577 scope.go:117] "RemoveContainer" containerID="4df253820b367b48e56abebfbe53c4b89528116b57b27347b1e3303dfba1fc9f"
Jun 10 23:03:04.945789 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:04.945767    2577 scope.go:117] "RemoveContainer" containerID="c006586849c7a084f927da37e3bfa41e516cde98c2781b3fb879ff37bfbe1176"
Jun 10 23:03:04.945967 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:03:04.945947    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-5qb7f_openshift-console-operator(9d6c4d0e-573d-4aae-811e-9c387a814d46)\"" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f" podUID="9d6c4d0e-573d-4aae-811e-9c387a814d46"
Jun 10 23:03:05.950311 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:05.950283    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:03:09.204208 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.204176    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b55f2"]
Jun 10 23:03:09.232269 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.232247    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b55f2"]
Jun 10 23:03:09.232409 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.232342    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.234535 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.234510    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 10 23:03:09.234648 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.234514    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 10 23:03:09.234713 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.234651    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f6kv2\""
Jun 10 23:03:09.235025 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.235008    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 10 23:03:09.235096 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.235021    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 10 23:03:09.273023 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.272997    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-848d66fc84-drnlx"]
Jun 10 23:03:09.310569 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.310543    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59c5f755bc-5khnm"]
Jun 10 23:03:09.325921 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.325894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1d9880b-799c-4a75-8008-ed61945402cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b55f2\" (UID: \"b1d9880b-799c-4a75-8008-ed61945402cd\") " pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.326043 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.325928    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txtbw\" (UniqueName: \"kubernetes.io/projected/b1d9880b-799c-4a75-8008-ed61945402cd-kube-api-access-txtbw\") pod \"insights-runtime-extractor-b55f2\" (UID: \"b1d9880b-799c-4a75-8008-ed61945402cd\") " pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.326043 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.325961    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1d9880b-799c-4a75-8008-ed61945402cd-data-volume\") pod \"insights-runtime-extractor-b55f2\" (UID: \"b1d9880b-799c-4a75-8008-ed61945402cd\") " pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.326043 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.326003    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1d9880b-799c-4a75-8008-ed61945402cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b55f2\" (UID: \"b1d9880b-799c-4a75-8008-ed61945402cd\") " pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.326150 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.326063    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1d9880b-799c-4a75-8008-ed61945402cd-crio-socket\") pod \"insights-runtime-extractor-b55f2\" (UID: \"b1d9880b-799c-4a75-8008-ed61945402cd\") " pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.336166 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.336143    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59c5f755bc-5khnm"]
Jun 10 23:03:09.336267 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.336224    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.407710 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.407683    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:09.426881 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.426840    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-ca-trust-extracted\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.426995 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.426900    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-image-registry-private-configuration\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.426995 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.426933    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-trusted-ca\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.426995 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.426985    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1d9880b-799c-4a75-8008-ed61945402cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b55f2\" (UID: \"b1d9880b-799c-4a75-8008-ed61945402cd\") " pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.427119 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.427001    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txtbw\" (UniqueName: \"kubernetes.io/projected/b1d9880b-799c-4a75-8008-ed61945402cd-kube-api-access-txtbw\") pod \"insights-runtime-extractor-b55f2\" (UID: \"b1d9880b-799c-4a75-8008-ed61945402cd\") " pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.427119 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.427023    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1d9880b-799c-4a75-8008-ed61945402cd-data-volume\") pod \"insights-runtime-extractor-b55f2\" (UID: \"b1d9880b-799c-4a75-8008-ed61945402cd\") " pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.427119 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.427038    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-registry-tls\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.427119 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.427061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1d9880b-799c-4a75-8008-ed61945402cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b55f2\" (UID: \"b1d9880b-799c-4a75-8008-ed61945402cd\") " pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.427299 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.427145    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-installation-pull-secrets\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.427299 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.427175    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-bound-sa-token\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.427299 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.427196    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1d9880b-799c-4a75-8008-ed61945402cd-crio-socket\") pod \"insights-runtime-extractor-b55f2\" (UID: \"b1d9880b-799c-4a75-8008-ed61945402cd\") " pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.427299 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.427212    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-registry-certificates\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.427299 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.427267    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vszsm\" (UniqueName: \"kubernetes.io/projected/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-kube-api-access-vszsm\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.427299 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.427285    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1d9880b-799c-4a75-8008-ed61945402cd-crio-socket\") pod \"insights-runtime-extractor-b55f2\" (UID: \"b1d9880b-799c-4a75-8008-ed61945402cd\") " pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.427517 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.427455    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1d9880b-799c-4a75-8008-ed61945402cd-data-volume\") pod \"insights-runtime-extractor-b55f2\" (UID: \"b1d9880b-799c-4a75-8008-ed61945402cd\") " pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.427657 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.427638    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1d9880b-799c-4a75-8008-ed61945402cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b55f2\" (UID: \"b1d9880b-799c-4a75-8008-ed61945402cd\") " pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.429402 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.429379    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1d9880b-799c-4a75-8008-ed61945402cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b55f2\" (UID: \"b1d9880b-799c-4a75-8008-ed61945402cd\") " pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.439106 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.439089    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txtbw\" (UniqueName: \"kubernetes.io/projected/b1d9880b-799c-4a75-8008-ed61945402cd-kube-api-access-txtbw\") pod \"insights-runtime-extractor-b55f2\" (UID: \"b1d9880b-799c-4a75-8008-ed61945402cd\") " pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.504704 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.504639    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:09.527931 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.527898    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vszsm\" (UniqueName: \"kubernetes.io/projected/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-kube-api-access-vszsm\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.528049 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.527940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-ca-trust-extracted\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.528049 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.527982    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-image-registry-private-configuration\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.528049 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.528007    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-trusted-ca\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.528049 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.528042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-registry-tls\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.528249 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.528113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-installation-pull-secrets\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.528249 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.528170    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-bound-sa-token\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.528249 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.528204    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-registry-certificates\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.528419 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.528384    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-ca-trust-extracted\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.529020 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.528998    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-trusted-ca\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.529238 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.529212    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-registry-certificates\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.530530 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.530494    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-installation-pull-secrets\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.530610 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.530511    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-registry-tls\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.530610 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.530592    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-image-registry-private-configuration\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.538976 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.538955    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-bound-sa-token\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.539149 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.539134    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vszsm\" (UniqueName: \"kubernetes.io/projected/6ad9d9ec-6bef-43e4-9e87-6eb0304bb630-kube-api-access-vszsm\") pod \"image-registry-59c5f755bc-5khnm\" (UID: \"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630\") " pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.541925 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.541912    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b55f2"
Jun 10 23:03:09.644562 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.644534    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.693115 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.693090    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b55f2"]
Jun 10 23:03:09.695342 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:03:09.695320    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1d9880b_799c_4a75_8008_ed61945402cd.slice/crio-d229d6505785d3cbcbc89e76d47a6fccd89fdf7ba1a786c8d1e8c37b5afab2ce WatchSource:0}: Error finding container d229d6505785d3cbcbc89e76d47a6fccd89fdf7ba1a786c8d1e8c37b5afab2ce: Status 404 returned error can't find the container with id d229d6505785d3cbcbc89e76d47a6fccd89fdf7ba1a786c8d1e8c37b5afab2ce
Jun 10 23:03:09.794438 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.793969    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59c5f755bc-5khnm"]
Jun 10 23:03:09.799318 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:03:09.799284    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad9d9ec_6bef_43e4_9e87_6eb0304bb630.slice/crio-fd419c8afc5009382e0b0fb1fd44a128083bd3684409fadf826c234f0d1d5718 WatchSource:0}: Error finding container fd419c8afc5009382e0b0fb1fd44a128083bd3684409fadf826c234f0d1d5718: Status 404 returned error can't find the container with id fd419c8afc5009382e0b0fb1fd44a128083bd3684409fadf826c234f0d1d5718
Jun 10 23:03:09.964485 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.964446    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm" event={"ID":"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630","Type":"ContainerStarted","Data":"d56d57b730b338eb17513a2d88deac8ccbda88091103c5b364464634c1f51a44"}
Jun 10 23:03:09.964654 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.964508    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm" event={"ID":"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630","Type":"ContainerStarted","Data":"fd419c8afc5009382e0b0fb1fd44a128083bd3684409fadf826c234f0d1d5718"}
Jun 10 23:03:09.964654 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.964537    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:09.965994 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.965969    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b55f2" event={"ID":"b1d9880b-799c-4a75-8008-ed61945402cd","Type":"ContainerStarted","Data":"1fc91b988471f89e04f6db5fb47f97c29dfdfc37cff9f8bf02293cfa04630191"}
Jun 10 23:03:09.966101 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.966013    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b55f2" event={"ID":"b1d9880b-799c-4a75-8008-ed61945402cd","Type":"ContainerStarted","Data":"d229d6505785d3cbcbc89e76d47a6fccd89fdf7ba1a786c8d1e8c37b5afab2ce"}
Jun 10 23:03:09.978742 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.978710    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:03:09.978839 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.978766    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:03:09.979089 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.979074    2577 scope.go:117] "RemoveContainer" containerID="c006586849c7a084f927da37e3bfa41e516cde98c2781b3fb879ff37bfbe1176"
Jun 10 23:03:09.979249 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:03:09.979230    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-5qb7f_openshift-console-operator(9d6c4d0e-573d-4aae-811e-9c387a814d46)\"" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f" podUID="9d6c4d0e-573d-4aae-811e-9c387a814d46"
Jun 10 23:03:09.985413 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:09.985372    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm" podStartSLOduration=0.985359047 podStartE2EDuration="985.359047ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:03:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:03:09.983935961 +0000 UTC m=+236.141560120" watchObservedRunningTime="2026-06-10 23:03:09.985359047 +0000 UTC m=+236.142983183"
Jun 10 23:03:10.971578 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:10.971500    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b55f2" event={"ID":"b1d9880b-799c-4a75-8008-ed61945402cd","Type":"ContainerStarted","Data":"19b4087a0d039365aabfce04821e7feb20ca360007fc2d1268ca9b3ccd0012c2"}
Jun 10 23:03:12.980514 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:12.980476    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b55f2" event={"ID":"b1d9880b-799c-4a75-8008-ed61945402cd","Type":"ContainerStarted","Data":"d5baeb42eb4029e786173290441d36f63026c35b3aff461c19b6d40a05a927d5"}
Jun 10 23:03:12.998731 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:12.998686    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-b55f2" podStartSLOduration=1.5848468709999999 podStartE2EDuration="3.998673392s" totalImagesPullingTime="2.413826521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 23:03:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:03:12.997815037 +0000 UTC m=+239.155439196" watchObservedRunningTime="2026-06-10 23:03:12.998673392 +0000 UTC m=+239.156297549"
Jun 10 23:03:14.038458 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:14.038426    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:14.132771 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:14.132731    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:14.204341 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:14.204313    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:14.363970 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:14.363942    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:16.207625 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:16.207594    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:16.269343 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:16.269318    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:16.417618 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:16.417592    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:17.963163 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:17.963130    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:19.278088 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.278055    2577 patch_prober.go:28] interesting pod/image-registry-848d66fc84-drnlx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 10 23:03:19.278524 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.278110    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-848d66fc84-drnlx" podUID="7538d367-44aa-4cee-b50b-d4be3e02b611" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 10 23:03:19.328205 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.328175    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:19.451722 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.451691    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:19.558070 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.557986    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:19.574090 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.574066    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zp8hh"]
Jun 10 23:03:19.578634 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.578619    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.581034 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.581009    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 10 23:03:19.581034 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.581027    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 10 23:03:19.581034 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.581029    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 10 23:03:19.581221 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.581029    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9pdvb\""
Jun 10 23:03:19.581693 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.581676    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 10 23:03:19.581774 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.581679    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 10 23:03:19.581774 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.581741    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 10 23:03:19.635665 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.635632    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:19.707600 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.707559    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-node-exporter-textfile\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.707786 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.707608    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-node-exporter-accelerators-collector-config\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.707786 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.707640    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-node-exporter-wtmp\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.707786 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.707668    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-sys\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.707786 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.707728    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.708005 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.707805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-node-exporter-tls\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.708005 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.707824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-root\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.708005 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.707840    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-metrics-client-ca\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.708005 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.707919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhcb9\" (UniqueName: \"kubernetes.io/projected/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-kube-api-access-mhcb9\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.734165 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.734135    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:19.808446 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.808380    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-sys\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.808446 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.808419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.808633 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.808478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-node-exporter-tls\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.808633 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.808496    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-root\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.808633 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.808498    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-sys\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.808633 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.808519    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-metrics-client-ca\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.808633 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.808556    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-root\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.808896 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.808683    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhcb9\" (UniqueName: \"kubernetes.io/projected/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-kube-api-access-mhcb9\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.808896 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.808715    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-node-exporter-textfile\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.808896 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.808748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-node-exporter-accelerators-collector-config\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.808896 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.808782    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-node-exporter-wtmp\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.809087 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.808953    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-node-exporter-wtmp\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.809180 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.809159    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-metrics-client-ca\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.809238 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.809210    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-node-exporter-textfile\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.809447 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.809428    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-node-exporter-accelerators-collector-config\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.811342 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.811311    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-node-exporter-tls\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.811433 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.811349    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.815874 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.815830    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhcb9\" (UniqueName: \"kubernetes.io/projected/ee03dc6e-68a4-4ed0-9152-cca82c57bc12-kube-api-access-mhcb9\") pod \"node-exporter-zp8hh\" (UID: \"ee03dc6e-68a4-4ed0-9152-cca82c57bc12\") " pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.836997 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.836970    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:19.886998 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.886973    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zp8hh"
Jun 10 23:03:19.898299 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:03:19.898276    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee03dc6e_68a4_4ed0_9152_cca82c57bc12.slice/crio-af696d120ef00ad15e08ace8622e1b89308223ce86e7f71f4475b1a946f0785c WatchSource:0}: Error finding container af696d120ef00ad15e08ace8622e1b89308223ce86e7f71f4475b1a946f0785c: Status 404 returned error can't find the container with id af696d120ef00ad15e08ace8622e1b89308223ce86e7f71f4475b1a946f0785c
Jun 10 23:03:19.935206 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:19.935179    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:20.000489 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.000469    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zp8hh" event={"ID":"ee03dc6e-68a4-4ed0-9152-cca82c57bc12","Type":"ContainerStarted","Data":"af696d120ef00ad15e08ace8622e1b89308223ce86e7f71f4475b1a946f0785c"}
Jun 10 23:03:20.034201 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.034177    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:20.483777 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.483748    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:20.578915 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.578878    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:20.639660 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.639629    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 23:03:20.643276 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.643259    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.645424 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.645405    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 10 23:03:20.645690 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.645650    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 10 23:03:20.645807 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.645719    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 10 23:03:20.645807 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.645657    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 10 23:03:20.645807 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.645658    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w8wr9\""
Jun 10 23:03:20.645807 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.645798    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 10 23:03:20.646075 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.646061    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 10 23:03:20.646175 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.646154    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 10 23:03:20.646357 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.646336    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 10 23:03:20.646357 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.646352    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 10 23:03:20.659411 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.659389    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 23:03:20.665472 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.665449    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:20.718796 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.718766    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.718952 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.718816    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ab8aba6-f291-44c9-9e4d-124521b7b678-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.718952 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.718841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.718952 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.718901    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.718952 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.718923    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b658s\" (UniqueName: \"kubernetes.io/projected/0ab8aba6-f291-44c9-9e4d-124521b7b678-kube-api-access-b658s\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.719134 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.718992    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-web-config\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.719134 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.719028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.719134 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.719054    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ab8aba6-f291-44c9-9e4d-124521b7b678-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.719134 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.719107    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ab8aba6-f291-44c9-9e4d-124521b7b678-config-out\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.719134 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.719128    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ab8aba6-f291-44c9-9e4d-124521b7b678-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.719394 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.719176    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.719394 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.719194    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.719394 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.719230    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ab8aba6-f291-44c9-9e4d-124521b7b678-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.819839 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.819753    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-web-config\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.819839 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.819789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.819839 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.819809    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ab8aba6-f291-44c9-9e4d-124521b7b678-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.820123 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.819863    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ab8aba6-f291-44c9-9e4d-124521b7b678-config-out\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.820123 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.819897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ab8aba6-f291-44c9-9e4d-124521b7b678-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.820123 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.819950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.820123 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.819977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.820123 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.820010    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ab8aba6-f291-44c9-9e4d-124521b7b678-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.820123 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.820068    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.820123 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.820100    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ab8aba6-f291-44c9-9e4d-124521b7b678-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.820123 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.820122    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.820478 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.820150    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.820478 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.820167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b658s\" (UniqueName: \"kubernetes.io/projected/0ab8aba6-f291-44c9-9e4d-124521b7b678-kube-api-access-b658s\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.821127 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.820768    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ab8aba6-f291-44c9-9e4d-124521b7b678-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.821127 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.820829    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ab8aba6-f291-44c9-9e4d-124521b7b678-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.821127 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:03:20.821008    2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jun 10 23:03:20.821127 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:03:20.821078    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-main-tls podName:0ab8aba6-f291-44c9-9e4d-124521b7b678 nodeName:}" failed. No retries permitted until 2026-06-10 23:03:21.321058043 +0000 UTC m=+247.478682181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0ab8aba6-f291-44c9-9e4d-124521b7b678") : secret "alertmanager-main-tls" not found
Jun 10 23:03:20.821127 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.821097    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ab8aba6-f291-44c9-9e4d-124521b7b678-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.822953 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.822667    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ab8aba6-f291-44c9-9e4d-124521b7b678-config-out\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.823309 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.823266    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.823699 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.823679    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.823835 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.823815    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ab8aba6-f291-44c9-9e4d-124521b7b678-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.823922 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.823897    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-web-config\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.824309 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.824291    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.824696 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.824680    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.824953 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.824933    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:20.831823 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:20.831802    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b658s\" (UniqueName: \"kubernetes.io/projected/0ab8aba6-f291-44c9-9e4d-124521b7b678-kube-api-access-b658s\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:21.005213 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:21.005178    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zp8hh" event={"ID":"ee03dc6e-68a4-4ed0-9152-cca82c57bc12","Type":"ContainerStarted","Data":"43d3aef088121acea16c488e77a88ee81d0af9090da26df083c8d4920805a659"}
Jun 10 23:03:21.046480 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:21.046453    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:21.324740 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:21.324696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:21.327080 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:21.327051    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:21.555458 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:21.555410    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:03:21.685704 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:21.685681    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 23:03:21.687644 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:03:21.687617    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab8aba6_f291_44c9_9e4d_124521b7b678.slice/crio-92410432c6b1d0ece54c64b25413cefb71a884ff99ea6a576805aa4beec9edd2 WatchSource:0}: Error finding container 92410432c6b1d0ece54c64b25413cefb71a884ff99ea6a576805aa4beec9edd2: Status 404 returned error can't find the container with id 92410432c6b1d0ece54c64b25413cefb71a884ff99ea6a576805aa4beec9edd2
Jun 10 23:03:22.010001 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.009905    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ab8aba6-f291-44c9-9e4d-124521b7b678","Type":"ContainerStarted","Data":"92410432c6b1d0ece54c64b25413cefb71a884ff99ea6a576805aa4beec9edd2"}
Jun 10 23:03:22.011239 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.011204    2577 generic.go:356] "Generic (PLEG): container finished" podID="ee03dc6e-68a4-4ed0-9152-cca82c57bc12" containerID="43d3aef088121acea16c488e77a88ee81d0af9090da26df083c8d4920805a659" exitCode=0
Jun 10 23:03:22.011239 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.011240    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zp8hh" event={"ID":"ee03dc6e-68a4-4ed0-9152-cca82c57bc12","Type":"ContainerDied","Data":"43d3aef088121acea16c488e77a88ee81d0af9090da26df083c8d4920805a659"}
Jun 10 23:03:22.483879 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.483835    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:22.551820 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.551787    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:22.555071 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.555046    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-556859b59d-qk7bx"]
Jun 10 23:03:22.558943 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.558922    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.561112 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.561087    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 10 23:03:22.561237 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.561126    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 10 23:03:22.561237 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.561188    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 10 23:03:22.561403 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.561360    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 10 23:03:22.561471 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.561443    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-67w7d\""
Jun 10 23:03:22.561536 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.561497    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 10 23:03:22.561682 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.561663    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-crvfb48fnv173\""
Jun 10 23:03:22.570238 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.570214    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-556859b59d-qk7bx"]
Jun 10 23:03:22.634125 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.634101    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-thanos-querier-tls\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.634263 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.634147    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.634263 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.634197    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-metrics-client-ca\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.634362 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.634282    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44rrw\" (UniqueName: \"kubernetes.io/projected/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-kube-api-access-44rrw\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.634362 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.634312    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.634451 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.634356    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-grpc-tls\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.634451 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.634426    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.634520 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.634477    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.671642 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.671621    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:22.735275 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.735224    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.735275 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.735259    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-metrics-client-ca\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.735392 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.735308    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44rrw\" (UniqueName: \"kubernetes.io/projected/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-kube-api-access-44rrw\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.735392 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.735348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.735392 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.735376    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-grpc-tls\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.735547 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.735511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.735603 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.735589    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.735680 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.735647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-thanos-querier-tls\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.736124 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.736084    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-metrics-client-ca\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.738115 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.738089    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.738347 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.738126    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-thanos-querier-tls\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.738347 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.738169    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-grpc-tls\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.738347 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.738176    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.738522 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.738429    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.738784 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.738764    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.743231 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.743215    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44rrw\" (UniqueName: \"kubernetes.io/projected/9e0c3a35-b1a2-4332-be76-ea8a04b4b15f-kube-api-access-44rrw\") pod \"thanos-querier-556859b59d-qk7bx\" (UID: \"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f\") " pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.773127 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.773102    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:22.869489 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.869458    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:22.991595 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:22.991524    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-556859b59d-qk7bx"]
Jun 10 23:03:22.994598 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:03:22.994575    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e0c3a35_b1a2_4332_be76_ea8a04b4b15f.slice/crio-2194c7f2c532b65c608b2c95a0cb6c97cacbaf53b92003338fa6af924d8778ba WatchSource:0}: Error finding container 2194c7f2c532b65c608b2c95a0cb6c97cacbaf53b92003338fa6af924d8778ba: Status 404 returned error can't find the container with id 2194c7f2c532b65c608b2c95a0cb6c97cacbaf53b92003338fa6af924d8778ba
Jun 10 23:03:23.015837 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:23.015813    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zp8hh" event={"ID":"ee03dc6e-68a4-4ed0-9152-cca82c57bc12","Type":"ContainerStarted","Data":"c7bc046d400a0cfaf7292b9caffbb102a68f4629417f372bb54734ccf0daeb69"}
Jun 10 23:03:23.015956 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:23.015872    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zp8hh" event={"ID":"ee03dc6e-68a4-4ed0-9152-cca82c57bc12","Type":"ContainerStarted","Data":"349be7fc48c6014d9c2abc4ebfcdcbf678a62607ebc5e7d9d873eea22ad60551"}
Jun 10 23:03:23.017322 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:23.017303    2577 generic.go:356] "Generic (PLEG): container finished" podID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerID="89ae5f8c9aff172e8bd88af0474d59c24bc6248d2250206299bbf9ff70d9fe2e" exitCode=0
Jun 10 23:03:23.017417 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:23.017352    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ab8aba6-f291-44c9-9e4d-124521b7b678","Type":"ContainerDied","Data":"89ae5f8c9aff172e8bd88af0474d59c24bc6248d2250206299bbf9ff70d9fe2e"}
Jun 10 23:03:23.018550 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:23.018530    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx" event={"ID":"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f","Type":"ContainerStarted","Data":"2194c7f2c532b65c608b2c95a0cb6c97cacbaf53b92003338fa6af924d8778ba"}
Jun 10 23:03:23.033771 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:23.033729    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zp8hh" podStartSLOduration=2.987302492 podStartE2EDuration="4.033716887s" totalImagesPullingTime="983.721828ms" totalInitContainerRuntime="62.692567ms" isStatefulPod=true podCreationTimestamp="2026-06-10 23:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:03:23.033454052 +0000 UTC m=+249.191078210" watchObservedRunningTime="2026-06-10 23:03:23.033716887 +0000 UTC m=+249.191341045"
Jun 10 23:03:23.251270 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:23.251208    2577 scope.go:117] "RemoveContainer" containerID="c006586849c7a084f927da37e3bfa41e516cde98c2781b3fb879ff37bfbe1176"
Jun 10 23:03:23.251380 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:03:23.251341    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-5qb7f_openshift-console-operator(9d6c4d0e-573d-4aae-811e-9c387a814d46)\"" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f" podUID="9d6c4d0e-573d-4aae-811e-9c387a814d46"
Jun 10 23:03:24.348700 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:24.348663    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:24.349160 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:24.348903    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk"]
Jun 10 23:03:24.352087 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:24.352068    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk"
Jun 10 23:03:24.354437 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:24.354412    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jun 10 23:03:24.354616 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:24.354600    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6c9k5\""
Jun 10 23:03:24.360880 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:24.360174    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk"]
Jun 10 23:03:24.449976 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:24.449932    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66d4v\" (UniqueName: \"kubernetes.io/projected/1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8-kube-api-access-66d4v\") pod \"monitoring-plugin-76b68cc874-gnzhk\" (UID: \"1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk"
Jun 10 23:03:24.450154 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:24.450069    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-gnzhk\" (UID: \"1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk"
Jun 10 23:03:24.551424 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:24.551392    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-gnzhk\" (UID: \"1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk"
Jun 10 23:03:24.551587 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:03:24.551534    2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jun 10 23:03:24.551666 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:24.551614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66d4v\" (UniqueName: \"kubernetes.io/projected/1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8-kube-api-access-66d4v\") pod \"monitoring-plugin-76b68cc874-gnzhk\" (UID: \"1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk"
Jun 10 23:03:24.551666 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:03:24.551622    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8-monitoring-plugin-cert podName:1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8 nodeName:}" failed. No retries permitted until 2026-06-10 23:03:25.051602372 +0000 UTC m=+251.209226508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-gnzhk" (UID: "1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8") : secret "monitoring-plugin-cert" not found
Jun 10 23:03:24.562445 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:24.562417    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66d4v\" (UniqueName: \"kubernetes.io/projected/1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8-kube-api-access-66d4v\") pod \"monitoring-plugin-76b68cc874-gnzhk\" (UID: \"1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk"
Jun 10 23:03:25.055269 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:25.055245    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-gnzhk\" (UID: \"1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk"
Jun 10 23:03:25.055403 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:03:25.055383    2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jun 10 23:03:25.055473 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:03:25.055461    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8-monitoring-plugin-cert podName:1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8 nodeName:}" failed. No retries permitted until 2026-06-10 23:03:26.055435171 +0000 UTC m=+252.213059323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-gnzhk" (UID: "1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8") : secret "monitoring-plugin-cert" not found
Jun 10 23:03:25.718335 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:25.718296    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:25.807770 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:25.807741    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:26.033172 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.033093    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ab8aba6-f291-44c9-9e4d-124521b7b678","Type":"ContainerStarted","Data":"8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd"}
Jun 10 23:03:26.033172 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.033161    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ab8aba6-f291-44c9-9e4d-124521b7b678","Type":"ContainerStarted","Data":"05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4"}
Jun 10 23:03:26.033378 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.033186    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ab8aba6-f291-44c9-9e4d-124521b7b678","Type":"ContainerStarted","Data":"ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1"}
Jun 10 23:03:26.033378 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.033212    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ab8aba6-f291-44c9-9e4d-124521b7b678","Type":"ContainerStarted","Data":"ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e"}
Jun 10 23:03:26.033378 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.033234    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ab8aba6-f291-44c9-9e4d-124521b7b678","Type":"ContainerStarted","Data":"ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8"}
Jun 10 23:03:26.034901 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.034876    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx" event={"ID":"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f","Type":"ContainerStarted","Data":"aac4c687c6a87d914551ffd035d404e16afbfb82040a8acf42dce4651d99adad"}
Jun 10 23:03:26.035004 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.034930    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx" event={"ID":"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f","Type":"ContainerStarted","Data":"a5ef24e4781b93c8aca7dea8bc749f235ef70045b2f4a20bbb5855904289e6ad"}
Jun 10 23:03:26.035004 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.034956    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx" event={"ID":"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f","Type":"ContainerStarted","Data":"bfaf39a339c11a5a8772041708f3d17b42147c64a86819a3e5008734274571eb"}
Jun 10 23:03:26.063328 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.063298    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-gnzhk\" (UID: \"1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk"
Jun 10 23:03:26.065532 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.065508    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-gnzhk\" (UID: \"1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk"
Jun 10 23:03:26.163729 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.163704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs\") pod \"network-metrics-daemon-fjp6x\" (UID: \"4425be81-8f51-4c34-8d00-7a454584e0bf\") " pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 23:03:26.165802 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.165778    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4425be81-8f51-4c34-8d00-7a454584e0bf-metrics-certs\") pod \"network-metrics-daemon-fjp6x\" (UID: \"4425be81-8f51-4c34-8d00-7a454584e0bf\") " pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 23:03:26.168460 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.168435    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk"
Jun 10 23:03:26.207792 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.207767    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:26.303758 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.303735    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk"]
Jun 10 23:03:26.304695 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.304654    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:26.305509 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:03:26.305485    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e1c48f1_d704_4bc6_9c4e_da6ac71dd5b8.slice/crio-873e428a6c415d41679ef85cdaa8e6182fee0a74758bac4b07ee43ad8851901d WatchSource:0}: Error finding container 873e428a6c415d41679ef85cdaa8e6182fee0a74758bac4b07ee43ad8851901d: Status 404 returned error can't find the container with id 873e428a6c415d41679ef85cdaa8e6182fee0a74758bac4b07ee43ad8851901d
Jun 10 23:03:26.454782 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.454755    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gj5t4\""
Jun 10 23:03:26.462997 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.462979    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fjp6x"
Jun 10 23:03:26.581615 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:26.581594    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fjp6x"]
Jun 10 23:03:26.584151 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:03:26.584124    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4425be81_8f51_4c34_8d00_7a454584e0bf.slice/crio-94c5f49b448480b9a868fa1cc795019e853316df82ce2bb9442c7aca9bc83253 WatchSource:0}: Error finding container 94c5f49b448480b9a868fa1cc795019e853316df82ce2bb9442c7aca9bc83253: Status 404 returned error can't find the container with id 94c5f49b448480b9a868fa1cc795019e853316df82ce2bb9442c7aca9bc83253
Jun 10 23:03:27.042082 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:27.042044    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ab8aba6-f291-44c9-9e4d-124521b7b678","Type":"ContainerStarted","Data":"268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac"}
Jun 10 23:03:27.043481 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:27.043452    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fjp6x" event={"ID":"4425be81-8f51-4c34-8d00-7a454584e0bf","Type":"ContainerStarted","Data":"94c5f49b448480b9a868fa1cc795019e853316df82ce2bb9442c7aca9bc83253"}
Jun 10 23:03:27.044607 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:27.044575    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk" event={"ID":"1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8","Type":"ContainerStarted","Data":"873e428a6c415d41679ef85cdaa8e6182fee0a74758bac4b07ee43ad8851901d"}
Jun 10 23:03:27.048445 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:27.048421    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx" event={"ID":"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f","Type":"ContainerStarted","Data":"14a1389f06694e0867170c5b5a3951c6a2eb74af585a192fded567a0e3947b86"}
Jun 10 23:03:27.048553 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:27.048475    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx" event={"ID":"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f","Type":"ContainerStarted","Data":"2e80ebc2c7dadcdf150ca12f1be2c19cf93885f595c889dfdef7b44e4e0c028f"}
Jun 10 23:03:27.048553 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:27.048513    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx" event={"ID":"9e0c3a35-b1a2-4332-be76-ea8a04b4b15f","Type":"ContainerStarted","Data":"a96fda3441fc5f6c9c1e58c20e6c7d30d61979f19b057375577b6eaaa1df699d"}
Jun 10 23:03:27.048666 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:27.048606    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:27.070280 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:27.070230    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.345690928 podStartE2EDuration="7.070211848s" totalImagesPullingTime="3.706681226s" totalInitContainerRuntime="17.839694ms" isStatefulPod=false podCreationTimestamp="2026-06-10 23:03:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:03:27.067900259 +0000 UTC m=+253.225524416" watchObservedRunningTime="2026-06-10 23:03:27.070211848 +0000 UTC m=+253.227836007"
Jun 10 23:03:27.089858 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:27.089810    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx" podStartSLOduration=2.224055577 podStartE2EDuration="5.089794793s" totalImagesPullingTime="2.865739216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:03:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:03:27.088413695 +0000 UTC m=+253.246037878" watchObservedRunningTime="2026-06-10 23:03:27.089794793 +0000 UTC m=+253.247418951"
Jun 10 23:03:28.054450 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:28.054358    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fjp6x" event={"ID":"4425be81-8f51-4c34-8d00-7a454584e0bf","Type":"ContainerStarted","Data":"74bd9855df7e145806ac731e278c4e5515b9e45c4d03f7f8028c21462c864164"}
Jun 10 23:03:28.054450 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:28.054420    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fjp6x" event={"ID":"4425be81-8f51-4c34-8d00-7a454584e0bf","Type":"ContainerStarted","Data":"0907d24e9a1da3e07fbca59d93160ef1da4b81092324f3c246fe94ed8adb77a9"}
Jun 10 23:03:28.055800 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:28.055779    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk" event={"ID":"1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8","Type":"ContainerStarted","Data":"651ef06c15f3c6e2ca37ac1938d5c301c01f2e13a9e83e3f55b19310631dd20a"}
Jun 10 23:03:28.055891 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:28.055819    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk"
Jun 10 23:03:28.060461 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:28.060441    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk"
Jun 10 23:03:28.071896 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:28.071526    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fjp6x" podStartSLOduration=252.916354781 podStartE2EDuration="4m14.071509843s" totalImagesPullingTime="1.155155062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 22:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:03:28.070827526 +0000 UTC m=+254.228451684" watchObservedRunningTime="2026-06-10 23:03:28.071509843 +0000 UTC m=+254.229134001"
Jun 10 23:03:28.086204 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:28.086170    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-gnzhk" podStartSLOduration=2.649189261 podStartE2EDuration="4.086159631s" totalImagesPullingTime="1.43697037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:03:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:03:28.085160343 +0000 UTC m=+254.242784500" watchObservedRunningTime="2026-06-10 23:03:28.086159631 +0000 UTC m=+254.243783788"
Jun 10 23:03:28.169788 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:28.169762    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:28.225338 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:28.225307    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:28.282206 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:28.282169    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:29.277826 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:29.277794    2577 patch_prober.go:28] interesting pod/image-registry-848d66fc84-drnlx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 10 23:03:29.278190 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:29.277843    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-848d66fc84-drnlx" podUID="7538d367-44aa-4cee-b50b-d4be3e02b611" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 10 23:03:29.648782 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:29.648749    2577 patch_prober.go:28] interesting pod/image-registry-59c5f755bc-5khnm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 10 23:03:29.648964 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:29.648801    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm" podUID="6ad9d9ec-6bef-43e4-9e87-6eb0304bb630" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 10 23:03:30.975558 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:30.975481    2577 patch_prober.go:28] interesting pod/image-registry-59c5f755bc-5khnm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 10 23:03:30.975558 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:30.975540    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm" podUID="6ad9d9ec-6bef-43e4-9e87-6eb0304bb630" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 10 23:03:33.061807 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:33.061774    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-556859b59d-qk7bx"
Jun 10 23:03:34.293738 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.293697    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-848d66fc84-drnlx" podUID="7538d367-44aa-4cee-b50b-d4be3e02b611" containerName="registry" containerID="cri-o://ca0fd65694b5987361264d5fd2641fa8a80cfdc0889f553a84790ee33e13f80e" gracePeriod=30
Jun 10 23:03:34.532553 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.532531    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:03:34.639391 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.639355    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7538d367-44aa-4cee-b50b-d4be3e02b611-ca-trust-extracted\") pod \"7538d367-44aa-4cee-b50b-d4be3e02b611\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") "
Jun 10 23:03:34.639629 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.639407    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvvtf\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-kube-api-access-zvvtf\") pod \"7538d367-44aa-4cee-b50b-d4be3e02b611\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") "
Jun 10 23:03:34.639629 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.639432    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-bound-sa-token\") pod \"7538d367-44aa-4cee-b50b-d4be3e02b611\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") "
Jun 10 23:03:34.639629 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.639456    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7538d367-44aa-4cee-b50b-d4be3e02b611-image-registry-private-configuration\") pod \"7538d367-44aa-4cee-b50b-d4be3e02b611\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") "
Jun 10 23:03:34.639629 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.639477    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls\") pod \"7538d367-44aa-4cee-b50b-d4be3e02b611\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") "
Jun 10 23:03:34.639629 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.639523    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-certificates\") pod \"7538d367-44aa-4cee-b50b-d4be3e02b611\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") "
Jun 10 23:03:34.639629 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.639550    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7538d367-44aa-4cee-b50b-d4be3e02b611-trusted-ca\") pod \"7538d367-44aa-4cee-b50b-d4be3e02b611\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") "
Jun 10 23:03:34.639978 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.639636    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7538d367-44aa-4cee-b50b-d4be3e02b611-installation-pull-secrets\") pod \"7538d367-44aa-4cee-b50b-d4be3e02b611\" (UID: \"7538d367-44aa-4cee-b50b-d4be3e02b611\") "
Jun 10 23:03:34.640091 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.640027    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7538d367-44aa-4cee-b50b-d4be3e02b611" (UID: "7538d367-44aa-4cee-b50b-d4be3e02b611"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 23:03:34.640091 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.640039    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7538d367-44aa-4cee-b50b-d4be3e02b611-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7538d367-44aa-4cee-b50b-d4be3e02b611" (UID: "7538d367-44aa-4cee-b50b-d4be3e02b611"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 23:03:34.641894 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.641829    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7538d367-44aa-4cee-b50b-d4be3e02b611-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7538d367-44aa-4cee-b50b-d4be3e02b611" (UID: "7538d367-44aa-4cee-b50b-d4be3e02b611"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 23:03:34.641894 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.641873    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7538d367-44aa-4cee-b50b-d4be3e02b611" (UID: "7538d367-44aa-4cee-b50b-d4be3e02b611"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:03:34.642111 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.642084    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-kube-api-access-zvvtf" (OuterVolumeSpecName: "kube-api-access-zvvtf") pod "7538d367-44aa-4cee-b50b-d4be3e02b611" (UID: "7538d367-44aa-4cee-b50b-d4be3e02b611"). InnerVolumeSpecName "kube-api-access-zvvtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:03:34.642185 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.642164    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7538d367-44aa-4cee-b50b-d4be3e02b611-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7538d367-44aa-4cee-b50b-d4be3e02b611" (UID: "7538d367-44aa-4cee-b50b-d4be3e02b611"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 23:03:34.642259 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.642241    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7538d367-44aa-4cee-b50b-d4be3e02b611" (UID: "7538d367-44aa-4cee-b50b-d4be3e02b611"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:03:34.648143 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.648122    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7538d367-44aa-4cee-b50b-d4be3e02b611-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7538d367-44aa-4cee-b50b-d4be3e02b611" (UID: "7538d367-44aa-4cee-b50b-d4be3e02b611"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:03:34.741004 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.740975    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvvtf\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-kube-api-access-zvvtf\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:03:34.741004 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.740998    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-bound-sa-token\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:03:34.741152 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.741009    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7538d367-44aa-4cee-b50b-d4be3e02b611-image-registry-private-configuration\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:03:34.741152 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.741019    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-tls\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:03:34.741152 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.741028    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7538d367-44aa-4cee-b50b-d4be3e02b611-registry-certificates\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:03:34.741152 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.741036    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7538d367-44aa-4cee-b50b-d4be3e02b611-trusted-ca\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:03:34.741152 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.741046    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7538d367-44aa-4cee-b50b-d4be3e02b611-installation-pull-secrets\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:03:34.741152 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:34.741054    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7538d367-44aa-4cee-b50b-d4be3e02b611-ca-trust-extracted\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:03:35.081346 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:35.081265    2577 generic.go:356] "Generic (PLEG): container finished" podID="7538d367-44aa-4cee-b50b-d4be3e02b611" containerID="ca0fd65694b5987361264d5fd2641fa8a80cfdc0889f553a84790ee33e13f80e" exitCode=0
Jun 10 23:03:35.081346 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:35.081301    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-848d66fc84-drnlx"
Jun 10 23:03:35.081513 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:35.081347    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-848d66fc84-drnlx" event={"ID":"7538d367-44aa-4cee-b50b-d4be3e02b611","Type":"ContainerDied","Data":"ca0fd65694b5987361264d5fd2641fa8a80cfdc0889f553a84790ee33e13f80e"}
Jun 10 23:03:35.081513 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:35.081399    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-848d66fc84-drnlx" event={"ID":"7538d367-44aa-4cee-b50b-d4be3e02b611","Type":"ContainerDied","Data":"97077045f7b16c6434d5f5955e79854e423250293e970601134e3940418e159f"}
Jun 10 23:03:35.081513 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:35.081422    2577 scope.go:117] "RemoveContainer" containerID="ca0fd65694b5987361264d5fd2641fa8a80cfdc0889f553a84790ee33e13f80e"
Jun 10 23:03:35.089834 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:35.089808    2577 scope.go:117] "RemoveContainer" containerID="ca0fd65694b5987361264d5fd2641fa8a80cfdc0889f553a84790ee33e13f80e"
Jun 10 23:03:35.090134 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:03:35.090110    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca0fd65694b5987361264d5fd2641fa8a80cfdc0889f553a84790ee33e13f80e\": container with ID starting with ca0fd65694b5987361264d5fd2641fa8a80cfdc0889f553a84790ee33e13f80e not found: ID does not exist" containerID="ca0fd65694b5987361264d5fd2641fa8a80cfdc0889f553a84790ee33e13f80e"
Jun 10 23:03:35.090205 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:35.090147    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca0fd65694b5987361264d5fd2641fa8a80cfdc0889f553a84790ee33e13f80e"} err="failed to get container status \"ca0fd65694b5987361264d5fd2641fa8a80cfdc0889f553a84790ee33e13f80e\": rpc error: code = NotFound desc = could not find container \"ca0fd65694b5987361264d5fd2641fa8a80cfdc0889f553a84790ee33e13f80e\": container with ID starting with ca0fd65694b5987361264d5fd2641fa8a80cfdc0889f553a84790ee33e13f80e not found: ID does not exist"
Jun 10 23:03:35.101931 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:35.101910    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-848d66fc84-drnlx"]
Jun 10 23:03:35.106395 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:35.106376    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-848d66fc84-drnlx"]
Jun 10 23:03:36.255808 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:36.255776    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7538d367-44aa-4cee-b50b-d4be3e02b611" path="/var/lib/kubelet/pods/7538d367-44aa-4cee-b50b-d4be3e02b611/volumes"
Jun 10 23:03:37.251603 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:37.251573    2577 scope.go:117] "RemoveContainer" containerID="c006586849c7a084f927da37e3bfa41e516cde98c2781b3fb879ff37bfbe1176"
Jun 10 23:03:37.988633 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:37.988597    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-wz6nd"]
Jun 10 23:03:37.989024 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:37.989008    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7538d367-44aa-4cee-b50b-d4be3e02b611" containerName="registry"
Jun 10 23:03:37.989088 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:37.989026    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7538d367-44aa-4cee-b50b-d4be3e02b611" containerName="registry"
Jun 10 23:03:37.989088 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:37.989082    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7538d367-44aa-4cee-b50b-d4be3e02b611" containerName="registry"
Jun 10 23:03:37.992072 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:37.992056    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-wz6nd"
Jun 10 23:03:37.994286 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:37.994265    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 10 23:03:37.994949 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:37.994935    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 10 23:03:37.994996 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:37.994939    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kvwbk\""
Jun 10 23:03:38.003041 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.003024    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-wz6nd"]
Jun 10 23:03:38.003308 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.003292    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:38.075811 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.075778    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnj25\" (UniqueName: \"kubernetes.io/projected/7282447e-15cb-4f68-af49-6ebfe35a3b25-kube-api-access-lnj25\") pod \"downloads-6657875f97-wz6nd\" (UID: \"7282447e-15cb-4f68-af49-6ebfe35a3b25\") " pod="openshift-console/downloads-6657875f97-wz6nd"
Jun 10 23:03:38.095969 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.095940    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:38.096109 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.096097    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:03:38.096175 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.096158    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f" event={"ID":"9d6c4d0e-573d-4aae-811e-9c387a814d46","Type":"ContainerStarted","Data":"997b30e19c178bc7911074d2101ead73df91aa32672305f195d1626ef47f9424"}
Jun 10 23:03:38.096494 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.096477    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:03:38.100990 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.100970    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f"
Jun 10 23:03:38.114504 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.114462    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-5qb7f" podStartSLOduration=56.47483659 podStartE2EDuration="59.11445043s" totalImagesPullingTime="2.63961384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:03:38.112877917 +0000 UTC m=+264.270502073" watchObservedRunningTime="2026-06-10 23:03:38.11445043 +0000 UTC m=+264.272074588"
Jun 10 23:03:38.177218 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.177184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnj25\" (UniqueName: \"kubernetes.io/projected/7282447e-15cb-4f68-af49-6ebfe35a3b25-kube-api-access-lnj25\") pod \"downloads-6657875f97-wz6nd\" (UID: \"7282447e-15cb-4f68-af49-6ebfe35a3b25\") " pod="openshift-console/downloads-6657875f97-wz6nd"
Jun 10 23:03:38.185834 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.185810    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnj25\" (UniqueName: \"kubernetes.io/projected/7282447e-15cb-4f68-af49-6ebfe35a3b25-kube-api-access-lnj25\") pod \"downloads-6657875f97-wz6nd\" (UID: \"7282447e-15cb-4f68-af49-6ebfe35a3b25\") " pod="openshift-console/downloads-6657875f97-wz6nd"
Jun 10 23:03:38.196186 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.196161    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:38.296301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.296224    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:38.301105 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.301090    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-wz6nd"
Jun 10 23:03:38.427311 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.427288    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-wz6nd"]
Jun 10 23:03:38.429211 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:03:38.429186    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7282447e_15cb_4f68_af49_6ebfe35a3b25.slice/crio-55d27b94d350a093a6789f9d06643c4dd2be4208d4dd4426ed081d6929763ce9 WatchSource:0}: Error finding container 55d27b94d350a093a6789f9d06643c4dd2be4208d4dd4426ed081d6929763ce9: Status 404 returned error can't find the container with id 55d27b94d350a093a6789f9d06643c4dd2be4208d4dd4426ed081d6929763ce9
Jun 10 23:03:38.456907 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.456880    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:38.518829 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.518808    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:38.657724 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.657699    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:38.758991 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.758964    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:38.927282 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:38.927214    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:39.030357 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:39.030328    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:39.101124 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:39.101095    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-wz6nd" event={"ID":"7282447e-15cb-4f68-af49-6ebfe35a3b25","Type":"ContainerStarted","Data":"55d27b94d350a093a6789f9d06643c4dd2be4208d4dd4426ed081d6929763ce9"}
Jun 10 23:03:39.130276 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:39.130253    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:39.650115 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:39.650067    2577 patch_prober.go:28] interesting pod/image-registry-59c5f755bc-5khnm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 10 23:03:39.650302 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:39.650124    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm" podUID="6ad9d9ec-6bef-43e4-9e87-6eb0304bb630" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 10 23:03:39.670338 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:39.670302    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:39.819045 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:39.818998    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:39.920473 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:39.920386    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:40.976703 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:40.976673    2577 patch_prober.go:28] interesting pod/image-registry-59c5f755bc-5khnm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 10 23:03:40.977196 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:40.976725    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm" podUID="6ad9d9ec-6bef-43e4-9e87-6eb0304bb630" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 10 23:03:41.087729 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:41.087693    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:43.111408 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:43.111366    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:43.171266 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:43.171227    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:44.189359 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:44.189330    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:44.243342 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:44.243295    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:48.281177 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:48.281122    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:48.333336 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:48.333299    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:49.649139 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:49.649090    2577 patch_prober.go:28] interesting pod/image-registry-59c5f755bc-5khnm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 10 23:03:49.649590 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:49.649153    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm" podUID="6ad9d9ec-6bef-43e4-9e87-6eb0304bb630" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 10 23:03:49.649590 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:49.649207    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:03:49.649760 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:49.649738    2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"d56d57b730b338eb17513a2d88deac8ccbda88091103c5b364464634c1f51a44"} pod="openshift-image-registry/image-registry-59c5f755bc-5khnm" containerMessage="Container registry failed liveness probe, will be restarted"
Jun 10 23:03:49.653930 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:49.653903    2577 patch_prober.go:28] interesting pod/image-registry-59c5f755bc-5khnm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 10 23:03:49.654065 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:49.653949    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm" podUID="6ad9d9ec-6bef-43e4-9e87-6eb0304bb630" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 10 23:03:50.882135 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:50.882097    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:54.276144 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:54.276110    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:54.333553 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:54.333519    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:55.722551 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:03:55.722515    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-m8jw6" podUID="175518a2-4b83-4a85-97f8-422c8a203700"
Jun 10 23:03:56.171451 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:56.171416    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m8jw6"
Jun 10 23:03:57.281233 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.281190    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64b99f6c88-jgl4c"]
Jun 10 23:03:57.287187 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.287160    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.290236 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.290212    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 10 23:03:57.290389 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.290215    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 10 23:03:57.291038 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.290931    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-h2flr\""
Jun 10 23:03:57.291038 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.290945    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 10 23:03:57.291038 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.290977    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 10 23:03:57.291038 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.290980    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 10 23:03:57.295217 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.295155    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64b99f6c88-jgl4c"]
Jun 10 23:03:57.296454 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.296387    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 10 23:03:57.451424 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.451392    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjp6m\" (UniqueName: \"kubernetes.io/projected/b4d5e131-c031-4a57-a20a-1b3033500360-kube-api-access-gjp6m\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.451616 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.451490    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4d5e131-c031-4a57-a20a-1b3033500360-console-oauth-config\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.451616 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.451524    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-service-ca\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.451616 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.451558    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-console-config\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.451743 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.451648    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-oauth-serving-cert\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.451743 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.451688    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4d5e131-c031-4a57-a20a-1b3033500360-console-serving-cert\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.451743 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.451722    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-trusted-ca-bundle\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.552237 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.552154    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4d5e131-c031-4a57-a20a-1b3033500360-console-oauth-config\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.552237 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.552201    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-service-ca\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.552237 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.552228    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-console-config\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.552455 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.552264    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-oauth-serving-cert\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.552455 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.552300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4d5e131-c031-4a57-a20a-1b3033500360-console-serving-cert\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.552455 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.552338    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-trusted-ca-bundle\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.552455 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.552365    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjp6m\" (UniqueName: \"kubernetes.io/projected/b4d5e131-c031-4a57-a20a-1b3033500360-kube-api-access-gjp6m\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.553006 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.552954    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-service-ca\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.553210 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.553191    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-console-config\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.553312 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.553269    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-oauth-serving-cert\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.553799 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.553778    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-trusted-ca-bundle\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.555216 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.555198    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4d5e131-c031-4a57-a20a-1b3033500360-console-oauth-config\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.555640 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.555621    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4d5e131-c031-4a57-a20a-1b3033500360-console-serving-cert\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.563938 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.563918    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjp6m\" (UniqueName: \"kubernetes.io/projected/b4d5e131-c031-4a57-a20a-1b3033500360-kube-api-access-gjp6m\") pod \"console-64b99f6c88-jgl4c\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") " pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:57.599976 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:57.599946    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:03:58.105092 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:58.105063    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64b99f6c88-jgl4c"]
Jun 10 23:03:58.112065 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:03:58.112028    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d5e131_c031_4a57_a20a_1b3033500360.slice/crio-08f375825e6a1b65c3ba94fa899a5e62b15a18480de008e99c59ac953b7fe53f WatchSource:0}: Error finding container 08f375825e6a1b65c3ba94fa899a5e62b15a18480de008e99c59ac953b7fe53f: Status 404 returned error can't find the container with id 08f375825e6a1b65c3ba94fa899a5e62b15a18480de008e99c59ac953b7fe53f
Jun 10 23:03:58.179771 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:58.179738    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b99f6c88-jgl4c" event={"ID":"b4d5e131-c031-4a57-a20a-1b3033500360","Type":"ContainerStarted","Data":"08f375825e6a1b65c3ba94fa899a5e62b15a18480de008e99c59ac953b7fe53f"}
Jun 10 23:03:58.181181 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:58.181158    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-wz6nd" event={"ID":"7282447e-15cb-4f68-af49-6ebfe35a3b25","Type":"ContainerStarted","Data":"4fcd3d85a9ea9bd8dbd60ee72111cd51b014dacb4a309f837db61f7f3719d063"}
Jun 10 23:03:58.181295 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:58.181261    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-wz6nd"
Jun 10 23:03:58.182542 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:58.182520    2577 patch_prober.go:28] interesting pod/downloads-6657875f97-wz6nd container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.20:8080/\": dial tcp 10.133.0.20:8080: connect: connection refused" start-of-body=
Jun 10 23:03:58.182637 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:58.182557    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6657875f97-wz6nd" podUID="7282447e-15cb-4f68-af49-6ebfe35a3b25" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.20:8080/\": dial tcp 10.133.0.20:8080: connect: connection refused"
Jun 10 23:03:58.198579 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:58.198532    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-wz6nd" podStartSLOduration=1.547969861 podStartE2EDuration="21.198519176s" totalImagesPullingTime="19.650549315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:03:58.196773944 +0000 UTC m=+284.354398103" watchObservedRunningTime="2026-06-10 23:03:58.198519176 +0000 UTC m=+284.356143334"
Jun 10 23:03:58.661843 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:58.661812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 23:03:58.665161 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:58.665064    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/175518a2-4b83-4a85-97f8-422c8a203700-metrics-tls\") pod \"dns-default-m8jw6\" (UID: \"175518a2-4b83-4a85-97f8-422c8a203700\") " pod="openshift-dns/dns-default-m8jw6"
Jun 10 23:03:58.874954 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:58.874910    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8g4j7\""
Jun 10 23:03:58.881996 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:58.881926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:58.883865 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:58.883735    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m8jw6"
Jun 10 23:03:58.935011 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:58.934931    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:03:59.098738 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:59.098664    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m8jw6"]
Jun 10 23:03:59.103317 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:03:59.103286    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod175518a2_4b83_4a85_97f8_422c8a203700.slice/crio-3fec349dc169d6c476f44685226b74154f888321f66b92c432879f211eb1380e WatchSource:0}: Error finding container 3fec349dc169d6c476f44685226b74154f888321f66b92c432879f211eb1380e: Status 404 returned error can't find the container with id 3fec349dc169d6c476f44685226b74154f888321f66b92c432879f211eb1380e
Jun 10 23:03:59.189582 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:59.189470    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m8jw6" event={"ID":"175518a2-4b83-4a85-97f8-422c8a203700","Type":"ContainerStarted","Data":"3fec349dc169d6c476f44685226b74154f888321f66b92c432879f211eb1380e"}
Jun 10 23:03:59.205209 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:59.205178    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-wz6nd"
Jun 10 23:03:59.655394 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:59.655296    2577 patch_prober.go:28] interesting pod/image-registry-59c5f755bc-5khnm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 10 23:03:59.655589 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:03:59.655394    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm" podUID="6ad9d9ec-6bef-43e4-9e87-6eb0304bb630" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 10 23:04:01.351003 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:01.350967    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pm4l7_fe618dc0-9887-4d65-b68a-afdb1ce1365e/dns-node-resolver/0.log"
Jun 10 23:04:01.551878 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:01.551779    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59c5f755bc-5khnm_6ad9d9ec-6bef-43e4-9e87-6eb0304bb630/registry/0.log"
Jun 10 23:04:02.151547 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:02.151512    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-klpjf_2fad7168-329e-4592-b5cb-8ff587c89170/node-ca/0.log"
Jun 10 23:04:02.388715 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:02.388682    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:02.442007 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:02.441930    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:03.151361 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:03.151332    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vddps_3dafdac3-c9a8-4928-99dd-92a008b6bc5f/serve-healthcheck-canary/0.log"
Jun 10 23:04:03.211706 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:03.211507    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b99f6c88-jgl4c" event={"ID":"b4d5e131-c031-4a57-a20a-1b3033500360","Type":"ContainerStarted","Data":"e43babae6438c5fd82f34bb1dafa1d1b945f8aceaa75bfe2945fcaf83fa85245"}
Jun 10 23:04:03.213874 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:03.213827    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m8jw6" event={"ID":"175518a2-4b83-4a85-97f8-422c8a203700","Type":"ContainerStarted","Data":"f1d84e79b4c9cd300a0cce51e3788b645837ce7b580bdfb0f766b10c515fd01e"}
Jun 10 23:04:03.214054 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:03.213897    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m8jw6"
Jun 10 23:04:03.214054 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:03.213921    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m8jw6" event={"ID":"175518a2-4b83-4a85-97f8-422c8a203700","Type":"ContainerStarted","Data":"571cb74cd3f2bbc2392fa353a839d363e20ed0e4693bc1326041fc8ff8e7a51f"}
Jun 10 23:04:03.229554 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:03.229498    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64b99f6c88-jgl4c" podStartSLOduration=1.586358128 podStartE2EDuration="6.229481875s" totalImagesPullingTime="4.643123747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:04:03.228017531 +0000 UTC m=+289.385641689" watchObservedRunningTime="2026-06-10 23:04:03.229481875 +0000 UTC m=+289.387106034"
Jun 10 23:04:03.243692 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:03.243650    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m8jw6" podStartSLOduration=251.587065989 podStartE2EDuration="4m15.243634574s" totalImagesPullingTime="3.656568585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 22:59:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:04:03.242233825 +0000 UTC m=+289.399857984" watchObservedRunningTime="2026-06-10 23:04:03.243634574 +0000 UTC m=+289.401258733"
Jun 10 23:04:06.894727 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:06.894685    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:06.995604 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:06.995561    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:07.600295 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:07.600259    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:04:07.600462 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:07.600317    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:04:07.601626 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:07.601605    2577 patch_prober.go:28] interesting pod/console-64b99f6c88-jgl4c container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused" start-of-body=
Jun 10 23:04:07.601681 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:07.601651    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-64b99f6c88-jgl4c" podUID="b4d5e131-c031-4a57-a20a-1b3033500360" containerName="console" probeResult="failure" output="Get \"https://10.133.0.21:8443/health\": dial tcp 10.133.0.21:8443: connect: connection refused"
Jun 10 23:04:09.242082 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:09.242047    2577 generic.go:356] "Generic (PLEG): container finished" podID="ee19c560-59e2-4020-a607-914123d4d186" containerID="dd2454790d2fe0e65e4e653ee1ae65f7930e3e8cec1b4ff856f0cf2b476aab2c" exitCode=0
Jun 10 23:04:09.242504 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:09.242088    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf" event={"ID":"ee19c560-59e2-4020-a607-914123d4d186","Type":"ContainerDied","Data":"dd2454790d2fe0e65e4e653ee1ae65f7930e3e8cec1b4ff856f0cf2b476aab2c"}
Jun 10 23:04:09.242504 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:09.242368    2577 scope.go:117] "RemoveContainer" containerID="dd2454790d2fe0e65e4e653ee1ae65f7930e3e8cec1b4ff856f0cf2b476aab2c"
Jun 10 23:04:09.654050 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:09.654014    2577 patch_prober.go:28] interesting pod/image-registry-59c5f755bc-5khnm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 10 23:04:09.654235 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:09.654076    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm" podUID="6ad9d9ec-6bef-43e4-9e87-6eb0304bb630" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 10 23:04:10.247653 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:10.247614    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-gdxgf" event={"ID":"ee19c560-59e2-4020-a607-914123d4d186","Type":"ContainerStarted","Data":"73e6bab8e99f49cb206bf578ce3b941a4bffca3e91b744ab1ccab6a0c3d74652"}
Jun 10 23:04:11.736737 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:11.736706    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:11.837673 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:11.837639    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:13.221842 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:13.221810    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m8jw6"
Jun 10 23:04:14.197459 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:14.197432    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:04:14.197617 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:14.197596    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:04:14.206636 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:14.206618    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:04:14.206719 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:14.206636    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:04:14.210481 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:14.210462    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jun 10 23:04:14.673192 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:14.673159    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm" podUID="6ad9d9ec-6bef-43e4-9e87-6eb0304bb630" containerName="registry" containerID="cri-o://d56d57b730b338eb17513a2d88deac8ccbda88091103c5b364464634c1f51a44" gracePeriod=30
Jun 10 23:04:16.285539 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:16.285503    2577 generic.go:356] "Generic (PLEG): container finished" podID="6ad9d9ec-6bef-43e4-9e87-6eb0304bb630" containerID="d56d57b730b338eb17513a2d88deac8ccbda88091103c5b364464634c1f51a44" exitCode=0
Jun 10 23:04:16.286036 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:16.285557    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm" event={"ID":"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630","Type":"ContainerDied","Data":"d56d57b730b338eb17513a2d88deac8ccbda88091103c5b364464634c1f51a44"}
Jun 10 23:04:16.286036 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:16.285597    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm" event={"ID":"6ad9d9ec-6bef-43e4-9e87-6eb0304bb630","Type":"ContainerStarted","Data":"4a284cce206ca837aabdb8e51f24931f9d776eadf049310d1ffc30a38543b647"}
Jun 10 23:04:16.286036 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:16.285875    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:04:17.604738 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:17.604709    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:04:17.608608 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:17.608589    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:04:17.805752 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:17.805716    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:18.766432 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:18.766393    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:19.299268 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:19.299240    2577 generic.go:356] "Generic (PLEG): container finished" podID="55d4eb1d-6ab4-4236-b4e9-4462da21f72f" containerID="162b1fc3e5ee84bf3dff3131521485abf9dc55a45499b71c89fc30bfaa420a12" exitCode=0
Jun 10 23:04:19.299438 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:19.299316    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67" event={"ID":"55d4eb1d-6ab4-4236-b4e9-4462da21f72f","Type":"ContainerDied","Data":"162b1fc3e5ee84bf3dff3131521485abf9dc55a45499b71c89fc30bfaa420a12"}
Jun 10 23:04:19.299686 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:19.299672    2577 scope.go:117] "RemoveContainer" containerID="162b1fc3e5ee84bf3dff3131521485abf9dc55a45499b71c89fc30bfaa420a12"
Jun 10 23:04:19.319417 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:19.319387    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:19.419090 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:19.419053    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:20.304964 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:20.304932    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-9hh67" event={"ID":"55d4eb1d-6ab4-4236-b4e9-4462da21f72f","Type":"ContainerStarted","Data":"529c6cd1611760dc51faf3e8bfbc348ef0ccbbc6328b5b5025102fe45b3301a0"}
Jun 10 23:04:20.656982 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:20.656950    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:20.712332 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:20.712300    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:23.122010 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:23.121974    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:23.222386 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:23.222357    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:23.322743 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:23.322714    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:28.325976 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:28.325936    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:28.426785 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:28.426756    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:29.721753 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:29.721714    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:29.820488 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:29.820459    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:32.394271 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:32.394238    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:32.494041 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:32.494012    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:35.608391 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:35.608354    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:35.657710 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:35.657655    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:36.632771 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.632732    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f4f78fd86-zt764"]
Jun 10 23:04:36.655390 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.655359    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.655390 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.655362    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f4f78fd86-zt764"]
Jun 10 23:04:36.748417 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.748386    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:36.809321 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.809295    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/777e78df-449c-4c4a-af23-ee4231b5484c-console-oauth-config\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.809443 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.809326    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-console-config\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.809443 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.809343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-oauth-serving-cert\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.809443 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.809362    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/777e78df-449c-4c4a-af23-ee4231b5484c-console-serving-cert\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.809562 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.809469    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-trusted-ca-bundle\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.809562 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.809501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsbxv\" (UniqueName: \"kubernetes.io/projected/777e78df-449c-4c4a-af23-ee4231b5484c-kube-api-access-jsbxv\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.809562 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.809531    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-service-ca\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.848827 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.848802    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:36.910536 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.910478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/777e78df-449c-4c4a-af23-ee4231b5484c-console-oauth-config\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.910536 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.910509    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-console-config\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.910536 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.910526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-oauth-serving-cert\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.910740 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.910543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/777e78df-449c-4c4a-af23-ee4231b5484c-console-serving-cert\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.910740 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.910577    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-trusted-ca-bundle\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.910740 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.910595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsbxv\" (UniqueName: \"kubernetes.io/projected/777e78df-449c-4c4a-af23-ee4231b5484c-kube-api-access-jsbxv\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.910740 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.910617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-service-ca\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.911315 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.911295    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-oauth-serving-cert\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.911402 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.911374    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-console-config\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.911443 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.911427    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-service-ca\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.911668 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.911650    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-trusted-ca-bundle\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.913077 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.913057    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/777e78df-449c-4c4a-af23-ee4231b5484c-console-serving-cert\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.913175 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.913102    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/777e78df-449c-4c4a-af23-ee4231b5484c-console-oauth-config\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.915808 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.915787    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:36.918081 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.918059    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsbxv\" (UniqueName: \"kubernetes.io/projected/777e78df-449c-4c4a-af23-ee4231b5484c-kube-api-access-jsbxv\") pod \"console-f4f78fd86-zt764\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") " pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:36.964900 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:36.964877    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:37.131768 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:37.131745    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f4f78fd86-zt764"]
Jun 10 23:04:37.133964 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:04:37.133941    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777e78df_449c_4c4a_af23_ee4231b5484c.slice/crio-c98a73ee04acda40ae423e26548e1724febe6fd039d97dd22f95f7df8c6f985c WatchSource:0}: Error finding container c98a73ee04acda40ae423e26548e1724febe6fd039d97dd22f95f7df8c6f985c: Status 404 returned error can't find the container with id c98a73ee04acda40ae423e26548e1724febe6fd039d97dd22f95f7df8c6f985c
Jun 10 23:04:37.290109 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:37.290073    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:37.294362 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:37.294185    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59c5f755bc-5khnm"
Jun 10 23:04:37.372578 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:37.372546    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4f78fd86-zt764" event={"ID":"777e78df-449c-4c4a-af23-ee4231b5484c","Type":"ContainerStarted","Data":"cacafe9254cb07b2dd0a187ed8cabca9086a9bb90f68e610c401d25e25070470"}
Jun 10 23:04:37.372737 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:37.372596    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4f78fd86-zt764" event={"ID":"777e78df-449c-4c4a-af23-ee4231b5484c","Type":"ContainerStarted","Data":"c98a73ee04acda40ae423e26548e1724febe6fd039d97dd22f95f7df8c6f985c"}
Jun 10 23:04:37.373627 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:37.373604    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:37.393241 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:37.393191    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f4f78fd86-zt764" podStartSLOduration=1.3931635 podStartE2EDuration="1.3931635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:04:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:04:37.393016789 +0000 UTC m=+323.550640951" watchObservedRunningTime="2026-06-10 23:04:37.3931635 +0000 UTC m=+323.550787663"
Jun 10 23:04:37.433805 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:37.433733    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:37.582198 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:37.582170    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:37.641480 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:37.641430    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:38.330912 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:38.330878    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:38.381738 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:38.381700    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:39.827470 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:39.827436    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 23:04:39.827983 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:39.827780    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="alertmanager" containerID="cri-o://ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8" gracePeriod=120
Jun 10 23:04:39.827983 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:39.827875    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="kube-rbac-proxy-web" containerID="cri-o://ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1" gracePeriod=120
Jun 10 23:04:39.827983 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:39.827926    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="prom-label-proxy" containerID="cri-o://268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac" gracePeriod=120
Jun 10 23:04:39.827983 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:39.827879    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="kube-rbac-proxy-metric" containerID="cri-o://8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd" gracePeriod=120
Jun 10 23:04:39.828215 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:39.827938    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="config-reloader" containerID="cri-o://ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e" gracePeriod=120
Jun 10 23:04:39.828215 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:39.827902    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="kube-rbac-proxy" containerID="cri-o://05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4" gracePeriod=120
Jun 10 23:04:40.389443 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:40.389414    2577 generic.go:356] "Generic (PLEG): container finished" podID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerID="268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac" exitCode=0
Jun 10 23:04:40.389443 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:40.389437    2577 generic.go:356] "Generic (PLEG): container finished" podID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerID="05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4" exitCode=0
Jun 10 23:04:40.389443 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:40.389447    2577 generic.go:356] "Generic (PLEG): container finished" podID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerID="ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e" exitCode=0
Jun 10 23:04:40.389667 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:40.389456    2577 generic.go:356] "Generic (PLEG): container finished" podID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerID="ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8" exitCode=0
Jun 10 23:04:40.389667 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:40.389480    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ab8aba6-f291-44c9-9e4d-124521b7b678","Type":"ContainerDied","Data":"268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac"}
Jun 10 23:04:40.389667 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:40.389543    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ab8aba6-f291-44c9-9e4d-124521b7b678","Type":"ContainerDied","Data":"05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4"}
Jun 10 23:04:40.389667 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:40.389570    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ab8aba6-f291-44c9-9e4d-124521b7b678","Type":"ContainerDied","Data":"ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e"}
Jun 10 23:04:40.389667 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:40.389595    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ab8aba6-f291-44c9-9e4d-124521b7b678","Type":"ContainerDied","Data":"ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8"}
Jun 10 23:04:41.113819 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.113785    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.248085 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.248003    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-cluster-tls-config\") pod \"0ab8aba6-f291-44c9-9e4d-124521b7b678\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") "
Jun 10 23:04:41.248085 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.248052    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ab8aba6-f291-44c9-9e4d-124521b7b678-metrics-client-ca\") pod \"0ab8aba6-f291-44c9-9e4d-124521b7b678\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") "
Jun 10 23:04:41.248085 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.248080    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-web-config\") pod \"0ab8aba6-f291-44c9-9e4d-124521b7b678\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") "
Jun 10 23:04:41.248359 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.248121    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ab8aba6-f291-44c9-9e4d-124521b7b678-config-out\") pod \"0ab8aba6-f291-44c9-9e4d-124521b7b678\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") "
Jun 10 23:04:41.248359 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.248281    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b658s\" (UniqueName: \"kubernetes.io/projected/0ab8aba6-f291-44c9-9e4d-124521b7b678-kube-api-access-b658s\") pod \"0ab8aba6-f291-44c9-9e4d-124521b7b678\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") "
Jun 10 23:04:41.248359 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.248327    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy\") pod \"0ab8aba6-f291-44c9-9e4d-124521b7b678\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") "
Jun 10 23:04:41.248513 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.248359    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ab8aba6-f291-44c9-9e4d-124521b7b678-alertmanager-trusted-ca-bundle\") pod \"0ab8aba6-f291-44c9-9e4d-124521b7b678\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") "
Jun 10 23:04:41.248513 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.248413    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy-web\") pod \"0ab8aba6-f291-44c9-9e4d-124521b7b678\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") "
Jun 10 23:04:41.248513 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.248442    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0ab8aba6-f291-44c9-9e4d-124521b7b678\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") "
Jun 10 23:04:41.248513 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.248453    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ab8aba6-f291-44c9-9e4d-124521b7b678-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0ab8aba6-f291-44c9-9e4d-124521b7b678" (UID: "0ab8aba6-f291-44c9-9e4d-124521b7b678"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 23:04:41.248513 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.248477    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-main-tls\") pod \"0ab8aba6-f291-44c9-9e4d-124521b7b678\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") "
Jun 10 23:04:41.248758 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.248515    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ab8aba6-f291-44c9-9e4d-124521b7b678-alertmanager-main-db\") pod \"0ab8aba6-f291-44c9-9e4d-124521b7b678\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") "
Jun 10 23:04:41.248758 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.248544    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-config-volume\") pod \"0ab8aba6-f291-44c9-9e4d-124521b7b678\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") "
Jun 10 23:04:41.248758 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.248596    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ab8aba6-f291-44c9-9e4d-124521b7b678-tls-assets\") pod \"0ab8aba6-f291-44c9-9e4d-124521b7b678\" (UID: \"0ab8aba6-f291-44c9-9e4d-124521b7b678\") "
Jun 10 23:04:41.248954 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.248904    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ab8aba6-f291-44c9-9e4d-124521b7b678-metrics-client-ca\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:04:41.249040 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.249013    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ab8aba6-f291-44c9-9e4d-124521b7b678-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0ab8aba6-f291-44c9-9e4d-124521b7b678" (UID: "0ab8aba6-f291-44c9-9e4d-124521b7b678"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 23:04:41.251095 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.251065    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ab8aba6-f291-44c9-9e4d-124521b7b678-config-out" (OuterVolumeSpecName: "config-out") pod "0ab8aba6-f291-44c9-9e4d-124521b7b678" (UID: "0ab8aba6-f291-44c9-9e4d-124521b7b678"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:04:41.251225 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.251129    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0ab8aba6-f291-44c9-9e4d-124521b7b678" (UID: "0ab8aba6-f291-44c9-9e4d-124521b7b678"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 23:04:41.251385 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.251348    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ab8aba6-f291-44c9-9e4d-124521b7b678-kube-api-access-b658s" (OuterVolumeSpecName: "kube-api-access-b658s") pod "0ab8aba6-f291-44c9-9e4d-124521b7b678" (UID: "0ab8aba6-f291-44c9-9e4d-124521b7b678"). InnerVolumeSpecName "kube-api-access-b658s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:04:41.251385 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.251364    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ab8aba6-f291-44c9-9e4d-124521b7b678-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0ab8aba6-f291-44c9-9e4d-124521b7b678" (UID: "0ab8aba6-f291-44c9-9e4d-124521b7b678"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:04:41.251559 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.251396    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ab8aba6-f291-44c9-9e4d-124521b7b678-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0ab8aba6-f291-44c9-9e4d-124521b7b678" (UID: "0ab8aba6-f291-44c9-9e4d-124521b7b678"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:04:41.251680 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.251654    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0ab8aba6-f291-44c9-9e4d-124521b7b678" (UID: "0ab8aba6-f291-44c9-9e4d-124521b7b678"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 23:04:41.251828 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.251798    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0ab8aba6-f291-44c9-9e4d-124521b7b678" (UID: "0ab8aba6-f291-44c9-9e4d-124521b7b678"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 23:04:41.252881 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.252826    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0ab8aba6-f291-44c9-9e4d-124521b7b678" (UID: "0ab8aba6-f291-44c9-9e4d-124521b7b678"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 23:04:41.253057 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.253033    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-config-volume" (OuterVolumeSpecName: "config-volume") pod "0ab8aba6-f291-44c9-9e4d-124521b7b678" (UID: "0ab8aba6-f291-44c9-9e4d-124521b7b678"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 23:04:41.254996 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.254967    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0ab8aba6-f291-44c9-9e4d-124521b7b678" (UID: "0ab8aba6-f291-44c9-9e4d-124521b7b678"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 23:04:41.262075 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.262051    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-web-config" (OuterVolumeSpecName: "web-config") pod "0ab8aba6-f291-44c9-9e4d-124521b7b678" (UID: "0ab8aba6-f291-44c9-9e4d-124521b7b678"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 23:04:41.350273 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.350245    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:04:41.350273 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.350267    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:04:41.350422 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.350279    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-main-tls\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:04:41.350422 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.350289    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ab8aba6-f291-44c9-9e4d-124521b7b678-alertmanager-main-db\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:04:41.350422 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.350299    2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-config-volume\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:04:41.350422 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.350307    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ab8aba6-f291-44c9-9e4d-124521b7b678-tls-assets\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:04:41.350422 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.350315    2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-cluster-tls-config\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:04:41.350422 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.350323    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-web-config\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:04:41.350422 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.350331    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ab8aba6-f291-44c9-9e4d-124521b7b678-config-out\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:04:41.350422 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.350339    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b658s\" (UniqueName: \"kubernetes.io/projected/0ab8aba6-f291-44c9-9e4d-124521b7b678-kube-api-access-b658s\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:04:41.350422 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.350347    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ab8aba6-f291-44c9-9e4d-124521b7b678-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:04:41.350422 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.350355    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ab8aba6-f291-44c9-9e4d-124521b7b678-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:04:41.396162 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.396131    2577 generic.go:356] "Generic (PLEG): container finished" podID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerID="8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd" exitCode=0
Jun 10 23:04:41.396162 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.396154    2577 generic.go:356] "Generic (PLEG): container finished" podID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerID="ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1" exitCode=0
Jun 10 23:04:41.396308 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.396169    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ab8aba6-f291-44c9-9e4d-124521b7b678","Type":"ContainerDied","Data":"8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd"}
Jun 10 23:04:41.396308 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.396203    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.396308 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.396252    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ab8aba6-f291-44c9-9e4d-124521b7b678","Type":"ContainerDied","Data":"ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1"}
Jun 10 23:04:41.396308 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.396280    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ab8aba6-f291-44c9-9e4d-124521b7b678","Type":"ContainerDied","Data":"92410432c6b1d0ece54c64b25413cefb71a884ff99ea6a576805aa4beec9edd2"}
Jun 10 23:04:41.396446 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.396319    2577 scope.go:117] "RemoveContainer" containerID="268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac"
Jun 10 23:04:41.404658 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.404642    2577 scope.go:117] "RemoveContainer" containerID="8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd"
Jun 10 23:04:41.411925 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.411907    2577 scope.go:117] "RemoveContainer" containerID="05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4"
Jun 10 23:04:41.418551 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.418533    2577 scope.go:117] "RemoveContainer" containerID="ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1"
Jun 10 23:04:41.421915 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.421893    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 23:04:41.425888 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.425863    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 23:04:41.426246 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.426227    2577 scope.go:117] "RemoveContainer" containerID="ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e"
Jun 10 23:04:41.433058 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.433040    2577 scope.go:117] "RemoveContainer" containerID="ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8"
Jun 10 23:04:41.440134 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.440118    2577 scope.go:117] "RemoveContainer" containerID="89ae5f8c9aff172e8bd88af0474d59c24bc6248d2250206299bbf9ff70d9fe2e"
Jun 10 23:04:41.447155 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.447140    2577 scope.go:117] "RemoveContainer" containerID="268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac"
Jun 10 23:04:41.447419 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:04:41.447403    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac\": container with ID starting with 268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac not found: ID does not exist" containerID="268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac"
Jun 10 23:04:41.447470 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.447426    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac"} err="failed to get container status \"268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac\": rpc error: code = NotFound desc = could not find container \"268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac\": container with ID starting with 268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac not found: ID does not exist"
Jun 10 23:04:41.447470 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.447447    2577 scope.go:117] "RemoveContainer" containerID="8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd"
Jun 10 23:04:41.447652 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:04:41.447638    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd\": container with ID starting with 8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd not found: ID does not exist" containerID="8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd"
Jun 10 23:04:41.447694 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.447655    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd"} err="failed to get container status \"8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd\": rpc error: code = NotFound desc = could not find container \"8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd\": container with ID starting with 8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd not found: ID does not exist"
Jun 10 23:04:41.447694 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.447668    2577 scope.go:117] "RemoveContainer" containerID="05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4"
Jun 10 23:04:41.447934 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:04:41.447916    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4\": container with ID starting with 05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4 not found: ID does not exist" containerID="05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4"
Jun 10 23:04:41.447991 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.447940    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4"} err="failed to get container status \"05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4\": rpc error: code = NotFound desc = could not find container \"05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4\": container with ID starting with 05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4 not found: ID does not exist"
Jun 10 23:04:41.447991 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.447959    2577 scope.go:117] "RemoveContainer" containerID="ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1"
Jun 10 23:04:41.448182 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:04:41.448167    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1\": container with ID starting with ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1 not found: ID does not exist" containerID="ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1"
Jun 10 23:04:41.448231 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.448185    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1"} err="failed to get container status \"ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1\": rpc error: code = NotFound desc = could not find container \"ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1\": container with ID starting with ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1 not found: ID does not exist"
Jun 10 23:04:41.448231 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.448197    2577 scope.go:117] "RemoveContainer" containerID="ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e"
Jun 10 23:04:41.448398 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:04:41.448377    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e\": container with ID starting with ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e not found: ID does not exist" containerID="ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e"
Jun 10 23:04:41.448438 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.448408    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e"} err="failed to get container status \"ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e\": rpc error: code = NotFound desc = could not find container \"ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e\": container with ID starting with ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e not found: ID does not exist"
Jun 10 23:04:41.448438 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.448431    2577 scope.go:117] "RemoveContainer" containerID="ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8"
Jun 10 23:04:41.448665 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:04:41.448647    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8\": container with ID starting with ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8 not found: ID does not exist" containerID="ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8"
Jun 10 23:04:41.448738 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.448669    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8"} err="failed to get container status \"ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8\": rpc error: code = NotFound desc = could not find container \"ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8\": container with ID starting with ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8 not found: ID does not exist"
Jun 10 23:04:41.448738 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.448689    2577 scope.go:117] "RemoveContainer" containerID="89ae5f8c9aff172e8bd88af0474d59c24bc6248d2250206299bbf9ff70d9fe2e"
Jun 10 23:04:41.449057 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:04:41.449034    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89ae5f8c9aff172e8bd88af0474d59c24bc6248d2250206299bbf9ff70d9fe2e\": container with ID starting with 89ae5f8c9aff172e8bd88af0474d59c24bc6248d2250206299bbf9ff70d9fe2e not found: ID does not exist" containerID="89ae5f8c9aff172e8bd88af0474d59c24bc6248d2250206299bbf9ff70d9fe2e"
Jun 10 23:04:41.449158 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.449060    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ae5f8c9aff172e8bd88af0474d59c24bc6248d2250206299bbf9ff70d9fe2e"} err="failed to get container status \"89ae5f8c9aff172e8bd88af0474d59c24bc6248d2250206299bbf9ff70d9fe2e\": rpc error: code = NotFound desc = could not find container \"89ae5f8c9aff172e8bd88af0474d59c24bc6248d2250206299bbf9ff70d9fe2e\": container with ID starting with 89ae5f8c9aff172e8bd88af0474d59c24bc6248d2250206299bbf9ff70d9fe2e not found: ID does not exist"
Jun 10 23:04:41.449158 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.449078    2577 scope.go:117] "RemoveContainer" containerID="268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac"
Jun 10 23:04:41.449397 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.449342    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac"} err="failed to get container status \"268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac\": rpc error: code = NotFound desc = could not find container \"268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac\": container with ID starting with 268097eb7e4e21588b3bff1245e65977ba468b5a2b1d5c042b064e17b76652ac not found: ID does not exist"
Jun 10 23:04:41.449397 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.449366    2577 scope.go:117] "RemoveContainer" containerID="8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd"
Jun 10 23:04:41.449663 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.449641    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd"} err="failed to get container status \"8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd\": rpc error: code = NotFound desc = could not find container \"8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd\": container with ID starting with 8a943bdd2353b5cc4e98d678fd01d8a38ac587abd6e1404b24373e5f8b1b85cd not found: ID does not exist"
Jun 10 23:04:41.449663 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.449665    2577 scope.go:117] "RemoveContainer" containerID="05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4"
Jun 10 23:04:41.449908 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.449887    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4"} err="failed to get container status \"05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4\": rpc error: code = NotFound desc = could not find container \"05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4\": container with ID starting with 05ce6d3bc13163ac28861df612356e0535ccc2c383c7507314cb69bce5642ea4 not found: ID does not exist"
Jun 10 23:04:41.449972 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.449911    2577 scope.go:117] "RemoveContainer" containerID="ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1"
Jun 10 23:04:41.450202 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.450175    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1"} err="failed to get container status \"ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1\": rpc error: code = NotFound desc = could not find container \"ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1\": container with ID starting with ed93c4263f5abc79191daf9aaaf335ce0c4d66f20f3b92f8c7b25354c863e1f1 not found: ID does not exist"
Jun 10 23:04:41.450202 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.450202    2577 scope.go:117] "RemoveContainer" containerID="ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e"
Jun 10 23:04:41.450456 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.450436    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e"} err="failed to get container status \"ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e\": rpc error: code = NotFound desc = could not find container \"ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e\": container with ID starting with ba9fc00b0f9fc5844087b4a73af4f324fdfd36ac3f9c38337234a60254c24b8e not found: ID does not exist"
Jun 10 23:04:41.450542 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.450457    2577 scope.go:117] "RemoveContainer" containerID="ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8"
Jun 10 23:04:41.450627 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.450608    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 23:04:41.450740 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.450716    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8"} err="failed to get container status \"ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8\": rpc error: code = NotFound desc = could not find container \"ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8\": container with ID starting with ad1ab7843b1f42047bdb0f5efa00cfd225838c7204680069be0c63a65c950dd8 not found: ID does not exist"
Jun 10 23:04:41.450784 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.450741    2577 scope.go:117] "RemoveContainer" containerID="89ae5f8c9aff172e8bd88af0474d59c24bc6248d2250206299bbf9ff70d9fe2e"
Jun 10 23:04:41.450947 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.450928    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="prom-label-proxy"
Jun 10 23:04:41.450947 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.450948    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="prom-label-proxy"
Jun 10 23:04:41.451052 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.450971    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="kube-rbac-proxy-web"
Jun 10 23:04:41.451052 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.450981    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="kube-rbac-proxy-web"
Jun 10 23:04:41.451052 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.450989    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="kube-rbac-proxy"
Jun 10 23:04:41.451052 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.450995    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="kube-rbac-proxy"
Jun 10 23:04:41.451052 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.451003    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="init-config-reloader"
Jun 10 23:04:41.451052 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.451009    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="init-config-reloader"
Jun 10 23:04:41.451052 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.451004    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ae5f8c9aff172e8bd88af0474d59c24bc6248d2250206299bbf9ff70d9fe2e"} err="failed to get container status \"89ae5f8c9aff172e8bd88af0474d59c24bc6248d2250206299bbf9ff70d9fe2e\": rpc error: code = NotFound desc = could not find container \"89ae5f8c9aff172e8bd88af0474d59c24bc6248d2250206299bbf9ff70d9fe2e\": container with ID starting with 89ae5f8c9aff172e8bd88af0474d59c24bc6248d2250206299bbf9ff70d9fe2e not found: ID does not exist"
Jun 10 23:04:41.451052 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.451018    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="alertmanager"
Jun 10 23:04:41.451052 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.451026    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="alertmanager"
Jun 10 23:04:41.451052 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.451033    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="config-reloader"
Jun 10 23:04:41.451052 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.451038    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="config-reloader"
Jun 10 23:04:41.451052 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.451045    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="kube-rbac-proxy-metric"
Jun 10 23:04:41.451052 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.451050    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="kube-rbac-proxy-metric"
Jun 10 23:04:41.451468 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.451104    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="alertmanager"
Jun 10 23:04:41.451468 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.451111    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="prom-label-proxy"
Jun 10 23:04:41.451468 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.451117    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="kube-rbac-proxy-web"
Jun 10 23:04:41.451468 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.451123    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="kube-rbac-proxy-metric"
Jun 10 23:04:41.451468 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.451131    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="config-reloader"
Jun 10 23:04:41.451468 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.451137    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" containerName="kube-rbac-proxy"
Jun 10 23:04:41.478208 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.478189    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 23:04:41.478329 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.478318    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.481025 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.481006    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 10 23:04:41.481224 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.481209    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 10 23:04:41.481284 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.481235    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w8wr9\""
Jun 10 23:04:41.481332 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.481294    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 10 23:04:41.481497 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.481474    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 10 23:04:41.481554 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.481498    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 10 23:04:41.481723 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.481710    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 10 23:04:41.481778 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.481733    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 10 23:04:41.481979 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.481968    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 10 23:04:41.491109 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.491090    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 10 23:04:41.651466 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.651435    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.651599 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.651470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.651599 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.651490    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.651599 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.651535    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.651599 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.651565    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.651759 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.651621    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-549wt\" (UniqueName: \"kubernetes.io/projected/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-kube-api-access-549wt\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.651759 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.651660    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.651759 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.651685    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.651759 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.651703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-config-out\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.651759 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.651742    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-web-config\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.651953 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.651785    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.651953 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.651805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.651953 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.651826    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.752983 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.752949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.753088 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.752991    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.753088 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.753014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.753088 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.753039    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.753088 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.753067    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-549wt\" (UniqueName: \"kubernetes.io/projected/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-kube-api-access-549wt\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.753275 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.753112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.753275 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.753148    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.753275 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.753168    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-config-out\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.753275 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.753197    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-web-config\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.753275 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.753239    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.753275 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.753267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.753570 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.753306    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.753570 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.753352    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.753961 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.753765    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.753961 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.753952    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.754545 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.754516    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.756313 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.756284    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.756413 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.756293    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.756413 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.756344    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.756540 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.756457    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.756869 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.756830    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.756952 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.756915    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-web-config\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.757225 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.757205    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-config-out\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.757262 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.757228    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.757262 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.757252    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.760495 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.760478    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-549wt\" (UniqueName: \"kubernetes.io/projected/b7b6d2a0-7c26-4216-aab0-4c3d63f301b0-kube-api-access-549wt\") pod \"alertmanager-main-0\" (UID: \"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.794964 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.794946    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 10 23:04:41.957993 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:41.957971    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 10 23:04:41.959811 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:04:41.959789    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b6d2a0_7c26_4216_aab0_4c3d63f301b0.slice/crio-d3d96163b2d4639583baaeaa209c2a088e156de0fa7bee2043d8991652f01579 WatchSource:0}: Error finding container d3d96163b2d4639583baaeaa209c2a088e156de0fa7bee2043d8991652f01579: Status 404 returned error can't find the container with id d3d96163b2d4639583baaeaa209c2a088e156de0fa7bee2043d8991652f01579
Jun 10 23:04:42.256535 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:42.256456    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ab8aba6-f291-44c9-9e4d-124521b7b678" path="/var/lib/kubelet/pods/0ab8aba6-f291-44c9-9e4d-124521b7b678/volumes"
Jun 10 23:04:42.401763 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:42.401730    2577 generic.go:356] "Generic (PLEG): container finished" podID="b7b6d2a0-7c26-4216-aab0-4c3d63f301b0" containerID="0c76a4d34c8d0dff450ae6982f4c5b4c47587c4782a09f981e3a184153cb9535" exitCode=0
Jun 10 23:04:42.401937 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:42.401811    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0","Type":"ContainerDied","Data":"0c76a4d34c8d0dff450ae6982f4c5b4c47587c4782a09f981e3a184153cb9535"}
Jun 10 23:04:42.401937 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:42.401899    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0","Type":"ContainerStarted","Data":"d3d96163b2d4639583baaeaa209c2a088e156de0fa7bee2043d8991652f01579"}
Jun 10 23:04:43.410044 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:43.410013    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0","Type":"ContainerStarted","Data":"fdf49cd030273129cef4d06bffeea85f4c5e8e4f566e151dd4c543ea6a03f9b4"}
Jun 10 23:04:43.410412 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:43.410074    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0","Type":"ContainerStarted","Data":"d24c729a6d92f26ad9707a35eef9ee68e6c799d71c5460432ee9e59ca3a1f39f"}
Jun 10 23:04:43.410412 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:43.410102    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0","Type":"ContainerStarted","Data":"e2953a72f9de071d31f141ed0edc5d13a8c367ebf6d8c9f815a7a8de59f66e9f"}
Jun 10 23:04:43.410412 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:43.410127    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0","Type":"ContainerStarted","Data":"9aba19a9d4ae95a5becf37923c7017c4ec8470936a82fbbc859c2a1876e799b1"}
Jun 10 23:04:43.410412 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:43.410151    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0","Type":"ContainerStarted","Data":"dbaa0cf1ecc7869e9e80c34b78697d4fcaea812a74f4150a11e6389cc84776f4"}
Jun 10 23:04:43.410412 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:43.410174    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b6d2a0-7c26-4216-aab0-4c3d63f301b0","Type":"ContainerStarted","Data":"3ffe509f4a5f29a0ba5cb5ccdf516f097745808fc09578b7c2402b5b69bd96bb"}
Jun 10 23:04:43.434153 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:43.433656    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.415330946 podStartE2EDuration="2.433638677s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.307731ms" isStatefulPod=false podCreationTimestamp="2026-06-10 23:04:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:04:43.432507705 +0000 UTC m=+329.590131885" watchObservedRunningTime="2026-06-10 23:04:43.433638677 +0000 UTC m=+329.591262836"
Jun 10 23:04:46.965647 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:46.965613    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:46.966264 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:46.965668    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:46.970447 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:46.970425    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:47.399195 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:47.399165    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:47.429864 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:47.429825    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:04:47.483001 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:47.482976    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64b99f6c88-jgl4c"]
Jun 10 23:04:47.496487 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:47.496455    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:47.590687 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:47.590651    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:47.696660 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:47.696579    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:04:47.791510 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:04:47.791465    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:12.505470 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.505427    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-64b99f6c88-jgl4c" podUID="b4d5e131-c031-4a57-a20a-1b3033500360" containerName="console" containerID="cri-o://e43babae6438c5fd82f34bb1dafa1d1b945f8aceaa75bfe2945fcaf83fa85245" gracePeriod=15
Jun 10 23:05:12.752502 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.752479    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:05:12.884829 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.884803    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-trusted-ca-bundle\") pod \"b4d5e131-c031-4a57-a20a-1b3033500360\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") "
Jun 10 23:05:12.885044 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.884872    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-oauth-serving-cert\") pod \"b4d5e131-c031-4a57-a20a-1b3033500360\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") "
Jun 10 23:05:12.885044 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.884916    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-console-config\") pod \"b4d5e131-c031-4a57-a20a-1b3033500360\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") "
Jun 10 23:05:12.885044 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.884946    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4d5e131-c031-4a57-a20a-1b3033500360-console-serving-cert\") pod \"b4d5e131-c031-4a57-a20a-1b3033500360\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") "
Jun 10 23:05:12.885044 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.884977    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjp6m\" (UniqueName: \"kubernetes.io/projected/b4d5e131-c031-4a57-a20a-1b3033500360-kube-api-access-gjp6m\") pod \"b4d5e131-c031-4a57-a20a-1b3033500360\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") "
Jun 10 23:05:12.885044 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.885009    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-service-ca\") pod \"b4d5e131-c031-4a57-a20a-1b3033500360\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") "
Jun 10 23:05:12.885346 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.885052    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4d5e131-c031-4a57-a20a-1b3033500360-console-oauth-config\") pod \"b4d5e131-c031-4a57-a20a-1b3033500360\" (UID: \"b4d5e131-c031-4a57-a20a-1b3033500360\") "
Jun 10 23:05:12.885346 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.885268    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b4d5e131-c031-4a57-a20a-1b3033500360" (UID: "b4d5e131-c031-4a57-a20a-1b3033500360"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 23:05:12.885346 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.885310    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b4d5e131-c031-4a57-a20a-1b3033500360" (UID: "b4d5e131-c031-4a57-a20a-1b3033500360"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 23:05:12.885712 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.885675    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-service-ca" (OuterVolumeSpecName: "service-ca") pod "b4d5e131-c031-4a57-a20a-1b3033500360" (UID: "b4d5e131-c031-4a57-a20a-1b3033500360"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 23:05:12.885712 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.885688    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-console-config" (OuterVolumeSpecName: "console-config") pod "b4d5e131-c031-4a57-a20a-1b3033500360" (UID: "b4d5e131-c031-4a57-a20a-1b3033500360"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 23:05:12.887213 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.887187    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4d5e131-c031-4a57-a20a-1b3033500360-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b4d5e131-c031-4a57-a20a-1b3033500360" (UID: "b4d5e131-c031-4a57-a20a-1b3033500360"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 23:05:12.887213 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.887206    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4d5e131-c031-4a57-a20a-1b3033500360-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b4d5e131-c031-4a57-a20a-1b3033500360" (UID: "b4d5e131-c031-4a57-a20a-1b3033500360"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 23:05:12.887591 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.887565    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4d5e131-c031-4a57-a20a-1b3033500360-kube-api-access-gjp6m" (OuterVolumeSpecName: "kube-api-access-gjp6m") pod "b4d5e131-c031-4a57-a20a-1b3033500360" (UID: "b4d5e131-c031-4a57-a20a-1b3033500360"). InnerVolumeSpecName "kube-api-access-gjp6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:05:12.986040 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.986014    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-trusted-ca-bundle\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:05:12.986040 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.986036    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-oauth-serving-cert\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:05:12.986040 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.986045    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-console-config\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:05:12.986237 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.986054    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b4d5e131-c031-4a57-a20a-1b3033500360-console-serving-cert\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:05:12.986237 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.986065    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjp6m\" (UniqueName: \"kubernetes.io/projected/b4d5e131-c031-4a57-a20a-1b3033500360-kube-api-access-gjp6m\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:05:12.986237 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.986073    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b4d5e131-c031-4a57-a20a-1b3033500360-service-ca\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:05:12.986237 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:12.986081    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b4d5e131-c031-4a57-a20a-1b3033500360-console-oauth-config\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:05:13.534025 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:13.533993    2577 generic.go:356] "Generic (PLEG): container finished" podID="b4d5e131-c031-4a57-a20a-1b3033500360" containerID="e43babae6438c5fd82f34bb1dafa1d1b945f8aceaa75bfe2945fcaf83fa85245" exitCode=0
Jun 10 23:05:13.534395 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:13.534035    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64b99f6c88-jgl4c"
Jun 10 23:05:13.534395 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:13.534079    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b99f6c88-jgl4c" event={"ID":"b4d5e131-c031-4a57-a20a-1b3033500360","Type":"ContainerDied","Data":"e43babae6438c5fd82f34bb1dafa1d1b945f8aceaa75bfe2945fcaf83fa85245"}
Jun 10 23:05:13.534395 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:13.534128    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64b99f6c88-jgl4c" event={"ID":"b4d5e131-c031-4a57-a20a-1b3033500360","Type":"ContainerDied","Data":"08f375825e6a1b65c3ba94fa899a5e62b15a18480de008e99c59ac953b7fe53f"}
Jun 10 23:05:13.534395 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:13.534149    2577 scope.go:117] "RemoveContainer" containerID="e43babae6438c5fd82f34bb1dafa1d1b945f8aceaa75bfe2945fcaf83fa85245"
Jun 10 23:05:13.543378 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:13.543362    2577 scope.go:117] "RemoveContainer" containerID="e43babae6438c5fd82f34bb1dafa1d1b945f8aceaa75bfe2945fcaf83fa85245"
Jun 10 23:05:13.543591 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:05:13.543574    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e43babae6438c5fd82f34bb1dafa1d1b945f8aceaa75bfe2945fcaf83fa85245\": container with ID starting with e43babae6438c5fd82f34bb1dafa1d1b945f8aceaa75bfe2945fcaf83fa85245 not found: ID does not exist" containerID="e43babae6438c5fd82f34bb1dafa1d1b945f8aceaa75bfe2945fcaf83fa85245"
Jun 10 23:05:13.543635 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:13.543599    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e43babae6438c5fd82f34bb1dafa1d1b945f8aceaa75bfe2945fcaf83fa85245"} err="failed to get container status \"e43babae6438c5fd82f34bb1dafa1d1b945f8aceaa75bfe2945fcaf83fa85245\": rpc error: code = NotFound desc = could not find container \"e43babae6438c5fd82f34bb1dafa1d1b945f8aceaa75bfe2945fcaf83fa85245\": container with ID starting with e43babae6438c5fd82f34bb1dafa1d1b945f8aceaa75bfe2945fcaf83fa85245 not found: ID does not exist"
Jun 10 23:05:13.554696 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:13.554674    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64b99f6c88-jgl4c"]
Jun 10 23:05:13.564933 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:13.564913    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64b99f6c88-jgl4c"]
Jun 10 23:05:14.255959 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:14.255927    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4d5e131-c031-4a57-a20a-1b3033500360" path="/var/lib/kubelet/pods/b4d5e131-c031-4a57-a20a-1b3033500360/volumes"
Jun 10 23:05:24.904108 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:24.904074    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:25.000862 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.000820    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:25.562217 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.562183    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b"]
Jun 10 23:05:25.562477 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.562466    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4d5e131-c031-4a57-a20a-1b3033500360" containerName="console"
Jun 10 23:05:25.562527 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.562478    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4d5e131-c031-4a57-a20a-1b3033500360" containerName="console"
Jun 10 23:05:25.562566 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.562540    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4d5e131-c031-4a57-a20a-1b3033500360" containerName="console"
Jun 10 23:05:25.565570 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.565554    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b"
Jun 10 23:05:25.568579 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.568555    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-64grf\""
Jun 10 23:05:25.568706 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.568564    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 10 23:05:25.569131 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.569113    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 10 23:05:25.579592 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.579566    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b"]
Jun 10 23:05:25.684599 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.684571    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bqk2\" (UniqueName: \"kubernetes.io/projected/6a99178c-e7a3-49ad-aa90-dacb3876f18e-kube-api-access-4bqk2\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b\" (UID: \"6a99178c-e7a3-49ad-aa90-dacb3876f18e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b"
Jun 10 23:05:25.684725 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.684604    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a99178c-e7a3-49ad-aa90-dacb3876f18e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b\" (UID: \"6a99178c-e7a3-49ad-aa90-dacb3876f18e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b"
Jun 10 23:05:25.684725 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.684635    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a99178c-e7a3-49ad-aa90-dacb3876f18e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b\" (UID: \"6a99178c-e7a3-49ad-aa90-dacb3876f18e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b"
Jun 10 23:05:25.785994 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.785962    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a99178c-e7a3-49ad-aa90-dacb3876f18e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b\" (UID: \"6a99178c-e7a3-49ad-aa90-dacb3876f18e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b"
Jun 10 23:05:25.786139 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.786059    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bqk2\" (UniqueName: \"kubernetes.io/projected/6a99178c-e7a3-49ad-aa90-dacb3876f18e-kube-api-access-4bqk2\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b\" (UID: \"6a99178c-e7a3-49ad-aa90-dacb3876f18e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b"
Jun 10 23:05:25.786139 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.786090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a99178c-e7a3-49ad-aa90-dacb3876f18e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b\" (UID: \"6a99178c-e7a3-49ad-aa90-dacb3876f18e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b"
Jun 10 23:05:25.786337 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.786317    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a99178c-e7a3-49ad-aa90-dacb3876f18e-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b\" (UID: \"6a99178c-e7a3-49ad-aa90-dacb3876f18e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b"
Jun 10 23:05:25.786415 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.786394    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a99178c-e7a3-49ad-aa90-dacb3876f18e-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b\" (UID: \"6a99178c-e7a3-49ad-aa90-dacb3876f18e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b"
Jun 10 23:05:25.795233 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.795205    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bqk2\" (UniqueName: \"kubernetes.io/projected/6a99178c-e7a3-49ad-aa90-dacb3876f18e-kube-api-access-4bqk2\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b\" (UID: \"6a99178c-e7a3-49ad-aa90-dacb3876f18e\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b"
Jun 10 23:05:25.878406 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:25.878375    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b"
Jun 10 23:05:26.005211 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:26.005187    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b"]
Jun 10 23:05:26.007367 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:05:26.007336    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a99178c_e7a3_49ad_aa90_dacb3876f18e.slice/crio-e82b343f8a3ebef9be8b30486212a03cf1e53f7cc1a34f84b37888dc74564386 WatchSource:0}: Error finding container e82b343f8a3ebef9be8b30486212a03cf1e53f7cc1a34f84b37888dc74564386: Status 404 returned error can't find the container with id e82b343f8a3ebef9be8b30486212a03cf1e53f7cc1a34f84b37888dc74564386
Jun 10 23:05:26.009529 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:26.009513    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 10 23:05:26.586256 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:26.586214    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b" event={"ID":"6a99178c-e7a3-49ad-aa90-dacb3876f18e","Type":"ContainerStarted","Data":"e82b343f8a3ebef9be8b30486212a03cf1e53f7cc1a34f84b37888dc74564386"}
Jun 10 23:05:29.272417 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:29.272384    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:29.325763 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:29.325729    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:33.617499 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:33.617461    2577 generic.go:356] "Generic (PLEG): container finished" podID="6a99178c-e7a3-49ad-aa90-dacb3876f18e" containerID="4d9f99c0184fd7edf4e5210fee8d1485476a246fad81cc91d439b19fe9fee847" exitCode=0
Jun 10 23:05:33.617499 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:33.617498    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b" event={"ID":"6a99178c-e7a3-49ad-aa90-dacb3876f18e","Type":"ContainerDied","Data":"4d9f99c0184fd7edf4e5210fee8d1485476a246fad81cc91d439b19fe9fee847"}
Jun 10 23:05:34.623441 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:34.623407    2577 generic.go:356] "Generic (PLEG): container finished" podID="6a99178c-e7a3-49ad-aa90-dacb3876f18e" containerID="36a08717f5e58f6cc2b3fbf8dc607a2e310030ed2b1d8ba65bf7cbb51009ac2d" exitCode=0
Jun 10 23:05:34.623778 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:34.623482    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b" event={"ID":"6a99178c-e7a3-49ad-aa90-dacb3876f18e","Type":"ContainerDied","Data":"36a08717f5e58f6cc2b3fbf8dc607a2e310030ed2b1d8ba65bf7cbb51009ac2d"}
Jun 10 23:05:42.660046 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:42.660019    2577 generic.go:356] "Generic (PLEG): container finished" podID="6a99178c-e7a3-49ad-aa90-dacb3876f18e" containerID="b5ec2fc4a3ae70d64db02f72383349f55e740f1279bbc7dbc45c7109fa242d95" exitCode=0
Jun 10 23:05:42.660382 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:42.660111    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b" event={"ID":"6a99178c-e7a3-49ad-aa90-dacb3876f18e","Type":"ContainerDied","Data":"b5ec2fc4a3ae70d64db02f72383349f55e740f1279bbc7dbc45c7109fa242d95"}
Jun 10 23:05:43.788553 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:43.788528    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b"
Jun 10 23:05:43.944744 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:43.944652    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a99178c-e7a3-49ad-aa90-dacb3876f18e-util\") pod \"6a99178c-e7a3-49ad-aa90-dacb3876f18e\" (UID: \"6a99178c-e7a3-49ad-aa90-dacb3876f18e\") "
Jun 10 23:05:43.944933 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:43.944742    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bqk2\" (UniqueName: \"kubernetes.io/projected/6a99178c-e7a3-49ad-aa90-dacb3876f18e-kube-api-access-4bqk2\") pod \"6a99178c-e7a3-49ad-aa90-dacb3876f18e\" (UID: \"6a99178c-e7a3-49ad-aa90-dacb3876f18e\") "
Jun 10 23:05:43.944933 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:43.944783    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a99178c-e7a3-49ad-aa90-dacb3876f18e-bundle\") pod \"6a99178c-e7a3-49ad-aa90-dacb3876f18e\" (UID: \"6a99178c-e7a3-49ad-aa90-dacb3876f18e\") "
Jun 10 23:05:43.945396 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:43.945366    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a99178c-e7a3-49ad-aa90-dacb3876f18e-bundle" (OuterVolumeSpecName: "bundle") pod "6a99178c-e7a3-49ad-aa90-dacb3876f18e" (UID: "6a99178c-e7a3-49ad-aa90-dacb3876f18e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:05:43.946988 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:43.946964    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a99178c-e7a3-49ad-aa90-dacb3876f18e-kube-api-access-4bqk2" (OuterVolumeSpecName: "kube-api-access-4bqk2") pod "6a99178c-e7a3-49ad-aa90-dacb3876f18e" (UID: "6a99178c-e7a3-49ad-aa90-dacb3876f18e"). InnerVolumeSpecName "kube-api-access-4bqk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:05:43.948800 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:43.948776    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a99178c-e7a3-49ad-aa90-dacb3876f18e-util" (OuterVolumeSpecName: "util") pod "6a99178c-e7a3-49ad-aa90-dacb3876f18e" (UID: "6a99178c-e7a3-49ad-aa90-dacb3876f18e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:05:44.045550 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:44.045519    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a99178c-e7a3-49ad-aa90-dacb3876f18e-util\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:05:44.045550 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:44.045542    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bqk2\" (UniqueName: \"kubernetes.io/projected/6a99178c-e7a3-49ad-aa90-dacb3876f18e-kube-api-access-4bqk2\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:05:44.045550 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:44.045552    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a99178c-e7a3-49ad-aa90-dacb3876f18e-bundle\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:05:44.670650 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:44.670618    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b" event={"ID":"6a99178c-e7a3-49ad-aa90-dacb3876f18e","Type":"ContainerDied","Data":"e82b343f8a3ebef9be8b30486212a03cf1e53f7cc1a34f84b37888dc74564386"}
Jun 10 23:05:44.670650 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:44.670641    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dj4s6b"
Jun 10 23:05:44.670921 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:44.670666    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e82b343f8a3ebef9be8b30486212a03cf1e53f7cc1a34f84b37888dc74564386"
Jun 10 23:05:46.513331 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:46.513299    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:47.480474 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:47.480444    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:48.453817 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.453781    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bhmqr"]
Jun 10 23:05:48.454381 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.454228    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a99178c-e7a3-49ad-aa90-dacb3876f18e" containerName="pull"
Jun 10 23:05:48.454381 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.454246    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a99178c-e7a3-49ad-aa90-dacb3876f18e" containerName="pull"
Jun 10 23:05:48.454381 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.454270    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a99178c-e7a3-49ad-aa90-dacb3876f18e" containerName="util"
Jun 10 23:05:48.454381 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.454278    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a99178c-e7a3-49ad-aa90-dacb3876f18e" containerName="util"
Jun 10 23:05:48.454381 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.454308    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a99178c-e7a3-49ad-aa90-dacb3876f18e" containerName="extract"
Jun 10 23:05:48.454381 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.454318    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a99178c-e7a3-49ad-aa90-dacb3876f18e" containerName="extract"
Jun 10 23:05:48.454675 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.454385    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a99178c-e7a3-49ad-aa90-dacb3876f18e" containerName="extract"
Jun 10 23:05:48.457525 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.457505    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bhmqr"
Jun 10 23:05:48.459709 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.459687    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jun 10 23:05:48.459830 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.459691    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jun 10 23:05:48.459830 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.459750    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-79pc5\""
Jun 10 23:05:48.469317 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.469297    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bhmqr"]
Jun 10 23:05:48.480151 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.480129    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/474af7e1-a552-41ab-b4de-d55ecd559d6b-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bhmqr\" (UID: \"474af7e1-a552-41ab-b4de-d55ecd559d6b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bhmqr"
Jun 10 23:05:48.480252 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.480160    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8d5c\" (UniqueName: \"kubernetes.io/projected/474af7e1-a552-41ab-b4de-d55ecd559d6b-kube-api-access-t8d5c\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bhmqr\" (UID: \"474af7e1-a552-41ab-b4de-d55ecd559d6b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bhmqr"
Jun 10 23:05:48.581028 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.580989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/474af7e1-a552-41ab-b4de-d55ecd559d6b-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bhmqr\" (UID: \"474af7e1-a552-41ab-b4de-d55ecd559d6b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bhmqr"
Jun 10 23:05:48.581150 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.581035    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8d5c\" (UniqueName: \"kubernetes.io/projected/474af7e1-a552-41ab-b4de-d55ecd559d6b-kube-api-access-t8d5c\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bhmqr\" (UID: \"474af7e1-a552-41ab-b4de-d55ecd559d6b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bhmqr"
Jun 10 23:05:48.581315 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.581299    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/474af7e1-a552-41ab-b4de-d55ecd559d6b-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bhmqr\" (UID: \"474af7e1-a552-41ab-b4de-d55ecd559d6b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bhmqr"
Jun 10 23:05:48.588739 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.588719    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8d5c\" (UniqueName: \"kubernetes.io/projected/474af7e1-a552-41ab-b4de-d55ecd559d6b-kube-api-access-t8d5c\") pod \"cert-manager-operator-controller-manager-57757f7cfc-bhmqr\" (UID: \"474af7e1-a552-41ab-b4de-d55ecd559d6b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bhmqr"
Jun 10 23:05:48.766966 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.766887    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bhmqr"
Jun 10 23:05:48.899839 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:48.899817    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bhmqr"]
Jun 10 23:05:48.902783 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:05:48.902755    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod474af7e1_a552_41ab_b4de_d55ecd559d6b.slice/crio-37b7e98069b48e277261ab84a72efb81e6fc72d113c7e808c6336b8bc8b6d0fb WatchSource:0}: Error finding container 37b7e98069b48e277261ab84a72efb81e6fc72d113c7e808c6336b8bc8b6d0fb: Status 404 returned error can't find the container with id 37b7e98069b48e277261ab84a72efb81e6fc72d113c7e808c6336b8bc8b6d0fb
Jun 10 23:05:49.691457 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:49.691418    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bhmqr" event={"ID":"474af7e1-a552-41ab-b4de-d55ecd559d6b","Type":"ContainerStarted","Data":"37b7e98069b48e277261ab84a72efb81e6fc72d113c7e808c6336b8bc8b6d0fb"}
Jun 10 23:05:50.119116 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:50.119071    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:50.219303 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:50.219275    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:51.703182 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:51.703110    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bhmqr" event={"ID":"474af7e1-a552-41ab-b4de-d55ecd559d6b","Type":"ContainerStarted","Data":"e19d8a2684429ccb5ff864bb0b89f2956d9bdba0b604e6848c1746c0b9d50562"}
Jun 10 23:05:51.722516 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:51.722458    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-bhmqr" podStartSLOduration=1.532223896 podStartE2EDuration="3.722439295s" totalImagesPullingTime="2.190215399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:05:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:05:51.72087275 +0000 UTC m=+397.878496907" watchObservedRunningTime="2026-06-10 23:05:51.722439295 +0000 UTC m=+397.880063454"
Jun 10 23:05:51.783519 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:51.783483    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:51.886981 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:51.886915    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:52.105468 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.105434    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:52.230493 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.230464    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:52.748947 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.748917    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7"]
Jun 10 23:05:52.767680 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.767644    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7"]
Jun 10 23:05:52.767819 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.767782    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7"
Jun 10 23:05:52.769931 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.769909    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-64grf\""
Jun 10 23:05:52.770047 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.769909    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 10 23:05:52.770549 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.770525    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 10 23:05:52.819332 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.819304    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a1a183a-2630-45d2-8f4c-babae9afcab0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7\" (UID: \"0a1a183a-2630-45d2-8f4c-babae9afcab0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7"
Jun 10 23:05:52.819332 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.819336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sszlf\" (UniqueName: \"kubernetes.io/projected/0a1a183a-2630-45d2-8f4c-babae9afcab0-kube-api-access-sszlf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7\" (UID: \"0a1a183a-2630-45d2-8f4c-babae9afcab0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7"
Jun 10 23:05:52.819540 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.819364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a1a183a-2630-45d2-8f4c-babae9afcab0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7\" (UID: \"0a1a183a-2630-45d2-8f4c-babae9afcab0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7"
Jun 10 23:05:52.920464 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.920435    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a1a183a-2630-45d2-8f4c-babae9afcab0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7\" (UID: \"0a1a183a-2630-45d2-8f4c-babae9afcab0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7"
Jun 10 23:05:52.920464 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.920468    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sszlf\" (UniqueName: \"kubernetes.io/projected/0a1a183a-2630-45d2-8f4c-babae9afcab0-kube-api-access-sszlf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7\" (UID: \"0a1a183a-2630-45d2-8f4c-babae9afcab0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7"
Jun 10 23:05:52.920696 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.920498    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a1a183a-2630-45d2-8f4c-babae9afcab0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7\" (UID: \"0a1a183a-2630-45d2-8f4c-babae9afcab0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7"
Jun 10 23:05:52.920882 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.920862    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a1a183a-2630-45d2-8f4c-babae9afcab0-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7\" (UID: \"0a1a183a-2630-45d2-8f4c-babae9afcab0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7"
Jun 10 23:05:52.920951 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.920905    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a1a183a-2630-45d2-8f4c-babae9afcab0-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7\" (UID: \"0a1a183a-2630-45d2-8f4c-babae9afcab0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7"
Jun 10 23:05:52.931100 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:52.931077    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sszlf\" (UniqueName: \"kubernetes.io/projected/0a1a183a-2630-45d2-8f4c-babae9afcab0-kube-api-access-sszlf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7\" (UID: \"0a1a183a-2630-45d2-8f4c-babae9afcab0\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7"
Jun 10 23:05:53.077231 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.077148    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7"
Jun 10 23:05:53.232046 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.232020    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7"]
Jun 10 23:05:53.234143 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:05:53.234112    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a1a183a_2630_45d2_8f4c_babae9afcab0.slice/crio-a0bdc7e1dfa5abef6a51408b87710b5d050971eb87a59652d2430dcc12ee840d WatchSource:0}: Error finding container a0bdc7e1dfa5abef6a51408b87710b5d050971eb87a59652d2430dcc12ee840d: Status 404 returned error can't find the container with id a0bdc7e1dfa5abef6a51408b87710b5d050971eb87a59652d2430dcc12ee840d
Jun 10 23:05:53.550004 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.549973    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-d5942"]
Jun 10 23:05:53.564551 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.564525    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-d5942"]
Jun 10 23:05:53.564672 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.564621    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d5942"
Jun 10 23:05:53.566819 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.566800    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jun 10 23:05:53.566978 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.566825    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jun 10 23:05:53.566978 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.566804    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wckz8\""
Jun 10 23:05:53.626479 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.626453    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fbb9f39-54fc-4e27-9873-9bbe05a4ce70-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-d5942\" (UID: \"6fbb9f39-54fc-4e27-9873-9bbe05a4ce70\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d5942"
Jun 10 23:05:53.626621 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.626489    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkxll\" (UniqueName: \"kubernetes.io/projected/6fbb9f39-54fc-4e27-9873-9bbe05a4ce70-kube-api-access-lkxll\") pod \"cert-manager-webhook-7dc76cbb94-d5942\" (UID: \"6fbb9f39-54fc-4e27-9873-9bbe05a4ce70\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d5942"
Jun 10 23:05:53.712396 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.712367    2577 generic.go:356] "Generic (PLEG): container finished" podID="0a1a183a-2630-45d2-8f4c-babae9afcab0" containerID="a38e580d933391fd66c1ec6618ab46bb5a79a0b77319adb44d2176387ea8f726" exitCode=0
Jun 10 23:05:53.712521 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.712458    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7" event={"ID":"0a1a183a-2630-45d2-8f4c-babae9afcab0","Type":"ContainerDied","Data":"a38e580d933391fd66c1ec6618ab46bb5a79a0b77319adb44d2176387ea8f726"}
Jun 10 23:05:53.712521 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.712512    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7" event={"ID":"0a1a183a-2630-45d2-8f4c-babae9afcab0","Type":"ContainerStarted","Data":"a0bdc7e1dfa5abef6a51408b87710b5d050971eb87a59652d2430dcc12ee840d"}
Jun 10 23:05:53.727350 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.727329    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fbb9f39-54fc-4e27-9873-9bbe05a4ce70-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-d5942\" (UID: \"6fbb9f39-54fc-4e27-9873-9bbe05a4ce70\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d5942"
Jun 10 23:05:53.727468 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.727423    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkxll\" (UniqueName: \"kubernetes.io/projected/6fbb9f39-54fc-4e27-9873-9bbe05a4ce70-kube-api-access-lkxll\") pod \"cert-manager-webhook-7dc76cbb94-d5942\" (UID: \"6fbb9f39-54fc-4e27-9873-9bbe05a4ce70\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d5942"
Jun 10 23:05:53.735762 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.735743    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fbb9f39-54fc-4e27-9873-9bbe05a4ce70-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-d5942\" (UID: \"6fbb9f39-54fc-4e27-9873-9bbe05a4ce70\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d5942"
Jun 10 23:05:53.735953 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.735938    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkxll\" (UniqueName: \"kubernetes.io/projected/6fbb9f39-54fc-4e27-9873-9bbe05a4ce70-kube-api-access-lkxll\") pod \"cert-manager-webhook-7dc76cbb94-d5942\" (UID: \"6fbb9f39-54fc-4e27-9873-9bbe05a4ce70\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-d5942"
Jun 10 23:05:53.874045 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:53.874018    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d5942"
Jun 10 23:05:54.008705 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:54.008647    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-d5942"]
Jun 10 23:05:54.010911 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:05:54.010883    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fbb9f39_54fc_4e27_9873_9bbe05a4ce70.slice/crio-054fefa68b9b530fb57ffc4ef0fda69c18aa0d0beffe00ccca0d3b4cc2e836c4 WatchSource:0}: Error finding container 054fefa68b9b530fb57ffc4ef0fda69c18aa0d0beffe00ccca0d3b4cc2e836c4: Status 404 returned error can't find the container with id 054fefa68b9b530fb57ffc4ef0fda69c18aa0d0beffe00ccca0d3b4cc2e836c4
Jun 10 23:05:54.721156 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:54.721117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d5942" event={"ID":"6fbb9f39-54fc-4e27-9873-9bbe05a4ce70","Type":"ContainerStarted","Data":"054fefa68b9b530fb57ffc4ef0fda69c18aa0d0beffe00ccca0d3b4cc2e836c4"}
Jun 10 23:05:54.824550 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:54.824480    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:55.103355 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:55.103325    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:55.686960 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:55.686926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:57.115687 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:57.115650    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:57.170301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:57.170276    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:05:57.736605 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:57.736562    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d5942" event={"ID":"6fbb9f39-54fc-4e27-9873-9bbe05a4ce70","Type":"ContainerStarted","Data":"e8f567b4bf3706b73d3f990f75dfde8db9b9c6d1b9ca83999111dbdaaf434f60"}
Jun 10 23:05:57.736787 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:57.736614    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d5942"
Jun 10 23:05:57.738428 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:57.738401    2577 generic.go:356] "Generic (PLEG): container finished" podID="0a1a183a-2630-45d2-8f4c-babae9afcab0" containerID="711b3ceb9616b182baa90bc008c7d2e6a7b4bb834865cd9a857be84223de4c4b" exitCode=0
Jun 10 23:05:57.738537 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:57.738432    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7" event={"ID":"0a1a183a-2630-45d2-8f4c-babae9afcab0","Type":"ContainerDied","Data":"711b3ceb9616b182baa90bc008c7d2e6a7b4bb834865cd9a857be84223de4c4b"}
Jun 10 23:05:57.752761 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:57.752716    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d5942" podStartSLOduration=1.8045334450000001 podStartE2EDuration="4.752699789s" totalImagesPullingTime="2.948166344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:05:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:05:57.752424924 +0000 UTC m=+403.910049085" watchObservedRunningTime="2026-06-10 23:05:57.752699789 +0000 UTC m=+403.910323948"
Jun 10 23:05:58.745589 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:58.745555    2577 generic.go:356] "Generic (PLEG): container finished" podID="0a1a183a-2630-45d2-8f4c-babae9afcab0" containerID="821aa56360a14fb9316737db1419c8628ff0c9badb2c348735af30750b26c25b" exitCode=0
Jun 10 23:05:58.745998 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:58.745625    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7" event={"ID":"0a1a183a-2630-45d2-8f4c-babae9afcab0","Type":"ContainerDied","Data":"821aa56360a14fb9316737db1419c8628ff0c9badb2c348735af30750b26c25b"}
Jun 10 23:05:59.871705 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:59.871684    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7"
Jun 10 23:05:59.976636 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:59.976603    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a1a183a-2630-45d2-8f4c-babae9afcab0-util\") pod \"0a1a183a-2630-45d2-8f4c-babae9afcab0\" (UID: \"0a1a183a-2630-45d2-8f4c-babae9afcab0\") "
Jun 10 23:05:59.976764 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:59.976653    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sszlf\" (UniqueName: \"kubernetes.io/projected/0a1a183a-2630-45d2-8f4c-babae9afcab0-kube-api-access-sszlf\") pod \"0a1a183a-2630-45d2-8f4c-babae9afcab0\" (UID: \"0a1a183a-2630-45d2-8f4c-babae9afcab0\") "
Jun 10 23:05:59.976764 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:59.976706    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a1a183a-2630-45d2-8f4c-babae9afcab0-bundle\") pod \"0a1a183a-2630-45d2-8f4c-babae9afcab0\" (UID: \"0a1a183a-2630-45d2-8f4c-babae9afcab0\") "
Jun 10 23:05:59.977151 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:59.977117    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a1a183a-2630-45d2-8f4c-babae9afcab0-bundle" (OuterVolumeSpecName: "bundle") pod "0a1a183a-2630-45d2-8f4c-babae9afcab0" (UID: "0a1a183a-2630-45d2-8f4c-babae9afcab0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:05:59.978757 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:59.978736    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a1a183a-2630-45d2-8f4c-babae9afcab0-kube-api-access-sszlf" (OuterVolumeSpecName: "kube-api-access-sszlf") pod "0a1a183a-2630-45d2-8f4c-babae9afcab0" (UID: "0a1a183a-2630-45d2-8f4c-babae9afcab0"). InnerVolumeSpecName "kube-api-access-sszlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:05:59.983793 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:05:59.983754    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a1a183a-2630-45d2-8f4c-babae9afcab0-util" (OuterVolumeSpecName: "util") pod "0a1a183a-2630-45d2-8f4c-babae9afcab0" (UID: "0a1a183a-2630-45d2-8f4c-babae9afcab0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:06:00.078221 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:00.078166    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a1a183a-2630-45d2-8f4c-babae9afcab0-util\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:06:00.078221 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:00.078189    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sszlf\" (UniqueName: \"kubernetes.io/projected/0a1a183a-2630-45d2-8f4c-babae9afcab0-kube-api-access-sszlf\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:06:00.078221 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:00.078199    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a1a183a-2630-45d2-8f4c-babae9afcab0-bundle\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:06:00.726706 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:00.726671    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:00.755931 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:00.755911    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7"
Jun 10 23:06:00.755931 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:00.755925    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9pf7" event={"ID":"0a1a183a-2630-45d2-8f4c-babae9afcab0","Type":"ContainerDied","Data":"a0bdc7e1dfa5abef6a51408b87710b5d050971eb87a59652d2430dcc12ee840d"}
Jun 10 23:06:00.756091 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:00.755966    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0bdc7e1dfa5abef6a51408b87710b5d050971eb87a59652d2430dcc12ee840d"
Jun 10 23:06:03.493251 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:03.493216    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:03.748586 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:03.748509    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-d5942"
Jun 10 23:06:04.652436 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:04.652404    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:04.754243 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:04.754214    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:05.540691 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.540657    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-8tmvp"]
Jun 10 23:06:05.540975 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.540963    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a1a183a-2630-45d2-8f4c-babae9afcab0" containerName="pull"
Jun 10 23:06:05.541035 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.540977    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a1a183a-2630-45d2-8f4c-babae9afcab0" containerName="pull"
Jun 10 23:06:05.541035 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.540989    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a1a183a-2630-45d2-8f4c-babae9afcab0" containerName="util"
Jun 10 23:06:05.541035 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.540995    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a1a183a-2630-45d2-8f4c-babae9afcab0" containerName="util"
Jun 10 23:06:05.541035 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.541006    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a1a183a-2630-45d2-8f4c-babae9afcab0" containerName="extract"
Jun 10 23:06:05.541035 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.541012    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a1a183a-2630-45d2-8f4c-babae9afcab0" containerName="extract"
Jun 10 23:06:05.541198 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.541065    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a1a183a-2630-45d2-8f4c-babae9afcab0" containerName="extract"
Jun 10 23:06:05.544052 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.544037    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-8tmvp"
Jun 10 23:06:05.546314 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.546294    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qhvqz\""
Jun 10 23:06:05.549889 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.549870    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-8tmvp"]
Jun 10 23:06:05.617165 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.617143    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xtc8\" (UniqueName: \"kubernetes.io/projected/2621e9d0-1f93-4016-a54c-9171c9963b56-kube-api-access-5xtc8\") pod \"cert-manager-59c77684cc-8tmvp\" (UID: \"2621e9d0-1f93-4016-a54c-9171c9963b56\") " pod="cert-manager/cert-manager-59c77684cc-8tmvp"
Jun 10 23:06:05.617276 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.617189    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2621e9d0-1f93-4016-a54c-9171c9963b56-bound-sa-token\") pod \"cert-manager-59c77684cc-8tmvp\" (UID: \"2621e9d0-1f93-4016-a54c-9171c9963b56\") " pod="cert-manager/cert-manager-59c77684cc-8tmvp"
Jun 10 23:06:05.717631 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.717606    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xtc8\" (UniqueName: \"kubernetes.io/projected/2621e9d0-1f93-4016-a54c-9171c9963b56-kube-api-access-5xtc8\") pod \"cert-manager-59c77684cc-8tmvp\" (UID: \"2621e9d0-1f93-4016-a54c-9171c9963b56\") " pod="cert-manager/cert-manager-59c77684cc-8tmvp"
Jun 10 23:06:05.717967 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.717655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2621e9d0-1f93-4016-a54c-9171c9963b56-bound-sa-token\") pod \"cert-manager-59c77684cc-8tmvp\" (UID: \"2621e9d0-1f93-4016-a54c-9171c9963b56\") " pod="cert-manager/cert-manager-59c77684cc-8tmvp"
Jun 10 23:06:05.726169 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.726144    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2621e9d0-1f93-4016-a54c-9171c9963b56-bound-sa-token\") pod \"cert-manager-59c77684cc-8tmvp\" (UID: \"2621e9d0-1f93-4016-a54c-9171c9963b56\") " pod="cert-manager/cert-manager-59c77684cc-8tmvp"
Jun 10 23:06:05.726259 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.726204    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xtc8\" (UniqueName: \"kubernetes.io/projected/2621e9d0-1f93-4016-a54c-9171c9963b56-kube-api-access-5xtc8\") pod \"cert-manager-59c77684cc-8tmvp\" (UID: \"2621e9d0-1f93-4016-a54c-9171c9963b56\") " pod="cert-manager/cert-manager-59c77684cc-8tmvp"
Jun 10 23:06:05.853337 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.853309    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-8tmvp"
Jun 10 23:06:05.975541 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:05.975515    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-8tmvp"]
Jun 10 23:06:05.977086 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:06:05.977060    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2621e9d0_1f93_4016_a54c_9171c9963b56.slice/crio-e9f7f07351f93d82aa969367c2503c9791088a68c52b1d0f82b35a16a73f03b5 WatchSource:0}: Error finding container e9f7f07351f93d82aa969367c2503c9791088a68c52b1d0f82b35a16a73f03b5: Status 404 returned error can't find the container with id e9f7f07351f93d82aa969367c2503c9791088a68c52b1d0f82b35a16a73f03b5
Jun 10 23:06:06.782136 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:06.782099    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-8tmvp" event={"ID":"2621e9d0-1f93-4016-a54c-9171c9963b56","Type":"ContainerStarted","Data":"dda83f788a6e982cd397150a81b1d648bf09c5c96db5fc00d5ac05381bd9d8d0"}
Jun 10 23:06:06.782484 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:06.782146    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-8tmvp" event={"ID":"2621e9d0-1f93-4016-a54c-9171c9963b56","Type":"ContainerStarted","Data":"e9f7f07351f93d82aa969367c2503c9791088a68c52b1d0f82b35a16a73f03b5"}
Jun 10 23:06:06.797379 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:06.797333    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-8tmvp" podStartSLOduration=1.797319077 podStartE2EDuration="1.797319077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:06:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:06:06.796866346 +0000 UTC m=+412.954490494" watchObservedRunningTime="2026-06-10 23:06:06.797319077 +0000 UTC m=+412.954943233"
Jun 10 23:06:10.419538 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:10.419500    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:10.522060 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:10.522029    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:12.206382 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.206346    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc"]
Jun 10 23:06:12.209818 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.209801    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc"
Jun 10 23:06:12.211933 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.211904    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 10 23:06:12.212542 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.212525    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 10 23:06:12.212542 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.212534    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-64grf\""
Jun 10 23:06:12.216685 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.216662    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc"]
Jun 10 23:06:12.270333 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.270308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6da9b983-2253-4d58-bfc9-9648997092c6-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc\" (UID: \"6da9b983-2253-4d58-bfc9-9648997092c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc"
Jun 10 23:06:12.270466 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.270344    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6da9b983-2253-4d58-bfc9-9648997092c6-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc\" (UID: \"6da9b983-2253-4d58-bfc9-9648997092c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc"
Jun 10 23:06:12.270466 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.270363    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4klwz\" (UniqueName: \"kubernetes.io/projected/6da9b983-2253-4d58-bfc9-9648997092c6-kube-api-access-4klwz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc\" (UID: \"6da9b983-2253-4d58-bfc9-9648997092c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc"
Jun 10 23:06:12.371046 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.371016    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6da9b983-2253-4d58-bfc9-9648997092c6-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc\" (UID: \"6da9b983-2253-4d58-bfc9-9648997092c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc"
Jun 10 23:06:12.371177 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.371055    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6da9b983-2253-4d58-bfc9-9648997092c6-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc\" (UID: \"6da9b983-2253-4d58-bfc9-9648997092c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc"
Jun 10 23:06:12.371177 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.371090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4klwz\" (UniqueName: \"kubernetes.io/projected/6da9b983-2253-4d58-bfc9-9648997092c6-kube-api-access-4klwz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc\" (UID: \"6da9b983-2253-4d58-bfc9-9648997092c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc"
Jun 10 23:06:12.371385 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.371368    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6da9b983-2253-4d58-bfc9-9648997092c6-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc\" (UID: \"6da9b983-2253-4d58-bfc9-9648997092c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc"
Jun 10 23:06:12.371425 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.371395    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6da9b983-2253-4d58-bfc9-9648997092c6-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc\" (UID: \"6da9b983-2253-4d58-bfc9-9648997092c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc"
Jun 10 23:06:12.379089 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.379064    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4klwz\" (UniqueName: \"kubernetes.io/projected/6da9b983-2253-4d58-bfc9-9648997092c6-kube-api-access-4klwz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc\" (UID: \"6da9b983-2253-4d58-bfc9-9648997092c6\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc"
Jun 10 23:06:12.520577 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.520501    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc"
Jun 10 23:06:12.638608 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.638571    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:12.651418 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.646654    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc"]
Jun 10 23:06:12.653004 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:06:12.652970    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6da9b983_2253_4d58_bfc9_9648997092c6.slice/crio-e73d673456641f782d57423a6e80b5eaf8990737fd2512864d73faaaf69aba42 WatchSource:0}: Error finding container e73d673456641f782d57423a6e80b5eaf8990737fd2512864d73faaaf69aba42: Status 404 returned error can't find the container with id e73d673456641f782d57423a6e80b5eaf8990737fd2512864d73faaaf69aba42
Jun 10 23:06:12.810750 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.810681    2577 generic.go:356] "Generic (PLEG): container finished" podID="6da9b983-2253-4d58-bfc9-9648997092c6" containerID="e11d7926774eace7ed7d104d66a0303dd8d273a40fffe1b988a7c8ad1ed67b1d" exitCode=0
Jun 10 23:06:12.810888 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.810738    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc" event={"ID":"6da9b983-2253-4d58-bfc9-9648997092c6","Type":"ContainerDied","Data":"e11d7926774eace7ed7d104d66a0303dd8d273a40fffe1b988a7c8ad1ed67b1d"}
Jun 10 23:06:12.810888 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:12.810790    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc" event={"ID":"6da9b983-2253-4d58-bfc9-9648997092c6","Type":"ContainerStarted","Data":"e73d673456641f782d57423a6e80b5eaf8990737fd2512864d73faaaf69aba42"}
Jun 10 23:06:13.816736 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:13.816656    2577 generic.go:356] "Generic (PLEG): container finished" podID="6da9b983-2253-4d58-bfc9-9648997092c6" containerID="a0b1d82d594f3de04a68226efaf1ad9ecc24bb8eb9c665c53b655c0a69237cc1" exitCode=0
Jun 10 23:06:13.817118 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:13.816740    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc" event={"ID":"6da9b983-2253-4d58-bfc9-9648997092c6","Type":"ContainerDied","Data":"a0b1d82d594f3de04a68226efaf1ad9ecc24bb8eb9c665c53b655c0a69237cc1"}
Jun 10 23:06:14.823664 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:14.823632    2577 generic.go:356] "Generic (PLEG): container finished" podID="6da9b983-2253-4d58-bfc9-9648997092c6" containerID="65a1e36676e51dab93049ec4638462d6f025a6d542f34dc4fdbab62155a5baac" exitCode=0
Jun 10 23:06:14.824120 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:14.823714    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc" event={"ID":"6da9b983-2253-4d58-bfc9-9648997092c6","Type":"ContainerDied","Data":"65a1e36676e51dab93049ec4638462d6f025a6d542f34dc4fdbab62155a5baac"}
Jun 10 23:06:15.956963 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:15.956942    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc"
Jun 10 23:06:16.103924 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:16.103901    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6da9b983-2253-4d58-bfc9-9648997092c6-bundle\") pod \"6da9b983-2253-4d58-bfc9-9648997092c6\" (UID: \"6da9b983-2253-4d58-bfc9-9648997092c6\") "
Jun 10 23:06:16.104056 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:16.103959    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6da9b983-2253-4d58-bfc9-9648997092c6-util\") pod \"6da9b983-2253-4d58-bfc9-9648997092c6\" (UID: \"6da9b983-2253-4d58-bfc9-9648997092c6\") "
Jun 10 23:06:16.104056 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:16.103984    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4klwz\" (UniqueName: \"kubernetes.io/projected/6da9b983-2253-4d58-bfc9-9648997092c6-kube-api-access-4klwz\") pod \"6da9b983-2253-4d58-bfc9-9648997092c6\" (UID: \"6da9b983-2253-4d58-bfc9-9648997092c6\") "
Jun 10 23:06:16.104776 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:16.104738    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6da9b983-2253-4d58-bfc9-9648997092c6-bundle" (OuterVolumeSpecName: "bundle") pod "6da9b983-2253-4d58-bfc9-9648997092c6" (UID: "6da9b983-2253-4d58-bfc9-9648997092c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:06:16.106039 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:16.106017    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6da9b983-2253-4d58-bfc9-9648997092c6-kube-api-access-4klwz" (OuterVolumeSpecName: "kube-api-access-4klwz") pod "6da9b983-2253-4d58-bfc9-9648997092c6" (UID: "6da9b983-2253-4d58-bfc9-9648997092c6"). InnerVolumeSpecName "kube-api-access-4klwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:06:16.109920 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:16.109886    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6da9b983-2253-4d58-bfc9-9648997092c6-util" (OuterVolumeSpecName: "util") pod "6da9b983-2253-4d58-bfc9-9648997092c6" (UID: "6da9b983-2253-4d58-bfc9-9648997092c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:06:16.205028 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:16.205002    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4klwz\" (UniqueName: \"kubernetes.io/projected/6da9b983-2253-4d58-bfc9-9648997092c6-kube-api-access-4klwz\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:06:16.205028 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:16.205023    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6da9b983-2253-4d58-bfc9-9648997092c6-bundle\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:06:16.205028 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:16.205032    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6da9b983-2253-4d58-bfc9-9648997092c6-util\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:06:16.834837 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:16.834790    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc" event={"ID":"6da9b983-2253-4d58-bfc9-9648997092c6","Type":"ContainerDied","Data":"e73d673456641f782d57423a6e80b5eaf8990737fd2512864d73faaaf69aba42"}
Jun 10 23:06:16.835033 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:16.834893    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e73d673456641f782d57423a6e80b5eaf8990737fd2512864d73faaaf69aba42"
Jun 10 23:06:16.835033 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:16.834808    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8bcpc"
Jun 10 23:06:25.745073 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:25.745041    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:25.848657 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:25.848632    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:26.362210 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.362177    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:26.602441 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.602408    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:26.703458 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.703380    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:26.735396 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.735371    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"]
Jun 10 23:06:26.735703 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.735684    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6da9b983-2253-4d58-bfc9-9648997092c6" containerName="pull"
Jun 10 23:06:26.735753 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.735704    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6da9b983-2253-4d58-bfc9-9648997092c6" containerName="pull"
Jun 10 23:06:26.735753 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.735717    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6da9b983-2253-4d58-bfc9-9648997092c6" containerName="util"
Jun 10 23:06:26.735753 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.735722    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6da9b983-2253-4d58-bfc9-9648997092c6" containerName="util"
Jun 10 23:06:26.735753 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.735737    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6da9b983-2253-4d58-bfc9-9648997092c6" containerName="extract"
Jun 10 23:06:26.735753 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.735741    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6da9b983-2253-4d58-bfc9-9648997092c6" containerName="extract"
Jun 10 23:06:26.735920 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.735788    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6da9b983-2253-4d58-bfc9-9648997092c6" containerName="extract"
Jun 10 23:06:26.741378 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.741360    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:26.743277 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.743254    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 10 23:06:26.743379 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.743319    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kgcr2\""
Jun 10 23:06:26.743588 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.743574    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 10 23:06:26.743841 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.743828    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 10 23:06:26.743915 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.743891    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 10 23:06:26.759010 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.758990    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"]
Jun 10 23:06:26.892126 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.892095    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3e43859-98e8-4c7d-a46f-b5c5c799d591-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bdf94bcbb-nk92n\" (UID: \"b3e43859-98e8-4c7d-a46f-b5c5c799d591\") " pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:26.892256 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.892147    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b3e43859-98e8-4c7d-a46f-b5c5c799d591-manifests\") pod \"opendatahub-operator-controller-manager-6bdf94bcbb-nk92n\" (UID: \"b3e43859-98e8-4c7d-a46f-b5c5c799d591\") " pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:26.892256 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.892193    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzfmm\" (UniqueName: \"kubernetes.io/projected/b3e43859-98e8-4c7d-a46f-b5c5c799d591-kube-api-access-jzfmm\") pod \"opendatahub-operator-controller-manager-6bdf94bcbb-nk92n\" (UID: \"b3e43859-98e8-4c7d-a46f-b5c5c799d591\") " pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:26.892256 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.892233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b3e43859-98e8-4c7d-a46f-b5c5c799d591-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bdf94bcbb-nk92n\" (UID: \"b3e43859-98e8-4c7d-a46f-b5c5c799d591\") " pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:26.892361 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.892271    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3e43859-98e8-4c7d-a46f-b5c5c799d591-tmp\") pod \"opendatahub-operator-controller-manager-6bdf94bcbb-nk92n\" (UID: \"b3e43859-98e8-4c7d-a46f-b5c5c799d591\") " pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:26.920895 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.920868    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:26.992977 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.992916    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzfmm\" (UniqueName: \"kubernetes.io/projected/b3e43859-98e8-4c7d-a46f-b5c5c799d591-kube-api-access-jzfmm\") pod \"opendatahub-operator-controller-manager-6bdf94bcbb-nk92n\" (UID: \"b3e43859-98e8-4c7d-a46f-b5c5c799d591\") " pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:26.992977 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.992960    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b3e43859-98e8-4c7d-a46f-b5c5c799d591-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bdf94bcbb-nk92n\" (UID: \"b3e43859-98e8-4c7d-a46f-b5c5c799d591\") " pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:26.993140 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.992994    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3e43859-98e8-4c7d-a46f-b5c5c799d591-tmp\") pod \"opendatahub-operator-controller-manager-6bdf94bcbb-nk92n\" (UID: \"b3e43859-98e8-4c7d-a46f-b5c5c799d591\") " pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:26.993140 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.993044    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3e43859-98e8-4c7d-a46f-b5c5c799d591-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bdf94bcbb-nk92n\" (UID: \"b3e43859-98e8-4c7d-a46f-b5c5c799d591\") " pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:26.993140 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.993090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b3e43859-98e8-4c7d-a46f-b5c5c799d591-manifests\") pod \"opendatahub-operator-controller-manager-6bdf94bcbb-nk92n\" (UID: \"b3e43859-98e8-4c7d-a46f-b5c5c799d591\") " pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:26.993466 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.993447    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b3e43859-98e8-4c7d-a46f-b5c5c799d591-manifests\") pod \"opendatahub-operator-controller-manager-6bdf94bcbb-nk92n\" (UID: \"b3e43859-98e8-4c7d-a46f-b5c5c799d591\") " pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:26.995340 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.995309    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3e43859-98e8-4c7d-a46f-b5c5c799d591-tmp\") pod \"opendatahub-operator-controller-manager-6bdf94bcbb-nk92n\" (UID: \"b3e43859-98e8-4c7d-a46f-b5c5c799d591\") " pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:26.995420 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.995385    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3e43859-98e8-4c7d-a46f-b5c5c799d591-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bdf94bcbb-nk92n\" (UID: \"b3e43859-98e8-4c7d-a46f-b5c5c799d591\") " pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:26.995520 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:26.995501    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b3e43859-98e8-4c7d-a46f-b5c5c799d591-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bdf94bcbb-nk92n\" (UID: \"b3e43859-98e8-4c7d-a46f-b5c5c799d591\") " pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:27.000606 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:27.000585    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzfmm\" (UniqueName: \"kubernetes.io/projected/b3e43859-98e8-4c7d-a46f-b5c5c799d591-kube-api-access-jzfmm\") pod \"opendatahub-operator-controller-manager-6bdf94bcbb-nk92n\" (UID: \"b3e43859-98e8-4c7d-a46f-b5c5c799d591\") " pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:27.026676 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:27.026649    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:27.051156 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:27.051134    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:27.122969 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:27.122935    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:27.181213 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:27.181190    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"]
Jun 10 23:06:27.186194 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:27.186166    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:27.243951 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:27.243894    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:27.349683 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:27.349654    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:27.456286 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:27.456260    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:27.885316 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:27.885277    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n" event={"ID":"b3e43859-98e8-4c7d-a46f-b5c5c799d591","Type":"ContainerStarted","Data":"4ad13454f77c6aec7710574e58a68e3d3ace73c14493399d49b53e2acd3b40b2"}
Jun 10 23:06:30.905924 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:30.905880    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n" event={"ID":"b3e43859-98e8-4c7d-a46f-b5c5c799d591","Type":"ContainerStarted","Data":"594457d6a372e1bc774f73d065b22a94e0f6e025977aa093e5017efbf258cda0"}
Jun 10 23:06:31.911950 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:31.911915    2577 generic.go:356] "Generic (PLEG): container finished" podID="b3e43859-98e8-4c7d-a46f-b5c5c799d591" containerID="594457d6a372e1bc774f73d065b22a94e0f6e025977aa093e5017efbf258cda0" exitCode=0
Jun 10 23:06:31.912370 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:31.911997    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n" event={"ID":"b3e43859-98e8-4c7d-a46f-b5c5c799d591","Type":"ContainerDied","Data":"594457d6a372e1bc774f73d065b22a94e0f6e025977aa093e5017efbf258cda0"}
Jun 10 23:06:32.918666 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:32.918635    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n" event={"ID":"b3e43859-98e8-4c7d-a46f-b5c5c799d591","Type":"ContainerStarted","Data":"61e7100795249434cc26cad747867f4ee2dccf910408261117e191aaed818e70"}
Jun 10 23:06:32.919106 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:32.918728    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:32.939443 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:32.939398    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n" podStartSLOduration=2.5260449659999997 podStartE2EDuration="6.939384509s" totalImagesPullingTime="3.442969584s" totalInitContainerRuntime="970.369959ms" isStatefulPod=false podCreationTimestamp="2026-06-10 23:06:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:06:32.93770915 +0000 UTC m=+439.095333308" watchObservedRunningTime="2026-06-10 23:06:32.939384509 +0000 UTC m=+439.097008689"
Jun 10 23:06:34.869817 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:34.869780    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:34.970790 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:34.970757    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:37.698437 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:37.698398    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:37.797304 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:37.797262    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:43.925634 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:43.925598    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bdf94bcbb-nk92n"
Jun 10 23:06:44.244715 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:44.244635    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:45.741731 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:45.741702    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:45.860532 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:45.860504    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:46.342277 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.342250    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-6st9w"]
Jun 10 23:06:46.350340 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.350318    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-6st9w"
Jun 10 23:06:46.353231 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.353208    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jun 10 23:06:46.353366 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.353280    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jn8f4\""
Jun 10 23:06:46.356035 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.356013    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-6st9w"]
Jun 10 23:06:46.373115 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.373081    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:46.448392 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.448355    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/167c52af-b701-423f-8338-fd0165a630e6-cert\") pod \"odh-model-controller-6dc94f689f-6st9w\" (UID: \"167c52af-b701-423f-8338-fd0165a630e6\") " pod="opendatahub/odh-model-controller-6dc94f689f-6st9w"
Jun 10 23:06:46.448568 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.448403    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl9tp\" (UniqueName: \"kubernetes.io/projected/167c52af-b701-423f-8338-fd0165a630e6-kube-api-access-cl9tp\") pod \"odh-model-controller-6dc94f689f-6st9w\" (UID: \"167c52af-b701-423f-8338-fd0165a630e6\") " pod="opendatahub/odh-model-controller-6dc94f689f-6st9w"
Jun 10 23:06:46.474499 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.474467    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:46.549599 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.549562    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl9tp\" (UniqueName: \"kubernetes.io/projected/167c52af-b701-423f-8338-fd0165a630e6-kube-api-access-cl9tp\") pod \"odh-model-controller-6dc94f689f-6st9w\" (UID: \"167c52af-b701-423f-8338-fd0165a630e6\") " pod="opendatahub/odh-model-controller-6dc94f689f-6st9w"
Jun 10 23:06:46.549764 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.549667    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/167c52af-b701-423f-8338-fd0165a630e6-cert\") pod \"odh-model-controller-6dc94f689f-6st9w\" (UID: \"167c52af-b701-423f-8338-fd0165a630e6\") " pod="opendatahub/odh-model-controller-6dc94f689f-6st9w"
Jun 10 23:06:46.549804 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:06:46.549764    2577 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jun 10 23:06:46.549841 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:06:46.549815    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/167c52af-b701-423f-8338-fd0165a630e6-cert podName:167c52af-b701-423f-8338-fd0165a630e6 nodeName:}" failed. No retries permitted until 2026-06-10 23:06:47.049799511 +0000 UTC m=+453.207423648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/167c52af-b701-423f-8338-fd0165a630e6-cert") pod "odh-model-controller-6dc94f689f-6st9w" (UID: "167c52af-b701-423f-8338-fd0165a630e6") : secret "odh-model-controller-webhook-cert" not found
Jun 10 23:06:46.560222 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.560201    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl9tp\" (UniqueName: \"kubernetes.io/projected/167c52af-b701-423f-8338-fd0165a630e6-kube-api-access-cl9tp\") pod \"odh-model-controller-6dc94f689f-6st9w\" (UID: \"167c52af-b701-423f-8338-fd0165a630e6\") " pod="opendatahub/odh-model-controller-6dc94f689f-6st9w"
Jun 10 23:06:46.679996 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.679948    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:46.783387 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.783349    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:46.839386 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.839353    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-wjklt"]
Jun 10 23:06:46.842554 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.842536    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-wjklt"
Jun 10 23:06:46.844899 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.844881    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jun 10 23:06:46.844978 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.844928    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-pwm7d\""
Jun 10 23:06:46.851780 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.851758    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd7qc\" (UniqueName: \"kubernetes.io/projected/f7496902-9d71-4be7-88d0-ad6d4014f461-kube-api-access-kd7qc\") pod \"model-serving-api-5dd488fc48-wjklt\" (UID: \"f7496902-9d71-4be7-88d0-ad6d4014f461\") " pod="opendatahub/model-serving-api-5dd488fc48-wjklt"
Jun 10 23:06:46.851921 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.851830    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7496902-9d71-4be7-88d0-ad6d4014f461-tls-certs\") pod \"model-serving-api-5dd488fc48-wjklt\" (UID: \"f7496902-9d71-4be7-88d0-ad6d4014f461\") " pod="opendatahub/model-serving-api-5dd488fc48-wjklt"
Jun 10 23:06:46.853373 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.853352    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-wjklt"]
Jun 10 23:06:46.952352 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.952257    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd7qc\" (UniqueName: \"kubernetes.io/projected/f7496902-9d71-4be7-88d0-ad6d4014f461-kube-api-access-kd7qc\") pod \"model-serving-api-5dd488fc48-wjklt\" (UID: \"f7496902-9d71-4be7-88d0-ad6d4014f461\") " pod="opendatahub/model-serving-api-5dd488fc48-wjklt"
Jun 10 23:06:46.952514 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.952367    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7496902-9d71-4be7-88d0-ad6d4014f461-tls-certs\") pod \"model-serving-api-5dd488fc48-wjklt\" (UID: \"f7496902-9d71-4be7-88d0-ad6d4014f461\") " pod="opendatahub/model-serving-api-5dd488fc48-wjklt"
Jun 10 23:06:46.953027 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.953001    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:46.954815 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.954795    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7496902-9d71-4be7-88d0-ad6d4014f461-tls-certs\") pod \"model-serving-api-5dd488fc48-wjklt\" (UID: \"f7496902-9d71-4be7-88d0-ad6d4014f461\") " pod="opendatahub/model-serving-api-5dd488fc48-wjklt"
Jun 10 23:06:46.962219 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:46.962179    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd7qc\" (UniqueName: \"kubernetes.io/projected/f7496902-9d71-4be7-88d0-ad6d4014f461-kube-api-access-kd7qc\") pod \"model-serving-api-5dd488fc48-wjklt\" (UID: \"f7496902-9d71-4be7-88d0-ad6d4014f461\") " pod="opendatahub/model-serving-api-5dd488fc48-wjklt"
Jun 10 23:06:47.053532 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:47.053496    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/167c52af-b701-423f-8338-fd0165a630e6-cert\") pod \"odh-model-controller-6dc94f689f-6st9w\" (UID: \"167c52af-b701-423f-8338-fd0165a630e6\") " pod="opendatahub/odh-model-controller-6dc94f689f-6st9w"
Jun 10 23:06:47.055922 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:47.055900    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/167c52af-b701-423f-8338-fd0165a630e6-cert\") pod \"odh-model-controller-6dc94f689f-6st9w\" (UID: \"167c52af-b701-423f-8338-fd0165a630e6\") " pod="opendatahub/odh-model-controller-6dc94f689f-6st9w"
Jun 10 23:06:47.153208 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:47.153172    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-wjklt"
Jun 10 23:06:47.261568 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:47.261541    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-6st9w"
Jun 10 23:06:47.301734 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:47.301710    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-wjklt"]
Jun 10 23:06:47.304445 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:06:47.304413    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7496902_9d71_4be7_88d0_ad6d4014f461.slice/crio-f0a63ac4ea6b338d3b48040376bc1f1776facd0da66170dd9016646c2e0bbc11 WatchSource:0}: Error finding container f0a63ac4ea6b338d3b48040376bc1f1776facd0da66170dd9016646c2e0bbc11: Status 404 returned error can't find the container with id f0a63ac4ea6b338d3b48040376bc1f1776facd0da66170dd9016646c2e0bbc11
Jun 10 23:06:47.422653 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:47.422624    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-6st9w"]
Jun 10 23:06:47.424577 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:06:47.424547    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod167c52af_b701_423f_8338_fd0165a630e6.slice/crio-db554d6644a5c8bceb769a47a34ee2a4c49a51c3b35419a72bcc575fb3c7000a WatchSource:0}: Error finding container db554d6644a5c8bceb769a47a34ee2a4c49a51c3b35419a72bcc575fb3c7000a: Status 404 returned error can't find the container with id db554d6644a5c8bceb769a47a34ee2a4c49a51c3b35419a72bcc575fb3c7000a
Jun 10 23:06:47.994517 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:47.992879    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-wjklt" event={"ID":"f7496902-9d71-4be7-88d0-ad6d4014f461","Type":"ContainerStarted","Data":"f0a63ac4ea6b338d3b48040376bc1f1776facd0da66170dd9016646c2e0bbc11"}
Jun 10 23:06:47.995101 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:47.994624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-6st9w" event={"ID":"167c52af-b701-423f-8338-fd0165a630e6","Type":"ContainerStarted","Data":"db554d6644a5c8bceb769a47a34ee2a4c49a51c3b35419a72bcc575fb3c7000a"}
Jun 10 23:06:48.996635 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:48.996585    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:49.097975 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.097923    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:49.220184 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.220137    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb"]
Jun 10 23:06:49.229782 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.229545    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb"
Jun 10 23:06:49.232482 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.232401    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 10 23:06:49.232482 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.232426    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 10 23:06:49.232689 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.232499    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 10 23:06:49.232746 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.232695    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 10 23:06:49.233478 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.233295    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ct2gv\""
Jun 10 23:06:49.233867 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.233827    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb"]
Jun 10 23:06:49.271798 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.271719    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f11bc405-f40e-4f93-8ec5-60fa8d5a5d21-tmp\") pod \"kube-auth-proxy-79b48b5dcd-kg8sb\" (UID: \"f11bc405-f40e-4f93-8ec5-60fa8d5a5d21\") " pod="openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb"
Jun 10 23:06:49.272008 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.271978    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs56h\" (UniqueName: \"kubernetes.io/projected/f11bc405-f40e-4f93-8ec5-60fa8d5a5d21-kube-api-access-zs56h\") pod \"kube-auth-proxy-79b48b5dcd-kg8sb\" (UID: \"f11bc405-f40e-4f93-8ec5-60fa8d5a5d21\") " pod="openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb"
Jun 10 23:06:49.272145 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.272039    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f11bc405-f40e-4f93-8ec5-60fa8d5a5d21-tls-certs\") pod \"kube-auth-proxy-79b48b5dcd-kg8sb\" (UID: \"f11bc405-f40e-4f93-8ec5-60fa8d5a5d21\") " pod="openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb"
Jun 10 23:06:49.372743 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.372706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs56h\" (UniqueName: \"kubernetes.io/projected/f11bc405-f40e-4f93-8ec5-60fa8d5a5d21-kube-api-access-zs56h\") pod \"kube-auth-proxy-79b48b5dcd-kg8sb\" (UID: \"f11bc405-f40e-4f93-8ec5-60fa8d5a5d21\") " pod="openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb"
Jun 10 23:06:49.372951 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.372765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f11bc405-f40e-4f93-8ec5-60fa8d5a5d21-tls-certs\") pod \"kube-auth-proxy-79b48b5dcd-kg8sb\" (UID: \"f11bc405-f40e-4f93-8ec5-60fa8d5a5d21\") " pod="openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb"
Jun 10 23:06:49.372951 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.372838    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f11bc405-f40e-4f93-8ec5-60fa8d5a5d21-tmp\") pod \"kube-auth-proxy-79b48b5dcd-kg8sb\" (UID: \"f11bc405-f40e-4f93-8ec5-60fa8d5a5d21\") " pod="openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb"
Jun 10 23:06:49.375629 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.375603    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f11bc405-f40e-4f93-8ec5-60fa8d5a5d21-tmp\") pod \"kube-auth-proxy-79b48b5dcd-kg8sb\" (UID: \"f11bc405-f40e-4f93-8ec5-60fa8d5a5d21\") " pod="openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb"
Jun 10 23:06:49.375875 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.375830    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f11bc405-f40e-4f93-8ec5-60fa8d5a5d21-tls-certs\") pod \"kube-auth-proxy-79b48b5dcd-kg8sb\" (UID: \"f11bc405-f40e-4f93-8ec5-60fa8d5a5d21\") " pod="openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb"
Jun 10 23:06:49.383582 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.383540    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs56h\" (UniqueName: \"kubernetes.io/projected/f11bc405-f40e-4f93-8ec5-60fa8d5a5d21-kube-api-access-zs56h\") pod \"kube-auth-proxy-79b48b5dcd-kg8sb\" (UID: \"f11bc405-f40e-4f93-8ec5-60fa8d5a5d21\") " pod="openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb"
Jun 10 23:06:49.386103 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.386073    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:49.542703 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:49.542621    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb"
Jun 10 23:06:50.725949 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:50.725913    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv"]
Jun 10 23:06:50.730019 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:50.729986    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv"
Jun 10 23:06:50.732398 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:50.732358    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 10 23:06:50.732523 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:50.732402    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-64grf\""
Jun 10 23:06:50.732523 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:50.732360    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 10 23:06:50.738083 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:50.738053    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv"]
Jun 10 23:06:50.786740 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:50.786706    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnl42\" (UniqueName: \"kubernetes.io/projected/75954938-c4a0-4067-b80f-8da607134c2a-kube-api-access-lnl42\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv\" (UID: \"75954938-c4a0-4067-b80f-8da607134c2a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv"
Jun 10 23:06:50.786740 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:50.786755    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75954938-c4a0-4067-b80f-8da607134c2a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv\" (UID: \"75954938-c4a0-4067-b80f-8da607134c2a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv"
Jun 10 23:06:50.786974 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:50.786793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75954938-c4a0-4067-b80f-8da607134c2a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv\" (UID: \"75954938-c4a0-4067-b80f-8da607134c2a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv"
Jun 10 23:06:50.888200 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:50.888167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75954938-c4a0-4067-b80f-8da607134c2a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv\" (UID: \"75954938-c4a0-4067-b80f-8da607134c2a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv"
Jun 10 23:06:50.888377 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:50.888211    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75954938-c4a0-4067-b80f-8da607134c2a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv\" (UID: \"75954938-c4a0-4067-b80f-8da607134c2a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv"
Jun 10 23:06:50.888377 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:50.888288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnl42\" (UniqueName: \"kubernetes.io/projected/75954938-c4a0-4067-b80f-8da607134c2a-kube-api-access-lnl42\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv\" (UID: \"75954938-c4a0-4067-b80f-8da607134c2a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv"
Jun 10 23:06:50.888615 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:50.888595    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75954938-c4a0-4067-b80f-8da607134c2a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv\" (UID: \"75954938-c4a0-4067-b80f-8da607134c2a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv"
Jun 10 23:06:50.888693 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:50.888646    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75954938-c4a0-4067-b80f-8da607134c2a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv\" (UID: \"75954938-c4a0-4067-b80f-8da607134c2a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv"
Jun 10 23:06:50.896170 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:50.896139    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnl42\" (UniqueName: \"kubernetes.io/projected/75954938-c4a0-4067-b80f-8da607134c2a-kube-api-access-lnl42\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv\" (UID: \"75954938-c4a0-4067-b80f-8da607134c2a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv"
Jun 10 23:06:51.042342 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:51.042268    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv"
Jun 10 23:06:51.208813 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:51.208780    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb"]
Jun 10 23:06:51.211127 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:06:51.211096    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf11bc405_f40e_4f93_8ec5_60fa8d5a5d21.slice/crio-e798d844ba304565a04ae5b9534a91a23a4e7c1d7ba89785103d4241318d095e WatchSource:0}: Error finding container e798d844ba304565a04ae5b9534a91a23a4e7c1d7ba89785103d4241318d095e: Status 404 returned error can't find the container with id e798d844ba304565a04ae5b9534a91a23a4e7c1d7ba89785103d4241318d095e
Jun 10 23:06:51.238154 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:51.238122    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv"]
Jun 10 23:06:51.239695 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:06:51.239670    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75954938_c4a0_4067_b80f_8da607134c2a.slice/crio-5286515eb99bc651f847e4a2dd5e089e172d0987f779633cf68c6d09f1cdc575 WatchSource:0}: Error finding container 5286515eb99bc651f847e4a2dd5e089e172d0987f779633cf68c6d09f1cdc575: Status 404 returned error can't find the container with id 5286515eb99bc651f847e4a2dd5e089e172d0987f779633cf68c6d09f1cdc575
Jun 10 23:06:52.019548 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:52.019510    2577 generic.go:356] "Generic (PLEG): container finished" podID="75954938-c4a0-4067-b80f-8da607134c2a" containerID="37a1ea32d097f0fa6a9313a01d759c292c9a1a2bf131b809f3cafcb067429e4e" exitCode=0
Jun 10 23:06:52.020060 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:52.019604    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv" event={"ID":"75954938-c4a0-4067-b80f-8da607134c2a","Type":"ContainerDied","Data":"37a1ea32d097f0fa6a9313a01d759c292c9a1a2bf131b809f3cafcb067429e4e"}
Jun 10 23:06:52.020060 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:52.019670    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv" event={"ID":"75954938-c4a0-4067-b80f-8da607134c2a","Type":"ContainerStarted","Data":"5286515eb99bc651f847e4a2dd5e089e172d0987f779633cf68c6d09f1cdc575"}
Jun 10 23:06:52.021076 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:52.021050    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb" event={"ID":"f11bc405-f40e-4f93-8ec5-60fa8d5a5d21","Type":"ContainerStarted","Data":"e798d844ba304565a04ae5b9534a91a23a4e7c1d7ba89785103d4241318d095e"}
Jun 10 23:06:52.022930 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:52.022876    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-wjklt" event={"ID":"f7496902-9d71-4be7-88d0-ad6d4014f461","Type":"ContainerStarted","Data":"34cfcb2fe3b215bcb94a8b8bec910c13779493112f8ece0df0b94af28716ccbd"}
Jun 10 23:06:52.023033 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:52.022960    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-wjklt"
Jun 10 23:06:52.024631 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:52.024612    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-6st9w" event={"ID":"167c52af-b701-423f-8338-fd0165a630e6","Type":"ContainerStarted","Data":"411631d80c4d19374f684a139905ad92b5760cacb0463f405ddba385271bdfcf"}
Jun 10 23:06:52.024758 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:52.024744    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-6st9w"
Jun 10 23:06:52.061092 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:52.061028    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-6st9w" podStartSLOduration=2.371803481 podStartE2EDuration="6.061005292s" totalImagesPullingTime="3.689201811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:06:52.058982244 +0000 UTC m=+458.216606403" watchObservedRunningTime="2026-06-10 23:06:52.061005292 +0000 UTC m=+458.218629453"
Jun 10 23:06:52.075759 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:52.075707    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-wjklt" podStartSLOduration=2.319598298 podStartE2EDuration="6.075686753s" totalImagesPullingTime="3.756088455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:06:52.074232419 +0000 UTC m=+458.231856578" watchObservedRunningTime="2026-06-10 23:06:52.075686753 +0000 UTC m=+458.233310914"
Jun 10 23:06:52.340878 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:52.340756    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:52.879167 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:52.879141    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:52.966105 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:52.966072    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:54.035942 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:54.035907    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb" event={"ID":"f11bc405-f40e-4f93-8ec5-60fa8d5a5d21","Type":"ContainerStarted","Data":"f402d12270a5d02b3c388eed7b9df2cb02a7324c402232eb0869f8cb1d874c6f"}
Jun 10 23:06:54.056376 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:54.056324    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79b48b5dcd-kg8sb" podStartSLOduration=3.21965962 podStartE2EDuration="5.05630846s" totalImagesPullingTime="1.83664884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:06:54.054313014 +0000 UTC m=+460.211937166" watchObservedRunningTime="2026-06-10 23:06:54.05630846 +0000 UTC m=+460.213932617"
Jun 10 23:06:56.404453 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.404414    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:56.459812 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.459781    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lbqs4"]
Jun 10 23:06:56.463076 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.463051    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-lbqs4"
Jun 10 23:06:56.465862 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.465824    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jun 10 23:06:56.465979 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.465858    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-mcj2l\""
Jun 10 23:06:56.472029 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.472008    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lbqs4"]
Jun 10 23:06:56.479633 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.479607    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-rq48p"]
Jun 10 23:06:56.483096 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.483080    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq48p"
Jun 10 23:06:56.485123 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.485101    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jun 10 23:06:56.485232 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.485169    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zjf87\""
Jun 10 23:06:56.493610 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.493590    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-rq48p"]
Jun 10 23:06:56.502329 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.502305    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:56.538675 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.538652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlh88\" (UniqueName: \"kubernetes.io/projected/63869cd0-d0fd-4fea-9644-18e4eb131cc8-kube-api-access-xlh88\") pod \"llmisvc-controller-manager-864bfd7bc9-rq48p\" (UID: \"63869cd0-d0fd-4fea-9644-18e4eb131cc8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq48p"
Jun 10 23:06:56.538784 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.538694    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/feb31a6b-1a08-49d9-ac04-78a11e22c0b4-cert\") pod \"kserve-controller-manager-69fc866d76-lbqs4\" (UID: \"feb31a6b-1a08-49d9-ac04-78a11e22c0b4\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lbqs4"
Jun 10 23:06:56.538784 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.538748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dztx\" (UniqueName: \"kubernetes.io/projected/feb31a6b-1a08-49d9-ac04-78a11e22c0b4-kube-api-access-6dztx\") pod \"kserve-controller-manager-69fc866d76-lbqs4\" (UID: \"feb31a6b-1a08-49d9-ac04-78a11e22c0b4\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lbqs4"
Jun 10 23:06:56.538904 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.538829    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63869cd0-d0fd-4fea-9644-18e4eb131cc8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-rq48p\" (UID: \"63869cd0-d0fd-4fea-9644-18e4eb131cc8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq48p"
Jun 10 23:06:56.605475 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.605446    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:56.639456 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.639428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63869cd0-d0fd-4fea-9644-18e4eb131cc8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-rq48p\" (UID: \"63869cd0-d0fd-4fea-9644-18e4eb131cc8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq48p"
Jun 10 23:06:56.639566 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.639489    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlh88\" (UniqueName: \"kubernetes.io/projected/63869cd0-d0fd-4fea-9644-18e4eb131cc8-kube-api-access-xlh88\") pod \"llmisvc-controller-manager-864bfd7bc9-rq48p\" (UID: \"63869cd0-d0fd-4fea-9644-18e4eb131cc8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq48p"
Jun 10 23:06:56.639566 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.639524    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/feb31a6b-1a08-49d9-ac04-78a11e22c0b4-cert\") pod \"kserve-controller-manager-69fc866d76-lbqs4\" (UID: \"feb31a6b-1a08-49d9-ac04-78a11e22c0b4\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lbqs4"
Jun 10 23:06:56.639651 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.639567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dztx\" (UniqueName: \"kubernetes.io/projected/feb31a6b-1a08-49d9-ac04-78a11e22c0b4-kube-api-access-6dztx\") pod \"kserve-controller-manager-69fc866d76-lbqs4\" (UID: \"feb31a6b-1a08-49d9-ac04-78a11e22c0b4\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lbqs4"
Jun 10 23:06:56.639688 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:06:56.639667    2577 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jun 10 23:06:56.639753 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:06:56.639739    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/feb31a6b-1a08-49d9-ac04-78a11e22c0b4-cert podName:feb31a6b-1a08-49d9-ac04-78a11e22c0b4 nodeName:}" failed. No retries permitted until 2026-06-10 23:06:57.139719021 +0000 UTC m=+463.297343173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/feb31a6b-1a08-49d9-ac04-78a11e22c0b4-cert") pod "kserve-controller-manager-69fc866d76-lbqs4" (UID: "feb31a6b-1a08-49d9-ac04-78a11e22c0b4") : secret "kserve-webhook-server-cert" not found
Jun 10 23:06:56.641710 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.641686    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63869cd0-d0fd-4fea-9644-18e4eb131cc8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-rq48p\" (UID: \"63869cd0-d0fd-4fea-9644-18e4eb131cc8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq48p"
Jun 10 23:06:56.647743 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.647719    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlh88\" (UniqueName: \"kubernetes.io/projected/63869cd0-d0fd-4fea-9644-18e4eb131cc8-kube-api-access-xlh88\") pod \"llmisvc-controller-manager-864bfd7bc9-rq48p\" (UID: \"63869cd0-d0fd-4fea-9644-18e4eb131cc8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq48p"
Jun 10 23:06:56.648194 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.648179    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dztx\" (UniqueName: \"kubernetes.io/projected/feb31a6b-1a08-49d9-ac04-78a11e22c0b4-kube-api-access-6dztx\") pod \"kserve-controller-manager-69fc866d76-lbqs4\" (UID: \"feb31a6b-1a08-49d9-ac04-78a11e22c0b4\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lbqs4"
Jun 10 23:06:56.793869 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.793790    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq48p"
Jun 10 23:06:56.872809 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.872779    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:56.924918 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:56.924897    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-rq48p"]
Jun 10 23:06:56.926589 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:06:56.926565    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod63869cd0_d0fd_4fea_9644_18e4eb131cc8.slice/crio-038f9e3b4fd098ac4fa98282dc1b6723ad3538458776636a54cd7dfa39beac0c WatchSource:0}: Error finding container 038f9e3b4fd098ac4fa98282dc1b6723ad3538458776636a54cd7dfa39beac0c: Status 404 returned error can't find the container with id 038f9e3b4fd098ac4fa98282dc1b6723ad3538458776636a54cd7dfa39beac0c
Jun 10 23:06:57.052660 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:57.052583    2577 generic.go:356] "Generic (PLEG): container finished" podID="75954938-c4a0-4067-b80f-8da607134c2a" containerID="6ef5198e32ba8e8b2b2dd62686b96e0da9e05cb99c05b841b6de57ac28baa26c" exitCode=0
Jun 10 23:06:57.052910 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:57.052661    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv" event={"ID":"75954938-c4a0-4067-b80f-8da607134c2a","Type":"ContainerDied","Data":"6ef5198e32ba8e8b2b2dd62686b96e0da9e05cb99c05b841b6de57ac28baa26c"}
Jun 10 23:06:57.053882 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:57.053837    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq48p" event={"ID":"63869cd0-d0fd-4fea-9644-18e4eb131cc8","Type":"ContainerStarted","Data":"038f9e3b4fd098ac4fa98282dc1b6723ad3538458776636a54cd7dfa39beac0c"}
Jun 10 23:06:57.143351 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:57.143323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/feb31a6b-1a08-49d9-ac04-78a11e22c0b4-cert\") pod \"kserve-controller-manager-69fc866d76-lbqs4\" (UID: \"feb31a6b-1a08-49d9-ac04-78a11e22c0b4\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lbqs4"
Jun 10 23:06:57.145549 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:57.145528    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/feb31a6b-1a08-49d9-ac04-78a11e22c0b4-cert\") pod \"kserve-controller-manager-69fc866d76-lbqs4\" (UID: \"feb31a6b-1a08-49d9-ac04-78a11e22c0b4\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lbqs4"
Jun 10 23:06:57.373593 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:57.373567    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-lbqs4"
Jun 10 23:06:57.519384 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:57.519351    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lbqs4"]
Jun 10 23:06:57.531016 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:06:57.530984    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb31a6b_1a08_49d9_ac04_78a11e22c0b4.slice/crio-7a907424bfd3e91da2d49bf41f1423e29691d111b9250ae7d6fb3e4397bc8abd WatchSource:0}: Error finding container 7a907424bfd3e91da2d49bf41f1423e29691d111b9250ae7d6fb3e4397bc8abd: Status 404 returned error can't find the container with id 7a907424bfd3e91da2d49bf41f1423e29691d111b9250ae7d6fb3e4397bc8abd
Jun 10 23:06:57.667244 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:57.667148    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:57.785308 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:57.785281    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:57.852078 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:57.852045    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:06:58.068522 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:58.068433    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-lbqs4" event={"ID":"feb31a6b-1a08-49d9-ac04-78a11e22c0b4","Type":"ContainerStarted","Data":"7a907424bfd3e91da2d49bf41f1423e29691d111b9250ae7d6fb3e4397bc8abd"}
Jun 10 23:06:58.070770 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:58.070736    2577 generic.go:356] "Generic (PLEG): container finished" podID="75954938-c4a0-4067-b80f-8da607134c2a" containerID="b012f16bbb2a15e553c93aa0eed553e339e6c60a73ce79082a6f35434c29f9bb" exitCode=0
Jun 10 23:06:58.070926 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:58.070792    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv" event={"ID":"75954938-c4a0-4067-b80f-8da607134c2a","Type":"ContainerDied","Data":"b012f16bbb2a15e553c93aa0eed553e339e6c60a73ce79082a6f35434c29f9bb"}
Jun 10 23:06:59.207282 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:59.207254    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv"
Jun 10 23:06:59.261672 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:59.261643    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75954938-c4a0-4067-b80f-8da607134c2a-util\") pod \"75954938-c4a0-4067-b80f-8da607134c2a\" (UID: \"75954938-c4a0-4067-b80f-8da607134c2a\") "
Jun 10 23:06:59.261866 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:59.261704    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75954938-c4a0-4067-b80f-8da607134c2a-bundle\") pod \"75954938-c4a0-4067-b80f-8da607134c2a\" (UID: \"75954938-c4a0-4067-b80f-8da607134c2a\") "
Jun 10 23:06:59.261866 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:59.261776    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnl42\" (UniqueName: \"kubernetes.io/projected/75954938-c4a0-4067-b80f-8da607134c2a-kube-api-access-lnl42\") pod \"75954938-c4a0-4067-b80f-8da607134c2a\" (UID: \"75954938-c4a0-4067-b80f-8da607134c2a\") "
Jun 10 23:06:59.262780 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:59.262737    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75954938-c4a0-4067-b80f-8da607134c2a-bundle" (OuterVolumeSpecName: "bundle") pod "75954938-c4a0-4067-b80f-8da607134c2a" (UID: "75954938-c4a0-4067-b80f-8da607134c2a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:06:59.264313 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:59.264276    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75954938-c4a0-4067-b80f-8da607134c2a-kube-api-access-lnl42" (OuterVolumeSpecName: "kube-api-access-lnl42") pod "75954938-c4a0-4067-b80f-8da607134c2a" (UID: "75954938-c4a0-4067-b80f-8da607134c2a"). InnerVolumeSpecName "kube-api-access-lnl42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:06:59.269569 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:59.268484    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75954938-c4a0-4067-b80f-8da607134c2a-util" (OuterVolumeSpecName: "util") pod "75954938-c4a0-4067-b80f-8da607134c2a" (UID: "75954938-c4a0-4067-b80f-8da607134c2a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:06:59.363365 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:59.363332    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnl42\" (UniqueName: \"kubernetes.io/projected/75954938-c4a0-4067-b80f-8da607134c2a-kube-api-access-lnl42\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:06:59.363365 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:59.363365    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75954938-c4a0-4067-b80f-8da607134c2a-util\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:06:59.363576 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:06:59.363380    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75954938-c4a0-4067-b80f-8da607134c2a-bundle\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:07:00.082718 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:00.082690    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv"
Jun 10 23:07:00.082922 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:00.082717    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0672bjv" event={"ID":"75954938-c4a0-4067-b80f-8da607134c2a","Type":"ContainerDied","Data":"5286515eb99bc651f847e4a2dd5e089e172d0987f779633cf68c6d09f1cdc575"}
Jun 10 23:07:00.082922 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:00.082784    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5286515eb99bc651f847e4a2dd5e089e172d0987f779633cf68c6d09f1cdc575"
Jun 10 23:07:01.089213 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:01.089113    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq48p" event={"ID":"63869cd0-d0fd-4fea-9644-18e4eb131cc8","Type":"ContainerStarted","Data":"10f316d88cc74a2a4cd32d93481fb32dab28bf7189c4ce7ce059eb85ce208e7a"}
Jun 10 23:07:01.089634 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:01.089230    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq48p"
Jun 10 23:07:01.090669 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:01.090643    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-lbqs4" event={"ID":"feb31a6b-1a08-49d9-ac04-78a11e22c0b4","Type":"ContainerStarted","Data":"279204ed41138ef54ddff8c4344d114e84ad1651c981aee8cb153db3a538bc97"}
Jun 10 23:07:01.090778 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:01.090704    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-lbqs4"
Jun 10 23:07:01.106839 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:01.106793    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq48p" podStartSLOduration=1.409695041 podStartE2EDuration="5.106777381s" totalImagesPullingTime="3.69708234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:06:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:07:01.105809227 +0000 UTC m=+467.263433409" watchObservedRunningTime="2026-06-10 23:07:01.106777381 +0000 UTC m=+467.264401538"
Jun 10 23:07:01.119922 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:01.119883    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-lbqs4" podStartSLOduration=2.025598069 podStartE2EDuration="5.119842499s" totalImagesPullingTime="3.09424443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:06:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:07:01.119425136 +0000 UTC m=+467.277049294" watchObservedRunningTime="2026-06-10 23:07:01.119842499 +0000 UTC m=+467.277466657"
Jun 10 23:07:01.628373 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:01.628325    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:03.032287 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:03.032255    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-6st9w"
Jun 10 23:07:03.034260 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:03.034238    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-wjklt"
Jun 10 23:07:04.549024 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:04.548990    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:04.648899 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:04.648831    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:05.771540 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:05.771509    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:05.884705 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:05.884670    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:05.898476 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:05.898447    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth"]
Jun 10 23:07:05.898786 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:05.898773    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75954938-c4a0-4067-b80f-8da607134c2a" containerName="pull"
Jun 10 23:07:05.898901 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:05.898787    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="75954938-c4a0-4067-b80f-8da607134c2a" containerName="pull"
Jun 10 23:07:05.898901 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:05.898806    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75954938-c4a0-4067-b80f-8da607134c2a" containerName="util"
Jun 10 23:07:05.898901 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:05.898811    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="75954938-c4a0-4067-b80f-8da607134c2a" containerName="util"
Jun 10 23:07:05.898901 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:05.898822    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75954938-c4a0-4067-b80f-8da607134c2a" containerName="extract"
Jun 10 23:07:05.898901 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:05.898827    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="75954938-c4a0-4067-b80f-8da607134c2a" containerName="extract"
Jun 10 23:07:05.898901 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:05.898899    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="75954938-c4a0-4067-b80f-8da607134c2a" containerName="extract"
Jun 10 23:07:05.901974 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:05.901959    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth"
Jun 10 23:07:05.904052 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:05.904032    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-64grf\""
Jun 10 23:07:05.904157 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:05.904101    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 10 23:07:05.904725 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:05.904708    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 10 23:07:05.921236 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:05.921209    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth"]
Jun 10 23:07:06.020701 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:06.020665    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth\" (UID: \"c45e71ba-a38d-4e6a-abc5-2acceffb37e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth"
Jun 10 23:07:06.020922 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:06.020719    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67pmx\" (UniqueName: \"kubernetes.io/projected/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-kube-api-access-67pmx\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth\" (UID: \"c45e71ba-a38d-4e6a-abc5-2acceffb37e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth"
Jun 10 23:07:06.020922 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:06.020830    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth\" (UID: \"c45e71ba-a38d-4e6a-abc5-2acceffb37e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth"
Jun 10 23:07:06.121490 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:06.121462    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67pmx\" (UniqueName: \"kubernetes.io/projected/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-kube-api-access-67pmx\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth\" (UID: \"c45e71ba-a38d-4e6a-abc5-2acceffb37e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth"
Jun 10 23:07:06.121642 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:06.121602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth\" (UID: \"c45e71ba-a38d-4e6a-abc5-2acceffb37e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth"
Jun 10 23:07:06.121642 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:06.121628    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth\" (UID: \"c45e71ba-a38d-4e6a-abc5-2acceffb37e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth"
Jun 10 23:07:06.121996 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:06.121980    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth\" (UID: \"c45e71ba-a38d-4e6a-abc5-2acceffb37e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth"
Jun 10 23:07:06.122044 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:06.122014    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth\" (UID: \"c45e71ba-a38d-4e6a-abc5-2acceffb37e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth"
Jun 10 23:07:06.130644 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:06.130615    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67pmx\" (UniqueName: \"kubernetes.io/projected/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-kube-api-access-67pmx\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth\" (UID: \"c45e71ba-a38d-4e6a-abc5-2acceffb37e1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth"
Jun 10 23:07:06.211033 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:06.211000    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth"
Jun 10 23:07:06.328913 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:06.328883    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:06.346997 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:06.346977    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth"]
Jun 10 23:07:06.348604 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:07:06.348574    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc45e71ba_a38d_4e6a_abc5_2acceffb37e1.slice/crio-96cddd81a10cead05ee358deed36f7308e599dba9cae0fc981d80f41a21c99a4 WatchSource:0}: Error finding container 96cddd81a10cead05ee358deed36f7308e599dba9cae0fc981d80f41a21c99a4: Status 404 returned error can't find the container with id 96cddd81a10cead05ee358deed36f7308e599dba9cae0fc981d80f41a21c99a4
Jun 10 23:07:06.423843 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:06.423813    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:06.527550 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:06.527522    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:06.620640 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:06.620607    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:07.083737 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.083707    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:07.121485 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.121452    2577 generic.go:356] "Generic (PLEG): container finished" podID="c45e71ba-a38d-4e6a-abc5-2acceffb37e1" containerID="da7ccfd3f16b92968f562e780412617824ccc2d61ca321b0bed0a69821cbe72c" exitCode=0
Jun 10 23:07:07.121640 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.121521    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth" event={"ID":"c45e71ba-a38d-4e6a-abc5-2acceffb37e1","Type":"ContainerDied","Data":"da7ccfd3f16b92968f562e780412617824ccc2d61ca321b0bed0a69821cbe72c"}
Jun 10 23:07:07.121640 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.121555    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth" event={"ID":"c45e71ba-a38d-4e6a-abc5-2acceffb37e1","Type":"ContainerStarted","Data":"96cddd81a10cead05ee358deed36f7308e599dba9cae0fc981d80f41a21c99a4"}
Jun 10 23:07:07.220909 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.218885    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-2fzmw"]
Jun 10 23:07:07.223921 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.223897    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2fzmw"
Jun 10 23:07:07.226549 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.226527    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
Jun 10 23:07:07.226807 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.226793    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
Jun 10 23:07:07.227153 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.227135    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-v64wz\""
Jun 10 23:07:07.236907 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.236887    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-2fzmw"]
Jun 10 23:07:07.330295 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.330255    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp2bj\" (UniqueName: \"kubernetes.io/projected/face1ba5-f940-4c68-9268-03dc97f66b34-kube-api-access-hp2bj\") pod \"servicemesh-operator3-57f65f65fb-2fzmw\" (UID: \"face1ba5-f940-4c68-9268-03dc97f66b34\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2fzmw"
Jun 10 23:07:07.330503 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.330343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/face1ba5-f940-4c68-9268-03dc97f66b34-operator-config\") pod \"servicemesh-operator3-57f65f65fb-2fzmw\" (UID: \"face1ba5-f940-4c68-9268-03dc97f66b34\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2fzmw"
Jun 10 23:07:07.430757 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.430719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp2bj\" (UniqueName: \"kubernetes.io/projected/face1ba5-f940-4c68-9268-03dc97f66b34-kube-api-access-hp2bj\") pod \"servicemesh-operator3-57f65f65fb-2fzmw\" (UID: \"face1ba5-f940-4c68-9268-03dc97f66b34\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2fzmw"
Jun 10 23:07:07.430962 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.430764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/face1ba5-f940-4c68-9268-03dc97f66b34-operator-config\") pod \"servicemesh-operator3-57f65f65fb-2fzmw\" (UID: \"face1ba5-f940-4c68-9268-03dc97f66b34\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2fzmw"
Jun 10 23:07:07.433303 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.433282    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/face1ba5-f940-4c68-9268-03dc97f66b34-operator-config\") pod \"servicemesh-operator3-57f65f65fb-2fzmw\" (UID: \"face1ba5-f940-4c68-9268-03dc97f66b34\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2fzmw"
Jun 10 23:07:07.444883 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.444842    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp2bj\" (UniqueName: \"kubernetes.io/projected/face1ba5-f940-4c68-9268-03dc97f66b34-kube-api-access-hp2bj\") pod \"servicemesh-operator3-57f65f65fb-2fzmw\" (UID: \"face1ba5-f940-4c68-9268-03dc97f66b34\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-2fzmw"
Jun 10 23:07:07.533171 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.533140    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2fzmw"
Jun 10 23:07:07.676799 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:07.676705    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-2fzmw"]
Jun 10 23:07:07.687134 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:07:07.687058    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podface1ba5_f940_4c68_9268_03dc97f66b34.slice/crio-5a81c0d69f818adf06f9c47a873275e15e66058b0b606e2ba3e05f6f38ab3757 WatchSource:0}: Error finding container 5a81c0d69f818adf06f9c47a873275e15e66058b0b606e2ba3e05f6f38ab3757: Status 404 returned error can't find the container with id 5a81c0d69f818adf06f9c47a873275e15e66058b0b606e2ba3e05f6f38ab3757
Jun 10 23:07:08.128274 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:08.128236    2577 generic.go:356] "Generic (PLEG): container finished" podID="c45e71ba-a38d-4e6a-abc5-2acceffb37e1" containerID="20d79643bbf1e9d0b753d371f3cd15521ad18ad36f645ff49d0d9c91891abad6" exitCode=0
Jun 10 23:07:08.128681 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:08.128289    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth" event={"ID":"c45e71ba-a38d-4e6a-abc5-2acceffb37e1","Type":"ContainerDied","Data":"20d79643bbf1e9d0b753d371f3cd15521ad18ad36f645ff49d0d9c91891abad6"}
Jun 10 23:07:08.130081 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:08.130056    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2fzmw" event={"ID":"face1ba5-f940-4c68-9268-03dc97f66b34","Type":"ContainerStarted","Data":"5a81c0d69f818adf06f9c47a873275e15e66058b0b606e2ba3e05f6f38ab3757"}
Jun 10 23:07:09.138562 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:09.138525    2577 generic.go:356] "Generic (PLEG): container finished" podID="c45e71ba-a38d-4e6a-abc5-2acceffb37e1" containerID="3163a39d666ebb04486cf581c4e3907253f835a8deef5bda02c40e62e350113b" exitCode=0
Jun 10 23:07:09.139027 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:09.138580    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth" event={"ID":"c45e71ba-a38d-4e6a-abc5-2acceffb37e1","Type":"ContainerDied","Data":"3163a39d666ebb04486cf581c4e3907253f835a8deef5bda02c40e62e350113b"}
Jun 10 23:07:10.312013 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:10.311992    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth"
Jun 10 23:07:10.456545 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:10.456457    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67pmx\" (UniqueName: \"kubernetes.io/projected/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-kube-api-access-67pmx\") pod \"c45e71ba-a38d-4e6a-abc5-2acceffb37e1\" (UID: \"c45e71ba-a38d-4e6a-abc5-2acceffb37e1\") "
Jun 10 23:07:10.456545 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:10.456539    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-util\") pod \"c45e71ba-a38d-4e6a-abc5-2acceffb37e1\" (UID: \"c45e71ba-a38d-4e6a-abc5-2acceffb37e1\") "
Jun 10 23:07:10.456764 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:10.456610    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-bundle\") pod \"c45e71ba-a38d-4e6a-abc5-2acceffb37e1\" (UID: \"c45e71ba-a38d-4e6a-abc5-2acceffb37e1\") "
Jun 10 23:07:10.457735 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:10.457704    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-bundle" (OuterVolumeSpecName: "bundle") pod "c45e71ba-a38d-4e6a-abc5-2acceffb37e1" (UID: "c45e71ba-a38d-4e6a-abc5-2acceffb37e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:07:10.459164 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:10.459136    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-kube-api-access-67pmx" (OuterVolumeSpecName: "kube-api-access-67pmx") pod "c45e71ba-a38d-4e6a-abc5-2acceffb37e1" (UID: "c45e71ba-a38d-4e6a-abc5-2acceffb37e1"). InnerVolumeSpecName "kube-api-access-67pmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:07:10.464358 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:10.464332    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-util" (OuterVolumeSpecName: "util") pod "c45e71ba-a38d-4e6a-abc5-2acceffb37e1" (UID: "c45e71ba-a38d-4e6a-abc5-2acceffb37e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:07:10.558366 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:10.558324    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-util\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:07:10.558366 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:10.558360    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-bundle\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:07:10.558366 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:10.558374    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67pmx\" (UniqueName: \"kubernetes.io/projected/c45e71ba-a38d-4e6a-abc5-2acceffb37e1-kube-api-access-67pmx\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:07:11.151670 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:11.151642    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth"
Jun 10 23:07:11.151901 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:11.151645    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4vqth" event={"ID":"c45e71ba-a38d-4e6a-abc5-2acceffb37e1","Type":"ContainerDied","Data":"96cddd81a10cead05ee358deed36f7308e599dba9cae0fc981d80f41a21c99a4"}
Jun 10 23:07:11.151901 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:11.151779    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96cddd81a10cead05ee358deed36f7308e599dba9cae0fc981d80f41a21c99a4"
Jun 10 23:07:11.153688 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:11.153654    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2fzmw" event={"ID":"face1ba5-f940-4c68-9268-03dc97f66b34","Type":"ContainerStarted","Data":"62c00affd67329ee636410baafb7eb224873cb326fdb8e6365c3329c7b584d2d"}
Jun 10 23:07:11.153828 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:11.153798    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2fzmw"
Jun 10 23:07:11.174440 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:11.174391    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2fzmw" podStartSLOduration=1.56344777 podStartE2EDuration="4.174373194s" totalImagesPullingTime="2.610925424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:07:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:07:11.17251973 +0000 UTC m=+477.330143888" watchObservedRunningTime="2026-06-10 23:07:11.174373194 +0000 UTC m=+477.331997351"
Jun 10 23:07:17.233994 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:17.233954    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:17.334687 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:17.334659    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:19.636555 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.636516    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"]
Jun 10 23:07:19.637039 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.637023    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c45e71ba-a38d-4e6a-abc5-2acceffb37e1" containerName="util"
Jun 10 23:07:19.637084 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.637042    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45e71ba-a38d-4e6a-abc5-2acceffb37e1" containerName="util"
Jun 10 23:07:19.637084 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.637059    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c45e71ba-a38d-4e6a-abc5-2acceffb37e1" containerName="extract"
Jun 10 23:07:19.637084 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.637071    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45e71ba-a38d-4e6a-abc5-2acceffb37e1" containerName="extract"
Jun 10 23:07:19.637181 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.637101    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c45e71ba-a38d-4e6a-abc5-2acceffb37e1" containerName="pull"
Jun 10 23:07:19.637181 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.637108    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45e71ba-a38d-4e6a-abc5-2acceffb37e1" containerName="pull"
Jun 10 23:07:19.637253 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.637218    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c45e71ba-a38d-4e6a-abc5-2acceffb37e1" containerName="extract"
Jun 10 23:07:19.638488 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.638463    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:19.642031 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.642014    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.644434 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.644414    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jun 10 23:07:19.644545 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.644416    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jun 10 23:07:19.644545 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.644453    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hktq9\""
Jun 10 23:07:19.644545 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.644534    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 10 23:07:19.644721 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.644699    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jun 10 23:07:19.651789 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.651765    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"]
Jun 10 23:07:19.710029 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.709987    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:19.739183 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.739152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.739272 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.739201    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.739272 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.739237    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frp9j\" (UniqueName: \"kubernetes.io/projected/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-kube-api-access-frp9j\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.739272 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.739256    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.739390 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.739282    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.739390 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.739373    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.739453 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.739407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.840329 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.840290    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.840329 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.840329    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.840570 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.840363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.840570 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.840406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.840570 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.840437    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frp9j\" (UniqueName: \"kubernetes.io/projected/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-kube-api-access-frp9j\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.840716 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.840650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.840771 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.840712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.841079 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.841045    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.843172 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.843148    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.843280 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.843175    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.843280 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.843153    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.843366 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.843346    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.848114 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.848091    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.848421 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.848400    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frp9j\" (UniqueName: \"kubernetes.io/projected/463bcd00-d5dd-4b1c-bd25-53c8f88bebf7-kube-api-access-frp9j\") pod \"istiod-openshift-gateway-75c67f8887-68gjk\" (UID: \"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:19.952233 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:19.952133    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:20.095149 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:20.095122    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"]
Jun 10 23:07:20.097029 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:07:20.097001    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod463bcd00_d5dd_4b1c_bd25_53c8f88bebf7.slice/crio-8445c375dd5b350e62c2faaa1f28f59b4ed3f560e6510170280197bfc2623a9b WatchSource:0}: Error finding container 8445c375dd5b350e62c2faaa1f28f59b4ed3f560e6510170280197bfc2623a9b: Status 404 returned error can't find the container with id 8445c375dd5b350e62c2faaa1f28f59b4ed3f560e6510170280197bfc2623a9b
Jun 10 23:07:20.168325 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:20.168288    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:20.200958 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:20.200914    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk" event={"ID":"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7","Type":"ContainerStarted","Data":"8445c375dd5b350e62c2faaa1f28f59b4ed3f560e6510170280197bfc2623a9b"}
Jun 10 23:07:22.162089 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:22.162059    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-2fzmw"
Jun 10 23:07:23.088508 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:23.088466    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 10 23:07:23.088604 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:23.088537    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 10 23:07:23.221591 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:23.221557    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk" event={"ID":"463bcd00-d5dd-4b1c-bd25-53c8f88bebf7","Type":"ContainerStarted","Data":"57d9835338d0164cbf2de65ae04c5f7de13c8d73cc3a0aa9216abcae0863c0d1"}
Jun 10 23:07:23.222005 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:23.221787    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:23.250225 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:23.250176    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk" podStartSLOduration=1.26126705 podStartE2EDuration="4.250160346s" totalImagesPullingTime="2.988893296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:07:23.249484548 +0000 UTC m=+489.407108707" watchObservedRunningTime="2026-06-10 23:07:23.250160346 +0000 UTC m=+489.407784503"
Jun 10 23:07:24.025401 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:24.025364    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:24.132457 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:24.132414    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:24.228585 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:24.228554    2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-68gjk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jun 10 23:07:24.228971 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:24.228605    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk" podUID="463bcd00-d5dd-4b1c-bd25-53c8f88bebf7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 10 23:07:24.321665 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:24.321564    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:24.491694 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:24.491664    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:24.588391 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:24.588296    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:27.228005 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:27.227972    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-68gjk"
Jun 10 23:07:28.294862 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:28.294825    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7f859cf96-bvc9d"]
Jun 10 23:07:28.297831 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:28.297809    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7f859cf96-bvc9d"
Jun 10 23:07:28.299952 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:28.299929    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nzl99\""
Jun 10 23:07:28.300081 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:28.299929    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 10 23:07:28.308153 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:28.308127    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7f859cf96-bvc9d"]
Jun 10 23:07:28.322301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:28.322280    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:28.421402 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:28.421376    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5007770b-c41d-457b-a3c0-799ad6a66e52-redirect-config\") pod \"dashboard-redirect-7f859cf96-bvc9d\" (UID: \"5007770b-c41d-457b-a3c0-799ad6a66e52\") " pod="opendatahub/dashboard-redirect-7f859cf96-bvc9d"
Jun 10 23:07:28.421543 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:28.421446    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr8bh\" (UniqueName: \"kubernetes.io/projected/5007770b-c41d-457b-a3c0-799ad6a66e52-kube-api-access-rr8bh\") pod \"dashboard-redirect-7f859cf96-bvc9d\" (UID: \"5007770b-c41d-457b-a3c0-799ad6a66e52\") " pod="opendatahub/dashboard-redirect-7f859cf96-bvc9d"
Jun 10 23:07:28.522810 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:28.522779    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr8bh\" (UniqueName: \"kubernetes.io/projected/5007770b-c41d-457b-a3c0-799ad6a66e52-kube-api-access-rr8bh\") pod \"dashboard-redirect-7f859cf96-bvc9d\" (UID: \"5007770b-c41d-457b-a3c0-799ad6a66e52\") " pod="opendatahub/dashboard-redirect-7f859cf96-bvc9d"
Jun 10 23:07:28.522940 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:28.522874    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5007770b-c41d-457b-a3c0-799ad6a66e52-redirect-config\") pod \"dashboard-redirect-7f859cf96-bvc9d\" (UID: \"5007770b-c41d-457b-a3c0-799ad6a66e52\") " pod="opendatahub/dashboard-redirect-7f859cf96-bvc9d"
Jun 10 23:07:28.523580 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:28.523562    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5007770b-c41d-457b-a3c0-799ad6a66e52-redirect-config\") pod \"dashboard-redirect-7f859cf96-bvc9d\" (UID: \"5007770b-c41d-457b-a3c0-799ad6a66e52\") " pod="opendatahub/dashboard-redirect-7f859cf96-bvc9d"
Jun 10 23:07:28.530496 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:28.530474    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr8bh\" (UniqueName: \"kubernetes.io/projected/5007770b-c41d-457b-a3c0-799ad6a66e52-kube-api-access-rr8bh\") pod \"dashboard-redirect-7f859cf96-bvc9d\" (UID: \"5007770b-c41d-457b-a3c0-799ad6a66e52\") " pod="opendatahub/dashboard-redirect-7f859cf96-bvc9d"
Jun 10 23:07:28.609777 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:28.609758    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7f859cf96-bvc9d"
Jun 10 23:07:28.733227 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:28.733151    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7f859cf96-bvc9d"]
Jun 10 23:07:28.735153 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:07:28.735128    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5007770b_c41d_457b_a3c0_799ad6a66e52.slice/crio-21ddf227aad203be3a3b942a733ccf4ebc4701ada2214280d84a6aa901a4e743 WatchSource:0}: Error finding container 21ddf227aad203be3a3b942a733ccf4ebc4701ada2214280d84a6aa901a4e743: Status 404 returned error can't find the container with id 21ddf227aad203be3a3b942a733ccf4ebc4701ada2214280d84a6aa901a4e743
Jun 10 23:07:29.257957 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:29.257888    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7f859cf96-bvc9d" event={"ID":"5007770b-c41d-457b-a3c0-799ad6a66e52","Type":"ContainerStarted","Data":"21ddf227aad203be3a3b942a733ccf4ebc4701ada2214280d84a6aa901a4e743"}
Jun 10 23:07:32.097809 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:32.097771    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq48p"
Jun 10 23:07:32.101075 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:32.101046    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-lbqs4"
Jun 10 23:07:33.281415 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:33.281373    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7f859cf96-bvc9d" event={"ID":"5007770b-c41d-457b-a3c0-799ad6a66e52","Type":"ContainerStarted","Data":"3a2aabf0cbdf2cabb867336da338778777ef5e62d555db493f7fdcd21e9fd2dc"}
Jun 10 23:07:33.299115 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:33.299041    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7f859cf96-bvc9d" podStartSLOduration=1.217907858 podStartE2EDuration="5.299017078s" totalImagesPullingTime="4.08110922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:07:33.297271133 +0000 UTC m=+499.454895292" watchObservedRunningTime="2026-06-10 23:07:33.299017078 +0000 UTC m=+499.456641232"
Jun 10 23:07:33.474429 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:33.474396    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:33.574505 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:33.574421    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:47.282390 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:47.282353    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:47.381107 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:47.381072    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:47.454694 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:47.454656    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:48.206103 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:48.206073    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:48.402355 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:48.402323    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:50.210933 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:50.210895    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:07:50.312994 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:07:50.312962    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:02.812308 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:02.812221    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp"]
Jun 10 23:08:02.816005 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:02.815981    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp"
Jun 10 23:08:02.818055 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:02.818038    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z9vkw\""
Jun 10 23:08:02.818128 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:02.818100    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 10 23:08:02.818607 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:02.818591    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 10 23:08:02.823234 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:02.823211    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp"]
Jun 10 23:08:02.922604 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:02.922573    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f86a8319-743b-4206-867a-fea58fc88c42-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp\" (UID: \"f86a8319-743b-4206-867a-fea58fc88c42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp"
Jun 10 23:08:02.922749 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:02.922613    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f86a8319-743b-4206-867a-fea58fc88c42-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp\" (UID: \"f86a8319-743b-4206-867a-fea58fc88c42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp"
Jun 10 23:08:02.922797 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:02.922739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb2xd\" (UniqueName: \"kubernetes.io/projected/f86a8319-743b-4206-867a-fea58fc88c42-kube-api-access-tb2xd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp\" (UID: \"f86a8319-743b-4206-867a-fea58fc88c42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp"
Jun 10 23:08:03.024071 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.024035    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f86a8319-743b-4206-867a-fea58fc88c42-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp\" (UID: \"f86a8319-743b-4206-867a-fea58fc88c42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp"
Jun 10 23:08:03.024227 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.024108    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb2xd\" (UniqueName: \"kubernetes.io/projected/f86a8319-743b-4206-867a-fea58fc88c42-kube-api-access-tb2xd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp\" (UID: \"f86a8319-743b-4206-867a-fea58fc88c42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp"
Jun 10 23:08:03.024227 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.024152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f86a8319-743b-4206-867a-fea58fc88c42-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp\" (UID: \"f86a8319-743b-4206-867a-fea58fc88c42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp"
Jun 10 23:08:03.024412 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.024389    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f86a8319-743b-4206-867a-fea58fc88c42-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp\" (UID: \"f86a8319-743b-4206-867a-fea58fc88c42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp"
Jun 10 23:08:03.024542 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.024425    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f86a8319-743b-4206-867a-fea58fc88c42-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp\" (UID: \"f86a8319-743b-4206-867a-fea58fc88c42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp"
Jun 10 23:08:03.032496 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.032477    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb2xd\" (UniqueName: \"kubernetes.io/projected/f86a8319-743b-4206-867a-fea58fc88c42-kube-api-access-tb2xd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp\" (UID: \"f86a8319-743b-4206-867a-fea58fc88c42\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp"
Jun 10 23:08:03.125696 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.125665    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp"
Jun 10 23:08:03.228209 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.225103    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q"]
Jun 10 23:08:03.243262 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.243236    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q"]
Jun 10 23:08:03.243463 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.243374    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q"
Jun 10 23:08:03.297330 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.297304    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp"]
Jun 10 23:08:03.298834 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:08:03.298805    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf86a8319_743b_4206_867a_fea58fc88c42.slice/crio-a47d7a02725409cab8183aec0200adf563989271e3be4a3c368f8f2edd0f5817 WatchSource:0}: Error finding container a47d7a02725409cab8183aec0200adf563989271e3be4a3c368f8f2edd0f5817: Status 404 returned error can't find the container with id a47d7a02725409cab8183aec0200adf563989271e3be4a3c368f8f2edd0f5817
Jun 10 23:08:03.330160 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.330135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39699aec-ba1f-411c-80cd-df4a308bf4d3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q\" (UID: \"39699aec-ba1f-411c-80cd-df4a308bf4d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q"
Jun 10 23:08:03.330252 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.330205    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39699aec-ba1f-411c-80cd-df4a308bf4d3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q\" (UID: \"39699aec-ba1f-411c-80cd-df4a308bf4d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q"
Jun 10 23:08:03.330353 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.330324    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtpt5\" (UniqueName: \"kubernetes.io/projected/39699aec-ba1f-411c-80cd-df4a308bf4d3-kube-api-access-mtpt5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q\" (UID: \"39699aec-ba1f-411c-80cd-df4a308bf4d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q"
Jun 10 23:08:03.431160 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.431129    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtpt5\" (UniqueName: \"kubernetes.io/projected/39699aec-ba1f-411c-80cd-df4a308bf4d3-kube-api-access-mtpt5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q\" (UID: \"39699aec-ba1f-411c-80cd-df4a308bf4d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q"
Jun 10 23:08:03.431295 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.431190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39699aec-ba1f-411c-80cd-df4a308bf4d3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q\" (UID: \"39699aec-ba1f-411c-80cd-df4a308bf4d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q"
Jun 10 23:08:03.431295 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.431291    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39699aec-ba1f-411c-80cd-df4a308bf4d3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q\" (UID: \"39699aec-ba1f-411c-80cd-df4a308bf4d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q"
Jun 10 23:08:03.431543 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.431523    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39699aec-ba1f-411c-80cd-df4a308bf4d3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q\" (UID: \"39699aec-ba1f-411c-80cd-df4a308bf4d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q"
Jun 10 23:08:03.431603 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.431544    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39699aec-ba1f-411c-80cd-df4a308bf4d3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q\" (UID: \"39699aec-ba1f-411c-80cd-df4a308bf4d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q"
Jun 10 23:08:03.434926 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.434903    2577 generic.go:356] "Generic (PLEG): container finished" podID="f86a8319-743b-4206-867a-fea58fc88c42" containerID="59ad7d08c08fee875d1315eebb81c3e51ab454a3ee455742d8c59c9731ffb53b" exitCode=0
Jun 10 23:08:03.435009 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.434955    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp" event={"ID":"f86a8319-743b-4206-867a-fea58fc88c42","Type":"ContainerDied","Data":"59ad7d08c08fee875d1315eebb81c3e51ab454a3ee455742d8c59c9731ffb53b"}
Jun 10 23:08:03.435009 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.434989    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp" event={"ID":"f86a8319-743b-4206-867a-fea58fc88c42","Type":"ContainerStarted","Data":"a47d7a02725409cab8183aec0200adf563989271e3be4a3c368f8f2edd0f5817"}
Jun 10 23:08:03.439203 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.439183    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtpt5\" (UniqueName: \"kubernetes.io/projected/39699aec-ba1f-411c-80cd-df4a308bf4d3-kube-api-access-mtpt5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q\" (UID: \"39699aec-ba1f-411c-80cd-df4a308bf4d3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q"
Jun 10 23:08:03.559183 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.559158    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q"
Jun 10 23:08:03.708682 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.708658    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q"]
Jun 10 23:08:03.710255 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:08:03.710230    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39699aec_ba1f_411c_80cd_df4a308bf4d3.slice/crio-2bed0e916851ad620e0446b510ba8070dd4f6156c0d3054c1ec7aa1c6ca30878 WatchSource:0}: Error finding container 2bed0e916851ad620e0446b510ba8070dd4f6156c0d3054c1ec7aa1c6ca30878: Status 404 returned error can't find the container with id 2bed0e916851ad620e0446b510ba8070dd4f6156c0d3054c1ec7aa1c6ca30878
Jun 10 23:08:03.812692 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.812666    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b"]
Jun 10 23:08:03.822968 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.822943    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b"
Jun 10 23:08:03.823095 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.823007    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b"]
Jun 10 23:08:03.936577 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.936545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc829694-423d-4fcc-a216-71a0bc474503-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b\" (UID: \"bc829694-423d-4fcc-a216-71a0bc474503\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b"
Jun 10 23:08:03.936716 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.936600    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc829694-423d-4fcc-a216-71a0bc474503-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b\" (UID: \"bc829694-423d-4fcc-a216-71a0bc474503\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b"
Jun 10 23:08:03.936716 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:03.936651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8bk2\" (UniqueName: \"kubernetes.io/projected/bc829694-423d-4fcc-a216-71a0bc474503-kube-api-access-s8bk2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b\" (UID: \"bc829694-423d-4fcc-a216-71a0bc474503\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b"
Jun 10 23:08:04.037430 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.037363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc829694-423d-4fcc-a216-71a0bc474503-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b\" (UID: \"bc829694-423d-4fcc-a216-71a0bc474503\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b"
Jun 10 23:08:04.037430 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.037407    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8bk2\" (UniqueName: \"kubernetes.io/projected/bc829694-423d-4fcc-a216-71a0bc474503-kube-api-access-s8bk2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b\" (UID: \"bc829694-423d-4fcc-a216-71a0bc474503\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b"
Jun 10 23:08:04.037612 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.037530    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc829694-423d-4fcc-a216-71a0bc474503-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b\" (UID: \"bc829694-423d-4fcc-a216-71a0bc474503\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b"
Jun 10 23:08:04.037695 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.037676    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc829694-423d-4fcc-a216-71a0bc474503-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b\" (UID: \"bc829694-423d-4fcc-a216-71a0bc474503\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b"
Jun 10 23:08:04.037869 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.037830    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc829694-423d-4fcc-a216-71a0bc474503-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b\" (UID: \"bc829694-423d-4fcc-a216-71a0bc474503\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b"
Jun 10 23:08:04.046023 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.046001    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8bk2\" (UniqueName: \"kubernetes.io/projected/bc829694-423d-4fcc-a216-71a0bc474503-kube-api-access-s8bk2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b\" (UID: \"bc829694-423d-4fcc-a216-71a0bc474503\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b"
Jun 10 23:08:04.134963 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.134937    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b"
Jun 10 23:08:04.281429 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.281400    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b"]
Jun 10 23:08:04.283237 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:08:04.283209    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc829694_423d_4fcc_a216_71a0bc474503.slice/crio-c5a1b1d4d0ddc124b119f884661ff2277e914521d1c32099a9cf94eb6b833f46 WatchSource:0}: Error finding container c5a1b1d4d0ddc124b119f884661ff2277e914521d1c32099a9cf94eb6b833f46: Status 404 returned error can't find the container with id c5a1b1d4d0ddc124b119f884661ff2277e914521d1c32099a9cf94eb6b833f46
Jun 10 23:08:04.413917 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.413883    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46"]
Jun 10 23:08:04.432023 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.431996    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46"]
Jun 10 23:08:04.432169 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.432092    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46"
Jun 10 23:08:04.441520 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.441497    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b" event={"ID":"bc829694-423d-4fcc-a216-71a0bc474503","Type":"ContainerStarted","Data":"c5a1b1d4d0ddc124b119f884661ff2277e914521d1c32099a9cf94eb6b833f46"}
Jun 10 23:08:04.443063 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.443038    2577 generic.go:356] "Generic (PLEG): container finished" podID="39699aec-ba1f-411c-80cd-df4a308bf4d3" containerID="8749cd620fe3774df17c23b24f103269ccbf070955abbf8ee691f0b5fc3fa503" exitCode=0
Jun 10 23:08:04.443153 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.443100    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q" event={"ID":"39699aec-ba1f-411c-80cd-df4a308bf4d3","Type":"ContainerDied","Data":"8749cd620fe3774df17c23b24f103269ccbf070955abbf8ee691f0b5fc3fa503"}
Jun 10 23:08:04.443153 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.443140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q" event={"ID":"39699aec-ba1f-411c-80cd-df4a308bf4d3","Type":"ContainerStarted","Data":"2bed0e916851ad620e0446b510ba8070dd4f6156c0d3054c1ec7aa1c6ca30878"}
Jun 10 23:08:04.542685 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.542655    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ada58d1c-59c9-4233-ab80-21d29da835cb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46\" (UID: \"ada58d1c-59c9-4233-ab80-21d29da835cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46"
Jun 10 23:08:04.542763 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.542696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ada58d1c-59c9-4233-ab80-21d29da835cb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46\" (UID: \"ada58d1c-59c9-4233-ab80-21d29da835cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46"
Jun 10 23:08:04.542839 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.542811    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg4xb\" (UniqueName: \"kubernetes.io/projected/ada58d1c-59c9-4233-ab80-21d29da835cb-kube-api-access-sg4xb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46\" (UID: \"ada58d1c-59c9-4233-ab80-21d29da835cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46"
Jun 10 23:08:04.644224 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.644195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg4xb\" (UniqueName: \"kubernetes.io/projected/ada58d1c-59c9-4233-ab80-21d29da835cb-kube-api-access-sg4xb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46\" (UID: \"ada58d1c-59c9-4233-ab80-21d29da835cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46"
Jun 10 23:08:04.644344 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.644281    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ada58d1c-59c9-4233-ab80-21d29da835cb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46\" (UID: \"ada58d1c-59c9-4233-ab80-21d29da835cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46"
Jun 10 23:08:04.644344 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.644306    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ada58d1c-59c9-4233-ab80-21d29da835cb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46\" (UID: \"ada58d1c-59c9-4233-ab80-21d29da835cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46"
Jun 10 23:08:04.644711 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.644687    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ada58d1c-59c9-4233-ab80-21d29da835cb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46\" (UID: \"ada58d1c-59c9-4233-ab80-21d29da835cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46"
Jun 10 23:08:04.644767 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.644690    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ada58d1c-59c9-4233-ab80-21d29da835cb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46\" (UID: \"ada58d1c-59c9-4233-ab80-21d29da835cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46"
Jun 10 23:08:04.651418 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.651393    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg4xb\" (UniqueName: \"kubernetes.io/projected/ada58d1c-59c9-4233-ab80-21d29da835cb-kube-api-access-sg4xb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46\" (UID: \"ada58d1c-59c9-4233-ab80-21d29da835cb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46"
Jun 10 23:08:04.742009 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.741985    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46"
Jun 10 23:08:04.866609 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:04.866585    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46"]
Jun 10 23:08:04.868110 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:08:04.868085    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada58d1c_59c9_4233_ab80_21d29da835cb.slice/crio-875ee917c5bd15fd2319e902f4172865880c15ba31dc8b3f0e1217e561c3d816 WatchSource:0}: Error finding container 875ee917c5bd15fd2319e902f4172865880c15ba31dc8b3f0e1217e561c3d816: Status 404 returned error can't find the container with id 875ee917c5bd15fd2319e902f4172865880c15ba31dc8b3f0e1217e561c3d816
Jun 10 23:08:05.450741 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:05.450664    2577 generic.go:356] "Generic (PLEG): container finished" podID="f86a8319-743b-4206-867a-fea58fc88c42" containerID="8ba211dbeaec2927d9ac587ef04d7c93b0a560ae0fdb7f40c8c23dbeef32f7eb" exitCode=0
Jun 10 23:08:05.450906 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:05.450752    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp" event={"ID":"f86a8319-743b-4206-867a-fea58fc88c42","Type":"ContainerDied","Data":"8ba211dbeaec2927d9ac587ef04d7c93b0a560ae0fdb7f40c8c23dbeef32f7eb"}
Jun 10 23:08:05.452316 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:05.452300    2577 generic.go:356] "Generic (PLEG): container finished" podID="bc829694-423d-4fcc-a216-71a0bc474503" containerID="8cb82fb7211b36c945795753954e5bd4e9472142245121b81dd44c32c28e2fc8" exitCode=0
Jun 10 23:08:05.452389 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:05.452364    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b" event={"ID":"bc829694-423d-4fcc-a216-71a0bc474503","Type":"ContainerDied","Data":"8cb82fb7211b36c945795753954e5bd4e9472142245121b81dd44c32c28e2fc8"}
Jun 10 23:08:05.454264 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:05.454243    2577 generic.go:356] "Generic (PLEG): container finished" podID="39699aec-ba1f-411c-80cd-df4a308bf4d3" containerID="524e2c4f4650413c7c95956436458afa6295bb515a8350043c0a285a734a853d" exitCode=0
Jun 10 23:08:05.454363 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:05.454347    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q" event={"ID":"39699aec-ba1f-411c-80cd-df4a308bf4d3","Type":"ContainerDied","Data":"524e2c4f4650413c7c95956436458afa6295bb515a8350043c0a285a734a853d"}
Jun 10 23:08:05.456047 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:05.456024    2577 generic.go:356] "Generic (PLEG): container finished" podID="ada58d1c-59c9-4233-ab80-21d29da835cb" containerID="4810b6e42686663f775981459c9c947e3beb6b5fd851ae83ab7ad0b758806c6a" exitCode=0
Jun 10 23:08:05.456143 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:05.456129    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46" event={"ID":"ada58d1c-59c9-4233-ab80-21d29da835cb","Type":"ContainerDied","Data":"4810b6e42686663f775981459c9c947e3beb6b5fd851ae83ab7ad0b758806c6a"}
Jun 10 23:08:05.456207 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:05.456161    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46" event={"ID":"ada58d1c-59c9-4233-ab80-21d29da835cb","Type":"ContainerStarted","Data":"875ee917c5bd15fd2319e902f4172865880c15ba31dc8b3f0e1217e561c3d816"}
Jun 10 23:08:05.652814 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:08:05.652780    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39699aec_ba1f_411c_80cd_df4a308bf4d3.slice/crio-8fe0a7e1a34151e242a772e09be5da6a55755f19d145e5047eefe1f780a61cde.scope\": RecentStats: unable to find data in memory cache]"
Jun 10 23:08:06.463746 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:06.463715    2577 generic.go:356] "Generic (PLEG): container finished" podID="ada58d1c-59c9-4233-ab80-21d29da835cb" containerID="79eda4c3235e196b436dff965006377fc4a2cb9379bb2bc01bbfdc0b8d034237" exitCode=0
Jun 10 23:08:06.464133 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:06.463753    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46" event={"ID":"ada58d1c-59c9-4233-ab80-21d29da835cb","Type":"ContainerDied","Data":"79eda4c3235e196b436dff965006377fc4a2cb9379bb2bc01bbfdc0b8d034237"}
Jun 10 23:08:06.466191 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:06.466170    2577 generic.go:356] "Generic (PLEG): container finished" podID="f86a8319-743b-4206-867a-fea58fc88c42" containerID="fc3d279154beb510f4aa32fb2b240bb0c5c2e0427cd0b5d4fba5ce8a1edb5929" exitCode=0
Jun 10 23:08:06.466289 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:06.466245    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp" event={"ID":"f86a8319-743b-4206-867a-fea58fc88c42","Type":"ContainerDied","Data":"fc3d279154beb510f4aa32fb2b240bb0c5c2e0427cd0b5d4fba5ce8a1edb5929"}
Jun 10 23:08:06.468079 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:06.468063    2577 generic.go:356] "Generic (PLEG): container finished" podID="bc829694-423d-4fcc-a216-71a0bc474503" containerID="6874122d9a3977da92f54b918383e8cccc49adcc821fc1609983ba3675814b4f" exitCode=0
Jun 10 23:08:06.468173 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:06.468124    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b" event={"ID":"bc829694-423d-4fcc-a216-71a0bc474503","Type":"ContainerDied","Data":"6874122d9a3977da92f54b918383e8cccc49adcc821fc1609983ba3675814b4f"}
Jun 10 23:08:06.470107 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:06.470086    2577 generic.go:356] "Generic (PLEG): container finished" podID="39699aec-ba1f-411c-80cd-df4a308bf4d3" containerID="8fe0a7e1a34151e242a772e09be5da6a55755f19d145e5047eefe1f780a61cde" exitCode=0
Jun 10 23:08:06.470209 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:06.470115    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q" event={"ID":"39699aec-ba1f-411c-80cd-df4a308bf4d3","Type":"ContainerDied","Data":"8fe0a7e1a34151e242a772e09be5da6a55755f19d145e5047eefe1f780a61cde"}
Jun 10 23:08:07.478690 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.478653    2577 generic.go:356] "Generic (PLEG): container finished" podID="bc829694-423d-4fcc-a216-71a0bc474503" containerID="6af699ca528450a6cee54c94fe7ba4f3fe30b3c8216ae78d84bdc7e5178eaf01" exitCode=0
Jun 10 23:08:07.479123 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.478731    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b" event={"ID":"bc829694-423d-4fcc-a216-71a0bc474503","Type":"ContainerDied","Data":"6af699ca528450a6cee54c94fe7ba4f3fe30b3c8216ae78d84bdc7e5178eaf01"}
Jun 10 23:08:07.480695 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.480671    2577 generic.go:356] "Generic (PLEG): container finished" podID="ada58d1c-59c9-4233-ab80-21d29da835cb" containerID="fe1df490b0e72f942789bdd060bd1f376d7b3159c9e01687770b687b807298be" exitCode=0
Jun 10 23:08:07.480791 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.480756    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46" event={"ID":"ada58d1c-59c9-4233-ab80-21d29da835cb","Type":"ContainerDied","Data":"fe1df490b0e72f942789bdd060bd1f376d7b3159c9e01687770b687b807298be"}
Jun 10 23:08:07.620017 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.619992    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp"
Jun 10 23:08:07.650895 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.650866    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q"
Jun 10 23:08:07.772179 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.772104    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39699aec-ba1f-411c-80cd-df4a308bf4d3-util\") pod \"39699aec-ba1f-411c-80cd-df4a308bf4d3\" (UID: \"39699aec-ba1f-411c-80cd-df4a308bf4d3\") "
Jun 10 23:08:07.772179 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.772157    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39699aec-ba1f-411c-80cd-df4a308bf4d3-bundle\") pod \"39699aec-ba1f-411c-80cd-df4a308bf4d3\" (UID: \"39699aec-ba1f-411c-80cd-df4a308bf4d3\") "
Jun 10 23:08:07.772389 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.772187    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtpt5\" (UniqueName: \"kubernetes.io/projected/39699aec-ba1f-411c-80cd-df4a308bf4d3-kube-api-access-mtpt5\") pod \"39699aec-ba1f-411c-80cd-df4a308bf4d3\" (UID: \"39699aec-ba1f-411c-80cd-df4a308bf4d3\") "
Jun 10 23:08:07.772389 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.772204    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f86a8319-743b-4206-867a-fea58fc88c42-bundle\") pod \"f86a8319-743b-4206-867a-fea58fc88c42\" (UID: \"f86a8319-743b-4206-867a-fea58fc88c42\") "
Jun 10 23:08:07.772389 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.772244    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f86a8319-743b-4206-867a-fea58fc88c42-util\") pod \"f86a8319-743b-4206-867a-fea58fc88c42\" (UID: \"f86a8319-743b-4206-867a-fea58fc88c42\") "
Jun 10 23:08:07.772389 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.772258    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tb2xd\" (UniqueName: \"kubernetes.io/projected/f86a8319-743b-4206-867a-fea58fc88c42-kube-api-access-tb2xd\") pod \"f86a8319-743b-4206-867a-fea58fc88c42\" (UID: \"f86a8319-743b-4206-867a-fea58fc88c42\") "
Jun 10 23:08:07.772806 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.772778    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f86a8319-743b-4206-867a-fea58fc88c42-bundle" (OuterVolumeSpecName: "bundle") pod "f86a8319-743b-4206-867a-fea58fc88c42" (UID: "f86a8319-743b-4206-867a-fea58fc88c42"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:08:07.772994 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.772971    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39699aec-ba1f-411c-80cd-df4a308bf4d3-bundle" (OuterVolumeSpecName: "bundle") pod "39699aec-ba1f-411c-80cd-df4a308bf4d3" (UID: "39699aec-ba1f-411c-80cd-df4a308bf4d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:08:07.774471 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.774450    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39699aec-ba1f-411c-80cd-df4a308bf4d3-kube-api-access-mtpt5" (OuterVolumeSpecName: "kube-api-access-mtpt5") pod "39699aec-ba1f-411c-80cd-df4a308bf4d3" (UID: "39699aec-ba1f-411c-80cd-df4a308bf4d3"). InnerVolumeSpecName "kube-api-access-mtpt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:08:07.774562 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.774497    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f86a8319-743b-4206-867a-fea58fc88c42-kube-api-access-tb2xd" (OuterVolumeSpecName: "kube-api-access-tb2xd") pod "f86a8319-743b-4206-867a-fea58fc88c42" (UID: "f86a8319-743b-4206-867a-fea58fc88c42"). InnerVolumeSpecName "kube-api-access-tb2xd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:08:07.781205 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.781180    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39699aec-ba1f-411c-80cd-df4a308bf4d3-util" (OuterVolumeSpecName: "util") pod "39699aec-ba1f-411c-80cd-df4a308bf4d3" (UID: "39699aec-ba1f-411c-80cd-df4a308bf4d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:08:07.781285 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.781180    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f86a8319-743b-4206-867a-fea58fc88c42-util" (OuterVolumeSpecName: "util") pod "f86a8319-743b-4206-867a-fea58fc88c42" (UID: "f86a8319-743b-4206-867a-fea58fc88c42"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:08:07.873616 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.873591    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtpt5\" (UniqueName: \"kubernetes.io/projected/39699aec-ba1f-411c-80cd-df4a308bf4d3-kube-api-access-mtpt5\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:08:07.873616 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.873614    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f86a8319-743b-4206-867a-fea58fc88c42-bundle\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:08:07.873734 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.873623    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f86a8319-743b-4206-867a-fea58fc88c42-util\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:08:07.873734 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.873631    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tb2xd\" (UniqueName: \"kubernetes.io/projected/f86a8319-743b-4206-867a-fea58fc88c42-kube-api-access-tb2xd\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:08:07.873734 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.873639    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39699aec-ba1f-411c-80cd-df4a308bf4d3-util\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:08:07.873734 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:07.873647    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39699aec-ba1f-411c-80cd-df4a308bf4d3-bundle\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:08:08.488487 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.488459    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp"
Jun 10 23:08:08.488487 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.488465    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp" event={"ID":"f86a8319-743b-4206-867a-fea58fc88c42","Type":"ContainerDied","Data":"a47d7a02725409cab8183aec0200adf563989271e3be4a3c368f8f2edd0f5817"}
Jun 10 23:08:08.489044 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.488552    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a47d7a02725409cab8183aec0200adf563989271e3be4a3c368f8f2edd0f5817"
Jun 10 23:08:08.490525 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.490499    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q" event={"ID":"39699aec-ba1f-411c-80cd-df4a308bf4d3","Type":"ContainerDied","Data":"2bed0e916851ad620e0446b510ba8070dd4f6156c0d3054c1ec7aa1c6ca30878"}
Jun 10 23:08:08.490734 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.490693    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bed0e916851ad620e0446b510ba8070dd4f6156c0d3054c1ec7aa1c6ca30878"
Jun 10 23:08:08.490734 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.490711    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q"
Jun 10 23:08:08.633618 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.633593    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b"
Jun 10 23:08:08.661596 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.661571    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46"
Jun 10 23:08:08.782298 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.782213    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc829694-423d-4fcc-a216-71a0bc474503-util\") pod \"bc829694-423d-4fcc-a216-71a0bc474503\" (UID: \"bc829694-423d-4fcc-a216-71a0bc474503\") "
Jun 10 23:08:08.782298 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.782242    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ada58d1c-59c9-4233-ab80-21d29da835cb-bundle\") pod \"ada58d1c-59c9-4233-ab80-21d29da835cb\" (UID: \"ada58d1c-59c9-4233-ab80-21d29da835cb\") "
Jun 10 23:08:08.782298 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.782261    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ada58d1c-59c9-4233-ab80-21d29da835cb-util\") pod \"ada58d1c-59c9-4233-ab80-21d29da835cb\" (UID: \"ada58d1c-59c9-4233-ab80-21d29da835cb\") "
Jun 10 23:08:08.782298 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.782281    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg4xb\" (UniqueName: \"kubernetes.io/projected/ada58d1c-59c9-4233-ab80-21d29da835cb-kube-api-access-sg4xb\") pod \"ada58d1c-59c9-4233-ab80-21d29da835cb\" (UID: \"ada58d1c-59c9-4233-ab80-21d29da835cb\") "
Jun 10 23:08:08.782662 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.782398    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc829694-423d-4fcc-a216-71a0bc474503-bundle\") pod \"bc829694-423d-4fcc-a216-71a0bc474503\" (UID: \"bc829694-423d-4fcc-a216-71a0bc474503\") "
Jun 10 23:08:08.782662 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.782469    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8bk2\" (UniqueName: \"kubernetes.io/projected/bc829694-423d-4fcc-a216-71a0bc474503-kube-api-access-s8bk2\") pod \"bc829694-423d-4fcc-a216-71a0bc474503\" (UID: \"bc829694-423d-4fcc-a216-71a0bc474503\") "
Jun 10 23:08:08.782795 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.782769    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada58d1c-59c9-4233-ab80-21d29da835cb-bundle" (OuterVolumeSpecName: "bundle") pod "ada58d1c-59c9-4233-ab80-21d29da835cb" (UID: "ada58d1c-59c9-4233-ab80-21d29da835cb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:08:08.782970 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.782944    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc829694-423d-4fcc-a216-71a0bc474503-bundle" (OuterVolumeSpecName: "bundle") pod "bc829694-423d-4fcc-a216-71a0bc474503" (UID: "bc829694-423d-4fcc-a216-71a0bc474503"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:08:08.785051 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.785030    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ada58d1c-59c9-4233-ab80-21d29da835cb-kube-api-access-sg4xb" (OuterVolumeSpecName: "kube-api-access-sg4xb") pod "ada58d1c-59c9-4233-ab80-21d29da835cb" (UID: "ada58d1c-59c9-4233-ab80-21d29da835cb"). InnerVolumeSpecName "kube-api-access-sg4xb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:08:08.785155 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.785057    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc829694-423d-4fcc-a216-71a0bc474503-kube-api-access-s8bk2" (OuterVolumeSpecName: "kube-api-access-s8bk2") pod "bc829694-423d-4fcc-a216-71a0bc474503" (UID: "bc829694-423d-4fcc-a216-71a0bc474503"). InnerVolumeSpecName "kube-api-access-s8bk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:08:08.787887 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.787862    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada58d1c-59c9-4233-ab80-21d29da835cb-util" (OuterVolumeSpecName: "util") pod "ada58d1c-59c9-4233-ab80-21d29da835cb" (UID: "ada58d1c-59c9-4233-ab80-21d29da835cb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:08:08.787978 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.787931    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc829694-423d-4fcc-a216-71a0bc474503-util" (OuterVolumeSpecName: "util") pod "bc829694-423d-4fcc-a216-71a0bc474503" (UID: "bc829694-423d-4fcc-a216-71a0bc474503"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:08:08.884173 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.884127    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8bk2\" (UniqueName: \"kubernetes.io/projected/bc829694-423d-4fcc-a216-71a0bc474503-kube-api-access-s8bk2\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:08:08.884173 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.884170    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc829694-423d-4fcc-a216-71a0bc474503-util\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:08:08.884173 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.884180    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ada58d1c-59c9-4233-ab80-21d29da835cb-bundle\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:08:08.884173 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.884188    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ada58d1c-59c9-4233-ab80-21d29da835cb-util\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:08:08.884430 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.884197    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg4xb\" (UniqueName: \"kubernetes.io/projected/ada58d1c-59c9-4233-ab80-21d29da835cb-kube-api-access-sg4xb\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:08:08.884430 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:08.884206    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc829694-423d-4fcc-a216-71a0bc474503-bundle\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:08:09.498194 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:09.498163    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b"
Jun 10 23:08:09.498625 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:09.498158    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b" event={"ID":"bc829694-423d-4fcc-a216-71a0bc474503","Type":"ContainerDied","Data":"c5a1b1d4d0ddc124b119f884661ff2277e914521d1c32099a9cf94eb6b833f46"}
Jun 10 23:08:09.498625 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:09.498301    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5a1b1d4d0ddc124b119f884661ff2277e914521d1c32099a9cf94eb6b833f46"
Jun 10 23:08:09.500018 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:09.499999    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46" event={"ID":"ada58d1c-59c9-4233-ab80-21d29da835cb","Type":"ContainerDied","Data":"875ee917c5bd15fd2319e902f4172865880c15ba31dc8b3f0e1217e561c3d816"}
Jun 10 23:08:09.500119 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:09.500029    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="875ee917c5bd15fd2319e902f4172865880c15ba31dc8b3f0e1217e561c3d816"
Jun 10 23:08:09.500119 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:09.500052    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46"
Jun 10 23:08:10.459680 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:10.459646    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:13.513832 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:13.513799    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:15.320025 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:15.319996    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:15.665500 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:15.665470    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:16.751200 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:16.751163    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:18.268593 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:18.268561    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:19.315931 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.315896    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:19.664157 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664128    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"]
Jun 10 23:08:19.664492 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664480    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc829694-423d-4fcc-a216-71a0bc474503" containerName="pull"
Jun 10 23:08:19.664537 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664493    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc829694-423d-4fcc-a216-71a0bc474503" containerName="pull"
Jun 10 23:08:19.664537 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664502    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f86a8319-743b-4206-867a-fea58fc88c42" containerName="util"
Jun 10 23:08:19.664537 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664507    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f86a8319-743b-4206-867a-fea58fc88c42" containerName="util"
Jun 10 23:08:19.664537 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664513    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada58d1c-59c9-4233-ab80-21d29da835cb" containerName="pull"
Jun 10 23:08:19.664537 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664520    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada58d1c-59c9-4233-ab80-21d29da835cb" containerName="pull"
Jun 10 23:08:19.664537 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664528    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f86a8319-743b-4206-867a-fea58fc88c42" containerName="extract"
Jun 10 23:08:19.664537 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664533    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f86a8319-743b-4206-867a-fea58fc88c42" containerName="extract"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664543    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada58d1c-59c9-4233-ab80-21d29da835cb" containerName="util"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664548    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada58d1c-59c9-4233-ab80-21d29da835cb" containerName="util"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664560    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc829694-423d-4fcc-a216-71a0bc474503" containerName="extract"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664565    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc829694-423d-4fcc-a216-71a0bc474503" containerName="extract"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664574    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc829694-423d-4fcc-a216-71a0bc474503" containerName="util"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664580    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc829694-423d-4fcc-a216-71a0bc474503" containerName="util"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664587    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f86a8319-743b-4206-867a-fea58fc88c42" containerName="pull"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664592    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f86a8319-743b-4206-867a-fea58fc88c42" containerName="pull"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664599    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39699aec-ba1f-411c-80cd-df4a308bf4d3" containerName="util"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664604    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="39699aec-ba1f-411c-80cd-df4a308bf4d3" containerName="util"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664610    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39699aec-ba1f-411c-80cd-df4a308bf4d3" containerName="pull"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664616    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="39699aec-ba1f-411c-80cd-df4a308bf4d3" containerName="pull"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664621    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39699aec-ba1f-411c-80cd-df4a308bf4d3" containerName="extract"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664626    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="39699aec-ba1f-411c-80cd-df4a308bf4d3" containerName="extract"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664639    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada58d1c-59c9-4233-ab80-21d29da835cb" containerName="extract"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664644    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada58d1c-59c9-4233-ab80-21d29da835cb" containerName="extract"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664710    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f86a8319-743b-4206-867a-fea58fc88c42" containerName="extract"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664721    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc829694-423d-4fcc-a216-71a0bc474503" containerName="extract"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664727    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="39699aec-ba1f-411c-80cd-df4a308bf4d3" containerName="extract"
Jun 10 23:08:19.664745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.664733    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ada58d1c-59c9-4233-ab80-21d29da835cb" containerName="extract"
Jun 10 23:08:19.667215 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.667196    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"
Jun 10 23:08:19.669889 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.669870    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 10 23:08:19.669972 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.669917    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 10 23:08:19.670455 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.670438    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5wd6p\""
Jun 10 23:08:19.678745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.678723    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"]
Jun 10 23:08:19.771108 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.771079    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssx6v\" (UniqueName: \"kubernetes.io/projected/39b71008-2233-4a14-b523-f69c01609d5c-kube-api-access-ssx6v\") pod \"limitador-operator-controller-manager-859d7b78bd-glcmx\" (UID: \"39b71008-2233-4a14-b523-f69c01609d5c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"
Jun 10 23:08:19.871772 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.871740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssx6v\" (UniqueName: \"kubernetes.io/projected/39b71008-2233-4a14-b523-f69c01609d5c-kube-api-access-ssx6v\") pod \"limitador-operator-controller-manager-859d7b78bd-glcmx\" (UID: \"39b71008-2233-4a14-b523-f69c01609d5c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"
Jun 10 23:08:19.879988 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.879969    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssx6v\" (UniqueName: \"kubernetes.io/projected/39b71008-2233-4a14-b523-f69c01609d5c-kube-api-access-ssx6v\") pod \"limitador-operator-controller-manager-859d7b78bd-glcmx\" (UID: \"39b71008-2233-4a14-b523-f69c01609d5c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"
Jun 10 23:08:19.977941 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:19.977872    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"
Jun 10 23:08:20.112377 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:20.112345    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"]
Jun 10 23:08:20.113420 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:08:20.113396    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b71008_2233_4a14_b523_f69c01609d5c.slice/crio-89be7dce364a7d9c03a1dfad174407875662ad21afe85cad3918025ee2657195 WatchSource:0}: Error finding container 89be7dce364a7d9c03a1dfad174407875662ad21afe85cad3918025ee2657195: Status 404 returned error can't find the container with id 89be7dce364a7d9c03a1dfad174407875662ad21afe85cad3918025ee2657195
Jun 10 23:08:20.559431 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:20.559394    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx" event={"ID":"39b71008-2233-4a14-b523-f69c01609d5c","Type":"ContainerStarted","Data":"89be7dce364a7d9c03a1dfad174407875662ad21afe85cad3918025ee2657195"}
Jun 10 23:08:20.688036 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:20.687998    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:21.917718 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:21.917693    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:22.576616 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:22.576581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx" event={"ID":"39b71008-2233-4a14-b523-f69c01609d5c","Type":"ContainerStarted","Data":"0a4f7883423e39ebd019518bbc7a1c81e0f3710108308d236c288e1aecae3c32"}
Jun 10 23:08:22.576763 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:22.576737    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"
Jun 10 23:08:22.594267 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:22.594221    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx" podStartSLOduration=1.810054077 podStartE2EDuration="3.594206667s" totalImagesPullingTime="1.78415259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:08:22.593422693 +0000 UTC m=+548.751046852" watchObservedRunningTime="2026-06-10 23:08:22.594206667 +0000 UTC m=+548.751830825"
Jun 10 23:08:24.477214 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:24.477174    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:24.577893 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:24.577839    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:24.912451 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:24.912412    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:25.181382 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:25.181304    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:33.584384 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:33.584357    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"
Jun 10 23:08:34.518542 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:34.518507    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:34.659145 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:34.659109    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:35.071787 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.071754    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"]
Jun 10 23:08:35.071980 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.071956    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx" podUID="39b71008-2233-4a14-b523-f69c01609d5c" containerName="manager" containerID="cri-o://0a4f7883423e39ebd019518bbc7a1c81e0f3710108308d236c288e1aecae3c32" gracePeriod=2
Jun 10 23:08:35.082889 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.082840    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"]
Jun 10 23:08:35.109041 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.109014    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r8jz5"]
Jun 10 23:08:35.109575 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.109560    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39b71008-2233-4a14-b523-f69c01609d5c" containerName="manager"
Jun 10 23:08:35.109619 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.109579    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="39b71008-2233-4a14-b523-f69c01609d5c" containerName="manager"
Jun 10 23:08:35.109701 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.109689    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="39b71008-2233-4a14-b523-f69c01609d5c" containerName="manager"
Jun 10 23:08:35.113252 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.113233    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r8jz5"
Jun 10 23:08:35.116898 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:08:35.116871    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-glcmx\" is forbidden: User \"system:node:ip-10-0-129-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-238.ec2.internal' and this object" podUID="39b71008-2233-4a14-b523-f69c01609d5c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"
Jun 10 23:08:35.126315 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.126288    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r8jz5"]
Jun 10 23:08:35.206123 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.206089    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfqp7\" (UniqueName: \"kubernetes.io/projected/7ea51e2f-e80a-4c48-9e57-8997892a3cb3-kube-api-access-zfqp7\") pod \"limitador-operator-controller-manager-859d7b78bd-r8jz5\" (UID: \"7ea51e2f-e80a-4c48-9e57-8997892a3cb3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r8jz5"
Jun 10 23:08:35.306699 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.306673    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfqp7\" (UniqueName: \"kubernetes.io/projected/7ea51e2f-e80a-4c48-9e57-8997892a3cb3-kube-api-access-zfqp7\") pod \"limitador-operator-controller-manager-859d7b78bd-r8jz5\" (UID: \"7ea51e2f-e80a-4c48-9e57-8997892a3cb3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r8jz5"
Jun 10 23:08:35.311475 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.311456    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"
Jun 10 23:08:35.313687 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:08:35.313663    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-glcmx\" is forbidden: User \"system:node:ip-10-0-129-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-238.ec2.internal' and this object" podUID="39b71008-2233-4a14-b523-f69c01609d5c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"
Jun 10 23:08:35.315016 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.314999    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfqp7\" (UniqueName: \"kubernetes.io/projected/7ea51e2f-e80a-4c48-9e57-8997892a3cb3-kube-api-access-zfqp7\") pod \"limitador-operator-controller-manager-859d7b78bd-r8jz5\" (UID: \"7ea51e2f-e80a-4c48-9e57-8997892a3cb3\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r8jz5"
Jun 10 23:08:35.407156 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.407126    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssx6v\" (UniqueName: \"kubernetes.io/projected/39b71008-2233-4a14-b523-f69c01609d5c-kube-api-access-ssx6v\") pod \"39b71008-2233-4a14-b523-f69c01609d5c\" (UID: \"39b71008-2233-4a14-b523-f69c01609d5c\") "
Jun 10 23:08:35.409142 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.409115    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39b71008-2233-4a14-b523-f69c01609d5c-kube-api-access-ssx6v" (OuterVolumeSpecName: "kube-api-access-ssx6v") pod "39b71008-2233-4a14-b523-f69c01609d5c" (UID: "39b71008-2233-4a14-b523-f69c01609d5c"). InnerVolumeSpecName "kube-api-access-ssx6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:08:35.452836 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.452810    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r8jz5"
Jun 10 23:08:35.508128 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.508101    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssx6v\" (UniqueName: \"kubernetes.io/projected/39b71008-2233-4a14-b523-f69c01609d5c-kube-api-access-ssx6v\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:08:35.586504 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.586477    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r8jz5"]
Jun 10 23:08:35.587575 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:08:35.587554    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ea51e2f_e80a_4c48_9e57_8997892a3cb3.slice/crio-d901bf38a073fa2fb5a2e5775b4d5a688eb315d09266635872786a6b65a7ef2d WatchSource:0}: Error finding container d901bf38a073fa2fb5a2e5775b4d5a688eb315d09266635872786a6b65a7ef2d: Status 404 returned error can't find the container with id d901bf38a073fa2fb5a2e5775b4d5a688eb315d09266635872786a6b65a7ef2d
Jun 10 23:08:35.649794 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.649768    2577 generic.go:356] "Generic (PLEG): container finished" podID="39b71008-2233-4a14-b523-f69c01609d5c" containerID="0a4f7883423e39ebd019518bbc7a1c81e0f3710108308d236c288e1aecae3c32" exitCode=0
Jun 10 23:08:35.649922 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.649817    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"
Jun 10 23:08:35.649922 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.649883    2577 scope.go:117] "RemoveContainer" containerID="0a4f7883423e39ebd019518bbc7a1c81e0f3710108308d236c288e1aecae3c32"
Jun 10 23:08:35.651745 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.651715    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r8jz5" event={"ID":"7ea51e2f-e80a-4c48-9e57-8997892a3cb3","Type":"ContainerStarted","Data":"d901bf38a073fa2fb5a2e5775b4d5a688eb315d09266635872786a6b65a7ef2d"}
Jun 10 23:08:35.652147 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:08:35.652121    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-glcmx\" is forbidden: User \"system:node:ip-10-0-129-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-238.ec2.internal' and this object" podUID="39b71008-2233-4a14-b523-f69c01609d5c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"
Jun 10 23:08:35.657812 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.657789    2577 scope.go:117] "RemoveContainer" containerID="0a4f7883423e39ebd019518bbc7a1c81e0f3710108308d236c288e1aecae3c32"
Jun 10 23:08:35.658048 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:08:35.658029    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a4f7883423e39ebd019518bbc7a1c81e0f3710108308d236c288e1aecae3c32\": container with ID starting with 0a4f7883423e39ebd019518bbc7a1c81e0f3710108308d236c288e1aecae3c32 not found: ID does not exist" containerID="0a4f7883423e39ebd019518bbc7a1c81e0f3710108308d236c288e1aecae3c32"
Jun 10 23:08:35.658134 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:35.658051    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a4f7883423e39ebd019518bbc7a1c81e0f3710108308d236c288e1aecae3c32"} err="failed to get container status \"0a4f7883423e39ebd019518bbc7a1c81e0f3710108308d236c288e1aecae3c32\": rpc error: code = NotFound desc = could not find container \"0a4f7883423e39ebd019518bbc7a1c81e0f3710108308d236c288e1aecae3c32\": container with ID starting with 0a4f7883423e39ebd019518bbc7a1c81e0f3710108308d236c288e1aecae3c32 not found: ID does not exist"
Jun 10 23:08:35.662335 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:08:35.662314    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-glcmx\" is forbidden: User \"system:node:ip-10-0-129-238.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-238.ec2.internal' and this object" podUID="39b71008-2233-4a14-b523-f69c01609d5c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-glcmx"
Jun 10 23:08:36.257079 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:36.257045    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39b71008-2233-4a14-b523-f69c01609d5c" path="/var/lib/kubelet/pods/39b71008-2233-4a14-b523-f69c01609d5c/volumes"
Jun 10 23:08:36.666391 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:36.666354    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r8jz5" event={"ID":"7ea51e2f-e80a-4c48-9e57-8997892a3cb3","Type":"ContainerStarted","Data":"d9c53b1394fd6899f145afa51b505e701fa97d51580661a92efa73240f6d4e56"}
Jun 10 23:08:36.666787 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:36.666482    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r8jz5"
Jun 10 23:08:36.684594 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:36.684553    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r8jz5" podStartSLOduration=1.684540229 podStartE2EDuration="1.684540229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:08:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:08:36.683105151 +0000 UTC m=+562.840729300" watchObservedRunningTime="2026-06-10 23:08:36.684540229 +0000 UTC m=+562.842164388"
Jun 10 23:08:37.517217 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:37.517187    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:37.614123 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:37.614085    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:38.062628 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:38.062594    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:38.151663 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:38.151632    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:39.926129 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:39.926096    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:40.027537 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:40.027502    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:45.881669 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:45.881638    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:45.980833 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:45.980801    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:47.674131 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:47.674101    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r8jz5"
Jun 10 23:08:54.863272 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:54.863225    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:54.963801 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:54.963771    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:55.063642 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:55.063600    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:57.896959 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:57.896926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:08:57.997738 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:08:57.997707    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:00.335713 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:00.335672    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:00.432031 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:00.432003    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:05.415464 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:05.415428    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f4f78fd86-zt764"]
Jun 10 23:09:05.520585 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:05.520552    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:05.581635 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:05.581602    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:05.637638 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:05.637609    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:08.824993 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:08.824961    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:09.606485 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:09.606439    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:11.366500 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:11.366462    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:11.479092 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:11.479053    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:11.550781 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:11.550748    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:11.726741 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:11.726660    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:09:11.729218 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:11.729200    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"
Jun 10 23:09:11.731495 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:11.731465    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jun 10 23:09:11.731603 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:11.731566    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z9vkw\""
Jun 10 23:09:11.740005 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:11.739986    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:09:11.773481 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:11.773458    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:09:11.830919 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:11.830894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/67606666-9ca8-4a82-b7e0-6af6bcd57f76-config-file\") pod \"limitador-limitador-54d6d988d5-vdgfx\" (UID: \"67606666-9ca8-4a82-b7e0-6af6bcd57f76\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"
Jun 10 23:09:11.831026 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:11.830936    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxfkh\" (UniqueName: \"kubernetes.io/projected/67606666-9ca8-4a82-b7e0-6af6bcd57f76-kube-api-access-hxfkh\") pod \"limitador-limitador-54d6d988d5-vdgfx\" (UID: \"67606666-9ca8-4a82-b7e0-6af6bcd57f76\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"
Jun 10 23:09:11.931730 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:11.931701    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/67606666-9ca8-4a82-b7e0-6af6bcd57f76-config-file\") pod \"limitador-limitador-54d6d988d5-vdgfx\" (UID: \"67606666-9ca8-4a82-b7e0-6af6bcd57f76\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"
Jun 10 23:09:11.931895 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:11.931746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxfkh\" (UniqueName: \"kubernetes.io/projected/67606666-9ca8-4a82-b7e0-6af6bcd57f76-kube-api-access-hxfkh\") pod \"limitador-limitador-54d6d988d5-vdgfx\" (UID: \"67606666-9ca8-4a82-b7e0-6af6bcd57f76\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"
Jun 10 23:09:11.932295 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:11.932278    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/67606666-9ca8-4a82-b7e0-6af6bcd57f76-config-file\") pod \"limitador-limitador-54d6d988d5-vdgfx\" (UID: \"67606666-9ca8-4a82-b7e0-6af6bcd57f76\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"
Jun 10 23:09:11.939422 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:11.939394    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxfkh\" (UniqueName: \"kubernetes.io/projected/67606666-9ca8-4a82-b7e0-6af6bcd57f76-kube-api-access-hxfkh\") pod \"limitador-limitador-54d6d988d5-vdgfx\" (UID: \"67606666-9ca8-4a82-b7e0-6af6bcd57f76\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"
Jun 10 23:09:12.040531 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:12.040449    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"
Jun 10 23:09:12.171698 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:12.171637    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:09:12.174895 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:09:12.174836    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67606666_9ca8_4a82_b7e0_6af6bcd57f76.slice/crio-a28b757ad3270a4876102222c51846aab9496db53fe356748a2217c809661026 WatchSource:0}: Error finding container a28b757ad3270a4876102222c51846aab9496db53fe356748a2217c809661026: Status 404 returned error can't find the container with id a28b757ad3270a4876102222c51846aab9496db53fe356748a2217c809661026
Jun 10 23:09:12.220148 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:12.220117    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:12.285688 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:12.285661    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:12.872134 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:12.872095    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vdgfx" event={"ID":"67606666-9ca8-4a82-b7e0-6af6bcd57f76","Type":"ContainerStarted","Data":"a28b757ad3270a4876102222c51846aab9496db53fe356748a2217c809661026"}
Jun 10 23:09:14.669297 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:14.669270    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:09:14.669686 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:14.669409    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:09:14.677555 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:14.677475    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:09:14.690297 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:14.677758    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:09:14.886948 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:14.886915    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vdgfx" event={"ID":"67606666-9ca8-4a82-b7e0-6af6bcd57f76","Type":"ContainerStarted","Data":"3f47ef81f69e1964beafbab399cb9bced712b70858439399865d7485bfccc88d"}
Jun 10 23:09:14.889952 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:14.887397    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"
Jun 10 23:09:14.907873 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:14.907817    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-vdgfx" podStartSLOduration=1.384153312 podStartE2EDuration="3.907803255s" totalImagesPullingTime="2.523649943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:09:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:09:14.906337597 +0000 UTC m=+601.063961753" watchObservedRunningTime="2026-06-10 23:09:14.907803255 +0000 UTC m=+601.065427413"
Jun 10 23:09:25.892670 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:25.892637    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"
Jun 10 23:09:27.483208 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:27.483172    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:30.435904 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.435825    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f4f78fd86-zt764" podUID="777e78df-449c-4c4a-af23-ee4231b5484c" containerName="console" containerID="cri-o://cacafe9254cb07b2dd0a187ed8cabca9086a9bb90f68e610c401d25e25070470" gracePeriod=15
Jun 10 23:09:30.683840 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.683818    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:09:30.791825 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.791747    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsbxv\" (UniqueName: \"kubernetes.io/projected/777e78df-449c-4c4a-af23-ee4231b5484c-kube-api-access-jsbxv\") pod \"777e78df-449c-4c4a-af23-ee4231b5484c\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") "
Jun 10 23:09:30.791825 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.791798    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-console-config\") pod \"777e78df-449c-4c4a-af23-ee4231b5484c\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") "
Jun 10 23:09:30.791825 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.791825    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/777e78df-449c-4c4a-af23-ee4231b5484c-console-oauth-config\") pod \"777e78df-449c-4c4a-af23-ee4231b5484c\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") "
Jun 10 23:09:30.792120 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.791841    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-service-ca\") pod \"777e78df-449c-4c4a-af23-ee4231b5484c\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") "
Jun 10 23:09:30.792120 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.791895    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-trusted-ca-bundle\") pod \"777e78df-449c-4c4a-af23-ee4231b5484c\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") "
Jun 10 23:09:30.792120 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.791925    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/777e78df-449c-4c4a-af23-ee4231b5484c-console-serving-cert\") pod \"777e78df-449c-4c4a-af23-ee4231b5484c\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") "
Jun 10 23:09:30.792120 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.792054    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-oauth-serving-cert\") pod \"777e78df-449c-4c4a-af23-ee4231b5484c\" (UID: \"777e78df-449c-4c4a-af23-ee4231b5484c\") "
Jun 10 23:09:30.792324 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.792301    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-console-config" (OuterVolumeSpecName: "console-config") pod "777e78df-449c-4c4a-af23-ee4231b5484c" (UID: "777e78df-449c-4c4a-af23-ee4231b5484c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 23:09:30.792324 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.792311    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-service-ca" (OuterVolumeSpecName: "service-ca") pod "777e78df-449c-4c4a-af23-ee4231b5484c" (UID: "777e78df-449c-4c4a-af23-ee4231b5484c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 23:09:30.792408 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.792335    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "777e78df-449c-4c4a-af23-ee4231b5484c" (UID: "777e78df-449c-4c4a-af23-ee4231b5484c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 23:09:30.792408 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.792383    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-console-config\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:09:30.792408 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.792403    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-service-ca\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:09:30.792697 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.792676    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "777e78df-449c-4c4a-af23-ee4231b5484c" (UID: "777e78df-449c-4c4a-af23-ee4231b5484c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 23:09:30.793947 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.793916    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/777e78df-449c-4c4a-af23-ee4231b5484c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "777e78df-449c-4c4a-af23-ee4231b5484c" (UID: "777e78df-449c-4c4a-af23-ee4231b5484c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 23:09:30.793947 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.793921    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/777e78df-449c-4c4a-af23-ee4231b5484c-kube-api-access-jsbxv" (OuterVolumeSpecName: "kube-api-access-jsbxv") pod "777e78df-449c-4c4a-af23-ee4231b5484c" (UID: "777e78df-449c-4c4a-af23-ee4231b5484c"). InnerVolumeSpecName "kube-api-access-jsbxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:09:30.794085 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.793962    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/777e78df-449c-4c4a-af23-ee4231b5484c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "777e78df-449c-4c4a-af23-ee4231b5484c" (UID: "777e78df-449c-4c4a-af23-ee4231b5484c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 23:09:30.893551 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.893524    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsbxv\" (UniqueName: \"kubernetes.io/projected/777e78df-449c-4c4a-af23-ee4231b5484c-kube-api-access-jsbxv\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:09:30.893551 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.893545    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/777e78df-449c-4c4a-af23-ee4231b5484c-console-oauth-config\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:09:30.893551 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.893554    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-trusted-ca-bundle\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:09:30.893753 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.893562    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/777e78df-449c-4c4a-af23-ee4231b5484c-console-serving-cert\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:09:30.893753 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.893571    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/777e78df-449c-4c4a-af23-ee4231b5484c-oauth-serving-cert\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:09:30.982016 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.981953    2577 generic.go:356] "Generic (PLEG): container finished" podID="777e78df-449c-4c4a-af23-ee4231b5484c" containerID="cacafe9254cb07b2dd0a187ed8cabca9086a9bb90f68e610c401d25e25070470" exitCode=0
Jun 10 23:09:30.982016 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.981992    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4f78fd86-zt764"
Jun 10 23:09:30.982016 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.982013    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4f78fd86-zt764" event={"ID":"777e78df-449c-4c4a-af23-ee4231b5484c","Type":"ContainerDied","Data":"cacafe9254cb07b2dd0a187ed8cabca9086a9bb90f68e610c401d25e25070470"}
Jun 10 23:09:30.982245 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.982053    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4f78fd86-zt764" event={"ID":"777e78df-449c-4c4a-af23-ee4231b5484c","Type":"ContainerDied","Data":"c98a73ee04acda40ae423e26548e1724febe6fd039d97dd22f95f7df8c6f985c"}
Jun 10 23:09:30.982245 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.982071    2577 scope.go:117] "RemoveContainer" containerID="cacafe9254cb07b2dd0a187ed8cabca9086a9bb90f68e610c401d25e25070470"
Jun 10 23:09:30.991541 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.991527    2577 scope.go:117] "RemoveContainer" containerID="cacafe9254cb07b2dd0a187ed8cabca9086a9bb90f68e610c401d25e25070470"
Jun 10 23:09:30.991817 ip-10-0-129-238 kubenswrapper[2577]: E0610 23:09:30.991800    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cacafe9254cb07b2dd0a187ed8cabca9086a9bb90f68e610c401d25e25070470\": container with ID starting with cacafe9254cb07b2dd0a187ed8cabca9086a9bb90f68e610c401d25e25070470 not found: ID does not exist" containerID="cacafe9254cb07b2dd0a187ed8cabca9086a9bb90f68e610c401d25e25070470"
Jun 10 23:09:30.991900 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:30.991824    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cacafe9254cb07b2dd0a187ed8cabca9086a9bb90f68e610c401d25e25070470"} err="failed to get container status \"cacafe9254cb07b2dd0a187ed8cabca9086a9bb90f68e610c401d25e25070470\": rpc error: code = NotFound desc = could not find container \"cacafe9254cb07b2dd0a187ed8cabca9086a9bb90f68e610c401d25e25070470\": container with ID starting with cacafe9254cb07b2dd0a187ed8cabca9086a9bb90f68e610c401d25e25070470 not found: ID does not exist"
Jun 10 23:09:31.003013 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:31.002996    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f4f78fd86-zt764"]
Jun 10 23:09:31.006441 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:31.006422    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f4f78fd86-zt764"]
Jun 10 23:09:32.258391 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:32.258360    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="777e78df-449c-4c4a-af23-ee4231b5484c" path="/var/lib/kubelet/pods/777e78df-449c-4c4a-af23-ee4231b5484c/volumes"
Jun 10 23:09:36.804946 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:36.804910    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:36.905544 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:36.905509    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:37.068675 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:37.068589    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:09:38.090701 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.090667    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9"]
Jun 10 23:09:38.091136 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.091122    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="777e78df-449c-4c4a-af23-ee4231b5484c" containerName="console"
Jun 10 23:09:38.091180 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.091137    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="777e78df-449c-4c4a-af23-ee4231b5484c" containerName="console"
Jun 10 23:09:38.091237 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.091229    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="777e78df-449c-4c4a-af23-ee4231b5484c" containerName="console"
Jun 10 23:09:38.094471 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.094454    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9"
Jun 10 23:09:38.096964 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.096944    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 10 23:09:38.097527 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.097512    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 10 23:09:38.097621 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.097537    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-64grf\""
Jun 10 23:09:38.103605 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.103577    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9"]
Jun 10 23:09:38.149686 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.149645    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a74a67e3-899b-4341-b125-38cd4e6eaccd-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9\" (UID: \"a74a67e3-899b-4341-b125-38cd4e6eaccd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9"
Jun 10 23:09:38.149894 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.149771    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a74a67e3-899b-4341-b125-38cd4e6eaccd-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9\" (UID: \"a74a67e3-899b-4341-b125-38cd4e6eaccd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9"
Jun 10 23:09:38.149894 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.149829    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5twf\" (UniqueName: \"kubernetes.io/projected/a74a67e3-899b-4341-b125-38cd4e6eaccd-kube-api-access-k5twf\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9\" (UID: \"a74a67e3-899b-4341-b125-38cd4e6eaccd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9"
Jun 10 23:09:38.250420 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.250384    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a74a67e3-899b-4341-b125-38cd4e6eaccd-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9\" (UID: \"a74a67e3-899b-4341-b125-38cd4e6eaccd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9"
Jun 10 23:09:38.250576 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.250448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5twf\" (UniqueName: \"kubernetes.io/projected/a74a67e3-899b-4341-b125-38cd4e6eaccd-kube-api-access-k5twf\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9\" (UID: \"a74a67e3-899b-4341-b125-38cd4e6eaccd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9"
Jun 10 23:09:38.250576 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.250488    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a74a67e3-899b-4341-b125-38cd4e6eaccd-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9\" (UID: \"a74a67e3-899b-4341-b125-38cd4e6eaccd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9"
Jun 10 23:09:38.250892 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.250839    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a74a67e3-899b-4341-b125-38cd4e6eaccd-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9\" (UID: \"a74a67e3-899b-4341-b125-38cd4e6eaccd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9"
Jun 10 23:09:38.250892 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.250883    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a74a67e3-899b-4341-b125-38cd4e6eaccd-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9\" (UID: \"a74a67e3-899b-4341-b125-38cd4e6eaccd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9"
Jun 10 23:09:38.265857 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.265812    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5twf\" (UniqueName: \"kubernetes.io/projected/a74a67e3-899b-4341-b125-38cd4e6eaccd-kube-api-access-k5twf\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9\" (UID: \"a74a67e3-899b-4341-b125-38cd4e6eaccd\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9"
Jun 10 23:09:38.405837 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.405800    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9"
Jun 10 23:09:38.536203 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:38.536175    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9"]
Jun 10 23:09:38.537423 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:09:38.537394    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda74a67e3_899b_4341_b125_38cd4e6eaccd.slice/crio-8174b4480d8a7ea62d72b7e1e6d5cef0dd1d750867272c3327830981b70b0e1e WatchSource:0}: Error finding container 8174b4480d8a7ea62d72b7e1e6d5cef0dd1d750867272c3327830981b70b0e1e: Status 404 returned error can't find the container with id 8174b4480d8a7ea62d72b7e1e6d5cef0dd1d750867272c3327830981b70b0e1e
Jun 10 23:09:39.028431 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:39.028396    2577 generic.go:356] "Generic (PLEG): container finished" podID="a74a67e3-899b-4341-b125-38cd4e6eaccd" containerID="3387766b716624afe5d57dabd29027d1aa4f2aa45161d03378572c26d787835b" exitCode=0
Jun 10 23:09:39.028605 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:39.028481    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9" event={"ID":"a74a67e3-899b-4341-b125-38cd4e6eaccd","Type":"ContainerDied","Data":"3387766b716624afe5d57dabd29027d1aa4f2aa45161d03378572c26d787835b"}
Jun 10 23:09:39.028605 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:39.028531    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9" event={"ID":"a74a67e3-899b-4341-b125-38cd4e6eaccd","Type":"ContainerStarted","Data":"8174b4480d8a7ea62d72b7e1e6d5cef0dd1d750867272c3327830981b70b0e1e"}
Jun 10 23:09:40.036108 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:40.036013    2577 generic.go:356] "Generic (PLEG): container finished" podID="a74a67e3-899b-4341-b125-38cd4e6eaccd" containerID="f40c28fb541bd385323e53ba3de70347ff81d45a8aabda56c18a2eef9b3b7d89" exitCode=0
Jun 10 23:09:40.036108 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:40.036071    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9" event={"ID":"a74a67e3-899b-4341-b125-38cd4e6eaccd","Type":"ContainerDied","Data":"f40c28fb541bd385323e53ba3de70347ff81d45a8aabda56c18a2eef9b3b7d89"}
Jun 10 23:09:41.044540 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:41.044506    2577 generic.go:356] "Generic (PLEG): container finished" podID="a74a67e3-899b-4341-b125-38cd4e6eaccd" containerID="9cfc186f47c995b57c82ef35b198251bfd9c3f05a8a1e6b99cf2af7a9e940adb" exitCode=0
Jun 10 23:09:41.044951 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:41.044568    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9" event={"ID":"a74a67e3-899b-4341-b125-38cd4e6eaccd","Type":"ContainerDied","Data":"9cfc186f47c995b57c82ef35b198251bfd9c3f05a8a1e6b99cf2af7a9e940adb"}
Jun 10 23:09:42.188145 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:42.188122    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9"
Jun 10 23:09:42.284937 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:42.284900    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a74a67e3-899b-4341-b125-38cd4e6eaccd-bundle\") pod \"a74a67e3-899b-4341-b125-38cd4e6eaccd\" (UID: \"a74a67e3-899b-4341-b125-38cd4e6eaccd\") "
Jun 10 23:09:42.285126 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:42.284969    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5twf\" (UniqueName: \"kubernetes.io/projected/a74a67e3-899b-4341-b125-38cd4e6eaccd-kube-api-access-k5twf\") pod \"a74a67e3-899b-4341-b125-38cd4e6eaccd\" (UID: \"a74a67e3-899b-4341-b125-38cd4e6eaccd\") "
Jun 10 23:09:42.285126 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:42.285045    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a74a67e3-899b-4341-b125-38cd4e6eaccd-util\") pod \"a74a67e3-899b-4341-b125-38cd4e6eaccd\" (UID: \"a74a67e3-899b-4341-b125-38cd4e6eaccd\") "
Jun 10 23:09:42.285516 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:42.285486    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a74a67e3-899b-4341-b125-38cd4e6eaccd-bundle" (OuterVolumeSpecName: "bundle") pod "a74a67e3-899b-4341-b125-38cd4e6eaccd" (UID: "a74a67e3-899b-4341-b125-38cd4e6eaccd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:09:42.287085 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:42.287061    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a74a67e3-899b-4341-b125-38cd4e6eaccd-kube-api-access-k5twf" (OuterVolumeSpecName: "kube-api-access-k5twf") pod "a74a67e3-899b-4341-b125-38cd4e6eaccd" (UID: "a74a67e3-899b-4341-b125-38cd4e6eaccd"). InnerVolumeSpecName "kube-api-access-k5twf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 23:09:42.290341 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:42.290306    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a74a67e3-899b-4341-b125-38cd4e6eaccd-util" (OuterVolumeSpecName: "util") pod "a74a67e3-899b-4341-b125-38cd4e6eaccd" (UID: "a74a67e3-899b-4341-b125-38cd4e6eaccd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 23:09:42.386251 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:42.386220    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a74a67e3-899b-4341-b125-38cd4e6eaccd-bundle\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:09:42.386251 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:42.386249    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5twf\" (UniqueName: \"kubernetes.io/projected/a74a67e3-899b-4341-b125-38cd4e6eaccd-kube-api-access-k5twf\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:09:42.386440 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:42.386261    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a74a67e3-899b-4341-b125-38cd4e6eaccd-util\") on node \"ip-10-0-129-238.ec2.internal\" DevicePath \"\""
Jun 10 23:09:43.057573 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:43.057545    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9"
Jun 10 23:09:43.057775 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:43.057569    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748rhdq9" event={"ID":"a74a67e3-899b-4341-b125-38cd4e6eaccd","Type":"ContainerDied","Data":"8174b4480d8a7ea62d72b7e1e6d5cef0dd1d750867272c3327830981b70b0e1e"}
Jun 10 23:09:43.057775 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:09:43.057618    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8174b4480d8a7ea62d72b7e1e6d5cef0dd1d750867272c3327830981b70b0e1e"
Jun 10 23:10:01.344839 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:10:01.344799    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:10:01.442452 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:10:01.442424    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:10:30.819997 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:10:30.819960    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:10:31.238218 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:10:31.238186    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:10:36.318479 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:10:36.318440    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:10:36.416510 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:10:36.416472    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:10:36.512474 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:10:36.512445    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:10:39.746770 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:10:39.746726    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:10:39.846493 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:10:39.846461    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:10:52.402270 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:10:52.402186    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:10:52.502255 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:10:52.502220    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:11:09.441540 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:11:09.441506    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:11:09.670588 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:11:09.670545    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:11:09.847371 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:11:09.847345    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:11:09.952330 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:11:09.952292    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:11:10.090158 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:11:10.090124    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:12:34.367097 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:12:34.367019    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:13:14.613808 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:13:14.613776    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:13:14.663116 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:13:14.663087    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:14:12.430110 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:12.430075    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:14:12.529961 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:12.529927    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:14:14.711086 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:14.710959    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:14:14.717917 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:14.713300    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:14:14.719423 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:14.719406    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:14:14.721774 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:14.721754    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:14:24.822750 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:24.822709    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:14:25.191482 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:25.191452    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:14:32.284711 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.284682    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"]
Jun 10 23:14:32.285099 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.285067    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a74a67e3-899b-4341-b125-38cd4e6eaccd" containerName="util"
Jun 10 23:14:32.285099 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.285079    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a74a67e3-899b-4341-b125-38cd4e6eaccd" containerName="util"
Jun 10 23:14:32.285099 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.285088    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a74a67e3-899b-4341-b125-38cd4e6eaccd" containerName="pull"
Jun 10 23:14:32.285099 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.285093    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a74a67e3-899b-4341-b125-38cd4e6eaccd" containerName="pull"
Jun 10 23:14:32.285240 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.285109    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a74a67e3-899b-4341-b125-38cd4e6eaccd" containerName="extract"
Jun 10 23:14:32.285240 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.285114    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a74a67e3-899b-4341-b125-38cd4e6eaccd" containerName="extract"
Jun 10 23:14:32.285240 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.285183    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a74a67e3-899b-4341-b125-38cd4e6eaccd" containerName="extract"
Jun 10 23:14:32.288436 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.288418    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.290779 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.290751    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 10 23:14:32.290926 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.290781    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 10 23:14:32.291018 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.290936    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jun 10 23:14:32.291018 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.290953    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lrw42\""
Jun 10 23:14:32.299696 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.299675    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"]
Jun 10 23:14:32.416442 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.416410    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d490384-7653-4a4e-a4be-c668fb53e0a3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.416442 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.416445    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d490384-7653-4a4e-a4be-c668fb53e0a3-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.416674 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.416487    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b5q2\" (UniqueName: \"kubernetes.io/projected/0d490384-7653-4a4e-a4be-c668fb53e0a3-kube-api-access-4b5q2\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.416674 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.416536    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d490384-7653-4a4e-a4be-c668fb53e0a3-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.416674 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.416591    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d490384-7653-4a4e-a4be-c668fb53e0a3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.416674 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.416617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d490384-7653-4a4e-a4be-c668fb53e0a3-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.517991 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.517955    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d490384-7653-4a4e-a4be-c668fb53e0a3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.517991 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.517996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d490384-7653-4a4e-a4be-c668fb53e0a3-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.518250 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.518029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b5q2\" (UniqueName: \"kubernetes.io/projected/0d490384-7653-4a4e-a4be-c668fb53e0a3-kube-api-access-4b5q2\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.518250 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.518083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d490384-7653-4a4e-a4be-c668fb53e0a3-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.518250 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.518125    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d490384-7653-4a4e-a4be-c668fb53e0a3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.518250 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.518152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d490384-7653-4a4e-a4be-c668fb53e0a3-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.518408 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.518376    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d490384-7653-4a4e-a4be-c668fb53e0a3-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.518456 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.518433    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d490384-7653-4a4e-a4be-c668fb53e0a3-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.518515 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.518472    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0d490384-7653-4a4e-a4be-c668fb53e0a3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.520365 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.520340    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d490384-7653-4a4e-a4be-c668fb53e0a3-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.520502 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.520485    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d490384-7653-4a4e-a4be-c668fb53e0a3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.526420 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.526395    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b5q2\" (UniqueName: \"kubernetes.io/projected/0d490384-7653-4a4e-a4be-c668fb53e0a3-kube-api-access-4b5q2\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fr8wj\" (UID: \"0d490384-7653-4a4e-a4be-c668fb53e0a3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.599365 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.599339    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:14:32.731080 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.731057    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"]
Jun 10 23:14:32.731946 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:14:32.731919    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d490384_7653_4a4e_a4be_c668fb53e0a3.slice/crio-a216c7eba451f9d00b4e58bae8f92a4cbe75f8d52d832394c2da47e7815a33af WatchSource:0}: Error finding container a216c7eba451f9d00b4e58bae8f92a4cbe75f8d52d832394c2da47e7815a33af: Status 404 returned error can't find the container with id a216c7eba451f9d00b4e58bae8f92a4cbe75f8d52d832394c2da47e7815a33af
Jun 10 23:14:32.733563 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:32.733545    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 10 23:14:33.729792 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:33.729751    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj" event={"ID":"0d490384-7653-4a4e-a4be-c668fb53e0a3","Type":"ContainerStarted","Data":"a216c7eba451f9d00b4e58bae8f92a4cbe75f8d52d832394c2da47e7815a33af"}
Jun 10 23:14:36.281379 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.281293    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"]
Jun 10 23:14:36.285475 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.285456    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.287603 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.287582    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jun 10 23:14:36.297513 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.297489    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"]
Jun 10 23:14:36.304562 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.304526    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:14:36.456187 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.456143    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb90148a-716d-41b9-bd2d-bcb18006865e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.456353 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.456204    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb90148a-716d-41b9-bd2d-bcb18006865e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.456353 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.456282    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb90148a-716d-41b9-bd2d-bcb18006865e-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.456353 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.456311    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cb90148a-716d-41b9-bd2d-bcb18006865e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.456353 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.456340    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmkk2\" (UniqueName: \"kubernetes.io/projected/cb90148a-716d-41b9-bd2d-bcb18006865e-kube-api-access-pmkk2\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.456489 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.456388    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb90148a-716d-41b9-bd2d-bcb18006865e-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.557865 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.557784    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb90148a-716d-41b9-bd2d-bcb18006865e-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.557865 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.557817    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cb90148a-716d-41b9-bd2d-bcb18006865e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.557865 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.557836    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmkk2\" (UniqueName: \"kubernetes.io/projected/cb90148a-716d-41b9-bd2d-bcb18006865e-kube-api-access-pmkk2\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.558129 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.557976    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb90148a-716d-41b9-bd2d-bcb18006865e-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.558129 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.558050    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb90148a-716d-41b9-bd2d-bcb18006865e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.558129 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.558079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb90148a-716d-41b9-bd2d-bcb18006865e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.558293 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.558239    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb90148a-716d-41b9-bd2d-bcb18006865e-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.558293 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.558259    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cb90148a-716d-41b9-bd2d-bcb18006865e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.558391 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.558346    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb90148a-716d-41b9-bd2d-bcb18006865e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.560147 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.560128    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb90148a-716d-41b9-bd2d-bcb18006865e-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.560929 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.560908    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb90148a-716d-41b9-bd2d-bcb18006865e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.569326 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.569307    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmkk2\" (UniqueName: \"kubernetes.io/projected/cb90148a-716d-41b9-bd2d-bcb18006865e-kube-api-access-pmkk2\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf\" (UID: \"cb90148a-716d-41b9-bd2d-bcb18006865e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.600292 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.600266    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"
Jun 10 23:14:36.738092 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.738059    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf"]
Jun 10 23:14:36.750436 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.750311    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj" event={"ID":"0d490384-7653-4a4e-a4be-c668fb53e0a3","Type":"ContainerStarted","Data":"7229acbea4b70bed36146476274ed17caadba81c91ec5af6915861b22f3d6d99"}
Jun 10 23:14:36.751516 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.751493    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf" event={"ID":"cb90148a-716d-41b9-bd2d-bcb18006865e","Type":"ContainerStarted","Data":"79f58b73facc74e9bf613a4b96a776b5b4ffb96134d5c0fe12033ad663da8820"}
Jun 10 23:14:36.877766 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:36.877732    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:14:37.759003 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:14:37.758949    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf" event={"ID":"cb90148a-716d-41b9-bd2d-bcb18006865e","Type":"ContainerStarted","Data":"b1e999e876c15cfefbda30fc25bcc46dfc5bd0a15e90a1520de8c0070ac739aa"}
Jun 10 23:15:04.605658 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:04.605626    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:15:05.289237 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:05.289194    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:15:17.282369 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:17.282332    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:15:17.331800 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:17.331768    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:15:20.891013 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:20.890980    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"]
Jun 10 23:15:20.893957 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:20.893921    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:20.896311 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:20.896290    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jun 10 23:15:20.905378 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:20.905352    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"]
Jun 10 23:15:20.922472 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:20.922446    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:15:21.025207 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.025181    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b41aa25-dda4-4c96-9098-f3b857c55354-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.025378 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.025223    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b41aa25-dda4-4c96-9098-f3b857c55354-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.025378 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.025256    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3b41aa25-dda4-4c96-9098-f3b857c55354-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.025378 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.025313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b41aa25-dda4-4c96-9098-f3b857c55354-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.025378 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.025329    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5l8v\" (UniqueName: \"kubernetes.io/projected/3b41aa25-dda4-4c96-9098-f3b857c55354-kube-api-access-q5l8v\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.025378 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.025370    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b41aa25-dda4-4c96-9098-f3b857c55354-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.126637 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.126608    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3b41aa25-dda4-4c96-9098-f3b857c55354-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.126797 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.126658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b41aa25-dda4-4c96-9098-f3b857c55354-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.126797 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.126676    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5l8v\" (UniqueName: \"kubernetes.io/projected/3b41aa25-dda4-4c96-9098-f3b857c55354-kube-api-access-q5l8v\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.126797 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.126702    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b41aa25-dda4-4c96-9098-f3b857c55354-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.126954 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.126897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b41aa25-dda4-4c96-9098-f3b857c55354-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.127009 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.126980    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b41aa25-dda4-4c96-9098-f3b857c55354-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.127138 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.127117    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3b41aa25-dda4-4c96-9098-f3b857c55354-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.127183 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.127133    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b41aa25-dda4-4c96-9098-f3b857c55354-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.127219 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.127196    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b41aa25-dda4-4c96-9098-f3b857c55354-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.129090 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.129066    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b41aa25-dda4-4c96-9098-f3b857c55354-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.129502 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.129482    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b41aa25-dda4-4c96-9098-f3b857c55354-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.134899 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.134872    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5l8v\" (UniqueName: \"kubernetes.io/projected/3b41aa25-dda4-4c96-9098-f3b857c55354-kube-api-access-q5l8v\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-htwkp\" (UID: \"3b41aa25-dda4-4c96-9098-f3b857c55354\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.207750 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.207687    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:21.339185 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.339159    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"]
Jun 10 23:15:21.340075 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:15:21.340052    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b41aa25_dda4_4c96_9098_f3b857c55354.slice/crio-207077988c9965a9b494e56a9f457dfefcb46b03a515d2e265127e4653c535a7 WatchSource:0}: Error finding container 207077988c9965a9b494e56a9f457dfefcb46b03a515d2e265127e4653c535a7: Status 404 returned error can't find the container with id 207077988c9965a9b494e56a9f457dfefcb46b03a515d2e265127e4653c535a7
Jun 10 23:15:21.581442 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:21.581361    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:15:22.018926 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:22.018882    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp" event={"ID":"3b41aa25-dda4-4c96-9098-f3b857c55354","Type":"ContainerStarted","Data":"b51bb1c5b1b6f8a482ac5d3a2f2d0bcabe85412caa1599db4d751a7e8e62c6c0"}
Jun 10 23:15:22.019303 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:22.018954    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp" event={"ID":"3b41aa25-dda4-4c96-9098-f3b857c55354","Type":"ContainerStarted","Data":"207077988c9965a9b494e56a9f457dfefcb46b03a515d2e265127e4653c535a7"}
Jun 10 23:15:23.029918 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:23.029807    2577 generic.go:356] "Generic (PLEG): container finished" podID="3b41aa25-dda4-4c96-9098-f3b857c55354" containerID="b51bb1c5b1b6f8a482ac5d3a2f2d0bcabe85412caa1599db4d751a7e8e62c6c0" exitCode=0
Jun 10 23:15:23.030369 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:23.030154    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp" event={"ID":"3b41aa25-dda4-4c96-9098-f3b857c55354","Type":"ContainerDied","Data":"b51bb1c5b1b6f8a482ac5d3a2f2d0bcabe85412caa1599db4d751a7e8e62c6c0"}
Jun 10 23:15:25.045862 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:25.045811    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp" event={"ID":"3b41aa25-dda4-4c96-9098-f3b857c55354","Type":"ContainerStarted","Data":"e0c78d8ae9f4c9fb2f4718727eff82cb98b075b7336145e2fd8a95251c2aa960"}
Jun 10 23:15:25.072764 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:25.072714    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp" podStartSLOduration=2.841727459 podStartE2EDuration="5.072699149s" totalImagesPullingTime="977.143891ms" totalInitContainerRuntime="1.253827799s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:15:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:15:25.070710705 +0000 UTC m=+971.228334875" watchObservedRunningTime="2026-06-10 23:15:25.072699149 +0000 UTC m=+971.230323306"
Jun 10 23:15:29.069874 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:29.069830    2577 generic.go:356] "Generic (PLEG): container finished" podID="0d490384-7653-4a4e-a4be-c668fb53e0a3" containerID="7229acbea4b70bed36146476274ed17caadba81c91ec5af6915861b22f3d6d99" exitCode=0
Jun 10 23:15:29.070277 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:29.069908    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj" event={"ID":"0d490384-7653-4a4e-a4be-c668fb53e0a3","Type":"ContainerDied","Data":"7229acbea4b70bed36146476274ed17caadba81c91ec5af6915861b22f3d6d99"}
Jun 10 23:15:30.077463 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:30.077429    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj" event={"ID":"0d490384-7653-4a4e-a4be-c668fb53e0a3","Type":"ContainerStarted","Data":"2b343fbb3ddab9f97dd42a6e211c80d752ed11f066ba0069f69d6872f42a0dd8"}
Jun 10 23:15:30.103957 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:30.103904    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj" podStartSLOduration=1.762346688 podStartE2EDuration="58.103888613s" totalImagesPullingTime="3.346240332s" totalInitContainerRuntime="52.995301593s" isStatefulPod=false podCreationTimestamp="2026-06-10 23:14:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:15:30.093969813 +0000 UTC m=+976.251593972" watchObservedRunningTime="2026-06-10 23:15:30.103888613 +0000 UTC m=+976.261512771"
Jun 10 23:15:31.208477 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:31.208399    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:31.208477 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:31.208457    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:31.221122 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:31.221097    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:32.099955 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:32.099927    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-htwkp"
Jun 10 23:15:32.599781 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:32.599752    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:15:32.600178 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:32.599815    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:15:32.612179 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:32.612156    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:15:33.105883 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:33.105842    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fr8wj"
Jun 10 23:15:40.322203 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:40.322130    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:15:41.285725 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:41.285688    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:15:56.204945 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:56.204907    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:15:57.393446 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:15:57.393398    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:16:34.035602 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:16:34.035568    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:16:34.134263 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:16:34.134232    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:16:35.168979 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:16:35.168945    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:16:35.264434 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:16:35.264402    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:16:40.809981 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:16:40.809948    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:16:43.269974 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:16:43.269942    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:17:05.037388 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:17:05.037305    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:17:05.087805 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:17:05.087775    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:17:15.487019 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:17:15.486986    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:17:24.190920 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:17:24.190884    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:17:34.481037 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:17:34.481005    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:17:43.395777 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:17:43.395740    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:17:53.678808 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:17:53.678771    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:18:01.641770 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:18:01.641728    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:18:02.934257 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:18:02.934226    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:18:25.882189 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:18:25.882144    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:18:30.579430 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:18:30.579391    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:18:42.815750 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:18:42.815669    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:18:42.913908 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:18:42.913878    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:18:51.311732 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:18:51.311700    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:18:57.026418 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:18:57.026387    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:18:57.089838 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:18:57.089809    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:19:06.487453 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:19:06.487416    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:19:14.752370 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:19:14.752265    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:19:14.756963 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:19:14.756940    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:19:14.760750 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:19:14.760731    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:19:14.770025 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:19:14.770008    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:19:22.583420 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:19:22.583381    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:19:29.212567 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:19:29.212533    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:19:29.312739 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:19:29.312711    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:19:53.181931 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:19:53.181895    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:19:58.842333 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:19:58.842301    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:19:58.896783 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:19:58.896752    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:19:58.965824 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:19:58.965787    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:19:59.067278 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:19:59.067246    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:19:59.196212 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:19:59.196178    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:19:59.297802 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:19:59.297775    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:20:00.581463 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:00.581426    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:20:15.809839 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:15.809803    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:20:15.907887 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:15.907817    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:20:16.013145 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:16.013115    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:20:17.188603 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:17.188569    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:20:21.778004 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:21.777967    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:20:21.878318 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:21.878288    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:20:29.917591 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:29.917559    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:20:30.016334 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:30.016306    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:20:30.113191 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:30.113159    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:20:30.213353 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:30.213269    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:20:30.312290 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:30.312260    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:20:31.688547 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:31.688508    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:20:46.614463 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:46.614428    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:20:46.716035 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:46.715999    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:20:46.819061 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:46.819023    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:20:47.881601 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:47.881562    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:20:52.494090 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:52.494059    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:20:52.550424 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:20:52.550390    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:21:08.672700 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:21:08.672661    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:21:08.774594 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:21:08.774551    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:21:08.892361 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:21:08.892325    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:21:14.643545 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:21:14.643508    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:21:14.750318 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:21:14.750282    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:21:14.845757 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:21:14.845729    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:21:14.977445 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:21:14.977363    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:21:20.586447 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:21:20.586391    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:21:20.641984 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:21:20.641950    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:21:46.892438 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:21:46.892357    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:21:55.790453 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:21:55.790414    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:22:09.425103 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:22:09.425066    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:22:12.588665 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:22:12.588629    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:22:21.279711 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:22:21.279677    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:22:38.478189 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:22:38.478155    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:22:47.084190 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:22:47.084155    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:23:19.582557 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:23:19.582526    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:23:28.286158 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:23:28.286130    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:23:37.385766 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:23:37.385734    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:23:44.677223 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:23:44.677193    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:23:53.181365 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:23:53.181329    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:24:14.797228 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:24:14.797110    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:24:14.805668 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:24:14.805648    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:24:14.817604 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:24:14.817584    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:24:14.825064 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:24:14.825048    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:24:18.691406 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:24:18.691373    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:24:30.780520 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:24:30.780485    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:25:17.484371 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:25:17.484325    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:25:25.391735 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:25:25.391692    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:25:44.291301 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:25:44.291267    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:25:52.888090 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:25:52.888059    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:26:01.882306 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:26:01.882217    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:26:10.384725 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:26:10.384690    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:26:19.483634 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:26:19.483600    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:26:28.290155 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:26:28.290115    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:26:37.178508 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:26:37.178475    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:26:45.478530 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:26:45.478493    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:26:53.974476 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:26:53.974442    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:27:02.086239 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:27:02.086201    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:27:54.434596 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:27:54.434514    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:27:55.416452 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:27:55.416410    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:29:13.232732 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:29:13.232694    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:29:14.836599 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:29:14.836497    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:29:14.844314 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:29:14.844295    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:29:14.857227 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:29:14.857210    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:29:14.864664 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:29:14.864648    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:29:51.188444 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:29:51.188407    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:29:54.678030 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:29:54.677988    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:30:05.374929 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:30:05.374894    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:30:06.876110 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:30:06.876074    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:30:06.931789 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:30:06.931762    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:30:14.780371 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:30:14.780333    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:30:24.682366 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:30:24.682335    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:30:34.179670 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:30:34.179637    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:30:44.079971 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:30:44.079928    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:30:53.477711 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:30:53.477673    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:31:03.079986 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:31:03.079952    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:31:12.581064 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:31:12.581027    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:31:21.681348 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:31:21.681313    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:31:26.880126 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:31:26.880087    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:31:54.477606 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:31:54.477569    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:32:38.677408 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:32:38.677374    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:32:45.191451 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:32:45.191415    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:32:55.880969 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:32:55.880934    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:33:03.585666 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:33:03.585633    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:33:13.077156 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:33:13.077121    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:33:17.757764 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:33:17.757725    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:33:24.681524 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:33:24.681472    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:33:34.876980 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:33:34.876896    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:33:38.673352 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:33:38.673316    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:33:49.178200 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:33:49.178164    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:33:56.580081 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:33:56.580050    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:34:04.477344 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:34:04.477308    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:34:14.675391 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:34:14.675353    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:34:14.876717 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:34:14.876685    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:34:14.885092 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:34:14.885070    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:34:14.898692 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:34:14.898673    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:34:14.906289 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:34:14.906273    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:34:33.783917 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:34:33.783885    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:34:41.585677 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:34:41.585637    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:34:51.477717 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:34:51.477677    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:34:58.386580 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:34:58.386532    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:35:16.581325 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:35:16.581283    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:35:23.177422 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:35:23.177379    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:35:33.877111 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:35:33.877078    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:35:40.879620 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:35:40.879585    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:35:51.076549 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:35:51.076502    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:35:58.874024 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:35:58.873988    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:36:08.579357 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:36:08.579324    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:36:20.184426 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:36:20.184391    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:36:30.678811 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:36:30.678776    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:36:42.582126 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:36:42.582092    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:36:53.076297 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:36:53.076266    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:36:57.288797 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:36:57.288761    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:37:07.874662 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:37:07.874622    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:37:11.576207 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:37:11.576173    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:37:28.387702 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:37:28.387668    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:37:36.989253 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:37:36.989217    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:37:45.150437 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:37:45.150406    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:37:46.582602 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:37:46.582568    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:37:48.381019 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:37:48.380963    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:37:52.689059 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:37:52.689010    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:38:12.641641 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:12.641600    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:14.080034 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:14.079999    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:38:25.682637 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:25.682589    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:26.181507 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:26.181466    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:38:27.314384 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:27.314353    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:27.412839 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:27.412800    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:27.512272 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:27.512225    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:27.612197 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:27.612151    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:30.839704 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:30.839672    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:31.878176 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:31.878141    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vdgfx"]
Jun 10 23:38:33.547520 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:33.547487    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:33.738106 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:33.738072    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:33.873560 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:33.873529    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:35.709740 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:35.709711    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:39.755341 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:39.755304    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:39.855864 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:39.855811    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:39.951264 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:39.951218    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:40.010609 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:40.010535    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:40.122985 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:40.122950    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:40.221638 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:40.221602    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:43.248923 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:43.248892    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:46.191370 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:46.191331    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:47.334674 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:47.334638    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:47.432695 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:47.432656    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:50.592078 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:50.592039    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:53.057778 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:53.057738    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:38:53.118477 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:38:53.118443    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:39:04.969072 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:04.969012    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7f859cf96-bvc9d_5007770b-c41d-457b-a3c0-799ad6a66e52/nginx/0.log"
Jun 10 23:39:05.180241 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:05.180213    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-lbqs4_feb31a6b-1a08-49d9-ac04-78a11e22c0b4/manager/0.log"
Jun 10 23:39:05.300368 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:05.300295    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-rq48p_63869cd0-d0fd-4fea-9644-18e4eb131cc8/manager/0.log"
Jun 10 23:39:05.893727 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:05.893696    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-wjklt_f7496902-9d71-4be7-88d0-ad6d4014f461/server/0.log"
Jun 10 23:39:06.008251 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:06.008215    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-6st9w_167c52af-b701-423f-8338-fd0165a630e6/manager/0.log"
Jun 10 23:39:06.250404 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:06.250327    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bdf94bcbb-nk92n_b3e43859-98e8-4c7d-a46f-b5c5c799d591/copy-manifests/0.log"
Jun 10 23:39:06.257230 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:06.257207    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bdf94bcbb-nk92n_b3e43859-98e8-4c7d-a46f-b5c5c799d591/manager/0.log"
Jun 10 23:39:07.249110 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:07.249077    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46_ada58d1c-59c9-4233-ab80-21d29da835cb/util/0.log"
Jun 10 23:39:07.255909 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:07.255887    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46_ada58d1c-59c9-4233-ab80-21d29da835cb/pull/0.log"
Jun 10 23:39:07.262287 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:07.262267    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46_ada58d1c-59c9-4233-ab80-21d29da835cb/extract/0.log"
Jun 10 23:39:07.367542 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:07.367520    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b_bc829694-423d-4fcc-a216-71a0bc474503/util/0.log"
Jun 10 23:39:07.373545 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:07.373522    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b_bc829694-423d-4fcc-a216-71a0bc474503/pull/0.log"
Jun 10 23:39:07.379590 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:07.379562    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b_bc829694-423d-4fcc-a216-71a0bc474503/extract/0.log"
Jun 10 23:39:07.487445 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:07.487422    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q_39699aec-ba1f-411c-80cd-df4a308bf4d3/util/0.log"
Jun 10 23:39:07.493639 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:07.493618    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q_39699aec-ba1f-411c-80cd-df4a308bf4d3/pull/0.log"
Jun 10 23:39:07.499564 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:07.499504    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q_39699aec-ba1f-411c-80cd-df4a308bf4d3/extract/0.log"
Jun 10 23:39:07.603494 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:07.603472    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp_f86a8319-743b-4206-867a-fea58fc88c42/util/0.log"
Jun 10 23:39:07.609204 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:07.609183    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp_f86a8319-743b-4206-867a-fea58fc88c42/pull/0.log"
Jun 10 23:39:07.614629 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:07.614596    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp_f86a8319-743b-4206-867a-fea58fc88c42/extract/0.log"
Jun 10 23:39:08.446104 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:08.446072    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vdgfx_67606666-9ca8-4a82-b7e0-6af6bcd57f76/limitador/0.log"
Jun 10 23:39:08.564062 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:08.564034    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-r8jz5_7ea51e2f-e80a-4c48-9e57-8997892a3cb3/manager/0.log"
Jun 10 23:39:09.029306 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:09.029275    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-68gjk_463bcd00-d5dd-4b1c-bd25-53c8f88bebf7/discovery/0.log"
Jun 10 23:39:09.151260 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:09.151220    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b48b5dcd-kg8sb_f11bc405-f40e-4f93-8ec5-60fa8d5a5d21/kube-auth-proxy/0.log"
Jun 10 23:39:10.184830 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:10.184802    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-fr8wj_0d490384-7653-4a4e-a4be-c668fb53e0a3/storage-initializer/0.log"
Jun 10 23:39:10.192125 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:10.192100    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-fr8wj_0d490384-7653-4a4e-a4be-c668fb53e0a3/main/0.log"
Jun 10 23:39:10.302118 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:10.302095    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-n97xf_cb90148a-716d-41b9-bd2d-bcb18006865e/storage-initializer/0.log"
Jun 10 23:39:10.531239 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:10.531152    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-htwkp_3b41aa25-dda4-4c96-9098-f3b857c55354/storage-initializer/0.log"
Jun 10 23:39:10.538180 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:10.538148    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-htwkp_3b41aa25-dda4-4c96-9098-f3b857c55354/main/0.log"
Jun 10 23:39:13.828641 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:13.828607    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:39:14.921958 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:14.921817    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:39:14.931756 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:14.931650    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:39:14.945483 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:14.945460    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:39:14.954198 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:14.954182    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:39:14.957805 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:14.957762    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:39:15.057956 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:15.057927    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log" limit=1024
Jun 10 23:39:18.042796 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:18.042766    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wp785_da6cc932-e39a-4812-bb40-eaa50d9cffc3/global-pull-secret-syncer/0.log"
Jun 10 23:39:18.097433 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:18.097406    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7zpbf_79d6d16a-a58d-4ecc-822c-da7ef30808d3/konnectivity-agent/0.log"
Jun 10 23:39:18.185945 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:18.185922    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-238.ec2.internal_4905a97957f0b6e1e96afb558749aa2f/haproxy/0.log"
Jun 10 23:39:21.014602 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:21.014573    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-2fzmw_face1ba5-f940-4c68-9268-03dc97f66b34/sail-operator/0.log"
Jun 10 23:39:23.119640 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:23.119605    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46_ada58d1c-59c9-4233-ab80-21d29da835cb/extract/0.log"
Jun 10 23:39:23.141213 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:23.141194    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46_ada58d1c-59c9-4233-ab80-21d29da835cb/util/0.log"
Jun 10 23:39:23.161710 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:23.161683    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759v7m46_ada58d1c-59c9-4233-ab80-21d29da835cb/pull/0.log"
Jun 10 23:39:23.191509 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:23.191489    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b_bc829694-423d-4fcc-a216-71a0bc474503/extract/0.log"
Jun 10 23:39:23.213156 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:23.213131    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b_bc829694-423d-4fcc-a216-71a0bc474503/util/0.log"
Jun 10 23:39:23.236156 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:23.236137    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jgk5b_bc829694-423d-4fcc-a216-71a0bc474503/pull/0.log"
Jun 10 23:39:23.262814 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:23.262791    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q_39699aec-ba1f-411c-80cd-df4a308bf4d3/extract/0.log"
Jun 10 23:39:23.285032 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:23.285013    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q_39699aec-ba1f-411c-80cd-df4a308bf4d3/util/0.log"
Jun 10 23:39:23.308169 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:23.308145    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73q8n8q_39699aec-ba1f-411c-80cd-df4a308bf4d3/pull/0.log"
Jun 10 23:39:23.338996 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:23.338977    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp_f86a8319-743b-4206-867a-fea58fc88c42/extract/0.log"
Jun 10 23:39:23.362022 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:23.362004    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp_f86a8319-743b-4206-867a-fea58fc88c42/util/0.log"
Jun 10 23:39:23.382365 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:23.382311    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qfbjp_f86a8319-743b-4206-867a-fea58fc88c42/pull/0.log"
Jun 10 23:39:23.977341 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:23.977313    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vdgfx_67606666-9ca8-4a82-b7e0-6af6bcd57f76/limitador/0.log"
Jun 10 23:39:24.064283 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:24.064245    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-r8jz5_7ea51e2f-e80a-4c48-9e57-8997892a3cb3/manager/0.log"
Jun 10 23:39:25.567266 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:25.567235    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7b6d2a0-7c26-4216-aab0-4c3d63f301b0/alertmanager/0.log"
Jun 10 23:39:25.592417 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:25.592392    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7b6d2a0-7c26-4216-aab0-4c3d63f301b0/config-reloader/0.log"
Jun 10 23:39:25.614265 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:25.614245    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7b6d2a0-7c26-4216-aab0-4c3d63f301b0/kube-rbac-proxy-web/0.log"
Jun 10 23:39:25.635936 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:25.635917    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7b6d2a0-7c26-4216-aab0-4c3d63f301b0/kube-rbac-proxy/0.log"
Jun 10 23:39:25.656729 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:25.656708    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7b6d2a0-7c26-4216-aab0-4c3d63f301b0/kube-rbac-proxy-metric/0.log"
Jun 10 23:39:25.677349 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:25.677326    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7b6d2a0-7c26-4216-aab0-4c3d63f301b0/prom-label-proxy/0.log"
Jun 10 23:39:25.700797 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:25.700779    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7b6d2a0-7c26-4216-aab0-4c3d63f301b0/init-config-reloader/0.log"
Jun 10 23:39:25.893101 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:25.893082    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-gnzhk_1e1c48f1-d704-4bc6-9c4e-da6ac71dd5b8/monitoring-plugin/0.log"
Jun 10 23:39:26.084910 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:26.084878    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zp8hh_ee03dc6e-68a4-4ed0-9152-cca82c57bc12/node-exporter/0.log"
Jun 10 23:39:26.109922 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:26.109893    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zp8hh_ee03dc6e-68a4-4ed0-9152-cca82c57bc12/kube-rbac-proxy/0.log"
Jun 10 23:39:26.140805 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:26.140785    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zp8hh_ee03dc6e-68a4-4ed0-9152-cca82c57bc12/init-textfile/0.log"
Jun 10 23:39:26.616382 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:26.616361    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-556859b59d-qk7bx_9e0c3a35-b1a2-4332-be76-ea8a04b4b15f/thanos-query/0.log"
Jun 10 23:39:26.640093 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:26.640067    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-556859b59d-qk7bx_9e0c3a35-b1a2-4332-be76-ea8a04b4b15f/kube-rbac-proxy-web/0.log"
Jun 10 23:39:26.663611 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:26.663590    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-556859b59d-qk7bx_9e0c3a35-b1a2-4332-be76-ea8a04b4b15f/kube-rbac-proxy/0.log"
Jun 10 23:39:26.684303 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:26.684287    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-556859b59d-qk7bx_9e0c3a35-b1a2-4332-be76-ea8a04b4b15f/prom-label-proxy/0.log"
Jun 10 23:39:26.705457 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:26.705439    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-556859b59d-qk7bx_9e0c3a35-b1a2-4332-be76-ea8a04b4b15f/kube-rbac-proxy-rules/0.log"
Jun 10 23:39:26.728009 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:26.727985    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-556859b59d-qk7bx_9e0c3a35-b1a2-4332-be76-ea8a04b4b15f/kube-rbac-proxy-metrics/0.log"
Jun 10 23:39:28.617836 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:28.617807    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/2.log"
Jun 10 23:39:28.625782 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:28.625754    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5qb7f_9d6c4d0e-573d-4aae-811e-9c387a814d46/console-operator/3.log"
Jun 10 23:39:29.203561 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.203533    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-wz6nd_7282447e-15cb-4f68-af49-6ebfe35a3b25/download-server/0.log"
Jun 10 23:39:29.292540 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.292513    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"]
Jun 10 23:39:29.296253 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.296223    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.298258 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.298236    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7bj74\"/\"default-dockercfg-5xw9f\""
Jun 10 23:39:29.298362 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.298236    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7bj74\"/\"openshift-service-ca.crt\""
Jun 10 23:39:29.298715 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.298700    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7bj74\"/\"kube-root-ca.crt\""
Jun 10 23:39:29.303293 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.303270    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"]
Jun 10 23:39:29.485033 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.484952    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8474f99d-1e95-445d-8e7a-adc8b9d5addf-sys\") pod \"perf-node-gather-daemonset-7fksr\" (UID: \"8474f99d-1e95-445d-8e7a-adc8b9d5addf\") " pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.485033 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.485016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8474f99d-1e95-445d-8e7a-adc8b9d5addf-proc\") pod \"perf-node-gather-daemonset-7fksr\" (UID: \"8474f99d-1e95-445d-8e7a-adc8b9d5addf\") " pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.485209 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.485057    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8474f99d-1e95-445d-8e7a-adc8b9d5addf-lib-modules\") pod \"perf-node-gather-daemonset-7fksr\" (UID: \"8474f99d-1e95-445d-8e7a-adc8b9d5addf\") " pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.485209 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.485080    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8474f99d-1e95-445d-8e7a-adc8b9d5addf-podres\") pod \"perf-node-gather-daemonset-7fksr\" (UID: \"8474f99d-1e95-445d-8e7a-adc8b9d5addf\") " pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.485209 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.485140    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wj74\" (UniqueName: \"kubernetes.io/projected/8474f99d-1e95-445d-8e7a-adc8b9d5addf-kube-api-access-4wj74\") pod \"perf-node-gather-daemonset-7fksr\" (UID: \"8474f99d-1e95-445d-8e7a-adc8b9d5addf\") " pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.586175 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.586145    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wj74\" (UniqueName: \"kubernetes.io/projected/8474f99d-1e95-445d-8e7a-adc8b9d5addf-kube-api-access-4wj74\") pod \"perf-node-gather-daemonset-7fksr\" (UID: \"8474f99d-1e95-445d-8e7a-adc8b9d5addf\") " pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.586354 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.586198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8474f99d-1e95-445d-8e7a-adc8b9d5addf-sys\") pod \"perf-node-gather-daemonset-7fksr\" (UID: \"8474f99d-1e95-445d-8e7a-adc8b9d5addf\") " pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.586354 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.586266    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8474f99d-1e95-445d-8e7a-adc8b9d5addf-proc\") pod \"perf-node-gather-daemonset-7fksr\" (UID: \"8474f99d-1e95-445d-8e7a-adc8b9d5addf\") " pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.586354 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.586283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8474f99d-1e95-445d-8e7a-adc8b9d5addf-lib-modules\") pod \"perf-node-gather-daemonset-7fksr\" (UID: \"8474f99d-1e95-445d-8e7a-adc8b9d5addf\") " pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.586354 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.586299    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8474f99d-1e95-445d-8e7a-adc8b9d5addf-podres\") pod \"perf-node-gather-daemonset-7fksr\" (UID: \"8474f99d-1e95-445d-8e7a-adc8b9d5addf\") " pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.586354 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.586338    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8474f99d-1e95-445d-8e7a-adc8b9d5addf-sys\") pod \"perf-node-gather-daemonset-7fksr\" (UID: \"8474f99d-1e95-445d-8e7a-adc8b9d5addf\") " pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.586354 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.586347    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8474f99d-1e95-445d-8e7a-adc8b9d5addf-proc\") pod \"perf-node-gather-daemonset-7fksr\" (UID: \"8474f99d-1e95-445d-8e7a-adc8b9d5addf\") " pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.586588 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.586412    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8474f99d-1e95-445d-8e7a-adc8b9d5addf-podres\") pod \"perf-node-gather-daemonset-7fksr\" (UID: \"8474f99d-1e95-445d-8e7a-adc8b9d5addf\") " pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.586588 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.586412    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8474f99d-1e95-445d-8e7a-adc8b9d5addf-lib-modules\") pod \"perf-node-gather-daemonset-7fksr\" (UID: \"8474f99d-1e95-445d-8e7a-adc8b9d5addf\") " pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.593247 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.593229    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wj74\" (UniqueName: \"kubernetes.io/projected/8474f99d-1e95-445d-8e7a-adc8b9d5addf-kube-api-access-4wj74\") pod \"perf-node-gather-daemonset-7fksr\" (UID: \"8474f99d-1e95-445d-8e7a-adc8b9d5addf\") " pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.607395 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.607372    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:29.738394 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.738363    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"]
Jun 10 23:39:29.739632 ip-10-0-129-238 kubenswrapper[2577]: W0610 23:39:29.739600    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8474f99d_1e95_445d_8e7a_adc8b9d5addf.slice/crio-a68ad5a81f226c3121f6e273b4150cd106d38408a6b0172bf232541ca1bd21ff WatchSource:0}: Error finding container a68ad5a81f226c3121f6e273b4150cd106d38408a6b0172bf232541ca1bd21ff: Status 404 returned error can't find the container with id a68ad5a81f226c3121f6e273b4150cd106d38408a6b0172bf232541ca1bd21ff
Jun 10 23:39:29.924540 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:29.924512    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-t4456_07475e5a-8bce-440d-8eed-aac7af4f3ff6/volume-data-source-validator/0.log"
Jun 10 23:39:30.498345 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:30.498310    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr" event={"ID":"8474f99d-1e95-445d-8e7a-adc8b9d5addf","Type":"ContainerStarted","Data":"286fdbe7027deb2dea3e2e9d2c47b6079fab18a08176672594d7c667eef000ab"}
Jun 10 23:39:30.498542 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:30.498370    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr" event={"ID":"8474f99d-1e95-445d-8e7a-adc8b9d5addf","Type":"ContainerStarted","Data":"a68ad5a81f226c3121f6e273b4150cd106d38408a6b0172bf232541ca1bd21ff"}
Jun 10 23:39:30.498542 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:30.498476    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:30.511828 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:30.511785    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr" podStartSLOduration=1.511772321 podStartE2EDuration="1.511772321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 23:39:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 23:39:30.51101878 +0000 UTC m=+2416.668642941" watchObservedRunningTime="2026-06-10 23:39:30.511772321 +0000 UTC m=+2416.669396479"
Jun 10 23:39:31.136490 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:31.136415    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m8jw6_175518a2-4b83-4a85-97f8-422c8a203700/dns/0.log"
Jun 10 23:39:31.156339 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:31.156313    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m8jw6_175518a2-4b83-4a85-97f8-422c8a203700/kube-rbac-proxy/0.log"
Jun 10 23:39:31.224907 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:31.224884    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pm4l7_fe618dc0-9887-4d65-b68a-afdb1ce1365e/dns-node-resolver/0.log"
Jun 10 23:39:31.737896 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:31.737862    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59c5f755bc-5khnm_6ad9d9ec-6bef-43e4-9e87-6eb0304bb630/registry/0.log"
Jun 10 23:39:31.753129 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:31.753099    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59c5f755bc-5khnm_6ad9d9ec-6bef-43e4-9e87-6eb0304bb630/registry/1.log"
Jun 10 23:39:31.798475 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:31.798450    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-klpjf_2fad7168-329e-4592-b5cb-8ff587c89170/node-ca/0.log"
Jun 10 23:39:32.800434 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:32.800403    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-68gjk_463bcd00-d5dd-4b1c-bd25-53c8f88bebf7/discovery/0.log"
Jun 10 23:39:32.819802 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:32.819743    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b48b5dcd-kg8sb_f11bc405-f40e-4f93-8ec5-60fa8d5a5d21/kube-auth-proxy/0.log"
Jun 10 23:39:33.720110 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:33.720077    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vddps_3dafdac3-c9a8-4928-99dd-92a008b6bc5f/serve-healthcheck-canary/0.log"
Jun 10 23:39:34.245292 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:34.245267    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b55f2_b1d9880b-799c-4a75-8008-ed61945402cd/kube-rbac-proxy/0.log"
Jun 10 23:39:34.271127 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:34.271103    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b55f2_b1d9880b-799c-4a75-8008-ed61945402cd/exporter/0.log"
Jun 10 23:39:34.291588 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:34.291569    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b55f2_b1d9880b-799c-4a75-8008-ed61945402cd/extractor/0.log"
Jun 10 23:39:36.503462 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:36.503433    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7f859cf96-bvc9d_5007770b-c41d-457b-a3c0-799ad6a66e52/nginx/0.log"
Jun 10 23:39:36.514726 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:36.514703    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7bj74/perf-node-gather-daemonset-7fksr"
Jun 10 23:39:36.556706 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:36.556680    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-lbqs4_feb31a6b-1a08-49d9-ac04-78a11e22c0b4/manager/0.log"
Jun 10 23:39:36.684840 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:36.684811    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-rq48p_63869cd0-d0fd-4fea-9644-18e4eb131cc8/manager/0.log"
Jun 10 23:39:36.914543 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:36.914521    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-wjklt_f7496902-9d71-4be7-88d0-ad6d4014f461/server/0.log"
Jun 10 23:39:36.986205 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:36.986175    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-6st9w_167c52af-b701-423f-8338-fd0165a630e6/manager/0.log"
Jun 10 23:39:37.148290 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:37.148261    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bdf94bcbb-nk92n_b3e43859-98e8-4c7d-a46f-b5c5c799d591/manager/0.log"
Jun 10 23:39:37.167610 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:37.167543    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bdf94bcbb-nk92n_b3e43859-98e8-4c7d-a46f-b5c5c799d591/copy-manifests/0.log"
Jun 10 23:39:43.043184 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:43.043147    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-68gjk_463bcd00-d5dd-4b1c-bd25-53c8f88bebf7/discovery/0.log"
Jun 10 23:39:43.054974 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:43.054949    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b48b5dcd-kg8sb_f11bc405-f40e-4f93-8ec5-60fa8d5a5d21/kube-auth-proxy/0.log"
Jun 10 23:39:44.031224 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:44.031172    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-84xww_1825ab36-4f9b-41e9-a177-092d5ee68655/migrator/0.log"
Jun 10 23:39:44.051584 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:44.051562    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-84xww_1825ab36-4f9b-41e9-a177-092d5ee68655/graceful-termination/0.log"
Jun 10 23:39:44.464246 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:44.464215    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-gdxgf_ee19c560-59e2-4020-a607-914123d4d186/kube-storage-version-migrator-operator/1.log"
Jun 10 23:39:44.466708 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:44.466681    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-gdxgf_ee19c560-59e2-4020-a607-914123d4d186/kube-storage-version-migrator-operator/0.log"
Jun 10 23:39:44.478087 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:44.478064    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-68gjk_463bcd00-d5dd-4b1c-bd25-53c8f88bebf7/discovery/0.log"
Jun 10 23:39:44.489447 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:44.489426    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b48b5dcd-kg8sb_f11bc405-f40e-4f93-8ec5-60fa8d5a5d21/kube-auth-proxy/0.log"
Jun 10 23:39:45.666570 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:45.666542    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2hrj6_49dd3977-df64-419b-b61b-160c02078017/kube-multus/0.log"
Jun 10 23:39:45.966402 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:45.966323    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8ddnh_8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd/kube-multus-additional-cni-plugins/0.log"
Jun 10 23:39:45.987671 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:45.987652    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8ddnh_8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd/egress-router-binary-copy/0.log"
Jun 10 23:39:46.009770 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:46.009724    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8ddnh_8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd/cni-plugins/0.log"
Jun 10 23:39:46.030788 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:46.030762    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8ddnh_8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd/bond-cni-plugin/0.log"
Jun 10 23:39:46.052446 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:46.052425    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8ddnh_8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd/routeoverride-cni/0.log"
Jun 10 23:39:46.073583 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:46.073565    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8ddnh_8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd/whereabouts-cni-bincopy/0.log"
Jun 10 23:39:46.095887 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:46.095865    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8ddnh_8fa3aad2-0571-4ab9-b5cf-8f5cd68172bd/whereabouts-cni/0.log"
Jun 10 23:39:46.363797 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:46.363769    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fjp6x_4425be81-8f51-4c34-8d00-7a454584e0bf/network-metrics-daemon/0.log"
Jun 10 23:39:46.380732 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:46.380712    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fjp6x_4425be81-8f51-4c34-8d00-7a454584e0bf/kube-rbac-proxy/0.log"
Jun 10 23:39:46.461678 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:46.461649    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-68gjk_463bcd00-d5dd-4b1c-bd25-53c8f88bebf7/discovery/0.log"
Jun 10 23:39:46.473306 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:46.473285    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b48b5dcd-kg8sb_f11bc405-f40e-4f93-8ec5-60fa8d5a5d21/kube-auth-proxy/0.log"
Jun 10 23:39:47.356948 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:47.356918    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-controller/0.log"
Jun 10 23:39:47.373911 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:47.373884    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/1.log"
Jun 10 23:39:47.374099 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:47.373912    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovn-acl-logging/0.log"
Jun 10 23:39:47.399429 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:47.399407    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/kube-rbac-proxy-node/0.log"
Jun 10 23:39:47.423432 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:47.423411    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/kube-rbac-proxy-ovn-metrics/0.log"
Jun 10 23:39:47.439414 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:47.439396    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/northd/0.log"
Jun 10 23:39:47.460321 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:47.460302    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/nbdb/0.log"
Jun 10 23:39:47.482060 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:47.482042    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/sbdb/0.log"
Jun 10 23:39:47.550243 ip-10-0-129-238 kubenswrapper[2577]: I0610 23:39:47.550215    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kknpk_5ab10782-c80c-4c40-8534-2e087ac816f0/ovnkube-controller/0.log"