May 28 19:43:15.256361 ip-10-0-138-85 systemd[1]: Starting Kubernetes Kubelet...
May 28 19:43:15.756473 ip-10-0-138-85 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 19:43:15.756473 ip-10-0-138-85 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 19:43:15.756473 ip-10-0-138-85 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 19:43:15.756473 ip-10-0-138-85 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 19:43:15.756473 ip-10-0-138-85 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 19:43:15.758254 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.758171    2564 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 19:43:15.761415 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761396    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 19:43:15.761415 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761412    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 19:43:15.761415 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761418    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761423    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761427    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761432    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761436    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761442    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761448    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761453    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761457    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761461    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761466    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761470    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761473    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761477    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761480    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761484    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761488    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761492    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761496    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761500    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 19:43:15.761610 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761504    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761508    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761513    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761517    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761521    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761525    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761529    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761533    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761538    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761542    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761547    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761551    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761555    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761561    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761566    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761570    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761577    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761581    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761585    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761590    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 19:43:15.762443 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761594    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761598    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761602    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761606    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761610    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761614    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761618    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761621    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761625    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761632    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761638    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761643    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761649    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761653    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761658    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761662    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761667    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761672    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761676    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 19:43:15.763152 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761680    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761685    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761689    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761693    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761697    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761701    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761706    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761711    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761715    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761719    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761723    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761728    2564 feature_gate.go:328] unrecognized feature gate: Example
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761732    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761737    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761741    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761745    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761749    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761753    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761757    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761763    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 19:43:15.763622 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761767    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761772    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761776    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761780    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.761784    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762380    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762389    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762394    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762399    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762403    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762408    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762413    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762417    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762421    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762426    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762430    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762434    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762438    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 19:43:15.764486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762442    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762446    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762450    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762454    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762458    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762462    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762466    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762471    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762476    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762480    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762485    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762489    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762493    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762500    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762505    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762510    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762515    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762520    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762524    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762529    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 19:43:15.765176 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762533    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762538    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762542    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762546    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762550    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762555    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762560    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762564    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762568    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762572    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762576    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762580    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762584    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762589    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762593    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762598    2564 feature_gate.go:328] unrecognized feature gate: Example
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762602    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762608    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762612    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762616    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 19:43:15.765690 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762620    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762625    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762629    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762633    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762637    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762641    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762646    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762650    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762654    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762658    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762662    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762666    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762671    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762676    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762680    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762684    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762697    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762702    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762707    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762711    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 19:43:15.766272 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762715    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762721    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762725    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762730    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762733    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762738    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762742    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762746    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762751    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762755    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762759    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762763    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.762766    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763606    2564 flags.go:64] FLAG: --address="0.0.0.0"
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763626    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763637    2564 flags.go:64] FLAG: --anonymous-auth="true"
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763643    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763650    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763655    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763663    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763669    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763674    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 19:43:15.766783 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763679    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763686    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763691    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763697    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763702    2564 flags.go:64] FLAG: --cgroup-root=""
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763706    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763712    2564 flags.go:64] FLAG: --client-ca-file=""
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763716    2564 flags.go:64] FLAG: --cloud-config=""
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763721    2564 flags.go:64] FLAG: --cloud-provider="external"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763727    2564 flags.go:64] FLAG: --cluster-dns="[]"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763733    2564 flags.go:64] FLAG: --cluster-domain=""
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763738    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763744    2564 flags.go:64] FLAG: --config-dir=""
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763748    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763754    2564 flags.go:64] FLAG: --container-log-max-files="5"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763760    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763765    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763771    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763777    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763782    2564 flags.go:64] FLAG: --contention-profiling="false"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763787    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763792    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763797    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763802    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763808    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 19:43:15.767518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763813    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763818    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763823    2564 flags.go:64] FLAG: --enable-load-reader="false"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763828    2564 flags.go:64] FLAG: --enable-server="true"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763833    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763842    2564 flags.go:64] FLAG: --event-burst="100"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763846    2564 flags.go:64] FLAG: --event-qps="50"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763851    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763857    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763862    2564 flags.go:64] FLAG: --eviction-hard=""
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763868    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763873    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763878    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763883    2564 flags.go:64] FLAG: --eviction-soft=""
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763888    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763893    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763898    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763904    2564 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763908    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763913    2564 flags.go:64] FLAG: --fail-swap-on="true"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763918    2564 flags.go:64] FLAG: --feature-gates=""
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763924    2564 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763934    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763940    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763945    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763950    2564 flags.go:64] FLAG: --healthz-port="10248"
May 28 19:43:15.768768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763955    2564 flags.go:64] FLAG: --help="false"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763960    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-138-85.ec2.internal"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763966    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763971    2564 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763976    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763982    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763988    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763993    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.763998    2564 flags.go:64] FLAG: --image-service-endpoint=""
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764003    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764008    2564 flags.go:64] FLAG: --kube-api-burst="100"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764012    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764017    2564 flags.go:64] FLAG: --kube-api-qps="50"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764022    2564 flags.go:64] FLAG: --kube-reserved=""
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764027    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764032    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764037    2564 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764042    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764047    2564 flags.go:64] FLAG: --lock-file=""
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764052    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764057    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764062    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764071    2564 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 19:43:15.769409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764076    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764081    2564 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764086    2564 flags.go:64] FLAG: --logging-format="text"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764105    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764112    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764118    2564 flags.go:64] FLAG: --manifest-url=""
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764123    2564 flags.go:64] FLAG: --manifest-url-header=""
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764130    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764135    2564 flags.go:64] FLAG: --max-open-files="1000000"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764142    2564 flags.go:64] FLAG: --max-pods="110"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764147    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764152    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764157    2564 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764161    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764166    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764171    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764176    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764187    2564 flags.go:64] FLAG: --node-status-max-images="50"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764192    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764197    2564 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764202    2564 flags.go:64] FLAG: --pod-cidr=""
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764207    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764216    2564 flags.go:64] FLAG: --pod-manifest-path=""
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764221    2564 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 19:43:15.769956 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764227    2564 flags.go:64] FLAG: --pods-per-core="0"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764232    2564 flags.go:64] FLAG: --port="10250"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764237    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764242    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-096e798a9165125c8"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764247    2564 flags.go:64] FLAG: --qos-reserved=""
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764252    2564 flags.go:64] FLAG: --read-only-port="10255"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764257    2564 flags.go:64] FLAG: --register-node="true"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764262    2564 flags.go:64] FLAG: --register-schedulable="true"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764267    2564 flags.go:64] FLAG: --register-with-taints=""
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764273    2564 flags.go:64] FLAG: --registry-burst="10"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764279    2564 flags.go:64] FLAG: --registry-qps="5"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764283    2564 flags.go:64] FLAG: --reserved-cpus=""
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764288    2564 flags.go:64] FLAG: --reserved-memory=""
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764295    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764301    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764306    2564 flags.go:64] FLAG: --rotate-certificates="false"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764311    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764316    2564 flags.go:64] FLAG: --runonce="false"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764321    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764326    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764331    2564 flags.go:64] FLAG: --seccomp-default="false"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764336    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764341    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764346    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764351    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764356    2564 flags.go:64] FLAG: --storage-driver-password="root"
May 28 19:43:15.770549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764360    2564 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764365    2564 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764370    2564 flags.go:64] FLAG: --storage-driver-user="root"
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764375    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764380    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764385    2564 flags.go:64] FLAG: --system-cgroups=""
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764391    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764400    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764404    2564 flags.go:64] FLAG: --tls-cert-file=""
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764409    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764415    2564 flags.go:64] FLAG: --tls-min-version=""
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764420    2564 flags.go:64] FLAG: --tls-private-key-file=""
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764425    2564 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764430    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764435    2564 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764440    2564 flags.go:64] FLAG: --v="2"
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764446    2564 flags.go:64] FLAG: --version="false"
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764453    2564 flags.go:64] FLAG: --vmodule=""
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764461    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.764466    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764612    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764619    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764623    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764628    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 19:43:15.771315 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764633    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764637    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764642    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764647    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764651    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764656    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764660    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764664    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764668    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764672    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764676    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764681    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764685    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764689    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764699    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764703    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764707    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764710    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764715    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764720    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 19:43:15.771938 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764724    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764728    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764732    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764736    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764740    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764745    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764749    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764754    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764759    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764764    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764768    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764772    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764776    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764780    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764785    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764789    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764793    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764798    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764802    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 19:43:15.772619 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764806    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764810    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764814    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764818    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764823    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764827    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764831    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764837    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764841    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764845    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764851    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764856    2564 feature_gate.go:328] unrecognized feature gate: Example
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764862    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764866    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764870    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764874    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764878    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764882    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764886    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764890    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 19:43:15.773299 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764895    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764901    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764907    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764913    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764917    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764921    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764926    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764930    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764934    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764938    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764942    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764946    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764950    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764955    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764959    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764963    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764967    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764971    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764976    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 19:43:15.773791 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764981    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 19:43:15.774274 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764986    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 19:43:15.774274 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764990    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 19:43:15.774274 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.764994    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 19:43:15.774274 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.765900    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 19:43:15.774274 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.773518    2564 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 19:43:15.774274 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.773533    2564 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 19:43:15.774274 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773580    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 19:43:15.774274 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773585    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 19:43:15.774274 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773588    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 19:43:15.774274 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773591    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 19:43:15.774274 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773595    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 28 19:43:15.774274 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773599    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 19:43:15.774274 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773603    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 19:43:15.774274 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773607    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 19:43:15.774274 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773610    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 19:43:15.774274 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773613    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773615    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773618    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773620    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773623    2564 feature_gate.go:328] unrecognized feature gate: Example
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773626    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773629    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773631    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773634    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773637    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773639    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773642    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773644    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773647    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773650    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773652    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773655    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773657    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773662    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 19:43:15.774675 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773666    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773670    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773673    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773677    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773679    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773683    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773685    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773688    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773691    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773693    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773696    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773698    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773701    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773703    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773706    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773709    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773711    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773714    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773716    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773719    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 19:43:15.775151 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773722    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773725    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773727    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773730    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773732    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773735    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773737    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773740    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773742    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773745    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773747    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773750    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773753    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773755    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773758    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773761    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773764    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773766    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773769    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773771    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 19:43:15.775665 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773774    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773776    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773779    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773781    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773784    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773786    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773789    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773791    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773795    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773797    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773800    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773803    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773805    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773808    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773810    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773813    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773815    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 19:43:15.776165 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773818    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 19:43:15.776586 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.773823    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 19:43:15.776586 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773916    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 19:43:15.776586 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773921    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 19:43:15.776586 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773925    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 19:43:15.776586 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773928    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 19:43:15.776586 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773931    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 19:43:15.776586 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773934    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 19:43:15.776586 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773936    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 19:43:15.776586 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773939    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 19:43:15.776586 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773942    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 19:43:15.776586 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773945    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 19:43:15.776586 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773947    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 19:43:15.776586 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773951    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 19:43:15.776586 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773954    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 19:43:15.776586 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773957    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773960    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773962    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773965    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773967    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773970    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773972    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773975    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773977    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773981    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773983    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773986    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773988    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773991    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773993    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773996    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.773999    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774001    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774004    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774006    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 19:43:15.776943 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774009    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774011    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774014    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774017    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774019    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774021    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774024    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774027    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774029    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774032    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774035    2564 feature_gate.go:328] unrecognized feature gate: Example
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774037    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774040    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774042    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774045    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774047    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774050    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774052    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774055    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774057    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 19:43:15.777437 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774059    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774062    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774066    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774068    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774070    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774073    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774075    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774078    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774080    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774083    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774085    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774088    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774103    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774106    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774108    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774111    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774114    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774116    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774119    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774122    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 19:43:15.777913 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774124    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 19:43:15.778409 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774127    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 19:43:15.778409 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774129    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 19:43:15.778409 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774132    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 19:43:15.778409 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774134    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 19:43:15.778409 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774137    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 19:43:15.778409 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774139    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 19:43:15.778409 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774141    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 19:43:15.778409 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774146    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 19:43:15.778409 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774149    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 19:43:15.778409 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774152    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 19:43:15.778409 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774155    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 19:43:15.778409 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:15.774158    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 19:43:15.778409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.774162    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 19:43:15.778409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.775046    2564 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 19:43:15.781076 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.781061    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 19:43:15.782150 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.782139    2564 server.go:1019] "Starting client certificate rotation"
May 28 19:43:15.782256 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.782240    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 19:43:15.782307 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.782278    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 19:43:15.809046 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.809027    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 19:43:15.810843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.810824    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 19:43:15.829527 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.829508    2564 log.go:25] "Validated CRI v1 runtime API"
May 28 19:43:15.836749 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.836736    2564 log.go:25] "Validated CRI v1 image API"
May 28 19:43:15.840305 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.840290    2564 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 19:43:15.842404 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.842390    2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 19:43:15.846639 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.846611    2564 fs.go:135] Filesystem UUIDs: map[487f3251-467a-49b8-a09a-a2653592a36d:/dev/nvme0n1p3 5f0cea79-cdc7-4923-a781-393a3c324e28:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
May 28 19:43:15.846726 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.846636    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 19:43:15.851870 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.851763    2564 manager.go:217] Machine: {Timestamp:2026-05-28 19:43:15.851290277 +0000 UTC m=+0.462014928 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097040 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b2a6b4f67c5ad37436326073a01e0 SystemUUID:ec2b2a6b-4f67-c5ad-3743-6326073a01e0 BootID:0aab1a0e-8932-46d6-9c63-23041a94a932 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b3:c8:40:62:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b3:c8:40:62:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:a1:ea:f2:e7:49 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 19:43:15.851870 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.851862    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 19:43:15.852029 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.851953    2564 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 19:43:15.854197 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.854167    2564 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 19:43:15.854322 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.854198    2564 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-85.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 19:43:15.854374 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.854331    2564 topology_manager.go:138] "Creating topology manager with none policy"
May 28 19:43:15.854374 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.854339    2564 container_manager_linux.go:306] "Creating device plugin manager"
May 28 19:43:15.854374 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.854346    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 19:43:15.854374 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.854362    2564 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 19:43:15.857310 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.857298    2564 state_mem.go:36] "Initialized new in-memory state store"
May 28 19:43:15.857416 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.857407    2564 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 19:43:15.857866 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.857850    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jvfbs"
May 28 19:43:15.860529 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.860518    2564 kubelet.go:491] "Attempting to sync node with API server"
May 28 19:43:15.860577 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.860538    2564 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 19:43:15.861479 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.861469    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 19:43:15.861516 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.861482    2564 kubelet.go:397] "Adding apiserver pod source"
May 28 19:43:15.861516 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.861492    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 19:43:15.863636 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.863622    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 19:43:15.863690 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.863640    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 19:43:15.865749 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.865734    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jvfbs"
May 28 19:43:15.867339 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.867322    2564 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 19:43:15.870179 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.870165    2564 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 19:43:15.871164 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.871152    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 19:43:15.871200 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.871169    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 19:43:15.871200 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.871176    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 19:43:15.871200 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.871181    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 19:43:15.871200 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.871188    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 19:43:15.871200 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.871194    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 19:43:15.871200 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.871200    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 19:43:15.871353 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.871205    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 19:43:15.871353 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.871213    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 19:43:15.871353 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.871219    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 19:43:15.871353 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.871227    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 19:43:15.871969 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.871956    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 19:43:15.873068 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.873058    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 19:43:15.873948 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.873069    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 19:43:15.873948 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.873774    2564 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 19:43:15.874461 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.874446    2564 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 19:43:15.875951 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.875937    2564 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 19:43:15.876003 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.875973    2564 server.go:1295] "Started kubelet"
May 28 19:43:15.876106 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.876070    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 19:43:15.876226 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.876059    2564 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 19:43:15.876281 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.876246    2564 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 19:43:15.876760 ip-10-0-138-85 systemd[1]: Started Kubernetes Kubelet.
May 28 19:43:15.878804 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.878787    2564 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 19:43:15.879054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.879031    2564 server.go:317] "Adding debug handlers to kubelet server"
May 28 19:43:15.881306 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.881289    2564 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-85.ec2.internal" not found
May 28 19:43:15.889573 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.889554    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 19:43:15.889948 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.889597    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 19:43:15.890111 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.890078    2564 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 19:43:15.890189 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.890181    2564 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 19:43:15.890353 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.890343    2564 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 19:43:15.890461 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.890453    2564 reconstruct.go:97] "Volume reconstruction finished"
May 28 19:43:15.890523 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.890516    2564 reconciler.go:26] "Reconciler: start to sync state"
May 28 19:43:15.892007 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:15.891818    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-85.ec2.internal\" not found"
May 28 19:43:15.892007 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:15.891987    2564 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 19:43:15.892164 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.892082    2564 factory.go:55] Registering systemd factory
May 28 19:43:15.892164 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.892115    2564 factory.go:223] Registration of the systemd container factory successfully
May 28 19:43:15.892348 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.892331    2564 factory.go:153] Registering CRI-O factory
May 28 19:43:15.892417 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.892350    2564 factory.go:223] Registration of the crio container factory successfully
May 28 19:43:15.892417 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.892395    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 19:43:15.892417 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.892412    2564 factory.go:103] Registering Raw factory
May 28 19:43:15.892518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.892428    2564 manager.go:1196] Started watching for new ooms in manager
May 28 19:43:15.893727 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.893707    2564 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 19:43:15.893875 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.893859    2564 manager.go:319] Starting recovery of all containers
May 28 19:43:15.895458 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:15.895441    2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-85.ec2.internal\" not found" node="ip-10-0-138-85.ec2.internal"
May 28 19:43:15.896137 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.896123    2564 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-85.ec2.internal" not found
May 28 19:43:15.898033 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.898009    2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 19:43:15.903246 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.903114    2564 manager.go:324] Recovery completed
May 28 19:43:15.907442 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.907430    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 19:43:15.909034 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.909013    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-85.ec2.internal" event="NodeHasSufficientMemory"
May 28 19:43:15.909107 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.909048    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-85.ec2.internal" event="NodeHasNoDiskPressure"
May 28 19:43:15.909107 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.909062    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-85.ec2.internal" event="NodeHasSufficientPID"
May 28 19:43:15.909492 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.909477    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 19:43:15.909492 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.909491    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 19:43:15.909588 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.909506    2564 state_mem.go:36] "Initialized new in-memory state store"
May 28 19:43:15.913524 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.913509    2564 policy_none.go:49] "None policy: Start"
May 28 19:43:15.913591 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.913529    2564 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 19:43:15.913591 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.913540    2564 state_mem.go:35] "Initializing new in-memory state store"
May 28 19:43:15.950678 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.950665    2564 manager.go:341] "Starting Device Plugin manager"
May 28 19:43:15.970484 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:15.950704    2564 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 19:43:15.970484 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.950714    2564 server.go:85] "Starting device plugin registration server"
May 28 19:43:15.970484 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.950895    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 19:43:15.970484 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.950907    2564 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 19:43:15.970484 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.951061    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 19:43:15.970484 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.951181    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 19:43:15.970484 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.951191    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 19:43:15.970484 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:15.951741    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 19:43:15.970484 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:15.951780    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-85.ec2.internal\" not found"
May 28 19:43:15.970484 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.955385    2564 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-85.ec2.internal" not found
May 28 19:43:15.994977 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.994956    2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 19:43:15.994977 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.994977    2564 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 19:43:15.995111 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.994991    2564 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 19:43:15.995111 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.995004    2564 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 19:43:15.995111 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:15.995036    2564 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 19:43:15.997741 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:15.997720    2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 19:43:16.051471 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.051429    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 19:43:16.052539 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.052525    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-85.ec2.internal" event="NodeHasSufficientMemory"
May 28 19:43:16.052592 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.052552    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-85.ec2.internal" event="NodeHasNoDiskPressure"
May 28 19:43:16.052592 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.052562    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-85.ec2.internal" event="NodeHasSufficientPID"
May 28 19:43:16.052592 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.052584    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-85.ec2.internal"
May 28 19:43:16.061636 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.061616    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-85.ec2.internal"
May 28 19:43:16.095584 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.095538    2564 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-85.ec2.internal"]
May 28 19:43:16.097925 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.097908    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal"
May 28 19:43:16.098013 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.097909    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.ec2.internal"
May 28 19:43:16.114574 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.114556    2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal"
May 28 19:43:16.118408 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.118391    2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.ec2.internal"
May 28 19:43:16.127448 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.127434    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 19:43:16.130244 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.130231    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 19:43:16.191808 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.191783    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/baeefc9190e426e2957710d584028c12-config\") pod \"kube-apiserver-proxy-ip-10-0-138-85.ec2.internal\" (UID: \"baeefc9190e426e2957710d584028c12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.ec2.internal"
May 28 19:43:16.292236 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.292214    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/baeefc9190e426e2957710d584028c12-config\") pod \"kube-apiserver-proxy-ip-10-0-138-85.ec2.internal\" (UID: \"baeefc9190e426e2957710d584028c12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.ec2.internal"
May 28 19:43:16.292317 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.292248    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/baeefc9190e426e2957710d584028c12-config\") pod \"kube-apiserver-proxy-ip-10-0-138-85.ec2.internal\" (UID: \"baeefc9190e426e2957710d584028c12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.ec2.internal"
May 28 19:43:16.292317 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.292284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2f07959bbc8e1863f8f61f4e16ca9cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal\" (UID: \"b2f07959bbc8e1863f8f61f4e16ca9cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal"
May 28 19:43:16.292317 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.292302    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2f07959bbc8e1863f8f61f4e16ca9cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal\" (UID: \"b2f07959bbc8e1863f8f61f4e16ca9cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal"
May 28 19:43:16.393040 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.392993    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2f07959bbc8e1863f8f61f4e16ca9cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal\" (UID: \"b2f07959bbc8e1863f8f61f4e16ca9cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal"
May 28 19:43:16.393040 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.393011    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2f07959bbc8e1863f8f61f4e16ca9cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal\" (UID: \"b2f07959bbc8e1863f8f61f4e16ca9cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal"
May 28 19:43:16.393040 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.393027    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2f07959bbc8e1863f8f61f4e16ca9cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal\" (UID: \"b2f07959bbc8e1863f8f61f4e16ca9cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal"
May 28 19:43:16.393194 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.393048    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b2f07959bbc8e1863f8f61f4e16ca9cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal\" (UID: \"b2f07959bbc8e1863f8f61f4e16ca9cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal"
May 28 19:43:16.431160 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.431137    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal"
May 28 19:43:16.433683 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.433668    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.ec2.internal"
May 28 19:43:16.781688 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.781662    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 19:43:16.782259 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.781815    2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 19:43:16.782259 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.781821    2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 19:43:16.782259 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.781836    2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 19:43:16.862119 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.862077    2564 apiserver.go:52] "Watching apiserver"
May 28 19:43:16.868258 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.868216    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 19:38:15 +0000 UTC" deadline="2027-11-13 17:34:31.628664451 +0000 UTC"
May 28 19:43:16.868258 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.868257    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12813h51m14.760411968s"
May 28 19:43:16.871518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.871495    2564 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 19:43:16.873356 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.873337    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-g8kcf","kube-system/kube-apiserver-proxy-ip-10-0-138-85.ec2.internal","openshift-dns/node-resolver-vwv8g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal","openshift-multus/multus-additional-cni-plugins-z2rbf","openshift-multus/network-metrics-daemon-8nltt","openshift-network-diagnostics/network-check-target-96qfr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld","openshift-cluster-node-tuning-operator/tuned-xsnq7","openshift-image-registry/node-ca-65m5l","openshift-multus/multus-br7kt","openshift-network-operator/iptables-alerter-dnn6h","openshift-ovn-kubernetes/ovnkube-node-9hmkh"]
May 28 19:43:16.877816 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.877778    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g8kcf"
May 28 19:43:16.877885 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.877872    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vwv8g"
May 28 19:43:16.880375 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.880349    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 19:43:16.880534 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.880520    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 19:43:16.880613 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.880598    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6sqlb\""
May 28 19:43:16.880670 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.880651    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 19:43:16.880724 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.880683    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.880898 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.880875    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 19:43:16.881062 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.881049    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g79r7\""
May 28 19:43:16.883213 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.883194    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:16.883349 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:16.883265    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:16.884015 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.884000    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 19:43:16.884272 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.884243    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 19:43:16.884326 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.884280    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-thjhm\""
May 28 19:43:16.884459 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.884447    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 19:43:16.884607 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.884597    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 19:43:16.885016 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.885004    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 19:43:16.886187 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.886174    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:16.886239 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:16.886221    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:16.888330 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.888308    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:16.890769 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.890634    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 19:43:16.890769 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.890651    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.893174 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.893086    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 19:43:16.893174 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.893132    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-65m5l"
May 28 19:43:16.895318 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895296    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 19:43:16.895402 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895339    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/825b4d5d-7813-44d3-9882-e4d91ccb3e8d-tmp-dir\") pod \"node-resolver-vwv8g\" (UID: \"825b4d5d-7813-44d3-9882-e4d91ccb3e8d\") " pod="openshift-dns/node-resolver-vwv8g"
May 28 19:43:16.895456 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88ec1a61-1657-45c9-baa3-a6cb36ac6417-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.895456 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-kubernetes\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.895542 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895457    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-host\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.895542 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/825b4d5d-7813-44d3-9882-e4d91ccb3e8d-hosts-file\") pod \"node-resolver-vwv8g\" (UID: \"825b4d5d-7813-44d3-9882-e4d91ccb3e8d\") " pod="openshift-dns/node-resolver-vwv8g"
May 28 19:43:16.895542 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895527    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9559z\" (UniqueName: \"kubernetes.io/projected/736956bd-c76a-4005-9901-94e77eac247e-kube-api-access-9559z\") pod \"node-ca-65m5l\" (UID: \"736956bd-c76a-4005-9901-94e77eac247e\") " pod="openshift-image-registry/node-ca-65m5l"
May 28 19:43:16.895674 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895551    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 19:43:16.895674 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895564    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88ec1a61-1657-45c9-baa3-a6cb36ac6417-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.895674 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895600    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88ec1a61-1657-45c9-baa3-a6cb36ac6417-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.895674 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895626    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-sysctl-d\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.895674 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895632    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gd7wp\""
May 28 19:43:16.895674 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-run\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.895930 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895686    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-var-lib-kubelet\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.895930 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895715    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsnsr\" (UniqueName: \"kubernetes.io/projected/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-kube-api-access-wsnsr\") pod \"network-metrics-daemon-8nltt\" (UID: \"9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f\") " pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:16.895930 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/736956bd-c76a-4005-9901-94e77eac247e-host\") pod \"node-ca-65m5l\" (UID: \"736956bd-c76a-4005-9901-94e77eac247e\") " pod="openshift-image-registry/node-ca-65m5l"
May 28 19:43:16.895930 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/736956bd-c76a-4005-9901-94e77eac247e-serviceca\") pod \"node-ca-65m5l\" (UID: \"736956bd-c76a-4005-9901-94e77eac247e\") " pod="openshift-image-registry/node-ca-65m5l"
May 28 19:43:16.895930 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895787    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 19:43:16.895930 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895837    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88ec1a61-1657-45c9-baa3-a6cb36ac6417-cnibin\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.895930 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895874    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-sys\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.895930 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895905    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-tmp\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.896293 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895934    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a2dd6a90-6627-48f5-8eed-d36d6564fe2d-konnectivity-ca\") pod \"konnectivity-agent-g8kcf\" (UID: \"a2dd6a90-6627-48f5-8eed-d36d6564fe2d\") " pod="kube-system/konnectivity-agent-g8kcf"
May 28 19:43:16.896293 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895965    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-socket-dir\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:16.896293 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.895995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88ec1a61-1657-45c9-baa3-a6cb36ac6417-system-cni-dir\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.896293 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896023    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wjx79\""
May 28 19:43:16.896293 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896024    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88ec1a61-1657-45c9-baa3-a6cb36ac6417-cni-binary-copy\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.896500 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896293    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gqqgl\""
May 28 19:43:16.896500 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896321    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29wv4\" (UniqueName: \"kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4\") pod \"network-check-target-96qfr\" (UID: \"de068191-ba48-4ec7-abc0-681b1ee42f3c\") " pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:16.896500 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896355    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fk8r\" (UniqueName: \"kubernetes.io/projected/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-kube-api-access-7fk8r\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.896500 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896387    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a2dd6a90-6627-48f5-8eed-d36d6564fe2d-agent-certs\") pod \"konnectivity-agent-g8kcf\" (UID: \"a2dd6a90-6627-48f5-8eed-d36d6564fe2d\") " pod="kube-system/konnectivity-agent-g8kcf"
May 28 19:43:16.896500 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896417    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xrnj\" (UniqueName: \"kubernetes.io/projected/825b4d5d-7813-44d3-9882-e4d91ccb3e8d-kube-api-access-9xrnj\") pod \"node-resolver-vwv8g\" (UID: \"825b4d5d-7813-44d3-9882-e4d91ccb3e8d\") " pod="openshift-dns/node-resolver-vwv8g"
May 28 19:43:16.896500 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896445    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs\") pod \"network-metrics-daemon-8nltt\" (UID: \"9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f\") " pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:16.896500 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896484    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-etc-selinux\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:16.896831 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896520    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-sys-fs\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:16.896831 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896550    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88ec1a61-1657-45c9-baa3-a6cb36ac6417-os-release\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.896831 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896585    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-sysctl-conf\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.896831 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896624    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsw7j\" (UniqueName: \"kubernetes.io/projected/1f2071eb-70e2-480a-bf23-94afe479ed8f-kube-api-access-lsw7j\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:16.896831 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896656    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8ckz\" (UniqueName: \"kubernetes.io/projected/88ec1a61-1657-45c9-baa3-a6cb36ac6417-kube-api-access-t8ckz\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.896831 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896756    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 19:43:16.897113 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896805    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-modprobe-d\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.897113 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896912    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 19:43:16.897113 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896930    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 19:43:16.897113 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896962    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-systemd\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.897113 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.896996    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-lib-modules\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.897113 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.897059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:16.897113 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.897106    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-registration-dir\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:16.897429 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.897129    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-device-dir\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:16.897429 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.897154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-sysconfig\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.897429 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.897173    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-tuned\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.897429 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.897258    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-br7kt"
May 28 19:43:16.897429 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.897277    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 19:43:16.899438 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.899418    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-298hk\""
May 28 19:43:16.899750 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.899736    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 19:43:16.900619 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.900601    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dnn6h"
May 28 19:43:16.903556 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.903434    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 19:43:16.903637 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.903577    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:16.903685 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.903635    2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 19:43:16.903685 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.903668    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 19:43:16.904051 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.904033    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d7tpp\""
May 28 19:43:16.904141 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.904068    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 19:43:16.905821 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.905804    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 19:43:16.905915 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.905830    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 19:43:16.906150 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.906109    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dkhnm\""
May 28 19:43:16.906150 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.906133    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 19:43:16.906288 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.906147    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 19:43:16.906288 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.906190    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 19:43:16.906288 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.906216    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 19:43:16.937025 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.937008    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z2ztd"
May 28 19:43:16.947854 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.947840    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z2ztd"
May 28 19:43:16.991114 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.991085    2564 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 19:43:16.997493 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.997476    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-sys\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.997584 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.997504    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-tmp\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.997584 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.997527    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88ec1a61-1657-45c9-baa3-a6cb36ac6417-system-cni-dir\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.997584 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.997561    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88ec1a61-1657-45c9-baa3-a6cb36ac6417-cni-binary-copy\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.997584 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.997535    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-sys\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.997770 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.997588    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29wv4\" (UniqueName: \"kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4\") pod \"network-check-target-96qfr\" (UID: \"de068191-ba48-4ec7-abc0-681b1ee42f3c\") " pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:16.997770 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.997610    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88ec1a61-1657-45c9-baa3-a6cb36ac6417-system-cni-dir\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.997863 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.997806    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 19:43:16.997863 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.997699    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-run-ovn\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:16.997954 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.997883    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-os-release\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:16.997954 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.997910    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-hostroot\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:16.998040 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.997952    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fk8r\" (UniqueName: \"kubernetes.io/projected/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-kube-api-access-7fk8r\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.998040 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.997976    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a2dd6a90-6627-48f5-8eed-d36d6564fe2d-agent-certs\") pod \"konnectivity-agent-g8kcf\" (UID: \"a2dd6a90-6627-48f5-8eed-d36d6564fe2d\") " pod="kube-system/konnectivity-agent-g8kcf"
May 28 19:43:16.998040 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.997993    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88ec1a61-1657-45c9-baa3-a6cb36ac6417-os-release\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.998040 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998020    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-var-lib-openvswitch\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:16.998243 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998047    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-multus-cni-dir\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:16.998243 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998071    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-run-multus-certs\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:16.998243 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998108    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88ec1a61-1657-45c9-baa3-a6cb36ac6417-os-release\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.998243 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998112    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-sysctl-conf\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.998243 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998128    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88ec1a61-1657-45c9-baa3-a6cb36ac6417-cni-binary-copy\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.998243 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998139    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-kubelet\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:16.998243 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998181    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-cnibin\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:16.998243 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998203    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-multus-socket-dir-parent\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:16.998243 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998238    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-sysctl-conf\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.998617 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v4g4\" (UniqueName: \"kubernetes.io/projected/7b2660dd-565b-4582-bc68-ded4688e255f-kube-api-access-2v4g4\") pod \"iptables-alerter-dnn6h\" (UID: \"7b2660dd-565b-4582-bc68-ded4688e255f\") " pod="openshift-network-operator/iptables-alerter-dnn6h"
May 28 19:43:16.998617 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998303    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-modprobe-d\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.998617 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998329    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-systemd\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.998617 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998355    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-etc-openvswitch\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:16.998617 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998381    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85ed5fce-971a-4650-945f-16d8518cd573-cni-binary-copy\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:16.998617 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998386    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-systemd\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.998617 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998407    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-tuned\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.998617 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998407    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-modprobe-d\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.998617 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998433    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:16.998617 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998472    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-system-cni-dir\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:16.998617 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998503    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-kubernetes\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.998617 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998520    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-host\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.998617 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998535    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9559z\" (UniqueName: \"kubernetes.io/projected/736956bd-c76a-4005-9901-94e77eac247e-kube-api-access-9559z\") pod \"node-ca-65m5l\" (UID: \"736956bd-c76a-4005-9901-94e77eac247e\") " pod="openshift-image-registry/node-ca-65m5l"
May 28 19:43:16.998617 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998551    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88ec1a61-1657-45c9-baa3-a6cb36ac6417-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.998617 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998577    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de3d3227-c930-454d-a166-00fc73e8e4c8-ovnkube-config\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:16.998617 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998601    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-host\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998648    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-kubernetes\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998603    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-sysctl-d\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998831    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-sysctl-d\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998732    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-run\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998887    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsnsr\" (UniqueName: \"kubernetes.io/projected/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-kube-api-access-wsnsr\") pod \"network-metrics-daemon-8nltt\" (UID: \"9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f\") " pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998927    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/736956bd-c76a-4005-9901-94e77eac247e-host\") pod \"node-ca-65m5l\" (UID: \"736956bd-c76a-4005-9901-94e77eac247e\") " pod="openshift-image-registry/node-ca-65m5l"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998951    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/736956bd-c76a-4005-9901-94e77eac247e-serviceca\") pod \"node-ca-65m5l\" (UID: \"736956bd-c76a-4005-9901-94e77eac247e\") " pod="openshift-image-registry/node-ca-65m5l"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998962    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-run\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.998977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-log-socket\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999013    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvp8q\" (UniqueName: \"kubernetes.io/projected/de3d3227-c930-454d-a166-00fc73e8e4c8-kube-api-access-zvp8q\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999019    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/736956bd-c76a-4005-9901-94e77eac247e-host\") pod \"node-ca-65m5l\" (UID: \"736956bd-c76a-4005-9901-94e77eac247e\") " pod="openshift-image-registry/node-ca-65m5l"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999042    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r9lg\" (UniqueName: \"kubernetes.io/projected/85ed5fce-971a-4650-945f-16d8518cd573-kube-api-access-9r9lg\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999048    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88ec1a61-1657-45c9-baa3-a6cb36ac6417-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999082    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88ec1a61-1657-45c9-baa3-a6cb36ac6417-cnibin\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999124    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-systemd-units\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999150    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-run-systemd\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:16.999331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999174    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-cni-bin\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999199    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de3d3227-c930-454d-a166-00fc73e8e4c8-ovn-node-metrics-cert\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999219    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88ec1a61-1657-45c9-baa3-a6cb36ac6417-cnibin\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999226    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a2dd6a90-6627-48f5-8eed-d36d6564fe2d-konnectivity-ca\") pod \"konnectivity-agent-g8kcf\" (UID: \"a2dd6a90-6627-48f5-8eed-d36d6564fe2d\") " pod="kube-system/konnectivity-agent-g8kcf"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999270    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-socket-dir\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999297    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xrnj\" (UniqueName: \"kubernetes.io/projected/825b4d5d-7813-44d3-9882-e4d91ccb3e8d-kube-api-access-9xrnj\") pod \"node-resolver-vwv8g\" (UID: \"825b4d5d-7813-44d3-9882-e4d91ccb3e8d\") " pod="openshift-dns/node-resolver-vwv8g"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999327    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs\") pod \"network-metrics-daemon-8nltt\" (UID: \"9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f\") " pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999350    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-etc-selinux\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999375    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-sys-fs\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999376    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-socket-dir\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999404    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-run-netns\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999423    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/736956bd-c76a-4005-9901-94e77eac247e-serviceca\") pod \"node-ca-65m5l\" (UID: \"736956bd-c76a-4005-9901-94e77eac247e\") " pod="openshift-image-registry/node-ca-65m5l"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999428    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-cni-netd\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999468    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-var-lib-cni-multus\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999488    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-sys-fs\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999497    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsw7j\" (UniqueName: \"kubernetes.io/projected/1f2071eb-70e2-480a-bf23-94afe479ed8f-kube-api-access-lsw7j\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999502    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-etc-selinux\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:17.000054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999530    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8ckz\" (UniqueName: \"kubernetes.io/projected/88ec1a61-1657-45c9-baa3-a6cb36ac6417-kube-api-access-t8ckz\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999585    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-run-netns\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:16.999591    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999622    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b2660dd-565b-4582-bc68-ded4688e255f-iptables-alerter-script\") pod \"iptables-alerter-dnn6h\" (UID: \"7b2660dd-565b-4582-bc68-ded4688e255f\") " pod="openshift-network-operator/iptables-alerter-dnn6h"
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999648    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a2dd6a90-6627-48f5-8eed-d36d6564fe2d-konnectivity-ca\") pod \"konnectivity-agent-g8kcf\" (UID: \"a2dd6a90-6627-48f5-8eed-d36d6564fe2d\") " pod="kube-system/konnectivity-agent-g8kcf"
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:16.999702    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs podName:9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f nodeName:}" failed. No retries permitted until 2026-05-28 19:43:17.49963581 +0000 UTC m=+2.110360469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs") pod "network-metrics-daemon-8nltt" (UID: "9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999725    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-lib-modules\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999761    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999794    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-registration-dir\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999821    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-var-lib-cni-bin\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999832    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-lib-modules\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999870    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-device-dir\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999874    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999874    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-registration-dir\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999894    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-sysconfig\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999925    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/825b4d5d-7813-44d3-9882-e4d91ccb3e8d-tmp-dir\") pod \"node-resolver-vwv8g\" (UID: \"825b4d5d-7813-44d3-9882-e4d91ccb3e8d\") " pod="openshift-dns/node-resolver-vwv8g"
May 28 19:43:17.000807 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999930    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-sysconfig\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999942    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f2071eb-70e2-480a-bf23-94afe479ed8f-device-dir\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:16.999941    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88ec1a61-1657-45c9-baa3-a6cb36ac6417-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000000    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-slash\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000027    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88ec1a61-1657-45c9-baa3-a6cb36ac6417-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000030    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/825b4d5d-7813-44d3-9882-e4d91ccb3e8d-hosts-file\") pod \"node-resolver-vwv8g\" (UID: \"825b4d5d-7813-44d3-9882-e4d91ccb3e8d\") " pod="openshift-dns/node-resolver-vwv8g"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000058    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88ec1a61-1657-45c9-baa3-a6cb36ac6417-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000083    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-run-openvswitch\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000111    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/825b4d5d-7813-44d3-9882-e4d91ccb3e8d-hosts-file\") pod \"node-resolver-vwv8g\" (UID: \"825b4d5d-7813-44d3-9882-e4d91ccb3e8d\") " pod="openshift-dns/node-resolver-vwv8g"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000124    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-multus-conf-dir\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000151    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-var-lib-kubelet\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000194    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/825b4d5d-7813-44d3-9882-e4d91ccb3e8d-tmp-dir\") pod \"node-resolver-vwv8g\" (UID: \"825b4d5d-7813-44d3-9882-e4d91ccb3e8d\") " pod="openshift-dns/node-resolver-vwv8g"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000212    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-node-log\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de3d3227-c930-454d-a166-00fc73e8e4c8-ovnkube-script-lib\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000298    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-var-lib-kubelet\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000298    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de3d3227-c930-454d-a166-00fc73e8e4c8-env-overrides\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-run-k8s-cni-cncf-io\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.001450 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000364    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-var-lib-kubelet\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.002047 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85ed5fce-971a-4650-945f-16d8518cd573-multus-daemon-config\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.002047 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-etc-kubernetes\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.002047 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000468    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b2660dd-565b-4582-bc68-ded4688e255f-host-slash\") pod \"iptables-alerter-dnn6h\" (UID: \"7b2660dd-565b-4582-bc68-ded4688e255f\") " pod="openshift-network-operator/iptables-alerter-dnn6h"
May 28 19:43:17.002047 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.000476    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88ec1a61-1657-45c9-baa3-a6cb36ac6417-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:17.002047 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.001218    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-tmp\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:17.002047 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.001483    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-etc-tuned\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:17.002047 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.001502    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a2dd6a90-6627-48f5-8eed-d36d6564fe2d-agent-certs\") pod \"konnectivity-agent-g8kcf\" (UID: \"a2dd6a90-6627-48f5-8eed-d36d6564fe2d\") " pod="kube-system/konnectivity-agent-g8kcf"
May 28 19:43:17.005164 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:17.005145    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 19:43:17.005256 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:17.005169    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 19:43:17.005256 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:17.005182    2564 projected.go:194] Error preparing data for projected volume kube-api-access-29wv4 for pod openshift-network-diagnostics/network-check-target-96qfr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:17.005256 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:17.005251    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4 podName:de068191-ba48-4ec7-abc0-681b1ee42f3c nodeName:}" failed. No retries permitted until 2026-05-28 19:43:17.505233216 +0000 UTC m=+2.115957857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-29wv4" (UniqueName: "kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4") pod "network-check-target-96qfr" (UID: "de068191-ba48-4ec7-abc0-681b1ee42f3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:17.006665 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.006631    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9559z\" (UniqueName: \"kubernetes.io/projected/736956bd-c76a-4005-9901-94e77eac247e-kube-api-access-9559z\") pod \"node-ca-65m5l\" (UID: \"736956bd-c76a-4005-9901-94e77eac247e\") " pod="openshift-image-registry/node-ca-65m5l"
May 28 19:43:17.007173 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.007149    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fk8r\" (UniqueName: \"kubernetes.io/projected/fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0-kube-api-access-7fk8r\") pod \"tuned-xsnq7\" (UID: \"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0\") " pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:17.007371 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.007354    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsnsr\" (UniqueName: \"kubernetes.io/projected/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-kube-api-access-wsnsr\") pod \"network-metrics-daemon-8nltt\" (UID: \"9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f\") " pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:17.007994 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.007975    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xrnj\" (UniqueName: \"kubernetes.io/projected/825b4d5d-7813-44d3-9882-e4d91ccb3e8d-kube-api-access-9xrnj\") pod \"node-resolver-vwv8g\" (UID: \"825b4d5d-7813-44d3-9882-e4d91ccb3e8d\") " pod="openshift-dns/node-resolver-vwv8g"
May 28 19:43:17.012354 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.012328    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8ckz\" (UniqueName: \"kubernetes.io/projected/88ec1a61-1657-45c9-baa3-a6cb36ac6417-kube-api-access-t8ckz\") pod \"multus-additional-cni-plugins-z2rbf\" (UID: \"88ec1a61-1657-45c9-baa3-a6cb36ac6417\") " pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:17.012897 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.012875    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsw7j\" (UniqueName: \"kubernetes.io/projected/1f2071eb-70e2-480a-bf23-94afe479ed8f-kube-api-access-lsw7j\") pod \"aws-ebs-csi-driver-node-fq5ld\" (UID: \"1f2071eb-70e2-480a-bf23-94afe479ed8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:17.026234 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:17.026211    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaeefc9190e426e2957710d584028c12.slice/crio-b200a6f6313abb36cb7abaac72c3a7d87cdb77ec2e1fe3ebcc3d52171150f87b WatchSource:0}: Error finding container b200a6f6313abb36cb7abaac72c3a7d87cdb77ec2e1fe3ebcc3d52171150f87b: Status 404 returned error can't find the container with id b200a6f6313abb36cb7abaac72c3a7d87cdb77ec2e1fe3ebcc3d52171150f87b
May 28 19:43:17.026402 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:17.026388    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f07959bbc8e1863f8f61f4e16ca9cf.slice/crio-0430e32bfaa782ec32e998041227e16bd1a062be3f5338db9a7a1038bf850173 WatchSource:0}: Error finding container 0430e32bfaa782ec32e998041227e16bd1a062be3f5338db9a7a1038bf850173: Status 404 returned error can't find the container with id 0430e32bfaa782ec32e998041227e16bd1a062be3f5338db9a7a1038bf850173
May 28 19:43:17.032971 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.032950    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 19:43:17.101018 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.100996    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-log-socket\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.101124 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101021    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvp8q\" (UniqueName: \"kubernetes.io/projected/de3d3227-c930-454d-a166-00fc73e8e4c8-kube-api-access-zvp8q\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.101124 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101039    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9r9lg\" (UniqueName: \"kubernetes.io/projected/85ed5fce-971a-4650-945f-16d8518cd573-kube-api-access-9r9lg\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.101124 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101055    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-systemd-units\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.101124 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101069    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-run-systemd\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.101124 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101083    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-cni-bin\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.101124 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101085    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-log-socket\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101129    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de3d3227-c930-454d-a166-00fc73e8e4c8-ovn-node-metrics-cert\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101143    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-systemd-units\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101159    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-run-netns\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101162    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-cni-bin\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101162    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-run-systemd\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101188    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-run-netns\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101194    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-cni-netd\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101226    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-var-lib-cni-multus\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101254    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101281    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-run-netns\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101293    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-var-lib-cni-multus\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101293    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-cni-netd\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101306    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b2660dd-565b-4582-bc68-ded4688e255f-iptables-alerter-script\") pod \"iptables-alerter-dnn6h\" (UID: \"7b2660dd-565b-4582-bc68-ded4688e255f\") " pod="openshift-network-operator/iptables-alerter-dnn6h"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101301    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101324    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-run-netns\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101328    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-var-lib-cni-bin\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.101405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101368    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-slash\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101376    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-var-lib-cni-bin\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101387    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-run-openvswitch\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101407    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-slash\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101411    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-multus-conf-dir\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101430    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-multus-conf-dir\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101439    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-run-openvswitch\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101454    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-node-log\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101479    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de3d3227-c930-454d-a166-00fc73e8e4c8-ovnkube-script-lib\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101504    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de3d3227-c930-454d-a166-00fc73e8e4c8-env-overrides\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101507    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-node-log\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101535    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-run-k8s-cni-cncf-io\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101558    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-var-lib-kubelet\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101578    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85ed5fce-971a-4650-945f-16d8518cd573-multus-daemon-config\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101594    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-etc-kubernetes\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101615    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b2660dd-565b-4582-bc68-ded4688e255f-host-slash\") pod \"iptables-alerter-dnn6h\" (UID: \"7b2660dd-565b-4582-bc68-ded4688e255f\") " pod="openshift-network-operator/iptables-alerter-dnn6h"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101639    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-var-lib-kubelet\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101701    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-run-ovn\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.102117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101757    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-os-release\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101783    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-hostroot\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101812    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-var-lib-openvswitch\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101821    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b2660dd-565b-4582-bc68-ded4688e255f-host-slash\") pod \"iptables-alerter-dnn6h\" (UID: \"7b2660dd-565b-4582-bc68-ded4688e255f\") " pod="openshift-network-operator/iptables-alerter-dnn6h"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101838    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-multus-cni-dir\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101864    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-run-multus-certs\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101871    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-etc-kubernetes\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101871    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7b2660dd-565b-4582-bc68-ded4688e255f-iptables-alerter-script\") pod \"iptables-alerter-dnn6h\" (UID: \"7b2660dd-565b-4582-bc68-ded4688e255f\") " pod="openshift-network-operator/iptables-alerter-dnn6h"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101890    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-kubelet\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101906    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de3d3227-c930-454d-a166-00fc73e8e4c8-env-overrides\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101914    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-hostroot\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101920    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-cnibin\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101930    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-kubelet\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101946    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-multus-socket-dir-parent\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101964    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-var-lib-openvswitch\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101968    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-os-release\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.101971    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2v4g4\" (UniqueName: \"kubernetes.io/projected/7b2660dd-565b-4582-bc68-ded4688e255f-kube-api-access-2v4g4\") pod \"iptables-alerter-dnn6h\" (UID: \"7b2660dd-565b-4582-bc68-ded4688e255f\") " pod="openshift-network-operator/iptables-alerter-dnn6h"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102004    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-run-multus-certs\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.102843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102005    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-etc-openvswitch\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102011    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-host-run-k8s-cni-cncf-io\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102034    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-etc-openvswitch\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102037    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85ed5fce-971a-4650-945f-16d8518cd573-cni-binary-copy\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102052    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-multus-cni-dir\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102071    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102120    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102123    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-system-cni-dir\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102135    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de3d3227-c930-454d-a166-00fc73e8e4c8-ovnkube-script-lib\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102164    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-system-cni-dir\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102180    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/85ed5fce-971a-4650-945f-16d8518cd573-multus-daemon-config\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102186    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-cnibin\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102196    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de3d3227-c930-454d-a166-00fc73e8e4c8-ovnkube-config\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102213    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de3d3227-c930-454d-a166-00fc73e8e4c8-run-ovn\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102235    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/85ed5fce-971a-4650-945f-16d8518cd573-multus-socket-dir-parent\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102424    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85ed5fce-971a-4650-945f-16d8518cd573-cni-binary-copy\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.102659    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de3d3227-c930-454d-a166-00fc73e8e4c8-ovnkube-config\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.103447 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.103378    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de3d3227-c930-454d-a166-00fc73e8e4c8-ovn-node-metrics-cert\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.109946 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.109928    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r9lg\" (UniqueName: \"kubernetes.io/projected/85ed5fce-971a-4650-945f-16d8518cd573-kube-api-access-9r9lg\") pod \"multus-br7kt\" (UID: \"85ed5fce-971a-4650-945f-16d8518cd573\") " pod="openshift-multus/multus-br7kt"
May 28 19:43:17.110286 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.110269    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvp8q\" (UniqueName: \"kubernetes.io/projected/de3d3227-c930-454d-a166-00fc73e8e4c8-kube-api-access-zvp8q\") pod \"ovnkube-node-9hmkh\" (UID: \"de3d3227-c930-454d-a166-00fc73e8e4c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.110506 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.110491    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v4g4\" (UniqueName: \"kubernetes.io/projected/7b2660dd-565b-4582-bc68-ded4688e255f-kube-api-access-2v4g4\") pod \"iptables-alerter-dnn6h\" (UID: \"7b2660dd-565b-4582-bc68-ded4688e255f\") " pod="openshift-network-operator/iptables-alerter-dnn6h"
May 28 19:43:17.199908 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.199879    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g8kcf"
May 28 19:43:17.206186 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:17.206167    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2dd6a90_6627_48f5_8eed_d36d6564fe2d.slice/crio-8aa642b208d9da92c7cf839afb4a6e8575ba6458dd84ac1a784946141649574f WatchSource:0}: Error finding container 8aa642b208d9da92c7cf839afb4a6e8575ba6458dd84ac1a784946141649574f: Status 404 returned error can't find the container with id 8aa642b208d9da92c7cf839afb4a6e8575ba6458dd84ac1a784946141649574f
May 28 19:43:17.210938 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.210922    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vwv8g"
May 28 19:43:17.216128 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:17.216085    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod825b4d5d_7813_44d3_9882_e4d91ccb3e8d.slice/crio-4fd000c307cd356457988ae241bd28251b333c0861c9855e9e404c8b709d449a WatchSource:0}: Error finding container 4fd000c307cd356457988ae241bd28251b333c0861c9855e9e404c8b709d449a: Status 404 returned error can't find the container with id 4fd000c307cd356457988ae241bd28251b333c0861c9855e9e404c8b709d449a
May 28 19:43:17.232990 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.232958    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z2rbf"
May 28 19:43:17.238284 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:17.238260    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ec1a61_1657_45c9_baa3_a6cb36ac6417.slice/crio-aafdb2dacd412d0a265b02c24ed5a4279ac3f749467090931b5c7c1bbede388d WatchSource:0}: Error finding container aafdb2dacd412d0a265b02c24ed5a4279ac3f749467090931b5c7c1bbede388d: Status 404 returned error can't find the container with id aafdb2dacd412d0a265b02c24ed5a4279ac3f749467090931b5c7c1bbede388d
May 28 19:43:17.242119 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.242103    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld"
May 28 19:43:17.247770 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:17.247752    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f2071eb_70e2_480a_bf23_94afe479ed8f.slice/crio-61e16b107b8bb03ab9468358e7bb60457c68f875c8f69191b7875e930cefb753 WatchSource:0}: Error finding container 61e16b107b8bb03ab9468358e7bb60457c68f875c8f69191b7875e930cefb753: Status 404 returned error can't find the container with id 61e16b107b8bb03ab9468358e7bb60457c68f875c8f69191b7875e930cefb753
May 28 19:43:17.262504 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.262484    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xsnq7"
May 28 19:43:17.267160 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.267143    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-65m5l"
May 28 19:43:17.267288 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:17.267268    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe11cafe_fd7a_4348_ad8e_4799bb9cb9c0.slice/crio-d1190071b8d2a0abcabc111a25a0d6d21290618e27a5a0c19b4e9c24a5cca020 WatchSource:0}: Error finding container d1190071b8d2a0abcabc111a25a0d6d21290618e27a5a0c19b4e9c24a5cca020: Status 404 returned error can't find the container with id d1190071b8d2a0abcabc111a25a0d6d21290618e27a5a0c19b4e9c24a5cca020
May 28 19:43:17.272499 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:17.272480    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod736956bd_c76a_4005_9901_94e77eac247e.slice/crio-0ebfe743b7a2d42c78008902bd017981fa8348a6b475f294f9dbfdd4b03357df WatchSource:0}: Error finding container 0ebfe743b7a2d42c78008902bd017981fa8348a6b475f294f9dbfdd4b03357df: Status 404 returned error can't find the container with id 0ebfe743b7a2d42c78008902bd017981fa8348a6b475f294f9dbfdd4b03357df
May 28 19:43:17.284141 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.284085    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-br7kt"
May 28 19:43:17.314175 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.314147    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dnn6h"
May 28 19:43:17.318746 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.318728    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:17.319522 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:17.319501    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b2660dd_565b_4582_bc68_ded4688e255f.slice/crio-4b14c6a56b3e46f895aa7e1e42bfad96208adf0208e790cb1827c28832dda665 WatchSource:0}: Error finding container 4b14c6a56b3e46f895aa7e1e42bfad96208adf0208e790cb1827c28832dda665: Status 404 returned error can't find the container with id 4b14c6a56b3e46f895aa7e1e42bfad96208adf0208e790cb1827c28832dda665
May 28 19:43:17.324073 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:17.324055    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3d3227_c930_454d_a166_00fc73e8e4c8.slice/crio-5d84c94b60c3486560b0ffdf61a793a1ee941673f1d16c42bdb837e8a14f216e WatchSource:0}: Error finding container 5d84c94b60c3486560b0ffdf61a793a1ee941673f1d16c42bdb837e8a14f216e: Status 404 returned error can't find the container with id 5d84c94b60c3486560b0ffdf61a793a1ee941673f1d16c42bdb837e8a14f216e
May 28 19:43:17.503913 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.503882    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs\") pod \"network-metrics-daemon-8nltt\" (UID: \"9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f\") " pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:17.504080 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:17.504048    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:17.504176 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:17.504134    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs podName:9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f nodeName:}" failed. No retries permitted until 2026-05-28 19:43:18.504114166 +0000 UTC m=+3.114838818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs") pod "network-metrics-daemon-8nltt" (UID: "9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:17.604299 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.604205    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29wv4\" (UniqueName: \"kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4\") pod \"network-check-target-96qfr\" (UID: \"de068191-ba48-4ec7-abc0-681b1ee42f3c\") " pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:17.604435 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:17.604418    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 19:43:17.604498 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:17.604440    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 19:43:17.604498 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:17.604453    2564 projected.go:194] Error preparing data for projected volume kube-api-access-29wv4 for pod openshift-network-diagnostics/network-check-target-96qfr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:17.604600 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:17.604507    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4 podName:de068191-ba48-4ec7-abc0-681b1ee42f3c nodeName:}" failed. No retries permitted until 2026-05-28 19:43:18.604488623 +0000 UTC m=+3.215213263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-29wv4" (UniqueName: "kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4") pod "network-check-target-96qfr" (UID: "de068191-ba48-4ec7-abc0-681b1ee42f3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:17.948911 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.948827    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 19:38:16 +0000 UTC" deadline="2027-12-19 03:01:14.614099627 +0000 UTC"
May 28 19:43:17.948911 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.948864    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13663h17m56.665239616s"
May 28 19:43:17.968505 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:17.968477    2564 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 19:43:18.013404 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.013337    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-65m5l" event={"ID":"736956bd-c76a-4005-9901-94e77eac247e","Type":"ContainerStarted","Data":"0ebfe743b7a2d42c78008902bd017981fa8348a6b475f294f9dbfdd4b03357df"}
May 28 19:43:18.022020 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.021980    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld" event={"ID":"1f2071eb-70e2-480a-bf23-94afe479ed8f","Type":"ContainerStarted","Data":"61e16b107b8bb03ab9468358e7bb60457c68f875c8f69191b7875e930cefb753"}
May 28 19:43:18.025611 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.025583    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vwv8g" event={"ID":"825b4d5d-7813-44d3-9882-e4d91ccb3e8d","Type":"ContainerStarted","Data":"4fd000c307cd356457988ae241bd28251b333c0861c9855e9e404c8b709d449a"}
May 28 19:43:18.030883 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.030859    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal" event={"ID":"b2f07959bbc8e1863f8f61f4e16ca9cf","Type":"ContainerStarted","Data":"0430e32bfaa782ec32e998041227e16bd1a062be3f5338db9a7a1038bf850173"}
May 28 19:43:18.033984 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.033937    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh" event={"ID":"de3d3227-c930-454d-a166-00fc73e8e4c8","Type":"ContainerStarted","Data":"5d84c94b60c3486560b0ffdf61a793a1ee941673f1d16c42bdb837e8a14f216e"}
May 28 19:43:18.035191 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.035147    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-br7kt" event={"ID":"85ed5fce-971a-4650-945f-16d8518cd573","Type":"ContainerStarted","Data":"23ea1ded21c45bf713db187dc3dd85a82a81c5738b8b0b97d7506e53ee3cbbb4"}
May 28 19:43:18.049764 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.049702    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xsnq7" event={"ID":"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0","Type":"ContainerStarted","Data":"d1190071b8d2a0abcabc111a25a0d6d21290618e27a5a0c19b4e9c24a5cca020"}
May 28 19:43:18.060441 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.060385    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2rbf" event={"ID":"88ec1a61-1657-45c9-baa3-a6cb36ac6417","Type":"ContainerStarted","Data":"aafdb2dacd412d0a265b02c24ed5a4279ac3f749467090931b5c7c1bbede388d"}
May 28 19:43:18.072337 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.072270    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g8kcf" event={"ID":"a2dd6a90-6627-48f5-8eed-d36d6564fe2d","Type":"ContainerStarted","Data":"8aa642b208d9da92c7cf839afb4a6e8575ba6458dd84ac1a784946141649574f"}
May 28 19:43:18.084802 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.084777    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.ec2.internal" event={"ID":"baeefc9190e426e2957710d584028c12","Type":"ContainerStarted","Data":"b200a6f6313abb36cb7abaac72c3a7d87cdb77ec2e1fe3ebcc3d52171150f87b"}
May 28 19:43:18.089062 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.089037    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dnn6h" event={"ID":"7b2660dd-565b-4582-bc68-ded4688e255f","Type":"ContainerStarted","Data":"4b14c6a56b3e46f895aa7e1e42bfad96208adf0208e790cb1827c28832dda665"}
May 28 19:43:18.280430 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.280358    2564 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 19:43:18.307366 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.307269    2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 19:43:18.513000 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.512903    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs\") pod \"network-metrics-daemon-8nltt\" (UID: \"9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f\") " pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:18.513196 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:18.513071    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:18.513196 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:18.513152    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs podName:9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f nodeName:}" failed. No retries permitted until 2026-05-28 19:43:20.513132859 +0000 UTC m=+5.123857523 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs") pod "network-metrics-daemon-8nltt" (UID: "9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:18.614348 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.614261    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29wv4\" (UniqueName: \"kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4\") pod \"network-check-target-96qfr\" (UID: \"de068191-ba48-4ec7-abc0-681b1ee42f3c\") " pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:18.614491 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:18.614441    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 19:43:18.614491 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:18.614458    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 19:43:18.614491 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:18.614471    2564 projected.go:194] Error preparing data for projected volume kube-api-access-29wv4 for pod openshift-network-diagnostics/network-check-target-96qfr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:18.614740 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:18.614523    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4 podName:de068191-ba48-4ec7-abc0-681b1ee42f3c nodeName:}" failed. No retries permitted until 2026-05-28 19:43:20.614505184 +0000 UTC m=+5.225229828 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-29wv4" (UniqueName: "kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4") pod "network-check-target-96qfr" (UID: "de068191-ba48-4ec7-abc0-681b1ee42f3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:18.949693 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.949182    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 19:38:16 +0000 UTC" deadline="2028-01-15 04:59:51.280879897 +0000 UTC"
May 28 19:43:18.949693 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.949219    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14313h16m32.33166488s"
May 28 19:43:18.996806 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.996177    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:18.996806 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:18.996308    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:18.996806 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:18.996404    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:18.996806 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:18.996470    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:20.530857 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:20.530823    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs\") pod \"network-metrics-daemon-8nltt\" (UID: \"9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f\") " pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:20.531334 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:20.531010    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:20.531334 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:20.531128    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs podName:9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f nodeName:}" failed. No retries permitted until 2026-05-28 19:43:24.531107452 +0000 UTC m=+9.141832108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs") pod "network-metrics-daemon-8nltt" (UID: "9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:20.632306 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:20.632251    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29wv4\" (UniqueName: \"kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4\") pod \"network-check-target-96qfr\" (UID: \"de068191-ba48-4ec7-abc0-681b1ee42f3c\") " pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:20.634368 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:20.633270    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 19:43:20.634368 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:20.633296    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 19:43:20.634368 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:20.633324    2564 projected.go:194] Error preparing data for projected volume kube-api-access-29wv4 for pod openshift-network-diagnostics/network-check-target-96qfr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:20.634368 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:20.633415    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4 podName:de068191-ba48-4ec7-abc0-681b1ee42f3c nodeName:}" failed. No retries permitted until 2026-05-28 19:43:24.633376766 +0000 UTC m=+9.244101415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-29wv4" (UniqueName: "kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4") pod "network-check-target-96qfr" (UID: "de068191-ba48-4ec7-abc0-681b1ee42f3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:20.995822 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:20.995762    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:20.996000 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:20.995881    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:20.996245 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:20.995762    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:20.996363 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:20.996342    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:22.996074 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:22.996046    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:22.996539 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:22.996174    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:22.996539 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:22.996233    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:22.996539 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:22.996335    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:24.562543 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:24.562489    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs\") pod \"network-metrics-daemon-8nltt\" (UID: \"9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f\") " pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:24.562907 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:24.562662    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:24.562907 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:24.562748    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs podName:9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f nodeName:}" failed. No retries permitted until 2026-05-28 19:43:32.562726896 +0000 UTC m=+17.173451537 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs") pod "network-metrics-daemon-8nltt" (UID: "9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:24.663783 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:24.663694    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29wv4\" (UniqueName: \"kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4\") pod \"network-check-target-96qfr\" (UID: \"de068191-ba48-4ec7-abc0-681b1ee42f3c\") " pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:24.663959 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:24.663845    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 19:43:24.663959 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:24.663864    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 19:43:24.663959 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:24.663875    2564 projected.go:194] Error preparing data for projected volume kube-api-access-29wv4 for pod openshift-network-diagnostics/network-check-target-96qfr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:24.663959 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:24.663942    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4 podName:de068191-ba48-4ec7-abc0-681b1ee42f3c nodeName:}" failed. No retries permitted until 2026-05-28 19:43:32.663924341 +0000 UTC m=+17.274648979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-29wv4" (UniqueName: "kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4") pod "network-check-target-96qfr" (UID: "de068191-ba48-4ec7-abc0-681b1ee42f3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:24.995980 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:24.995940    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:24.996182 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:24.996086    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:24.996182 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:24.996125    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:24.996314 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:24.996239    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:26.995786 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:26.995755    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:26.995786 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:26.995781    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:26.996285 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:26.995884    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:26.996285 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:26.996029    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:28.995509 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:28.995310    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:28.995946 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:28.995312    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:28.995946 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:28.995594    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:28.995946 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:28.995715    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:30.996108 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:30.996066    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:30.996536 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:30.996066    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:30.996536 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:30.996214    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:30.996536 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:30.996307    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:32.629260 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:32.629226    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs\") pod \"network-metrics-daemon-8nltt\" (UID: \"9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f\") " pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:32.629732 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:32.629355    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:32.629732 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:32.629426    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs podName:9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f nodeName:}" failed. No retries permitted until 2026-05-28 19:43:48.629406262 +0000 UTC m=+33.240130911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs") pod "network-metrics-daemon-8nltt" (UID: "9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:32.729936 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:32.729906    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29wv4\" (UniqueName: \"kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4\") pod \"network-check-target-96qfr\" (UID: \"de068191-ba48-4ec7-abc0-681b1ee42f3c\") " pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:32.730086 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:32.730028    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 19:43:32.730086 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:32.730041    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 19:43:32.730086 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:32.730052    2564 projected.go:194] Error preparing data for projected volume kube-api-access-29wv4 for pod openshift-network-diagnostics/network-check-target-96qfr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:32.730249 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:32.730113    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4 podName:de068191-ba48-4ec7-abc0-681b1ee42f3c nodeName:}" failed. No retries permitted until 2026-05-28 19:43:48.730087154 +0000 UTC m=+33.340811791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-29wv4" (UniqueName: "kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4") pod "network-check-target-96qfr" (UID: "de068191-ba48-4ec7-abc0-681b1ee42f3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:32.995909 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:32.995871    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:32.996062 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:32.995871    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:32.996062 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:32.995994    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:32.996062 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:32.996042    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:34.995439 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:34.995407    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:34.995439 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:34.995437    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:34.995912 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:34.995521    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:34.995912 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:34.995659    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:36.135985 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:36.135083    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 19:43:36.139487 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:36.139457    2564 generic.go:358] "Generic (PLEG): container finished" podID="de3d3227-c930-454d-a166-00fc73e8e4c8" containerID="40314b2e37a241801bf472ca76d298ff037251417524222f5b7b5b73e46d6a81" exitCode=1
May 28 19:43:36.139602 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:36.139493    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh" event={"ID":"de3d3227-c930-454d-a166-00fc73e8e4c8","Type":"ContainerDied","Data":"40314b2e37a241801bf472ca76d298ff037251417524222f5b7b5b73e46d6a81"}
May 28 19:43:36.139602 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:36.139538    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh" event={"ID":"de3d3227-c930-454d-a166-00fc73e8e4c8","Type":"ContainerStarted","Data":"79588a6af54ff7b03be5adb984c50bf2f55b72a1a708d8047e76fb3c7134bd08"}
May 28 19:43:36.144137 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:36.144050    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-br7kt" event={"ID":"85ed5fce-971a-4650-945f-16d8518cd573","Type":"ContainerStarted","Data":"44da83e90c5a8cf233891fd25ffe3a3f4564dac1fff3b42d81eae2190319a872"}
May 28 19:43:36.148561 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:36.148234    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xsnq7" event={"ID":"fe11cafe-fd7a-4348-ad8e-4799bb9cb9c0","Type":"ContainerStarted","Data":"f5a4de1b9e3632ee2410a22b371e049867d9686e1b99ea17ef5b25339edd1bef"}
May 28 19:43:36.160804 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:36.160777    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.ec2.internal" event={"ID":"baeefc9190e426e2957710d584028c12","Type":"ContainerStarted","Data":"6d4b236714c9d6122916bdb2c85b69c554982498f94f42897fd20cfa41b0f624"}
May 28 19:43:36.168729 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:36.168677    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-br7kt" podStartSLOduration=1.482452088 podStartE2EDuration="20.168660502s" podCreationTimestamp="2026-05-28 19:43:16 +0000 UTC" firstStartedPulling="2026-05-28 19:43:17.292599749 +0000 UTC m=+1.903324387" lastFinishedPulling="2026-05-28 19:43:35.978808149 +0000 UTC m=+20.589532801" observedRunningTime="2026-05-28 19:43:36.16826133 +0000 UTC m=+20.778985987" watchObservedRunningTime="2026-05-28 19:43:36.168660502 +0000 UTC m=+20.779385162"
May 28 19:43:36.189199 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:36.189056    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xsnq7" podStartSLOduration=1.83902719 podStartE2EDuration="20.189040013s" podCreationTimestamp="2026-05-28 19:43:16 +0000 UTC" firstStartedPulling="2026-05-28 19:43:17.268791876 +0000 UTC m=+1.879516514" lastFinishedPulling="2026-05-28 19:43:35.618804698 +0000 UTC m=+20.229529337" observedRunningTime="2026-05-28 19:43:36.18845783 +0000 UTC m=+20.799182526" watchObservedRunningTime="2026-05-28 19:43:36.189040013 +0000 UTC m=+20.799764674"
May 28 19:43:36.202156 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:36.202084    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-85.ec2.internal" podStartSLOduration=20.202068764 podStartE2EDuration="20.202068764s" podCreationTimestamp="2026-05-28 19:43:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:43:36.201905444 +0000 UTC m=+20.812630106" watchObservedRunningTime="2026-05-28 19:43:36.202068764 +0000 UTC m=+20.812793431"
May 28 19:43:36.995546 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:36.995469    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:36.995546 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:36.995503    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:36.995740 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:36.995585    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:36.995740 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:36.995682    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:37.163076 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.163047    2564 generic.go:358] "Generic (PLEG): container finished" podID="b2f07959bbc8e1863f8f61f4e16ca9cf" containerID="f2df770ae50c6de040d5a19792e1ad1d8058a25a60a8663e28d1189636021440" exitCode=0
May 28 19:43:37.163476 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.163125    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal" event={"ID":"b2f07959bbc8e1863f8f61f4e16ca9cf","Type":"ContainerDied","Data":"f2df770ae50c6de040d5a19792e1ad1d8058a25a60a8663e28d1189636021440"}
May 28 19:43:37.167065 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.167048    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 19:43:37.167380 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.167355    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh" event={"ID":"de3d3227-c930-454d-a166-00fc73e8e4c8","Type":"ContainerStarted","Data":"8dad5a46a87fd301de61b7232ebe34aed19fe598b4f0ed5d9200fcef92fded0c"}
May 28 19:43:37.167468 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.167387    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh" event={"ID":"de3d3227-c930-454d-a166-00fc73e8e4c8","Type":"ContainerStarted","Data":"eceff65bccd79f5803a031f10716e01a5aa44d5479a2944c46e1ba1b5b36a511"}
May 28 19:43:37.167468 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.167400    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh" event={"ID":"de3d3227-c930-454d-a166-00fc73e8e4c8","Type":"ContainerStarted","Data":"c0cc0209972df742dada1308ddbc782eba930d6cbe1f2459882fbf1e27213a41"}
May 28 19:43:37.167468 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.167411    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh" event={"ID":"de3d3227-c930-454d-a166-00fc73e8e4c8","Type":"ContainerStarted","Data":"2ded3e0d0835a41f707d42c51b3fb12763887766f3443d271e3d4c4954874e06"}
May 28 19:43:37.168471 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.168447    2564 generic.go:358] "Generic (PLEG): container finished" podID="88ec1a61-1657-45c9-baa3-a6cb36ac6417" containerID="e9218cca5098b53650ff540a41334f7e3f298bb879c6f3447f65301d4699afef" exitCode=0
May 28 19:43:37.168522 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.168506    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2rbf" event={"ID":"88ec1a61-1657-45c9-baa3-a6cb36ac6417","Type":"ContainerDied","Data":"e9218cca5098b53650ff540a41334f7e3f298bb879c6f3447f65301d4699afef"}
May 28 19:43:37.169913 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.169882    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g8kcf" event={"ID":"a2dd6a90-6627-48f5-8eed-d36d6564fe2d","Type":"ContainerStarted","Data":"47729dae3c9b37c38cba69f7d95dd27e888f57392ccb6173da9ef715e15d89e0"}
May 28 19:43:37.171922 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.171903    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dnn6h" event={"ID":"7b2660dd-565b-4582-bc68-ded4688e255f","Type":"ContainerStarted","Data":"12794ed06aa9b39ff39999b7a19161ffe1e387bccf1200bc5b3f4512e0f31446"}
May 28 19:43:37.173174 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.173085    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-65m5l" event={"ID":"736956bd-c76a-4005-9901-94e77eac247e","Type":"ContainerStarted","Data":"c48a0dd263e259cef27f99879c38a7e6f5108dbcf17d4748c0e5c6335f7469b4"}
May 28 19:43:37.174453 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.174434    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld" event={"ID":"1f2071eb-70e2-480a-bf23-94afe479ed8f","Type":"ContainerStarted","Data":"dc0be6a5bc2d4418584cd765319e1d671232afc4e8592d40d93992ff4e80b919"}
May 28 19:43:37.175810 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.175721    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vwv8g" event={"ID":"825b4d5d-7813-44d3-9882-e4d91ccb3e8d","Type":"ContainerStarted","Data":"61f90709af0642892b7019aa7125b9c7cccf5bec5213eec4cf88a73529cf7766"}
May 28 19:43:37.190867 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.190830    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g8kcf" podStartSLOduration=3.137965694 podStartE2EDuration="21.190815717s" podCreationTimestamp="2026-05-28 19:43:16 +0000 UTC" firstStartedPulling="2026-05-28 19:43:17.207537483 +0000 UTC m=+1.818262120" lastFinishedPulling="2026-05-28 19:43:35.260387491 +0000 UTC m=+19.871112143" observedRunningTime="2026-05-28 19:43:37.190465447 +0000 UTC m=+21.801190109" watchObservedRunningTime="2026-05-28 19:43:37.190815717 +0000 UTC m=+21.801540378"
May 28 19:43:37.207048 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.207016    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 19:43:37.223729 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.223674    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-vwv8g" podStartSLOduration=2.84300373 podStartE2EDuration="21.22366364s" podCreationTimestamp="2026-05-28 19:43:16 +0000 UTC" firstStartedPulling="2026-05-28 19:43:17.217634163 +0000 UTC m=+1.828358804" lastFinishedPulling="2026-05-28 19:43:35.598294059 +0000 UTC m=+20.209018714" observedRunningTime="2026-05-28 19:43:37.203211462 +0000 UTC m=+21.813936135" watchObservedRunningTime="2026-05-28 19:43:37.22366364 +0000 UTC m=+21.834388299"
May 28 19:43:37.238521 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.238489    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dnn6h" podStartSLOduration=2.941070979 podStartE2EDuration="21.238480153s" podCreationTimestamp="2026-05-28 19:43:16 +0000 UTC" firstStartedPulling="2026-05-28 19:43:17.321348323 +0000 UTC m=+1.932072960" lastFinishedPulling="2026-05-28 19:43:35.618757482 +0000 UTC m=+20.229482134" observedRunningTime="2026-05-28 19:43:37.238261672 +0000 UTC m=+21.848986332" watchObservedRunningTime="2026-05-28 19:43:37.238480153 +0000 UTC m=+21.849204813"
May 28 19:43:37.252291 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.252252    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-65m5l" podStartSLOduration=2.927797625 podStartE2EDuration="21.252242885s" podCreationTimestamp="2026-05-28 19:43:16 +0000 UTC" firstStartedPulling="2026-05-28 19:43:17.273850174 +0000 UTC m=+1.884574825" lastFinishedPulling="2026-05-28 19:43:35.598295433 +0000 UTC m=+20.209020085" observedRunningTime="2026-05-28 19:43:37.251958122 +0000 UTC m=+21.862682784" watchObservedRunningTime="2026-05-28 19:43:37.252242885 +0000 UTC m=+21.862967544"
May 28 19:43:37.343754 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.343729    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g8kcf"
May 28 19:43:37.962174 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.962016    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T19:43:37.20703461Z","UUID":"eda2153f-fcdf-421d-afb8-083839cf1324","Handler":null,"Name":"","Endpoint":""}
May 28 19:43:37.964959 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.964928    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 19:43:37.964959 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:37.964956    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 19:43:38.179163 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:38.179135    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld" event={"ID":"1f2071eb-70e2-480a-bf23-94afe479ed8f","Type":"ContainerStarted","Data":"3670a88f86f45841b40fecaccf795c3effd7f75e9ecf631ad84dec9727c66f22"}
May 28 19:43:38.181274 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:38.181245    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal" event={"ID":"b2f07959bbc8e1863f8f61f4e16ca9cf","Type":"ContainerStarted","Data":"751e7ad4201c0413f4b6a3cf2dd22ce131d5d172169375a1e00cf8b502743711"}
May 28 19:43:38.196025 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:38.195976    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-85.ec2.internal" podStartSLOduration=22.195965831 podStartE2EDuration="22.195965831s" podCreationTimestamp="2026-05-28 19:43:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:43:38.195386402 +0000 UTC m=+22.806111063" watchObservedRunningTime="2026-05-28 19:43:38.195965831 +0000 UTC m=+22.806690491"
May 28 19:43:38.995641 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:38.995612    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:38.995811 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:38.995617    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:38.995875 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:38.995816    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:38.995961 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:38.995941    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:39.184629 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:39.184589    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld" event={"ID":"1f2071eb-70e2-480a-bf23-94afe479ed8f","Type":"ContainerStarted","Data":"e3759ea56eb96d6db063e824e8ddfa0cb0b181af22a3bcf8afd3fbf05e008b21"}
May 28 19:43:39.187404 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:39.187381    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 19:43:39.187814 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:39.187788    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh" event={"ID":"de3d3227-c930-454d-a166-00fc73e8e4c8","Type":"ContainerStarted","Data":"6816a39211a5dfbff32ab10dfada27c56531f78a4a560bb8695acdd2e43e9550"}
May 28 19:43:39.205557 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:39.205519    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fq5ld" podStartSLOduration=2.325810471 podStartE2EDuration="23.205504944s" podCreationTimestamp="2026-05-28 19:43:16 +0000 UTC" firstStartedPulling="2026-05-28 19:43:17.249226824 +0000 UTC m=+1.859951465" lastFinishedPulling="2026-05-28 19:43:38.128921299 +0000 UTC m=+22.739645938" observedRunningTime="2026-05-28 19:43:39.205347021 +0000 UTC m=+23.816071682" watchObservedRunningTime="2026-05-28 19:43:39.205504944 +0000 UTC m=+23.816229608"
May 28 19:43:39.510348 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:39.510318    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-rm9gg"]
May 28 19:43:39.513419 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:39.513396    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:39.513538 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:39.513465    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm9gg" podUID="7de14915-8fec-4966-a17f-864b31d61a92"
May 28 19:43:39.580348 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:39.580322    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7de14915-8fec-4966-a17f-864b31d61a92-dbus\") pod \"global-pull-secret-syncer-rm9gg\" (UID: \"7de14915-8fec-4966-a17f-864b31d61a92\") " pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:39.580505 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:39.580363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7de14915-8fec-4966-a17f-864b31d61a92-kubelet-config\") pod \"global-pull-secret-syncer-rm9gg\" (UID: \"7de14915-8fec-4966-a17f-864b31d61a92\") " pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:39.580505 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:39.580464    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret\") pod \"global-pull-secret-syncer-rm9gg\" (UID: \"7de14915-8fec-4966-a17f-864b31d61a92\") " pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:39.681386 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:39.681355    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7de14915-8fec-4966-a17f-864b31d61a92-dbus\") pod \"global-pull-secret-syncer-rm9gg\" (UID: \"7de14915-8fec-4966-a17f-864b31d61a92\") " pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:39.681511 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:39.681398    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7de14915-8fec-4966-a17f-864b31d61a92-kubelet-config\") pod \"global-pull-secret-syncer-rm9gg\" (UID: \"7de14915-8fec-4966-a17f-864b31d61a92\") " pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:39.681511 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:39.681439    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret\") pod \"global-pull-secret-syncer-rm9gg\" (UID: \"7de14915-8fec-4966-a17f-864b31d61a92\") " pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:39.681616 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:39.681546    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7de14915-8fec-4966-a17f-864b31d61a92-kubelet-config\") pod \"global-pull-secret-syncer-rm9gg\" (UID: \"7de14915-8fec-4966-a17f-864b31d61a92\") " pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:39.681616 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:39.681567    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 19:43:39.681616 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:39.681617    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret podName:7de14915-8fec-4966-a17f-864b31d61a92 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:40.18160358 +0000 UTC m=+24.792328217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret") pod "global-pull-secret-syncer-rm9gg" (UID: "7de14915-8fec-4966-a17f-864b31d61a92") : object "kube-system"/"original-pull-secret" not registered
May 28 19:43:39.681764 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:39.681619    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7de14915-8fec-4966-a17f-864b31d61a92-dbus\") pod \"global-pull-secret-syncer-rm9gg\" (UID: \"7de14915-8fec-4966-a17f-864b31d61a92\") " pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:40.185077 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:40.185038    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret\") pod \"global-pull-secret-syncer-rm9gg\" (UID: \"7de14915-8fec-4966-a17f-864b31d61a92\") " pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:40.185475 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:40.185215    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 19:43:40.185475 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:40.185294    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret podName:7de14915-8fec-4966-a17f-864b31d61a92 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:41.185270441 +0000 UTC m=+25.795995091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret") pod "global-pull-secret-syncer-rm9gg" (UID: "7de14915-8fec-4966-a17f-864b31d61a92") : object "kube-system"/"original-pull-secret" not registered
May 28 19:43:40.996241 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:40.996045    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:40.996411 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:40.996047    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:40.996411 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:40.996323    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:40.996411 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:40.996083    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:40.996554 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:40.996413    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm9gg" podUID="7de14915-8fec-4966-a17f-864b31d61a92"
May 28 19:43:40.996554 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:40.996533    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:41.193036 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:41.192998    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret\") pod \"global-pull-secret-syncer-rm9gg\" (UID: \"7de14915-8fec-4966-a17f-864b31d61a92\") " pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:41.193437 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:41.193127    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 19:43:41.193437 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:41.193197    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret podName:7de14915-8fec-4966-a17f-864b31d61a92 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:43.19317825 +0000 UTC m=+27.803902888 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret") pod "global-pull-secret-syncer-rm9gg" (UID: "7de14915-8fec-4966-a17f-864b31d61a92") : object "kube-system"/"original-pull-secret" not registered
May 28 19:43:41.619194 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:41.619172    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g8kcf"
May 28 19:43:41.619681 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:41.619665    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g8kcf"
May 28 19:43:41.635180 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:41.635163    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g8kcf"
May 28 19:43:42.195500 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:42.195339    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 19:43:42.196219 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:42.195791    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh" event={"ID":"de3d3227-c930-454d-a166-00fc73e8e4c8","Type":"ContainerStarted","Data":"1c6100e7f783c1830ab5d4a44c8bed0eb8966053bfd1c150fc9b543314b7c154"}
May 28 19:43:42.196219 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:42.196045    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:42.196315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:42.196254    2564 scope.go:117] "RemoveContainer" containerID="40314b2e37a241801bf472ca76d298ff037251417524222f5b7b5b73e46d6a81"
May 28 19:43:42.197432 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:42.197406    2564 generic.go:358] "Generic (PLEG): container finished" podID="88ec1a61-1657-45c9-baa3-a6cb36ac6417" containerID="db718e275d979c57acfbef500c5a4286aa1942f11e2ed4582c4d7bab51fb58fc" exitCode=0
May 28 19:43:42.197536 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:42.197477    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2rbf" event={"ID":"88ec1a61-1657-45c9-baa3-a6cb36ac6417","Type":"ContainerDied","Data":"db718e275d979c57acfbef500c5a4286aa1942f11e2ed4582c4d7bab51fb58fc"}
May 28 19:43:42.211312 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:42.211290    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:42.995551 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:42.995515    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:42.995848 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:42.995650    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:42.995848 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:42.995743    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:42.995848 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:42.995818    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:42.996001 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:42.995877    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:42.996001 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:42.995938    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm9gg" podUID="7de14915-8fec-4966-a17f-864b31d61a92"
May 28 19:43:43.203285 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:43.203259    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 19:43:43.203698 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:43.203672    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh" event={"ID":"de3d3227-c930-454d-a166-00fc73e8e4c8","Type":"ContainerStarted","Data":"1d3fdf00e1e1284c6cd4a56033e4079782c2d8d19692e5ea26be2eb9c7f8a8c4"}
May 28 19:43:43.203912 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:43.203883    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:43.204020 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:43.203926    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:43.210851 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:43.210817    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret\") pod \"global-pull-secret-syncer-rm9gg\" (UID: \"7de14915-8fec-4966-a17f-864b31d61a92\") " pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:43.210996 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:43.210966    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 19:43:43.211053 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:43.211025    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret podName:7de14915-8fec-4966-a17f-864b31d61a92 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:47.211008001 +0000 UTC m=+31.821732642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret") pod "global-pull-secret-syncer-rm9gg" (UID: "7de14915-8fec-4966-a17f-864b31d61a92") : object "kube-system"/"original-pull-secret" not registered
May 28 19:43:43.222028 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:43.221789    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:43:43.241915 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:43.241820    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh" podStartSLOduration=8.909956679 podStartE2EDuration="27.24181025s" podCreationTimestamp="2026-05-28 19:43:16 +0000 UTC" firstStartedPulling="2026-05-28 19:43:17.325495399 +0000 UTC m=+1.936220037" lastFinishedPulling="2026-05-28 19:43:35.657348967 +0000 UTC m=+20.268073608" observedRunningTime="2026-05-28 19:43:43.240667066 +0000 UTC m=+27.851391726" watchObservedRunningTime="2026-05-28 19:43:43.24181025 +0000 UTC m=+27.852534927"
May 28 19:43:43.646078 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:43.646049    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rm9gg"]
May 28 19:43:43.646264 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:43.646152    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:43.646264 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:43.646226    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm9gg" podUID="7de14915-8fec-4966-a17f-864b31d61a92"
May 28 19:43:43.649306 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:43.649282    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-96qfr"]
May 28 19:43:43.649400 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:43.649366    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:43.649485 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:43.649464    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:43.649961 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:43.649940    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8nltt"]
May 28 19:43:43.650043 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:43.650030    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:43.650145 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:43.650126    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:44.206624 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:44.206590    2564 generic.go:358] "Generic (PLEG): container finished" podID="88ec1a61-1657-45c9-baa3-a6cb36ac6417" containerID="39d16c4be7b1b322e80721afa0b3eca4c12364fb5a2489b59e4f1246d8b60bbb" exitCode=0
May 28 19:43:44.207062 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:44.206677    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2rbf" event={"ID":"88ec1a61-1657-45c9-baa3-a6cb36ac6417","Type":"ContainerDied","Data":"39d16c4be7b1b322e80721afa0b3eca4c12364fb5a2489b59e4f1246d8b60bbb"}
May 28 19:43:44.995947 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:44.995884    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:44.995947 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:44.995902    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:44.996118 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:44.995984    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:44.996118 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:44.996059    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:44.996118 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:44.996060    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:44.996224 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:44.996147    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm9gg" podUID="7de14915-8fec-4966-a17f-864b31d61a92"
May 28 19:43:45.211563 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:45.211532    2564 generic.go:358] "Generic (PLEG): container finished" podID="88ec1a61-1657-45c9-baa3-a6cb36ac6417" containerID="222c0b0621177eef31d84bd80d0adb4604134c2afa38be40a4f7e40d07897b8c" exitCode=0
May 28 19:43:45.211910 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:45.211579    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2rbf" event={"ID":"88ec1a61-1657-45c9-baa3-a6cb36ac6417","Type":"ContainerDied","Data":"222c0b0621177eef31d84bd80d0adb4604134c2afa38be40a4f7e40d07897b8c"}
May 28 19:43:46.995814 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:46.995784    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:46.996257 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:46.995795    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:46.996257 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:46.995892    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nltt" podUID="9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f"
May 28 19:43:46.996257 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:46.995989    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-96qfr" podUID="de068191-ba48-4ec7-abc0-681b1ee42f3c"
May 28 19:43:46.996257 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:46.995795    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:46.996257 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:46.996146    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rm9gg" podUID="7de14915-8fec-4966-a17f-864b31d61a92"
May 28 19:43:47.244206 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:47.243985    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret\") pod \"global-pull-secret-syncer-rm9gg\" (UID: \"7de14915-8fec-4966-a17f-864b31d61a92\") " pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:47.244372 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:47.244149    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 19:43:47.244372 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:47.244312    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret podName:7de14915-8fec-4966-a17f-864b31d61a92 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:55.244293092 +0000 UTC m=+39.855017730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret") pod "global-pull-secret-syncer-rm9gg" (UID: "7de14915-8fec-4966-a17f-864b31d61a92") : object "kube-system"/"original-pull-secret" not registered
May 28 19:43:48.656174 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.656106    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs\") pod \"network-metrics-daemon-8nltt\" (UID: \"9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f\") " pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:48.656511 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:48.656248    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:48.656511 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:48.656305    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs podName:9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f nodeName:}" failed. No retries permitted until 2026-05-28 19:44:20.656289829 +0000 UTC m=+65.267014467 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs") pod "network-metrics-daemon-8nltt" (UID: "9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 19:43:48.708400 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.708375    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-85.ec2.internal" event="NodeReady"
May 28 19:43:48.708585 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.708482    2564 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 19:43:48.742007 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.741978    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5847dd8b5d-z4x66"]
May 28 19:43:48.756957 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.756929    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29wv4\" (UniqueName: \"kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4\") pod \"network-check-target-96qfr\" (UID: \"de068191-ba48-4ec7-abc0-681b1ee42f3c\") " pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:48.757074 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:48.757047    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 19:43:48.757074 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:48.757070    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 19:43:48.757187 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:48.757083    2564 projected.go:194] Error preparing data for projected volume kube-api-access-29wv4 for pod openshift-network-diagnostics/network-check-target-96qfr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:48.757187 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:48.757158    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4 podName:de068191-ba48-4ec7-abc0-681b1ee42f3c nodeName:}" failed. No retries permitted until 2026-05-28 19:44:20.757139746 +0000 UTC m=+65.367864388 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-29wv4" (UniqueName: "kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4") pod "network-check-target-96qfr" (UID: "de068191-ba48-4ec7-abc0-681b1ee42f3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 19:43:48.760009 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.759979    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s5dcl"]
May 28 19:43:48.760160 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.760140    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.762335 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.762295    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 19:43:48.762432 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.762370    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 19:43:48.762605 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.762590    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 19:43:48.762847 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.762827    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kw6nh\""
May 28 19:43:48.779026 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.779007    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 19:43:48.779891 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.779872    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g948k"]
May 28 19:43:48.780013 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.779996    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s5dcl"
May 28 19:43:48.781665 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.781646    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5847dd8b5d-z4x66"]
May 28 19:43:48.781764 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.781671    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s5dcl"]
May 28 19:43:48.781764 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.781684    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g948k"]
May 28 19:43:48.781865 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.781804    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g948k"
May 28 19:43:48.783077 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.783057    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mmzwh\""
May 28 19:43:48.783604 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.783533    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 19:43:48.784963 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.783945    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 19:43:48.784963 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.784478    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 19:43:48.784963 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.784499    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mqs6v\""
May 28 19:43:48.784963 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.784760    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 19:43:48.785642 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.785623    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 19:43:48.857429 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.857410    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-certificates\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.857508 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.857439    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-bound-sa-token\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.857508 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.857473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca1c6c19-7e44-4447-82ea-126a609cf510-image-registry-private-configuration\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.857585 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.857514    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca1c6c19-7e44-4447-82ea-126a609cf510-ca-trust-extracted\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.857585 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.857541    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrz87\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-kube-api-access-vrz87\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.857643 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.857598    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca1c6c19-7e44-4447-82ea-126a609cf510-installation-pull-secrets\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.857643 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.857627    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca1c6c19-7e44-4447-82ea-126a609cf510-trusted-ca\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.857700 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.857669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.958314 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.958261    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w5kv\" (UniqueName: \"kubernetes.io/projected/dde5c672-a941-41fc-b588-b9336531bd03-kube-api-access-6w5kv\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:43:48.958314 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.958293    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca1c6c19-7e44-4447-82ea-126a609cf510-image-registry-private-configuration\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.958467 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.958320    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca1c6c19-7e44-4447-82ea-126a609cf510-ca-trust-extracted\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.958467 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.958371    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrz87\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-kube-api-access-vrz87\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.958467 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.958438    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca1c6c19-7e44-4447-82ea-126a609cf510-installation-pull-secrets\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.958620 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.958501    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca1c6c19-7e44-4447-82ea-126a609cf510-trusted-ca\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.958620 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.958521    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.958620 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.958539    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dde5c672-a941-41fc-b588-b9336531bd03-tmp-dir\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:43:48.958620 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.958573    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-certificates\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.958620 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.958604    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-bound-sa-token\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.958924 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.958629    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:43:48.958924 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.958655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ckjj\" (UniqueName: \"kubernetes.io/projected/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-kube-api-access-9ckjj\") pod \"ingress-canary-s5dcl\" (UID: \"fd4eb1f4-fa6f-4929-8b84-c23031f62f83\") " pod="openshift-ingress-canary/ingress-canary-s5dcl"
May 28 19:43:48.958924 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.958682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert\") pod \"ingress-canary-s5dcl\" (UID: \"fd4eb1f4-fa6f-4929-8b84-c23031f62f83\") " pod="openshift-ingress-canary/ingress-canary-s5dcl"
May 28 19:43:48.958924 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:48.958717    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 19:43:48.958924 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:48.958734    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5847dd8b5d-z4x66: secret "image-registry-tls" not found
May 28 19:43:48.958924 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.958736    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dde5c672-a941-41fc-b588-b9336531bd03-config-volume\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:43:48.958924 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:48.958806    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls podName:ca1c6c19-7e44-4447-82ea-126a609cf510 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:49.458786704 +0000 UTC m=+34.069511357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls") pod "image-registry-5847dd8b5d-z4x66" (UID: "ca1c6c19-7e44-4447-82ea-126a609cf510") : secret "image-registry-tls" not found
May 28 19:43:48.958924 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.958877    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca1c6c19-7e44-4447-82ea-126a609cf510-ca-trust-extracted\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.959457 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.959439    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-certificates\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.959538 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.959522    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca1c6c19-7e44-4447-82ea-126a609cf510-trusted-ca\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.963542 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.963519    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca1c6c19-7e44-4447-82ea-126a609cf510-image-registry-private-configuration\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.963632 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.963555    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca1c6c19-7e44-4447-82ea-126a609cf510-installation-pull-secrets\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.966700 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.966674    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrz87\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-kube-api-access-vrz87\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.966779 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.966692    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-bound-sa-token\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:48.995977 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.995954    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:43:48.995977 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.995962    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:43:48.996133 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.995959    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:48.998535 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.998515    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 19:43:48.998535 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.998528    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 19:43:48.998687 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.998515    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 19:43:48.998687 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.998557    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 19:43:48.998803 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.998708    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-622pq\""
May 28 19:43:48.998902 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:48.998886    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-msmgn\""
May 28 19:43:49.059215 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:49.059188    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dde5c672-a941-41fc-b588-b9336531bd03-tmp-dir\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:43:49.059368 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:49.059340    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:43:49.059472 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:49.059394    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ckjj\" (UniqueName: \"kubernetes.io/projected/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-kube-api-access-9ckjj\") pod \"ingress-canary-s5dcl\" (UID: \"fd4eb1f4-fa6f-4929-8b84-c23031f62f83\") " pod="openshift-ingress-canary/ingress-canary-s5dcl"
May 28 19:43:49.059472 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:49.059424    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert\") pod \"ingress-canary-s5dcl\" (UID: \"fd4eb1f4-fa6f-4929-8b84-c23031f62f83\") " pod="openshift-ingress-canary/ingress-canary-s5dcl"
May 28 19:43:49.059472 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:49.059468    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dde5c672-a941-41fc-b588-b9336531bd03-config-volume\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:43:49.059605 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:49.059494    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6w5kv\" (UniqueName: \"kubernetes.io/projected/dde5c672-a941-41fc-b588-b9336531bd03-kube-api-access-6w5kv\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:43:49.059605 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:49.059510    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dde5c672-a941-41fc-b588-b9336531bd03-tmp-dir\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:43:49.059705 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:49.059689    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 19:43:49.059753 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:49.059747    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls podName:dde5c672-a941-41fc-b588-b9336531bd03 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:49.5597283 +0000 UTC m=+34.170452938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls") pod "dns-default-g948k" (UID: "dde5c672-a941-41fc-b588-b9336531bd03") : secret "dns-default-metrics-tls" not found
May 28 19:43:49.059885 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:49.059857    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 19:43:49.059964 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:49.059910    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert podName:fd4eb1f4-fa6f-4929-8b84-c23031f62f83 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:49.559893681 +0000 UTC m=+34.170618322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert") pod "ingress-canary-s5dcl" (UID: "fd4eb1f4-fa6f-4929-8b84-c23031f62f83") : secret "canary-serving-cert" not found
May 28 19:43:49.060279 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:49.060259    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dde5c672-a941-41fc-b588-b9336531bd03-config-volume\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:43:49.067552 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:49.067511    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ckjj\" (UniqueName: \"kubernetes.io/projected/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-kube-api-access-9ckjj\") pod \"ingress-canary-s5dcl\" (UID: \"fd4eb1f4-fa6f-4929-8b84-c23031f62f83\") " pod="openshift-ingress-canary/ingress-canary-s5dcl"
May 28 19:43:49.067691 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:49.067672    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w5kv\" (UniqueName: \"kubernetes.io/projected/dde5c672-a941-41fc-b588-b9336531bd03-kube-api-access-6w5kv\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:43:49.462114 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:49.462072    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:49.462250 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:49.462191    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 19:43:49.462250 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:49.462206    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5847dd8b5d-z4x66: secret "image-registry-tls" not found
May 28 19:43:49.462321 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:49.462257    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls podName:ca1c6c19-7e44-4447-82ea-126a609cf510 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:50.462242878 +0000 UTC m=+35.072967515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls") pod "image-registry-5847dd8b5d-z4x66" (UID: "ca1c6c19-7e44-4447-82ea-126a609cf510") : secret "image-registry-tls" not found
May 28 19:43:49.562972 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:49.562950    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:43:49.562972 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:49.562981    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert\") pod \"ingress-canary-s5dcl\" (UID: \"fd4eb1f4-fa6f-4929-8b84-c23031f62f83\") " pod="openshift-ingress-canary/ingress-canary-s5dcl"
May 28 19:43:49.563181 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:49.563119    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 19:43:49.563181 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:49.563174    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls podName:dde5c672-a941-41fc-b588-b9336531bd03 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:50.563161016 +0000 UTC m=+35.173885668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls") pod "dns-default-g948k" (UID: "dde5c672-a941-41fc-b588-b9336531bd03") : secret "dns-default-metrics-tls" not found
May 28 19:43:49.563260 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:49.563119    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 19:43:49.563294 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:49.563259    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert podName:fd4eb1f4-fa6f-4929-8b84-c23031f62f83 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:50.563247222 +0000 UTC m=+35.173971866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert") pod "ingress-canary-s5dcl" (UID: "fd4eb1f4-fa6f-4929-8b84-c23031f62f83") : secret "canary-serving-cert" not found
May 28 19:43:50.469151 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:50.469114    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:50.469721 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:50.469284    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 19:43:50.469721 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:50.469307    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5847dd8b5d-z4x66: secret "image-registry-tls" not found
May 28 19:43:50.469721 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:50.469373    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls podName:ca1c6c19-7e44-4447-82ea-126a609cf510 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:52.469354338 +0000 UTC m=+37.080078979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls") pod "image-registry-5847dd8b5d-z4x66" (UID: "ca1c6c19-7e44-4447-82ea-126a609cf510") : secret "image-registry-tls" not found
May 28 19:43:50.570360 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:50.570332    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:43:50.570531 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:50.570371    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert\") pod \"ingress-canary-s5dcl\" (UID: \"fd4eb1f4-fa6f-4929-8b84-c23031f62f83\") " pod="openshift-ingress-canary/ingress-canary-s5dcl"
May 28 19:43:50.570531 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:50.570487    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 19:43:50.570531 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:50.570489    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 19:43:50.570664 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:50.570551    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert podName:fd4eb1f4-fa6f-4929-8b84-c23031f62f83 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:52.570534035 +0000 UTC m=+37.181258674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert") pod "ingress-canary-s5dcl" (UID: "fd4eb1f4-fa6f-4929-8b84-c23031f62f83") : secret "canary-serving-cert" not found
May 28 19:43:50.570664 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:50.570569    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls podName:dde5c672-a941-41fc-b588-b9336531bd03 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:52.570560937 +0000 UTC m=+37.181285575 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls") pod "dns-default-g948k" (UID: "dde5c672-a941-41fc-b588-b9336531bd03") : secret "dns-default-metrics-tls" not found
May 28 19:43:52.485656 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:52.485611    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:52.486303 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:52.485757    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 19:43:52.486303 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:52.485775    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5847dd8b5d-z4x66: secret "image-registry-tls" not found
May 28 19:43:52.486303 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:52.485831    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls podName:ca1c6c19-7e44-4447-82ea-126a609cf510 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:56.485814729 +0000 UTC m=+41.096539389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls") pod "image-registry-5847dd8b5d-z4x66" (UID: "ca1c6c19-7e44-4447-82ea-126a609cf510") : secret "image-registry-tls" not found
May 28 19:43:52.586857 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:52.586831    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:43:52.586944 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:52.586884    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert\") pod \"ingress-canary-s5dcl\" (UID: \"fd4eb1f4-fa6f-4929-8b84-c23031f62f83\") " pod="openshift-ingress-canary/ingress-canary-s5dcl"
May 28 19:43:52.587001 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:52.586937    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 19:43:52.587001 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:52.586979    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 19:43:52.587001 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:52.586997    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls podName:dde5c672-a941-41fc-b588-b9336531bd03 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:56.586979135 +0000 UTC m=+41.197703788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls") pod "dns-default-g948k" (UID: "dde5c672-a941-41fc-b588-b9336531bd03") : secret "dns-default-metrics-tls" not found
May 28 19:43:52.587163 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:52.587030    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert podName:fd4eb1f4-fa6f-4929-8b84-c23031f62f83 nodeName:}" failed. No retries permitted until 2026-05-28 19:43:56.587019581 +0000 UTC m=+41.197744219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert") pod "ingress-canary-s5dcl" (UID: "fd4eb1f4-fa6f-4929-8b84-c23031f62f83") : secret "canary-serving-cert" not found
May 28 19:43:53.092188 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:53.092125    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"]
May 28 19:43:53.105390 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:53.105367    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"]
May 28 19:43:53.105495 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:53.105469    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"
May 28 19:43:53.107857 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:53.107803    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 28 19:43:53.107857 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:53.107825    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-t829b\""
May 28 19:43:53.108170 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:53.108147    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 28 19:43:53.191917 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:53.191895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-w8sv2\" (UID: \"ae20f3b7-0d46-4792-b2cf-1ec397c0644b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"
May 28 19:43:53.191997 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:53.191981    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-w8sv2\" (UID: \"ae20f3b7-0d46-4792-b2cf-1ec397c0644b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"
May 28 19:43:53.229139 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:53.229116    2564 generic.go:358] "Generic (PLEG): container finished" podID="88ec1a61-1657-45c9-baa3-a6cb36ac6417" containerID="c03f43212308584e682e7d80ab2d447c10fd7514bb1e697fd4089a09042cb49a" exitCode=0
May 28 19:43:53.229211 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:53.229172    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2rbf" event={"ID":"88ec1a61-1657-45c9-baa3-a6cb36ac6417","Type":"ContainerDied","Data":"c03f43212308584e682e7d80ab2d447c10fd7514bb1e697fd4089a09042cb49a"}
May 28 19:43:53.292735 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:53.292642    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-w8sv2\" (UID: \"ae20f3b7-0d46-4792-b2cf-1ec397c0644b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"
May 28 19:43:53.292834 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:53.292752    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-w8sv2\" (UID: \"ae20f3b7-0d46-4792-b2cf-1ec397c0644b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"
May 28 19:43:53.292894 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:53.292834    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 19:43:53.292950 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:53.292905    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert podName:ae20f3b7-0d46-4792-b2cf-1ec397c0644b nodeName:}" failed. No retries permitted until 2026-05-28 19:43:53.79288517 +0000 UTC m=+38.403609811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-w8sv2" (UID: "ae20f3b7-0d46-4792-b2cf-1ec397c0644b") : secret "networking-console-plugin-cert" not found
May 28 19:43:53.293491 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:53.293470    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-w8sv2\" (UID: \"ae20f3b7-0d46-4792-b2cf-1ec397c0644b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"
May 28 19:43:53.797708 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:53.797675    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-w8sv2\" (UID: \"ae20f3b7-0d46-4792-b2cf-1ec397c0644b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"
May 28 19:43:53.798284 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:53.797841    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 19:43:53.798284 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:53.797916    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert podName:ae20f3b7-0d46-4792-b2cf-1ec397c0644b nodeName:}" failed. No retries permitted until 2026-05-28 19:43:54.797896395 +0000 UTC m=+39.408621034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-w8sv2" (UID: "ae20f3b7-0d46-4792-b2cf-1ec397c0644b") : secret "networking-console-plugin-cert" not found
May 28 19:43:54.233431 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:54.233395    2564 generic.go:358] "Generic (PLEG): container finished" podID="88ec1a61-1657-45c9-baa3-a6cb36ac6417" containerID="c9af962bf7ba96ede5e7733a8a26fa9daf255c05933c75c3ee7a3bcd55e5c274" exitCode=0
May 28 19:43:54.233555 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:54.233446    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2rbf" event={"ID":"88ec1a61-1657-45c9-baa3-a6cb36ac6417","Type":"ContainerDied","Data":"c9af962bf7ba96ede5e7733a8a26fa9daf255c05933c75c3ee7a3bcd55e5c274"}
May 28 19:43:54.804482 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:54.804457    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-w8sv2\" (UID: \"ae20f3b7-0d46-4792-b2cf-1ec397c0644b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"
May 28 19:43:54.804765 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:54.804586    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 19:43:54.804765 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:54.804641    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert podName:ae20f3b7-0d46-4792-b2cf-1ec397c0644b nodeName:}" failed. No retries permitted until 2026-05-28 19:43:56.804624969 +0000 UTC m=+41.415349607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-w8sv2" (UID: "ae20f3b7-0d46-4792-b2cf-1ec397c0644b") : secret "networking-console-plugin-cert" not found
May 28 19:43:55.238314 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:55.238272    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z2rbf" event={"ID":"88ec1a61-1657-45c9-baa3-a6cb36ac6417","Type":"ContainerStarted","Data":"3dcc5efca9754d37635716d21c0b61b961fd1a8878a718c4e3d6245469fe97d3"}
May 28 19:43:55.261312 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:55.261253    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z2rbf" podStartSLOduration=3.9324703579999998 podStartE2EDuration="39.261240998s" podCreationTimestamp="2026-05-28 19:43:16 +0000 UTC" firstStartedPulling="2026-05-28 19:43:17.239744073 +0000 UTC m=+1.850468716" lastFinishedPulling="2026-05-28 19:43:52.568514719 +0000 UTC m=+37.179239356" observedRunningTime="2026-05-28 19:43:55.261128649 +0000 UTC m=+39.871853303" watchObservedRunningTime="2026-05-28 19:43:55.261240998 +0000 UTC m=+39.871965657"
May 28 19:43:55.307309 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:55.307286    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret\") pod \"global-pull-secret-syncer-rm9gg\" (UID: \"7de14915-8fec-4966-a17f-864b31d61a92\") " pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:55.309716 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:55.309695    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7de14915-8fec-4966-a17f-864b31d61a92-original-pull-secret\") pod \"global-pull-secret-syncer-rm9gg\" (UID: \"7de14915-8fec-4966-a17f-864b31d61a92\") " pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:55.312687 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:55.312664    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rm9gg"
May 28 19:43:55.494754 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:55.494681    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rm9gg"]
May 28 19:43:55.498877 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:55.498848    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de14915_8fec_4966_a17f_864b31d61a92.slice/crio-618c7d578a7ef3a11fbef206431b3b48819fee911647497281cc16028246c9af WatchSource:0}: Error finding container 618c7d578a7ef3a11fbef206431b3b48819fee911647497281cc16028246c9af: Status 404 returned error can't find the container with id 618c7d578a7ef3a11fbef206431b3b48819fee911647497281cc16028246c9af
May 28 19:43:56.241651 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:56.241613    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rm9gg" event={"ID":"7de14915-8fec-4966-a17f-864b31d61a92","Type":"ContainerStarted","Data":"618c7d578a7ef3a11fbef206431b3b48819fee911647497281cc16028246c9af"}
May 28 19:43:56.514892 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:56.514813    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:43:56.515026 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:56.514949    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 19:43:56.515026 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:56.514961    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5847dd8b5d-z4x66: secret "image-registry-tls" not found
May 28 19:43:56.515026 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:56.515008    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls podName:ca1c6c19-7e44-4447-82ea-126a609cf510 nodeName:}" failed. No retries permitted until 2026-05-28 19:44:04.514994 +0000 UTC m=+49.125718639 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls") pod "image-registry-5847dd8b5d-z4x66" (UID: "ca1c6c19-7e44-4447-82ea-126a609cf510") : secret "image-registry-tls" not found
May 28 19:43:56.615355 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:56.615323    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:43:56.615355 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:56.615357    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert\") pod \"ingress-canary-s5dcl\" (UID: \"fd4eb1f4-fa6f-4929-8b84-c23031f62f83\") " pod="openshift-ingress-canary/ingress-canary-s5dcl"
May 28 19:43:56.615533 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:56.615457    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 19:43:56.615533 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:56.615515    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls podName:dde5c672-a941-41fc-b588-b9336531bd03 nodeName:}" failed. No retries permitted until 2026-05-28 19:44:04.61550019 +0000 UTC m=+49.226224828 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls") pod "dns-default-g948k" (UID: "dde5c672-a941-41fc-b588-b9336531bd03") : secret "dns-default-metrics-tls" not found
May 28 19:43:56.615533 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:56.615518    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 19:43:56.615628 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:56.615556    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert podName:fd4eb1f4-fa6f-4929-8b84-c23031f62f83 nodeName:}" failed. No retries permitted until 2026-05-28 19:44:04.615544986 +0000 UTC m=+49.226269623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert") pod "ingress-canary-s5dcl" (UID: "fd4eb1f4-fa6f-4929-8b84-c23031f62f83") : secret "canary-serving-cert" not found
May 28 19:43:56.816449 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:56.816362    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-w8sv2\" (UID: \"ae20f3b7-0d46-4792-b2cf-1ec397c0644b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"
May 28 19:43:56.816620 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:56.816514    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 19:43:56.816620 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:43:56.816596    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert podName:ae20f3b7-0d46-4792-b2cf-1ec397c0644b nodeName:}" failed. No retries permitted until 2026-05-28 19:44:00.816572989 +0000 UTC m=+45.427297626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-w8sv2" (UID: "ae20f3b7-0d46-4792-b2cf-1ec397c0644b") : secret "networking-console-plugin-cert" not found
May 28 19:43:58.407164 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:58.407130    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-97ht6"]
May 28 19:43:58.425579 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:58.425549    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-97ht6"]
May 28 19:43:58.425729 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:58.425681    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-97ht6"
May 28 19:43:58.427950 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:58.427923    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 28 19:43:58.428726 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:58.428702    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mdh8c\""
May 28 19:43:58.428854 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:58.428735    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 28 19:43:58.529205 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:58.529171    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c72k\" (UniqueName: \"kubernetes.io/projected/928ba040-e175-4a27-a69f-823d313539b3-kube-api-access-2c72k\") pod \"migrator-b985f5d89-97ht6\" (UID: \"928ba040-e175-4a27-a69f-823d313539b3\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-97ht6"
May 28 19:43:58.630321 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:58.630292    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2c72k\" (UniqueName: \"kubernetes.io/projected/928ba040-e175-4a27-a69f-823d313539b3-kube-api-access-2c72k\") pod \"migrator-b985f5d89-97ht6\" (UID: \"928ba040-e175-4a27-a69f-823d313539b3\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-97ht6"
May 28 19:43:58.638341 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:58.638310    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c72k\" (UniqueName: \"kubernetes.io/projected/928ba040-e175-4a27-a69f-823d313539b3-kube-api-access-2c72k\") pod \"migrator-b985f5d89-97ht6\" (UID: \"928ba040-e175-4a27-a69f-823d313539b3\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-97ht6"
May 28 19:43:58.736953 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:58.736889    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-97ht6"
May 28 19:43:59.720520 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:43:59.720491    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-97ht6"]
May 28 19:43:59.723110 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:43:59.723070    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod928ba040_e175_4a27_a69f_823d313539b3.slice/crio-6cdc2957e065ad4e1dfbdb3b388ef399ab5e586f291c78521c38dc44349f4e67 WatchSource:0}: Error finding container 6cdc2957e065ad4e1dfbdb3b388ef399ab5e586f291c78521c38dc44349f4e67: Status 404 returned error can't find the container with id 6cdc2957e065ad4e1dfbdb3b388ef399ab5e586f291c78521c38dc44349f4e67
May 28 19:44:00.251805 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:00.251722    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rm9gg" event={"ID":"7de14915-8fec-4966-a17f-864b31d61a92","Type":"ContainerStarted","Data":"a679bf27fb13074620f59d3eae77876cb0c53b9953b6d531646b96666e77c7ad"}
May 28 19:44:00.252822 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:00.252796    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-97ht6" event={"ID":"928ba040-e175-4a27-a69f-823d313539b3","Type":"ContainerStarted","Data":"6cdc2957e065ad4e1dfbdb3b388ef399ab5e586f291c78521c38dc44349f4e67"}
May 28 19:44:00.268161 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:00.268115    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rm9gg" podStartSLOduration=16.774770224 podStartE2EDuration="21.268084667s" podCreationTimestamp="2026-05-28 19:43:39 +0000 UTC" firstStartedPulling="2026-05-28 19:43:55.50098265 +0000 UTC m=+40.111707300" lastFinishedPulling="2026-05-28 19:43:59.994297102 +0000 UTC m=+44.605021743" observedRunningTime="2026-05-28 19:44:00.266667807 +0000 UTC m=+44.877392467" watchObservedRunningTime="2026-05-28 19:44:00.268084667 +0000 UTC m=+44.878809329"
May 28 19:44:00.860580 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:00.860539    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-w8sv2\" (UID: \"ae20f3b7-0d46-4792-b2cf-1ec397c0644b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"
May 28 19:44:00.861026 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:44:00.860712    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 19:44:00.861026 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:44:00.860789    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert podName:ae20f3b7-0d46-4792-b2cf-1ec397c0644b nodeName:}" failed. No retries permitted until 2026-05-28 19:44:08.860770521 +0000 UTC m=+53.471495164 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-w8sv2" (UID: "ae20f3b7-0d46-4792-b2cf-1ec397c0644b") : secret "networking-console-plugin-cert" not found
May 28 19:44:00.868155 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:00.868128    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bqhgw"]
May 28 19:44:00.881345 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:00.881321    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bqhgw"]
May 28 19:44:00.881477 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:00.881424    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-bqhgw"
May 28 19:44:00.883826 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:00.883805    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 28 19:44:00.883942 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:00.883876    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 28 19:44:00.884702 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:00.884682    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 28 19:44:00.884949 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:00.884927    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pw89j\""
May 28 19:44:00.885117 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:00.884975    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 28 19:44:01.062632 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:01.062603    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2ndt\" (UniqueName: \"kubernetes.io/projected/3ffabbc5-9447-4c73-bf95-57debb100f80-kube-api-access-t2ndt\") pod \"service-ca-67d667c7d-bqhgw\" (UID: \"3ffabbc5-9447-4c73-bf95-57debb100f80\") " pod="openshift-service-ca/service-ca-67d667c7d-bqhgw"
May 28 19:44:01.062632 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:01.062636    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3ffabbc5-9447-4c73-bf95-57debb100f80-signing-cabundle\") pod \"service-ca-67d667c7d-bqhgw\" (UID: \"3ffabbc5-9447-4c73-bf95-57debb100f80\") " pod="openshift-service-ca/service-ca-67d667c7d-bqhgw"
May 28 19:44:01.062802 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:01.062657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3ffabbc5-9447-4c73-bf95-57debb100f80-signing-key\") pod \"service-ca-67d667c7d-bqhgw\" (UID: \"3ffabbc5-9447-4c73-bf95-57debb100f80\") " pod="openshift-service-ca/service-ca-67d667c7d-bqhgw"
May 28 19:44:01.163805 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:01.163782    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t2ndt\" (UniqueName: \"kubernetes.io/projected/3ffabbc5-9447-4c73-bf95-57debb100f80-kube-api-access-t2ndt\") pod \"service-ca-67d667c7d-bqhgw\" (UID: \"3ffabbc5-9447-4c73-bf95-57debb100f80\") " pod="openshift-service-ca/service-ca-67d667c7d-bqhgw"
May 28 19:44:01.163919 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:01.163814    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3ffabbc5-9447-4c73-bf95-57debb100f80-signing-cabundle\") pod \"service-ca-67d667c7d-bqhgw\" (UID: \"3ffabbc5-9447-4c73-bf95-57debb100f80\") " pod="openshift-service-ca/service-ca-67d667c7d-bqhgw"
May 28 19:44:01.163919 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:01.163835    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3ffabbc5-9447-4c73-bf95-57debb100f80-signing-key\") pod \"service-ca-67d667c7d-bqhgw\" (UID: \"3ffabbc5-9447-4c73-bf95-57debb100f80\") " pod="openshift-service-ca/service-ca-67d667c7d-bqhgw"
May 28 19:44:01.164387 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:01.164370    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3ffabbc5-9447-4c73-bf95-57debb100f80-signing-cabundle\") pod \"service-ca-67d667c7d-bqhgw\" (UID: \"3ffabbc5-9447-4c73-bf95-57debb100f80\") " pod="openshift-service-ca/service-ca-67d667c7d-bqhgw"
May 28 19:44:01.166056 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:01.166037    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3ffabbc5-9447-4c73-bf95-57debb100f80-signing-key\") pod \"service-ca-67d667c7d-bqhgw\" (UID: \"3ffabbc5-9447-4c73-bf95-57debb100f80\") " pod="openshift-service-ca/service-ca-67d667c7d-bqhgw"
May 28 19:44:01.171540 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:01.171522    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2ndt\" (UniqueName: \"kubernetes.io/projected/3ffabbc5-9447-4c73-bf95-57debb100f80-kube-api-access-t2ndt\") pod \"service-ca-67d667c7d-bqhgw\" (UID: \"3ffabbc5-9447-4c73-bf95-57debb100f80\") " pod="openshift-service-ca/service-ca-67d667c7d-bqhgw"
May 28 19:44:01.192366 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:01.192346    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-bqhgw"
May 28 19:44:01.306018 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:01.306002    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vwv8g_825b4d5d-7813-44d3-9882-e4d91ccb3e8d/dns-node-resolver/0.log"
May 28 19:44:01.486944 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:01.486918    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-bqhgw"]
May 28 19:44:01.490462 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:44:01.490438    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ffabbc5_9447_4c73_bf95_57debb100f80.slice/crio-756b70865e0be8583e1e5f0c03026279e1258d4dec6ef1ae228c153bedfcf9d2 WatchSource:0}: Error finding container 756b70865e0be8583e1e5f0c03026279e1258d4dec6ef1ae228c153bedfcf9d2: Status 404 returned error can't find the container with id 756b70865e0be8583e1e5f0c03026279e1258d4dec6ef1ae228c153bedfcf9d2
May 28 19:44:02.106552 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:02.106523    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-65m5l_736956bd-c76a-4005-9901-94e77eac247e/node-ca/0.log"
May 28 19:44:02.258020 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:02.257971    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-97ht6" event={"ID":"928ba040-e175-4a27-a69f-823d313539b3","Type":"ContainerStarted","Data":"d4d651d94407eb717b085d0eb2c623a11a17aafbce5c715557162c939207f3a1"}
May 28 19:44:02.258020 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:02.258016    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-97ht6" event={"ID":"928ba040-e175-4a27-a69f-823d313539b3","Type":"ContainerStarted","Data":"e8a53967fd1d8557afaff9612d47a23548c37777ac4a39414080e11e0bc069ed"}
May 28 19:44:02.259070 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:02.259045    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-bqhgw" event={"ID":"3ffabbc5-9447-4c73-bf95-57debb100f80","Type":"ContainerStarted","Data":"756b70865e0be8583e1e5f0c03026279e1258d4dec6ef1ae228c153bedfcf9d2"}
May 28 19:44:02.275768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:02.275718    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-97ht6" podStartSLOduration=2.6258539880000002 podStartE2EDuration="4.275700485s" podCreationTimestamp="2026-05-28 19:43:58 +0000 UTC" firstStartedPulling="2026-05-28 19:43:59.725483174 +0000 UTC m=+44.336207818" lastFinishedPulling="2026-05-28 19:44:01.375329662 +0000 UTC m=+45.986054315" observedRunningTime="2026-05-28 19:44:02.274187362 +0000 UTC m=+46.884912023" watchObservedRunningTime="2026-05-28 19:44:02.275700485 +0000 UTC m=+46.886425146"
May 28 19:44:03.307878 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:03.307846    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-97ht6_928ba040-e175-4a27-a69f-823d313539b3/migrator/0.log"
May 28 19:44:03.507173 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:03.507140    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-97ht6_928ba040-e175-4a27-a69f-823d313539b3/graceful-termination/0.log"
May 28 19:44:04.264773 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:04.264739    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-bqhgw" event={"ID":"3ffabbc5-9447-4c73-bf95-57debb100f80","Type":"ContainerStarted","Data":"ede833d7cff9de754451f2444530ddf6b323d94f7a287feeca785572a6bc2bf0"}
May 28 19:44:04.281761 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:04.281709    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-bqhgw" podStartSLOduration=1.9907803450000001 podStartE2EDuration="4.281695957s" podCreationTimestamp="2026-05-28 19:44:00 +0000 UTC" firstStartedPulling="2026-05-28 19:44:01.492237191 +0000 UTC m=+46.102961829" lastFinishedPulling="2026-05-28 19:44:03.783152799 +0000 UTC m=+48.393877441" observedRunningTime="2026-05-28 19:44:04.280979444 +0000 UTC m=+48.891704105" watchObservedRunningTime="2026-05-28 19:44:04.281695957 +0000 UTC m=+48.892420616"
May 28 19:44:04.586899 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:04.586836    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:44:04.587239 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:44:04.586971    2564 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 19:44:04.587239 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:44:04.586985    2564 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5847dd8b5d-z4x66: secret "image-registry-tls" not found
May 28 19:44:04.587239 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:44:04.587037    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls podName:ca1c6c19-7e44-4447-82ea-126a609cf510 nodeName:}" failed. No retries permitted until 2026-05-28 19:44:20.587022055 +0000 UTC m=+65.197746713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls") pod "image-registry-5847dd8b5d-z4x66" (UID: "ca1c6c19-7e44-4447-82ea-126a609cf510") : secret "image-registry-tls" not found
May 28 19:44:04.687802 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:04.687775    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:44:04.687917 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:04.687806    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert\") pod \"ingress-canary-s5dcl\" (UID: \"fd4eb1f4-fa6f-4929-8b84-c23031f62f83\") " pod="openshift-ingress-canary/ingress-canary-s5dcl"
May 28 19:44:04.687917 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:44:04.687903    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 19:44:04.688022 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:44:04.687922    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 19:44:04.688022 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:44:04.687958    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert podName:fd4eb1f4-fa6f-4929-8b84-c23031f62f83 nodeName:}" failed. No retries permitted until 2026-05-28 19:44:20.687943092 +0000 UTC m=+65.298667731 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert") pod "ingress-canary-s5dcl" (UID: "fd4eb1f4-fa6f-4929-8b84-c23031f62f83") : secret "canary-serving-cert" not found
May 28 19:44:04.688022 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:44:04.687982    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls podName:dde5c672-a941-41fc-b588-b9336531bd03 nodeName:}" failed. No retries permitted until 2026-05-28 19:44:20.687963849 +0000 UTC m=+65.298688502 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls") pod "dns-default-g948k" (UID: "dde5c672-a941-41fc-b588-b9336531bd03") : secret "dns-default-metrics-tls" not found
May 28 19:44:08.914830 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:08.914794    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-w8sv2\" (UID: \"ae20f3b7-0d46-4792-b2cf-1ec397c0644b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"
May 28 19:44:08.915368 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:44:08.914961    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 19:44:08.915368 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:44:08.915042    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert podName:ae20f3b7-0d46-4792-b2cf-1ec397c0644b nodeName:}" failed. No retries permitted until 2026-05-28 19:44:24.915020802 +0000 UTC m=+69.525745454 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-w8sv2" (UID: "ae20f3b7-0d46-4792-b2cf-1ec397c0644b") : secret "networking-console-plugin-cert" not found
May 28 19:44:15.222035 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:15.222005    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9hmkh"
May 28 19:44:20.291456 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.291424    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q9z4j"]
May 28 19:44:20.294341 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.294321    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.297875 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.297851    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 19:44:20.297988 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.297882    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 19:44:20.299124 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.298076    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 19:44:20.299124 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.298500    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5qmfg\""
May 28 19:44:20.299124 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.298627    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 19:44:20.307756 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.307736    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5847dd8b5d-z4x66"]
May 28 19:44:20.307868 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:44:20.307853    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66" podUID="ca1c6c19-7e44-4447-82ea-126a609cf510"
May 28 19:44:20.312878 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.312856    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q9z4j"]
May 28 19:44:20.351943 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.351917    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-lkbg4"]
May 28 19:44:20.353717 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.353703    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-lkbg4"
May 28 19:44:20.356291 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.356271    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 19:44:20.356376 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.356298    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 19:44:20.357817 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.357799    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-69mwq\""
May 28 19:44:20.358371 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.358348    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d96df59fd-wxrh7"]
May 28 19:44:20.360341 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.360324    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.361365 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.361347    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-629g4"]
May 28 19:44:20.363104 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.363076    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-629g4"
May 28 19:44:20.365878 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.365854    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 28 19:44:20.366591 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.366574    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-lkbg4"]
May 28 19:44:20.366666 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.366573    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-7dh5g\""
May 28 19:44:20.372846 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.372676    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d96df59fd-wxrh7"]
May 28 19:44:20.374743 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.374723    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-629g4"]
May 28 19:44:20.393344 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.393321    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-installation-pull-secrets\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.393434 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.393351    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9z4j\" (UID: \"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e\") " pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.393434 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.393395    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9z4j\" (UID: \"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e\") " pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.393513 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.393441    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtqdv\" (UniqueName: \"kubernetes.io/projected/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-kube-api-access-vtqdv\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.393513 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.393496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcwlm\" (UniqueName: \"kubernetes.io/projected/46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e-kube-api-access-pcwlm\") pod \"insights-runtime-extractor-q9z4j\" (UID: \"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e\") " pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.393584 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.393526    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c7hm\" (UniqueName: \"kubernetes.io/projected/d4071f1d-7d2b-4deb-86ea-a15623271352-kube-api-access-8c7hm\") pod \"downloads-57bd96b888-lkbg4\" (UID: \"d4071f1d-7d2b-4deb-86ea-a15623271352\") " pod="openshift-console/downloads-57bd96b888-lkbg4"
May 28 19:44:20.393584 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.393567    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-bound-sa-token\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.393652 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.393594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e-data-volume\") pod \"insights-runtime-extractor-q9z4j\" (UID: \"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e\") " pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.393652 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.393630    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-trusted-ca\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.393716 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.393654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-ca-trust-extracted\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.393716 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.393672    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-image-registry-private-configuration\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.393716 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.393688    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e-crio-socket\") pod \"insights-runtime-extractor-q9z4j\" (UID: \"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e\") " pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.393716 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.393711    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-registry-tls\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.393853 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.393799    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-registry-certificates\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.393853 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.393843    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f65847cf-f3b8-4ade-9d21-cb52e9908388-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-629g4\" (UID: \"f65847cf-f3b8-4ade-9d21-cb52e9908388\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-629g4"
May 28 19:44:20.494347 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.494325    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-ca-trust-extracted\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.494434 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.494350    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-image-registry-private-configuration\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.494434 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.494367    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e-crio-socket\") pod \"insights-runtime-extractor-q9z4j\" (UID: \"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e\") " pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.494434 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.494384    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-registry-tls\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.494434 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.494408    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-registry-certificates\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.494606 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.494434    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f65847cf-f3b8-4ade-9d21-cb52e9908388-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-629g4\" (UID: \"f65847cf-f3b8-4ade-9d21-cb52e9908388\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-629g4"
May 28 19:44:20.494606 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.494453    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-installation-pull-secrets\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.494606 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.494469    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9z4j\" (UID: \"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e\") " pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.494606 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.494471    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e-crio-socket\") pod \"insights-runtime-extractor-q9z4j\" (UID: \"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e\") " pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.494606 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.494497    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9z4j\" (UID: \"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e\") " pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.494606 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.494520    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vtqdv\" (UniqueName: \"kubernetes.io/projected/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-kube-api-access-vtqdv\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.495017 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.494997    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-ca-trust-extracted\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.495606 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.495155    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q9z4j\" (UID: \"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e\") " pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.495606 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.495265    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcwlm\" (UniqueName: \"kubernetes.io/projected/46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e-kube-api-access-pcwlm\") pod \"insights-runtime-extractor-q9z4j\" (UID: \"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e\") " pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.495606 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.495308    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8c7hm\" (UniqueName: \"kubernetes.io/projected/d4071f1d-7d2b-4deb-86ea-a15623271352-kube-api-access-8c7hm\") pod \"downloads-57bd96b888-lkbg4\" (UID: \"d4071f1d-7d2b-4deb-86ea-a15623271352\") " pod="openshift-console/downloads-57bd96b888-lkbg4"
May 28 19:44:20.495606 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.495339    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-bound-sa-token\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.495606 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.495370    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e-data-volume\") pod \"insights-runtime-extractor-q9z4j\" (UID: \"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e\") " pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.495606 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.495397    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-trusted-ca\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.495606 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.495587    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-registry-certificates\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.496073 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.495852    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e-data-volume\") pod \"insights-runtime-extractor-q9z4j\" (UID: \"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e\") " pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.497151 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.497125    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-trusted-ca\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.497303 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.497243    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-installation-pull-secrets\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.497538 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.497518    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q9z4j\" (UID: \"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e\") " pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.497603 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.497575    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f65847cf-f3b8-4ade-9d21-cb52e9908388-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-629g4\" (UID: \"f65847cf-f3b8-4ade-9d21-cb52e9908388\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-629g4"
May 28 19:44:20.497638 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.497627    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-registry-tls\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.497679 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.497659    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-image-registry-private-configuration\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.503043 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.503018    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtqdv\" (UniqueName: \"kubernetes.io/projected/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-kube-api-access-vtqdv\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.504663 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.504631    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcwlm\" (UniqueName: \"kubernetes.io/projected/46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e-kube-api-access-pcwlm\") pod \"insights-runtime-extractor-q9z4j\" (UID: \"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e\") " pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.505085 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.505067    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c7hm\" (UniqueName: \"kubernetes.io/projected/d4071f1d-7d2b-4deb-86ea-a15623271352-kube-api-access-8c7hm\") pod \"downloads-57bd96b888-lkbg4\" (UID: \"d4071f1d-7d2b-4deb-86ea-a15623271352\") " pod="openshift-console/downloads-57bd96b888-lkbg4"
May 28 19:44:20.505390 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.505363    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d85afd8b-d1f4-40ff-8919-7b5ec37f7115-bound-sa-token\") pod \"image-registry-5d96df59fd-wxrh7\" (UID: \"d85afd8b-d1f4-40ff-8919-7b5ec37f7115\") " pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.596118 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.596044    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:44:20.597867 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.597851    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls\") pod \"image-registry-5847dd8b5d-z4x66\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") " pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:44:20.604840 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.604823    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q9z4j"
May 28 19:44:20.662562 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.662529    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-lkbg4"
May 28 19:44:20.671744 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.671636    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kw6nh\""
May 28 19:44:20.676069 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.675662    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-629g4"
May 28 19:44:20.679636 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.679614    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:20.697054 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.697018    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:44:20.697207 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.697071    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert\") pod \"ingress-canary-s5dcl\" (UID: \"fd4eb1f4-fa6f-4929-8b84-c23031f62f83\") " pod="openshift-ingress-canary/ingress-canary-s5dcl"
May 28 19:44:20.697207 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.697186    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs\") pod \"network-metrics-daemon-8nltt\" (UID: \"9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f\") " pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:44:20.699843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.699650    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 19:44:20.699843 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.699694    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd4eb1f4-fa6f-4929-8b84-c23031f62f83-cert\") pod \"ingress-canary-s5dcl\" (UID: \"fd4eb1f4-fa6f-4929-8b84-c23031f62f83\") " pod="openshift-ingress-canary/ingress-canary-s5dcl"
May 28 19:44:20.700001 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.699980    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dde5c672-a941-41fc-b588-b9336531bd03-metrics-tls\") pod \"dns-default-g948k\" (UID: \"dde5c672-a941-41fc-b588-b9336531bd03\") " pod="openshift-dns/dns-default-g948k"
May 28 19:44:20.710469 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.710429    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f-metrics-certs\") pod \"network-metrics-daemon-8nltt\" (UID: \"9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f\") " pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:44:20.727848 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.727800    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q9z4j"]
May 28 19:44:20.734368 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:44:20.734338    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46fd38b6_2d92_4c6c_8cf8_0eebdb71a22e.slice/crio-3eef524ba49927bf3b89d2ccf2693696aba419171c210ae0533c5bb0042b93a0 WatchSource:0}: Error finding container 3eef524ba49927bf3b89d2ccf2693696aba419171c210ae0533c5bb0042b93a0: Status 404 returned error can't find the container with id 3eef524ba49927bf3b89d2ccf2693696aba419171c210ae0533c5bb0042b93a0
May 28 19:44:20.798584 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.798562    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29wv4\" (UniqueName: \"kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4\") pod \"network-check-target-96qfr\" (UID: \"de068191-ba48-4ec7-abc0-681b1ee42f3c\") " pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:44:20.801291 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.801264    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 19:44:20.808037 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.808013    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-lkbg4"]
May 28 19:44:20.808854 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.808834    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-msmgn\""
May 28 19:44:20.810689 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.810665    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 19:44:20.812629 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:44:20.812489    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4071f1d_7d2b_4deb_86ea_a15623271352.slice/crio-0ac30f0fc45f3c4ab8833cfcb08ee2808b2aa0c593c5507d47bfb23d1af98e96 WatchSource:0}: Error finding container 0ac30f0fc45f3c4ab8833cfcb08ee2808b2aa0c593c5507d47bfb23d1af98e96: Status 404 returned error can't find the container with id 0ac30f0fc45f3c4ab8833cfcb08ee2808b2aa0c593c5507d47bfb23d1af98e96
May 28 19:44:20.817543 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.817524    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nltt"
May 28 19:44:20.821268 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.821249    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29wv4\" (UniqueName: \"kubernetes.io/projected/de068191-ba48-4ec7-abc0-681b1ee42f3c-kube-api-access-29wv4\") pod \"network-check-target-96qfr\" (UID: \"de068191-ba48-4ec7-abc0-681b1ee42f3c\") " pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:44:20.827672 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.827647    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d96df59fd-wxrh7"]
May 28 19:44:20.830486 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:44:20.830458    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd85afd8b_d1f4_40ff_8919_7b5ec37f7115.slice/crio-820df92990f67b9d3735f3f2df54db57f79fa54da6ef95f5e9488b9bfd49a6f8 WatchSource:0}: Error finding container 820df92990f67b9d3735f3f2df54db57f79fa54da6ef95f5e9488b9bfd49a6f8: Status 404 returned error can't find the container with id 820df92990f67b9d3735f3f2df54db57f79fa54da6ef95f5e9488b9bfd49a6f8
May 28 19:44:20.840409 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.840385    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-629g4"]
May 28 19:44:20.843692 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:44:20.843648    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf65847cf_f3b8_4ade_9d21_cb52e9908388.slice/crio-614e74b07b1306c242b15effe96f046fde646d836cb6a30cb133f5742ac2605c WatchSource:0}: Error finding container 614e74b07b1306c242b15effe96f046fde646d836cb6a30cb133f5742ac2605c: Status 404 returned error can't find the container with id 614e74b07b1306c242b15effe96f046fde646d836cb6a30cb133f5742ac2605c
May 28 19:44:20.894691 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.894652    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mmzwh\""
May 28 19:44:20.900426 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.900239    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mqs6v\""
May 28 19:44:20.902386 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.902304    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s5dcl"
May 28 19:44:20.908879 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.908848    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g948k"
May 28 19:44:20.948780 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:20.948755    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8nltt"]
May 28 19:44:21.043622 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.043578    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s5dcl"]
May 28 19:44:21.046972 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:44:21.046943    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd4eb1f4_fa6f_4929_8b84_c23031f62f83.slice/crio-0a5c675c74d714c8e21b5214bd85653b9b2eab2f06244dc4677e93d03e6cac69 WatchSource:0}: Error finding container 0a5c675c74d714c8e21b5214bd85653b9b2eab2f06244dc4677e93d03e6cac69: Status 404 returned error can't find the container with id 0a5c675c74d714c8e21b5214bd85653b9b2eab2f06244dc4677e93d03e6cac69
May 28 19:44:21.064794 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.064772    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g948k"]
May 28 19:44:21.068300 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:44:21.068275    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde5c672_a941_41fc_b588_b9336531bd03.slice/crio-47aefd87b026823c4797bb670c24b5d436dc0d3ba000eae431efc30aada860a7 WatchSource:0}: Error finding container 47aefd87b026823c4797bb670c24b5d436dc0d3ba000eae431efc30aada860a7: Status 404 returned error can't find the container with id 47aefd87b026823c4797bb670c24b5d436dc0d3ba000eae431efc30aada860a7
May 28 19:44:21.119548 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.119493    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-622pq\""
May 28 19:44:21.128384 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.128364    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:44:21.256185 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.256156    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-96qfr"]
May 28 19:44:21.259915 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:44:21.259888    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde068191_ba48_4ec7_abc0_681b1ee42f3c.slice/crio-fa55e102c573b6a140159cf75957352c4f17b8a1aeb664622ddfc21a13c18797 WatchSource:0}: Error finding container fa55e102c573b6a140159cf75957352c4f17b8a1aeb664622ddfc21a13c18797: Status 404 returned error can't find the container with id fa55e102c573b6a140159cf75957352c4f17b8a1aeb664622ddfc21a13c18797
May 28 19:44:21.300824 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.300786    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-96qfr" event={"ID":"de068191-ba48-4ec7-abc0-681b1ee42f3c","Type":"ContainerStarted","Data":"fa55e102c573b6a140159cf75957352c4f17b8a1aeb664622ddfc21a13c18797"}
May 28 19:44:21.301980 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.301952    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s5dcl" event={"ID":"fd4eb1f4-fa6f-4929-8b84-c23031f62f83","Type":"ContainerStarted","Data":"0a5c675c74d714c8e21b5214bd85653b9b2eab2f06244dc4677e93d03e6cac69"}
May 28 19:44:21.303571 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.303550    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7" event={"ID":"d85afd8b-d1f4-40ff-8919-7b5ec37f7115","Type":"ContainerStarted","Data":"37a329986e4163067ef22a75d4e320c549b3ae107aed0bb3a745414862e56404"}
May 28 19:44:21.303681 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.303578    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7" event={"ID":"d85afd8b-d1f4-40ff-8919-7b5ec37f7115","Type":"ContainerStarted","Data":"820df92990f67b9d3735f3f2df54db57f79fa54da6ef95f5e9488b9bfd49a6f8"}
May 28 19:44:21.303745 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.303699    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:21.304721 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.304697    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-lkbg4" event={"ID":"d4071f1d-7d2b-4deb-86ea-a15623271352","Type":"ContainerStarted","Data":"0ac30f0fc45f3c4ab8833cfcb08ee2808b2aa0c593c5507d47bfb23d1af98e96"}
May 28 19:44:21.305784 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.305754    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g948k" event={"ID":"dde5c672-a941-41fc-b588-b9336531bd03","Type":"ContainerStarted","Data":"47aefd87b026823c4797bb670c24b5d436dc0d3ba000eae431efc30aada860a7"}
May 28 19:44:21.306861 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.306836    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8nltt" event={"ID":"9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f","Type":"ContainerStarted","Data":"3f814bca5a0559e058ba069ed03d72cdf2377ca167ece3e861ed03ad71c110f2"}
May 28 19:44:21.307951 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.307925    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-629g4" event={"ID":"f65847cf-f3b8-4ade-9d21-cb52e9908388","Type":"ContainerStarted","Data":"614e74b07b1306c242b15effe96f046fde646d836cb6a30cb133f5742ac2605c"}
May 28 19:44:21.309325 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.309299    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q9z4j" event={"ID":"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e","Type":"ContainerStarted","Data":"7edce62cdc7c0036934b752fbc1aafab6a778080a99b4f955344fbff0196dac8"}
May 28 19:44:21.309413 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.309331    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q9z4j" event={"ID":"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e","Type":"ContainerStarted","Data":"3eef524ba49927bf3b89d2ccf2693696aba419171c210ae0533c5bb0042b93a0"}
May 28 19:44:21.309413 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.309369    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:44:21.314385 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.314368    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:44:21.324602 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.324562    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7" podStartSLOduration=1.324549782 podStartE2EDuration="1.324549782s" podCreationTimestamp="2026-05-28 19:44:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:44:21.32336586 +0000 UTC m=+65.934090521" watchObservedRunningTime="2026-05-28 19:44:21.324549782 +0000 UTC m=+65.935274477"
May 28 19:44:21.404574 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.403174    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca1c6c19-7e44-4447-82ea-126a609cf510-ca-trust-extracted\") pod \"ca1c6c19-7e44-4447-82ea-126a609cf510\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") "
May 28 19:44:21.404574 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.403222    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrz87\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-kube-api-access-vrz87\") pod \"ca1c6c19-7e44-4447-82ea-126a609cf510\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") "
May 28 19:44:21.404574 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.403248    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls\") pod \"ca1c6c19-7e44-4447-82ea-126a609cf510\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") "
May 28 19:44:21.404574 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.403299    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-certificates\") pod \"ca1c6c19-7e44-4447-82ea-126a609cf510\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") "
May 28 19:44:21.404574 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.403335    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca1c6c19-7e44-4447-82ea-126a609cf510-installation-pull-secrets\") pod \"ca1c6c19-7e44-4447-82ea-126a609cf510\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") "
May 28 19:44:21.404574 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.403374    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca1c6c19-7e44-4447-82ea-126a609cf510-trusted-ca\") pod \"ca1c6c19-7e44-4447-82ea-126a609cf510\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") "
May 28 19:44:21.404574 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.403409    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-bound-sa-token\") pod \"ca1c6c19-7e44-4447-82ea-126a609cf510\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") "
May 28 19:44:21.404574 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.403448    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca1c6c19-7e44-4447-82ea-126a609cf510-image-registry-private-configuration\") pod \"ca1c6c19-7e44-4447-82ea-126a609cf510\" (UID: \"ca1c6c19-7e44-4447-82ea-126a609cf510\") "
May 28 19:44:21.404574 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.404286    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca1c6c19-7e44-4447-82ea-126a609cf510-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ca1c6c19-7e44-4447-82ea-126a609cf510" (UID: "ca1c6c19-7e44-4447-82ea-126a609cf510"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:44:21.406468 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.406109    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca1c6c19-7e44-4447-82ea-126a609cf510-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ca1c6c19-7e44-4447-82ea-126a609cf510" (UID: "ca1c6c19-7e44-4447-82ea-126a609cf510"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:44:21.406468 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.406413    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ca1c6c19-7e44-4447-82ea-126a609cf510" (UID: "ca1c6c19-7e44-4447-82ea-126a609cf510"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 19:44:21.412453 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.411451    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca1c6c19-7e44-4447-82ea-126a609cf510-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ca1c6c19-7e44-4447-82ea-126a609cf510" (UID: "ca1c6c19-7e44-4447-82ea-126a609cf510"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:44:21.412453 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.411658    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca1c6c19-7e44-4447-82ea-126a609cf510-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ca1c6c19-7e44-4447-82ea-126a609cf510" (UID: "ca1c6c19-7e44-4447-82ea-126a609cf510"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 19:44:21.412453 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.411784    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ca1c6c19-7e44-4447-82ea-126a609cf510" (UID: "ca1c6c19-7e44-4447-82ea-126a609cf510"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:44:21.412751 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.412731    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-kube-api-access-vrz87" (OuterVolumeSpecName: "kube-api-access-vrz87") pod "ca1c6c19-7e44-4447-82ea-126a609cf510" (UID: "ca1c6c19-7e44-4447-82ea-126a609cf510"). InnerVolumeSpecName "kube-api-access-vrz87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:44:21.413721 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.413698    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ca1c6c19-7e44-4447-82ea-126a609cf510" (UID: "ca1c6c19-7e44-4447-82ea-126a609cf510"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:44:21.505176 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.505071    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca1c6c19-7e44-4447-82ea-126a609cf510-trusted-ca\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:44:21.505176 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.505114    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-bound-sa-token\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:44:21.505176 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.505129    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca1c6c19-7e44-4447-82ea-126a609cf510-image-registry-private-configuration\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:44:21.505176 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.505145    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca1c6c19-7e44-4447-82ea-126a609cf510-ca-trust-extracted\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:44:21.505176 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.505160    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrz87\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-kube-api-access-vrz87\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:44:21.505176 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.505173    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-tls\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:44:21.505539 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.505185    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca1c6c19-7e44-4447-82ea-126a609cf510-registry-certificates\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:44:21.505539 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:21.505199    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca1c6c19-7e44-4447-82ea-126a609cf510-installation-pull-secrets\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:44:22.316931 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:22.316751    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5847dd8b5d-z4x66"
May 28 19:44:22.317370 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:22.317176    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q9z4j" event={"ID":"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e","Type":"ContainerStarted","Data":"3f46a7db57c764d813b2174e4f9545c1d0f2b05cee950105ce03cb2a9c544852"}
May 28 19:44:22.349408 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:22.349378    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5847dd8b5d-z4x66"]
May 28 19:44:22.353365 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:22.353316    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5847dd8b5d-z4x66"]
May 28 19:44:24.000029 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:23.999993    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca1c6c19-7e44-4447-82ea-126a609cf510" path="/var/lib/kubelet/pods/ca1c6c19-7e44-4447-82ea-126a609cf510/volumes"
May 28 19:44:24.937272 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:24.937233    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-w8sv2\" (UID: \"ae20f3b7-0d46-4792-b2cf-1ec397c0644b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"
May 28 19:44:24.939984 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:24.939960    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ae20f3b7-0d46-4792-b2cf-1ec397c0644b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-w8sv2\" (UID: \"ae20f3b7-0d46-4792-b2cf-1ec397c0644b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"
May 28 19:44:25.217420 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:25.217346    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-t829b\""
May 28 19:44:25.225228 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:25.225206    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"
May 28 19:44:26.225684 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:26.224582    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2"]
May 28 19:44:26.234821 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:44:26.234629    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae20f3b7_0d46_4792_b2cf_1ec397c0644b.slice/crio-d73e00b6274f16d06adda4fe4d11a03f149b58578603d2f27595aaba72bd0dff WatchSource:0}: Error finding container d73e00b6274f16d06adda4fe4d11a03f149b58578603d2f27595aaba72bd0dff: Status 404 returned error can't find the container with id d73e00b6274f16d06adda4fe4d11a03f149b58578603d2f27595aaba72bd0dff
May 28 19:44:26.338426 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:26.338394    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-96qfr" event={"ID":"de068191-ba48-4ec7-abc0-681b1ee42f3c","Type":"ContainerStarted","Data":"00754e8e318ee347f1eca6f398a81504159177f50b471f39ee60c5dfe7c0e0a7"}
May 28 19:44:26.338532 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:26.338483    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:44:26.340043 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:26.340012    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s5dcl" event={"ID":"fd4eb1f4-fa6f-4929-8b84-c23031f62f83","Type":"ContainerStarted","Data":"caba9033b6a3c57c81a8db464a033b52b1ef30947a06bd7d3dedf5f32e10c094"}
May 28 19:44:26.341478 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:26.341424    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2" event={"ID":"ae20f3b7-0d46-4792-b2cf-1ec397c0644b","Type":"ContainerStarted","Data":"d73e00b6274f16d06adda4fe4d11a03f149b58578603d2f27595aaba72bd0dff"}
May 28 19:44:26.347174 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:26.345605    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g948k" event={"ID":"dde5c672-a941-41fc-b588-b9336531bd03","Type":"ContainerStarted","Data":"856cb6fb6b855d1bf8308e9589bb8b81ac7d79aed59bcc7a467baaf50f620c06"}
May 28 19:44:26.348453 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:26.348418    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8nltt" event={"ID":"9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f","Type":"ContainerStarted","Data":"61075b92e1861e7f8761a8d4e41f77901e2f4dda04a786abf21617ade5b5649f"}
May 28 19:44:26.349906 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:26.349881    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-629g4" event={"ID":"f65847cf-f3b8-4ade-9d21-cb52e9908388","Type":"ContainerStarted","Data":"ec5f0d9590fa51a937ea0889f2aad523215b86b8c319d03edf505667f279aca9"}
May 28 19:44:26.350453 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:26.350433    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-629g4"
May 28 19:44:26.352887 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:26.352854    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q9z4j" event={"ID":"46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e","Type":"ContainerStarted","Data":"4195cb4e8f176616b705d9030f7618f7e28cd0b90da7a9be766fa65b1ba2a0ec"}
May 28 19:44:26.356967 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:26.356934    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-629g4"
May 28 19:44:26.357062 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:26.357012    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-96qfr" podStartSLOduration=65.571802786 podStartE2EDuration="1m10.356995838s" podCreationTimestamp="2026-05-28 19:43:16 +0000 UTC" firstStartedPulling="2026-05-28 19:44:21.262023862 +0000 UTC m=+65.872748509" lastFinishedPulling="2026-05-28 19:44:26.047216911 +0000 UTC m=+70.657941561" observedRunningTime="2026-05-28 19:44:26.356412671 +0000 UTC m=+70.967137332" watchObservedRunningTime="2026-05-28 19:44:26.356995838 +0000 UTC m=+70.967720498"
May 28 19:44:26.374651 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:26.374603    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-629g4" podStartSLOduration=1.199877836 podStartE2EDuration="6.374587135s" podCreationTimestamp="2026-05-28 19:44:20 +0000 UTC" firstStartedPulling="2026-05-28 19:44:20.846289139 +0000 UTC m=+65.457013791" lastFinishedPulling="2026-05-28 19:44:26.020998447 +0000 UTC m=+70.631723090" observedRunningTime="2026-05-28 19:44:26.373806892 +0000 UTC m=+70.984531553" watchObservedRunningTime="2026-05-28 19:44:26.374587135 +0000 UTC m=+70.985311796"
May 28 19:44:26.394012 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:26.393011    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s5dcl" podStartSLOduration=33.42128905 podStartE2EDuration="38.392994166s" podCreationTimestamp="2026-05-28 19:43:48 +0000 UTC" firstStartedPulling="2026-05-28 19:44:21.049309862 +0000 UTC m=+65.660034501" lastFinishedPulling="2026-05-28 19:44:26.021014963 +0000 UTC m=+70.631739617" observedRunningTime="2026-05-28 19:44:26.391410454 +0000 UTC m=+71.002135114" watchObservedRunningTime="2026-05-28 19:44:26.392994166 +0000 UTC m=+71.003718829"
May 28 19:44:26.448756 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:26.447981    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q9z4j" podStartSLOduration=1.220914436 podStartE2EDuration="6.447963181s" podCreationTimestamp="2026-05-28 19:44:20 +0000 UTC" firstStartedPulling="2026-05-28 19:44:20.822081647 +0000 UTC m=+65.432806286" lastFinishedPulling="2026-05-28 19:44:26.04913039 +0000 UTC m=+70.659855031" observedRunningTime="2026-05-28 19:44:26.412899685 +0000 UTC m=+71.023624350" watchObservedRunningTime="2026-05-28 19:44:26.447963181 +0000 UTC m=+71.058687842"
May 28 19:44:27.359197 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:27.359154    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g948k" event={"ID":"dde5c672-a941-41fc-b588-b9336531bd03","Type":"ContainerStarted","Data":"0dcc7b12e4ee2b15458d9a21f6b1cfbc77d95060ba0b6531766293400a1d205e"}
May 28 19:44:27.359705 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:27.359323    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g948k"
May 28 19:44:27.361246 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:27.361222    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8nltt" event={"ID":"9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f","Type":"ContainerStarted","Data":"cb4aff30d2b9ed2f216371bab4f22f8cbfe7c0951ce2eafdb95212db3e2efa83"}
May 28 19:44:27.383596 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:27.383546    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-g948k" podStartSLOduration=34.433003321 podStartE2EDuration="39.38352969s" podCreationTimestamp="2026-05-28 19:43:48 +0000 UTC" firstStartedPulling="2026-05-28 19:44:21.070492577 +0000 UTC m=+65.681217216" lastFinishedPulling="2026-05-28 19:44:26.021018929 +0000 UTC m=+70.631743585" observedRunningTime="2026-05-28 19:44:27.382312941 +0000 UTC m=+71.993037603" watchObservedRunningTime="2026-05-28 19:44:27.38352969 +0000 UTC m=+71.994254351"
May 28 19:44:27.398735 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:27.398686    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8nltt" podStartSLOduration=66.59888298 podStartE2EDuration="1m11.398669139s" podCreationTimestamp="2026-05-28 19:43:16 +0000 UTC" firstStartedPulling="2026-05-28 19:44:20.953563492 +0000 UTC m=+65.564288145" lastFinishedPulling="2026-05-28 19:44:25.753349666 +0000 UTC m=+70.364074304" observedRunningTime="2026-05-28 19:44:27.39731317 +0000 UTC m=+72.008037831" watchObservedRunningTime="2026-05-28 19:44:27.398669139 +0000 UTC m=+72.009393800"
May 28 19:44:28.366754 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:28.366718    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2" event={"ID":"ae20f3b7-0d46-4792-b2cf-1ec397c0644b","Type":"ContainerStarted","Data":"15e268e01dedc691dba7077a56c20b59b431b622d608b18a0ea089f40ddf06b8"}
May 28 19:44:28.382847 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:28.382799    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-w8sv2" podStartSLOduration=33.835106689 podStartE2EDuration="35.382783557s" podCreationTimestamp="2026-05-28 19:43:53 +0000 UTC" firstStartedPulling="2026-05-28 19:44:26.241290713 +0000 UTC m=+70.852015358" lastFinishedPulling="2026-05-28 19:44:27.788967588 +0000 UTC m=+72.399692226" observedRunningTime="2026-05-28 19:44:28.38216889 +0000 UTC m=+72.992893550" watchObservedRunningTime="2026-05-28 19:44:28.382783557 +0000 UTC m=+72.993508217"
May 28 19:44:33.514295 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.514198    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-csr9t"]
May 28 19:44:33.526130 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.526088    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.528710 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.528437    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 19:44:33.528710 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.528508    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 19:44:33.529455 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.529181    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 19:44:33.529455 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.529238    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 19:44:33.529455 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.529283    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 19:44:33.529455 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.529184    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nnht5\""
May 28 19:44:33.529455 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.529190    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 19:44:33.599013 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.598962    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ab00694-4463-46ca-a691-18023eea0e9b-root\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.599239 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.599070    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ab00694-4463-46ca-a691-18023eea0e9b-metrics-client-ca\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.599239 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.599172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftjll\" (UniqueName: \"kubernetes.io/projected/8ab00694-4463-46ca-a691-18023eea0e9b-kube-api-access-ftjll\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.599239 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.599206    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ab00694-4463-46ca-a691-18023eea0e9b-node-exporter-tls\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.599428 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.599247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ab00694-4463-46ca-a691-18023eea0e9b-node-exporter-wtmp\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.599428 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.599298    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ab00694-4463-46ca-a691-18023eea0e9b-node-exporter-accelerators-collector-config\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.599428 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.599335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ab00694-4463-46ca-a691-18023eea0e9b-sys\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.599428 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.599366    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ab00694-4463-46ca-a691-18023eea0e9b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.599428 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.599394    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ab00694-4463-46ca-a691-18023eea0e9b-node-exporter-textfile\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.700287 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.700255    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ab00694-4463-46ca-a691-18023eea0e9b-root\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.700437 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.700298    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ab00694-4463-46ca-a691-18023eea0e9b-metrics-client-ca\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.700437 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.700327    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftjll\" (UniqueName: \"kubernetes.io/projected/8ab00694-4463-46ca-a691-18023eea0e9b-kube-api-access-ftjll\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.700437 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.700354    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ab00694-4463-46ca-a691-18023eea0e9b-node-exporter-tls\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.700437 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.700378    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ab00694-4463-46ca-a691-18023eea0e9b-root\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.700437 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.700389    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ab00694-4463-46ca-a691-18023eea0e9b-node-exporter-wtmp\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.700707 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.700454    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ab00694-4463-46ca-a691-18023eea0e9b-node-exporter-accelerators-collector-config\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.700707 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.700490    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ab00694-4463-46ca-a691-18023eea0e9b-sys\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.700707 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.700507    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ab00694-4463-46ca-a691-18023eea0e9b-node-exporter-wtmp\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.700707 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.700521    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ab00694-4463-46ca-a691-18023eea0e9b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.700707 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.700560    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ab00694-4463-46ca-a691-18023eea0e9b-node-exporter-textfile\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.700707 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.700681    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ab00694-4463-46ca-a691-18023eea0e9b-sys\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.701222 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.701181    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ab00694-4463-46ca-a691-18023eea0e9b-node-exporter-accelerators-collector-config\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.701342 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.701264    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ab00694-4463-46ca-a691-18023eea0e9b-node-exporter-textfile\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.701572 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.701538    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ab00694-4463-46ca-a691-18023eea0e9b-metrics-client-ca\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.710841 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.710791    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ab00694-4463-46ca-a691-18023eea0e9b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.711021 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.710896    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ab00694-4463-46ca-a691-18023eea0e9b-node-exporter-tls\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.712381 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.712342    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftjll\" (UniqueName: \"kubernetes.io/projected/8ab00694-4463-46ca-a691-18023eea0e9b-kube-api-access-ftjll\") pod \"node-exporter-csr9t\" (UID: \"8ab00694-4463-46ca-a691-18023eea0e9b\") " pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:33.837966 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:33.837892    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-csr9t"
May 28 19:44:37.369673 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:37.369557    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g948k"
May 28 19:44:37.903941 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:37.903534    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-79fdd8cd76-f97jn"]
May 28 19:44:37.906628 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:37.906603    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:37.909067 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:37.909041    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 28 19:44:37.909067 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:37.909062    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 28 19:44:37.909677 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:37.909656    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d3qt9su9li3p7\""
May 28 19:44:37.909781 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:37.909696    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 28 19:44:37.909781 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:37.909722    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 19:44:37.909781 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:37.909766    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zrzqs\""
May 28 19:44:37.915089 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:37.915049    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79fdd8cd76-f97jn"]
May 28 19:44:38.040675 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.040636    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bbd155f4-f415-417f-952f-36cdb2dc983b-secret-metrics-server-tls\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.040835 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.040684    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8x59\" (UniqueName: \"kubernetes.io/projected/bbd155f4-f415-417f-952f-36cdb2dc983b-kube-api-access-n8x59\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.040835 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.040733    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bbd155f4-f415-417f-952f-36cdb2dc983b-audit-log\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.040835 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.040796    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bbd155f4-f415-417f-952f-36cdb2dc983b-secret-metrics-server-client-certs\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.040835 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.040824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbd155f4-f415-417f-952f-36cdb2dc983b-client-ca-bundle\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.041020 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.040853    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bbd155f4-f415-417f-952f-36cdb2dc983b-metrics-server-audit-profiles\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.041020 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.040942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd155f4-f415-417f-952f-36cdb2dc983b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.141960 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.141915    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd155f4-f415-417f-952f-36cdb2dc983b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.142172 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.141971    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bbd155f4-f415-417f-952f-36cdb2dc983b-secret-metrics-server-tls\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.142172 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.141999    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n8x59\" (UniqueName: \"kubernetes.io/projected/bbd155f4-f415-417f-952f-36cdb2dc983b-kube-api-access-n8x59\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.142172 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.142043    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bbd155f4-f415-417f-952f-36cdb2dc983b-audit-log\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.142172 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.142138    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bbd155f4-f415-417f-952f-36cdb2dc983b-secret-metrics-server-client-certs\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.142372 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.142182    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbd155f4-f415-417f-952f-36cdb2dc983b-client-ca-bundle\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.142372 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.142224    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bbd155f4-f415-417f-952f-36cdb2dc983b-metrics-server-audit-profiles\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.142515 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.142493    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bbd155f4-f415-417f-952f-36cdb2dc983b-audit-log\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.142798 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.142747    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbd155f4-f415-417f-952f-36cdb2dc983b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.143210 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.143185    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bbd155f4-f415-417f-952f-36cdb2dc983b-metrics-server-audit-profiles\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.145413 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.145392    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bbd155f4-f415-417f-952f-36cdb2dc983b-secret-metrics-server-tls\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.145525 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.145398    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbd155f4-f415-417f-952f-36cdb2dc983b-client-ca-bundle\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.145525 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.145438    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bbd155f4-f415-417f-952f-36cdb2dc983b-secret-metrics-server-client-certs\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.151216 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.151192    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8x59\" (UniqueName: \"kubernetes.io/projected/bbd155f4-f415-417f-952f-36cdb2dc983b-kube-api-access-n8x59\") pod \"metrics-server-79fdd8cd76-f97jn\" (UID: \"bbd155f4-f415-417f-952f-36cdb2dc983b\") " pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.218855 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.218783    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:38.254889 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.254862    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-gxdhf"]
May 28 19:44:38.257848 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.257827    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxdhf"
May 28 19:44:38.259849 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.259830    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 28 19:44:38.259942 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.259908    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-bq92t\""
May 28 19:44:38.264900 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.264872    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-gxdhf"]
May 28 19:44:38.343208 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.343178    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/83d8c2a9-173f-4889-a5c5-167da0e7e7a5-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-gxdhf\" (UID: \"83d8c2a9-173f-4889-a5c5-167da0e7e7a5\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxdhf"
May 28 19:44:38.444355 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.444312    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/83d8c2a9-173f-4889-a5c5-167da0e7e7a5-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-gxdhf\" (UID: \"83d8c2a9-173f-4889-a5c5-167da0e7e7a5\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxdhf"
May 28 19:44:38.444780 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:44:38.444511    2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 28 19:44:38.444780 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:44:38.444607    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83d8c2a9-173f-4889-a5c5-167da0e7e7a5-monitoring-plugin-cert podName:83d8c2a9-173f-4889-a5c5-167da0e7e7a5 nodeName:}" failed. No retries permitted until 2026-05-28 19:44:38.944584433 +0000 UTC m=+83.555309077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/83d8c2a9-173f-4889-a5c5-167da0e7e7a5-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-gxdhf" (UID: "83d8c2a9-173f-4889-a5c5-167da0e7e7a5") : secret "monitoring-plugin-cert" not found
May 28 19:44:38.949170 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:38.949128    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/83d8c2a9-173f-4889-a5c5-167da0e7e7a5-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-gxdhf\" (UID: \"83d8c2a9-173f-4889-a5c5-167da0e7e7a5\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxdhf"
May 28 19:44:38.949374 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:44:38.949277    2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 28 19:44:38.949374 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:44:38.949348    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83d8c2a9-173f-4889-a5c5-167da0e7e7a5-monitoring-plugin-cert podName:83d8c2a9-173f-4889-a5c5-167da0e7e7a5 nodeName:}" failed. No retries permitted until 2026-05-28 19:44:39.949331259 +0000 UTC m=+84.560055913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/83d8c2a9-173f-4889-a5c5-167da0e7e7a5-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-gxdhf" (UID: "83d8c2a9-173f-4889-a5c5-167da0e7e7a5") : secret "monitoring-plugin-cert" not found
May 28 19:44:39.216315 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:44:39.216280    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab00694_4463_46ca_a691_18023eea0e9b.slice/crio-7e36d0c1a8b33c9a0c7952a9ac57eb42a6ddaf9a60e7a7bd9ae5c1035188f2f6 WatchSource:0}: Error finding container 7e36d0c1a8b33c9a0c7952a9ac57eb42a6ddaf9a60e7a7bd9ae5c1035188f2f6: Status 404 returned error can't find the container with id 7e36d0c1a8b33c9a0c7952a9ac57eb42a6ddaf9a60e7a7bd9ae5c1035188f2f6
May 28 19:44:39.338577 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:39.338556    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79fdd8cd76-f97jn"]
May 28 19:44:39.348076 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:44:39.348051    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd155f4_f415_417f_952f_36cdb2dc983b.slice/crio-f3b5ccc3fc938e63ad8c2b525a62a6c0d83949f87b69049c11eaec92c9c43a16 WatchSource:0}: Error finding container f3b5ccc3fc938e63ad8c2b525a62a6c0d83949f87b69049c11eaec92c9c43a16: Status 404 returned error can't find the container with id f3b5ccc3fc938e63ad8c2b525a62a6c0d83949f87b69049c11eaec92c9c43a16
May 28 19:44:39.399820 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:39.399778    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-lkbg4" event={"ID":"d4071f1d-7d2b-4deb-86ea-a15623271352","Type":"ContainerStarted","Data":"ef965df7d1231631d80c7401821ac5038d3355c8321af575afd128e619f390cd"}
May 28 19:44:39.400004 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:39.399986    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-lkbg4"
May 28 19:44:39.401026 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:39.401000    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-csr9t" event={"ID":"8ab00694-4463-46ca-a691-18023eea0e9b","Type":"ContainerStarted","Data":"7e36d0c1a8b33c9a0c7952a9ac57eb42a6ddaf9a60e7a7bd9ae5c1035188f2f6"}
May 28 19:44:39.401634 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:39.401606    2564 patch_prober.go:28] interesting pod/downloads-57bd96b888-lkbg4 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.13:8080/\": dial tcp 10.133.0.13:8080: connect: connection refused" start-of-body=
May 28 19:44:39.401715 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:39.401649    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-57bd96b888-lkbg4" podUID="d4071f1d-7d2b-4deb-86ea-a15623271352" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.13:8080/\": dial tcp 10.133.0.13:8080: connect: connection refused"
May 28 19:44:39.402166 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:39.402142    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn" event={"ID":"bbd155f4-f415-417f-952f-36cdb2dc983b","Type":"ContainerStarted","Data":"f3b5ccc3fc938e63ad8c2b525a62a6c0d83949f87b69049c11eaec92c9c43a16"}
May 28 19:44:39.418814 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:39.418763    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-lkbg4" podStartSLOduration=0.936441875 podStartE2EDuration="19.418752342s" podCreationTimestamp="2026-05-28 19:44:20 +0000 UTC" firstStartedPulling="2026-05-28 19:44:20.814077334 +0000 UTC m=+65.424801973" lastFinishedPulling="2026-05-28 19:44:39.296387795 +0000 UTC m=+83.907112440" observedRunningTime="2026-05-28 19:44:39.417214808 +0000 UTC m=+84.027939482" watchObservedRunningTime="2026-05-28 19:44:39.418752342 +0000 UTC m=+84.029477028"
May 28 19:44:39.956362 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:39.956304    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/83d8c2a9-173f-4889-a5c5-167da0e7e7a5-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-gxdhf\" (UID: \"83d8c2a9-173f-4889-a5c5-167da0e7e7a5\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxdhf"
May 28 19:44:39.959715 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:39.959682    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/83d8c2a9-173f-4889-a5c5-167da0e7e7a5-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-gxdhf\" (UID: \"83d8c2a9-173f-4889-a5c5-167da0e7e7a5\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxdhf"
May 28 19:44:40.070669 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:40.070455    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxdhf"
May 28 19:44:40.249693 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:40.249287    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-gxdhf"]
May 28 19:44:40.255930 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:44:40.255895    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d8c2a9_173f_4889_a5c5_167da0e7e7a5.slice/crio-32bd455e2fa227d9da11938d70899ef7092c9c9358c7da20c987f888b84d5479 WatchSource:0}: Error finding container 32bd455e2fa227d9da11938d70899ef7092c9c9358c7da20c987f888b84d5479: Status 404 returned error can't find the container with id 32bd455e2fa227d9da11938d70899ef7092c9c9358c7da20c987f888b84d5479
May 28 19:44:40.407159 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:40.407044    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxdhf" event={"ID":"83d8c2a9-173f-4889-a5c5-167da0e7e7a5","Type":"ContainerStarted","Data":"32bd455e2fa227d9da11938d70899ef7092c9c9358c7da20c987f888b84d5479"}
May 28 19:44:40.409704 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:40.409061    2564 generic.go:358] "Generic (PLEG): container finished" podID="8ab00694-4463-46ca-a691-18023eea0e9b" containerID="7eb9a0f4eddb00f393f0c93369c24445a9f3d113fe7f198a6eefb8341b676e48" exitCode=0
May 28 19:44:40.409704 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:40.409192    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-csr9t" event={"ID":"8ab00694-4463-46ca-a691-18023eea0e9b","Type":"ContainerDied","Data":"7eb9a0f4eddb00f393f0c93369c24445a9f3d113fe7f198a6eefb8341b676e48"}
May 28 19:44:40.422228 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:40.422203    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-lkbg4"
May 28 19:44:41.415965 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:41.415419    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-csr9t" event={"ID":"8ab00694-4463-46ca-a691-18023eea0e9b","Type":"ContainerStarted","Data":"2625fe1033e8985558e426b9f12e36bd53b2129c92c1a59c87938533a980bc3e"}
May 28 19:44:41.415965 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:41.415490    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-csr9t" event={"ID":"8ab00694-4463-46ca-a691-18023eea0e9b","Type":"ContainerStarted","Data":"1a270855106ecda3d66a0306612b2876f78adb0c356511f09eb7ec26e1b96a7c"}
May 28 19:44:41.435610 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:41.435547    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-csr9t" podStartSLOduration=7.591679472 podStartE2EDuration="8.435528182s" podCreationTimestamp="2026-05-28 19:44:33 +0000 UTC" firstStartedPulling="2026-05-28 19:44:39.220815268 +0000 UTC m=+83.831539922" lastFinishedPulling="2026-05-28 19:44:40.064663981 +0000 UTC m=+84.675388632" observedRunningTime="2026-05-28 19:44:41.43395462 +0000 UTC m=+86.044679281" watchObservedRunningTime="2026-05-28 19:44:41.435528182 +0000 UTC m=+86.046252845"
May 28 19:44:42.323496 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:42.323457    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d96df59fd-wxrh7"
May 28 19:44:42.420922 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:42.420888    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn" event={"ID":"bbd155f4-f415-417f-952f-36cdb2dc983b","Type":"ContainerStarted","Data":"058c5479a4f5662892bc7cf7ef6c9ba79c8756e103d98887e5dae2920fdfb7e6"}
May 28 19:44:42.437943 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:42.437894    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn" podStartSLOduration=2.6968706190000002 podStartE2EDuration="5.437877445s" podCreationTimestamp="2026-05-28 19:44:37 +0000 UTC" firstStartedPulling="2026-05-28 19:44:39.349932763 +0000 UTC m=+83.960657401" lastFinishedPulling="2026-05-28 19:44:42.090939576 +0000 UTC m=+86.701664227" observedRunningTime="2026-05-28 19:44:42.437294926 +0000 UTC m=+87.048019587" watchObservedRunningTime="2026-05-28 19:44:42.437877445 +0000 UTC m=+87.048602106"
May 28 19:44:43.425254 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:43.425210    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxdhf" event={"ID":"83d8c2a9-173f-4889-a5c5-167da0e7e7a5","Type":"ContainerStarted","Data":"282010b14e0e51847244693648d9e827e36c949e1eed37a63d76de6c2d8ac9a1"}
May 28 19:44:43.425703 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:43.425505    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxdhf"
May 28 19:44:43.430481 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:43.430457    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxdhf"
May 28 19:44:43.445466 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:43.445394    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-gxdhf" podStartSLOduration=3.367964513 podStartE2EDuration="5.445379503s" podCreationTimestamp="2026-05-28 19:44:38 +0000 UTC" firstStartedPulling="2026-05-28 19:44:40.258290793 +0000 UTC m=+84.869015437" lastFinishedPulling="2026-05-28 19:44:42.335705774 +0000 UTC m=+86.946430427" observedRunningTime="2026-05-28 19:44:43.445343571 +0000 UTC m=+88.056068233" watchObservedRunningTime="2026-05-28 19:44:43.445379503 +0000 UTC m=+88.056104164"
May 28 19:44:57.364534 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:57.364505    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-96qfr"
May 28 19:44:58.219339 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:58.219299    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:44:58.219339 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:44:58.219343    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:45:18.224393 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:45:18.224362    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:45:18.228201 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:45:18.228180    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-79fdd8cd76-f97jn"
May 28 19:46:56.400050 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.400015    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4"]
May 28 19:46:56.402221 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.402205    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4"
May 28 19:46:56.404665 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.404645    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 19:46:56.405384 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.405362    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-228sc\""
May 28 19:46:56.405481 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.405363    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 19:46:56.411937 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.411917    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4"]
May 28 19:46:56.498835 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.498810    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442283ab-54e4-4296-817d-a881b9ae8544-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4\" (UID: \"442283ab-54e4-4296-817d-a881b9ae8544\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4"
May 28 19:46:56.498931 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.498845    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlgsc\" (UniqueName: \"kubernetes.io/projected/442283ab-54e4-4296-817d-a881b9ae8544-kube-api-access-xlgsc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4\" (UID: \"442283ab-54e4-4296-817d-a881b9ae8544\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4"
May 28 19:46:56.498931 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.498902    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442283ab-54e4-4296-817d-a881b9ae8544-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4\" (UID: \"442283ab-54e4-4296-817d-a881b9ae8544\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4"
May 28 19:46:56.600103 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.600070    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xlgsc\" (UniqueName: \"kubernetes.io/projected/442283ab-54e4-4296-817d-a881b9ae8544-kube-api-access-xlgsc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4\" (UID: \"442283ab-54e4-4296-817d-a881b9ae8544\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4"
May 28 19:46:56.600181 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.600139    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442283ab-54e4-4296-817d-a881b9ae8544-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4\" (UID: \"442283ab-54e4-4296-817d-a881b9ae8544\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4"
May 28 19:46:56.600181 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.600173    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442283ab-54e4-4296-817d-a881b9ae8544-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4\" (UID: \"442283ab-54e4-4296-817d-a881b9ae8544\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4"
May 28 19:46:56.600477 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.600462    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442283ab-54e4-4296-817d-a881b9ae8544-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4\" (UID: \"442283ab-54e4-4296-817d-a881b9ae8544\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4"
May 28 19:46:56.600538 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.600519    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442283ab-54e4-4296-817d-a881b9ae8544-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4\" (UID: \"442283ab-54e4-4296-817d-a881b9ae8544\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4"
May 28 19:46:56.608799 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.608776    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlgsc\" (UniqueName: \"kubernetes.io/projected/442283ab-54e4-4296-817d-a881b9ae8544-kube-api-access-xlgsc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4\" (UID: \"442283ab-54e4-4296-817d-a881b9ae8544\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4"
May 28 19:46:56.710487 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.710430    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4"
May 28 19:46:56.830709 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:56.830686    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4"]
May 28 19:46:56.833123 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:46:56.833083    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442283ab_54e4_4296_817d_a881b9ae8544.slice/crio-ca5f87c027742229999b4c59be36d8d3ee86e4e0c50c670fc407202764e4d6f6 WatchSource:0}: Error finding container ca5f87c027742229999b4c59be36d8d3ee86e4e0c50c670fc407202764e4d6f6: Status 404 returned error can't find the container with id ca5f87c027742229999b4c59be36d8d3ee86e4e0c50c670fc407202764e4d6f6
May 28 19:46:57.770923 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:46:57.770888    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4" event={"ID":"442283ab-54e4-4296-817d-a881b9ae8544","Type":"ContainerStarted","Data":"ca5f87c027742229999b4c59be36d8d3ee86e4e0c50c670fc407202764e4d6f6"}
May 28 19:47:04.792905 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:04.792872    2564 generic.go:358] "Generic (PLEG): container finished" podID="442283ab-54e4-4296-817d-a881b9ae8544" containerID="def8acc24bbe6cca8c6f40f04b5e78f9731b40f640cf886efc2427fd76f62ab0" exitCode=0
May 28 19:47:04.793301 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:04.792931    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4" event={"ID":"442283ab-54e4-4296-817d-a881b9ae8544","Type":"ContainerDied","Data":"def8acc24bbe6cca8c6f40f04b5e78f9731b40f640cf886efc2427fd76f62ab0"}
May 28 19:47:07.802894 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:07.802858    2564 generic.go:358] "Generic (PLEG): container finished" podID="442283ab-54e4-4296-817d-a881b9ae8544" containerID="6b4b959c03085ca34307def284c21e50efc59168d0b530e1b6d2543b41bc29ca" exitCode=0
May 28 19:47:07.802894 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:07.802898    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4" event={"ID":"442283ab-54e4-4296-817d-a881b9ae8544","Type":"ContainerDied","Data":"6b4b959c03085ca34307def284c21e50efc59168d0b530e1b6d2543b41bc29ca"}
May 28 19:47:15.828510 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:15.828470    2564 generic.go:358] "Generic (PLEG): container finished" podID="442283ab-54e4-4296-817d-a881b9ae8544" containerID="bca2c6d5eb08387b689cfc9792e695d1df0a33502b0ba6f1dc8078a2d1899d98" exitCode=0
May 28 19:47:15.828914 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:15.828533    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4" event={"ID":"442283ab-54e4-4296-817d-a881b9ae8544","Type":"ContainerDied","Data":"bca2c6d5eb08387b689cfc9792e695d1df0a33502b0ba6f1dc8078a2d1899d98"}
May 28 19:47:16.951173 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:16.951152    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4"
May 28 19:47:17.048063 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:17.048040    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442283ab-54e4-4296-817d-a881b9ae8544-util\") pod \"442283ab-54e4-4296-817d-a881b9ae8544\" (UID: \"442283ab-54e4-4296-817d-a881b9ae8544\") "
May 28 19:47:17.048179 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:17.048068    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442283ab-54e4-4296-817d-a881b9ae8544-bundle\") pod \"442283ab-54e4-4296-817d-a881b9ae8544\" (UID: \"442283ab-54e4-4296-817d-a881b9ae8544\") "
May 28 19:47:17.048179 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:17.048126    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlgsc\" (UniqueName: \"kubernetes.io/projected/442283ab-54e4-4296-817d-a881b9ae8544-kube-api-access-xlgsc\") pod \"442283ab-54e4-4296-817d-a881b9ae8544\" (UID: \"442283ab-54e4-4296-817d-a881b9ae8544\") "
May 28 19:47:17.048779 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:17.048752    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442283ab-54e4-4296-817d-a881b9ae8544-bundle" (OuterVolumeSpecName: "bundle") pod "442283ab-54e4-4296-817d-a881b9ae8544" (UID: "442283ab-54e4-4296-817d-a881b9ae8544"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:47:17.050191 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:17.050165    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/442283ab-54e4-4296-817d-a881b9ae8544-kube-api-access-xlgsc" (OuterVolumeSpecName: "kube-api-access-xlgsc") pod "442283ab-54e4-4296-817d-a881b9ae8544" (UID: "442283ab-54e4-4296-817d-a881b9ae8544"). InnerVolumeSpecName "kube-api-access-xlgsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:47:17.051977 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:17.051956    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/442283ab-54e4-4296-817d-a881b9ae8544-util" (OuterVolumeSpecName: "util") pod "442283ab-54e4-4296-817d-a881b9ae8544" (UID: "442283ab-54e4-4296-817d-a881b9ae8544"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:47:17.149343 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:17.149319    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/442283ab-54e4-4296-817d-a881b9ae8544-util\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:47:17.149343 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:17.149342    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/442283ab-54e4-4296-817d-a881b9ae8544-bundle\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:47:17.149466 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:17.149356    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlgsc\" (UniqueName: \"kubernetes.io/projected/442283ab-54e4-4296-817d-a881b9ae8544-kube-api-access-xlgsc\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:47:17.835623 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:17.835592    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4" event={"ID":"442283ab-54e4-4296-817d-a881b9ae8544","Type":"ContainerDied","Data":"ca5f87c027742229999b4c59be36d8d3ee86e4e0c50c670fc407202764e4d6f6"}
May 28 19:47:17.835623 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:17.835624    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca5f87c027742229999b4c59be36d8d3ee86e4e0c50c670fc407202764e4d6f6"
May 28 19:47:17.835826 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:17.835654    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d6tnt4"
May 28 19:47:24.285867 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.285829    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frlxv"]
May 28 19:47:24.286278 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.286204    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="442283ab-54e4-4296-817d-a881b9ae8544" containerName="util"
May 28 19:47:24.286278 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.286220    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="442283ab-54e4-4296-817d-a881b9ae8544" containerName="util"
May 28 19:47:24.286278 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.286232    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="442283ab-54e4-4296-817d-a881b9ae8544" containerName="extract"
May 28 19:47:24.286278 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.286239    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="442283ab-54e4-4296-817d-a881b9ae8544" containerName="extract"
May 28 19:47:24.286278 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.286265    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="442283ab-54e4-4296-817d-a881b9ae8544" containerName="pull"
May 28 19:47:24.286278 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.286275    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="442283ab-54e4-4296-817d-a881b9ae8544" containerName="pull"
May 28 19:47:24.286461 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.286335    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="442283ab-54e4-4296-817d-a881b9ae8544" containerName="extract"
May 28 19:47:24.290624 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.290605    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frlxv"
May 28 19:47:24.293347 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.293320    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jxgxk\""
May 28 19:47:24.293484 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.293354    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 28 19:47:24.293484 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.293353    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 28 19:47:24.301406 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.301385    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frlxv"]
May 28 19:47:24.394212 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.394183    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8840e953-6af2-4a5c-a05f-0358a188382c-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-frlxv\" (UID: \"8840e953-6af2-4a5c-a05f-0358a188382c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frlxv"
May 28 19:47:24.394316 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.394224    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc9md\" (UniqueName: \"kubernetes.io/projected/8840e953-6af2-4a5c-a05f-0358a188382c-kube-api-access-kc9md\") pod \"cert-manager-operator-controller-manager-54b9655956-frlxv\" (UID: \"8840e953-6af2-4a5c-a05f-0358a188382c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frlxv"
May 28 19:47:24.494941 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.494915    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kc9md\" (UniqueName: \"kubernetes.io/projected/8840e953-6af2-4a5c-a05f-0358a188382c-kube-api-access-kc9md\") pod \"cert-manager-operator-controller-manager-54b9655956-frlxv\" (UID: \"8840e953-6af2-4a5c-a05f-0358a188382c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frlxv"
May 28 19:47:24.495029 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.494971    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8840e953-6af2-4a5c-a05f-0358a188382c-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-frlxv\" (UID: \"8840e953-6af2-4a5c-a05f-0358a188382c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frlxv"
May 28 19:47:24.495332 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.495314    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8840e953-6af2-4a5c-a05f-0358a188382c-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-frlxv\" (UID: \"8840e953-6af2-4a5c-a05f-0358a188382c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frlxv"
May 28 19:47:24.503491 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.503469    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc9md\" (UniqueName: \"kubernetes.io/projected/8840e953-6af2-4a5c-a05f-0358a188382c-kube-api-access-kc9md\") pod \"cert-manager-operator-controller-manager-54b9655956-frlxv\" (UID: \"8840e953-6af2-4a5c-a05f-0358a188382c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frlxv"
May 28 19:47:24.600516 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.600460    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frlxv"
May 28 19:47:24.724368 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.724338    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frlxv"]
May 28 19:47:24.727086 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:47:24.727057    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8840e953_6af2_4a5c_a05f_0358a188382c.slice/crio-cdd36fbf273770679b8b658b9d03d116103535552eee1606b48632342bd455b5 WatchSource:0}: Error finding container cdd36fbf273770679b8b658b9d03d116103535552eee1606b48632342bd455b5: Status 404 returned error can't find the container with id cdd36fbf273770679b8b658b9d03d116103535552eee1606b48632342bd455b5
May 28 19:47:24.855187 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:24.855130    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frlxv" event={"ID":"8840e953-6af2-4a5c-a05f-0358a188382c","Type":"ContainerStarted","Data":"cdd36fbf273770679b8b658b9d03d116103535552eee1606b48632342bd455b5"}
May 28 19:47:26.862191 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:26.862156    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frlxv" event={"ID":"8840e953-6af2-4a5c-a05f-0358a188382c","Type":"ContainerStarted","Data":"438cf6b189e8e638ae02d9d1c8ee7bef7668adc55942cdf39f834d8a0fad2fe4"}
May 28 19:47:26.886999 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:26.886957    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-frlxv" podStartSLOduration=1.4810023700000001 podStartE2EDuration="2.886944878s" podCreationTimestamp="2026-05-28 19:47:24 +0000 UTC" firstStartedPulling="2026-05-28 19:47:24.729475345 +0000 UTC m=+249.340199983" lastFinishedPulling="2026-05-28 19:47:26.135417848 +0000 UTC m=+250.746142491" observedRunningTime="2026-05-28 19:47:26.885365086 +0000 UTC m=+251.496089747" watchObservedRunningTime="2026-05-28 19:47:26.886944878 +0000 UTC m=+251.497669537"
May 28 19:47:28.745199 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:28.745161    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p"]
May 28 19:47:28.747501 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:28.747484    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p"
May 28 19:47:28.750393 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:28.750374    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-228sc\""
May 28 19:47:28.750481 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:28.750381    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 19:47:28.751140 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:28.751118    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 19:47:28.759243 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:28.759223    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p"]
May 28 19:47:28.826746 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:28.826725    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxvmf\" (UniqueName: \"kubernetes.io/projected/ce66d9e6-08dd-47b3-9574-f51954a7672b-kube-api-access-kxvmf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p\" (UID: \"ce66d9e6-08dd-47b3-9574-f51954a7672b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p"
May 28 19:47:28.826837 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:28.826774    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce66d9e6-08dd-47b3-9574-f51954a7672b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p\" (UID: \"ce66d9e6-08dd-47b3-9574-f51954a7672b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p"
May 28 19:47:28.826878 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:28.826833    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce66d9e6-08dd-47b3-9574-f51954a7672b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p\" (UID: \"ce66d9e6-08dd-47b3-9574-f51954a7672b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p"
May 28 19:47:28.927723 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:28.927687    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce66d9e6-08dd-47b3-9574-f51954a7672b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p\" (UID: \"ce66d9e6-08dd-47b3-9574-f51954a7672b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p"
May 28 19:47:28.927820 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:28.927732    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce66d9e6-08dd-47b3-9574-f51954a7672b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p\" (UID: \"ce66d9e6-08dd-47b3-9574-f51954a7672b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p"
May 28 19:47:28.927820 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:28.927765    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxvmf\" (UniqueName: \"kubernetes.io/projected/ce66d9e6-08dd-47b3-9574-f51954a7672b-kube-api-access-kxvmf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p\" (UID: \"ce66d9e6-08dd-47b3-9574-f51954a7672b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p"
May 28 19:47:28.928134 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:28.928117    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce66d9e6-08dd-47b3-9574-f51954a7672b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p\" (UID: \"ce66d9e6-08dd-47b3-9574-f51954a7672b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p"
May 28 19:47:28.928172 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:28.928119    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce66d9e6-08dd-47b3-9574-f51954a7672b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p\" (UID: \"ce66d9e6-08dd-47b3-9574-f51954a7672b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p"
May 28 19:47:28.940416 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:28.940391    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxvmf\" (UniqueName: \"kubernetes.io/projected/ce66d9e6-08dd-47b3-9574-f51954a7672b-kube-api-access-kxvmf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p\" (UID: \"ce66d9e6-08dd-47b3-9574-f51954a7672b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p"
May 28 19:47:29.056341 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.056294    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p"
May 28 19:47:29.177968 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.177938    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p"]
May 28 19:47:29.181012 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:47:29.180985    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce66d9e6_08dd_47b3_9574_f51954a7672b.slice/crio-0ecb314f8b9026bef433bcb203cb554d98485d45f856f1220f067d75ca619b87 WatchSource:0}: Error finding container 0ecb314f8b9026bef433bcb203cb554d98485d45f856f1220f067d75ca619b87: Status 404 returned error can't find the container with id 0ecb314f8b9026bef433bcb203cb554d98485d45f856f1220f067d75ca619b87
May 28 19:47:29.556821 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.556792    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-s242x"]
May 28 19:47:29.558774 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.558759    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-s242x"
May 28 19:47:29.561190 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.561171    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 28 19:47:29.561903 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.561887    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-27dv8\""
May 28 19:47:29.561987 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.561913    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 28 19:47:29.572759 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.572737    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-s242x"]
May 28 19:47:29.631392 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.631361    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjctt\" (UniqueName: \"kubernetes.io/projected/25634532-ff11-43e4-a01f-9b166f3c1d08-kube-api-access-qjctt\") pod \"cert-manager-webhook-587ccfb98-s242x\" (UID: \"25634532-ff11-43e4-a01f-9b166f3c1d08\") " pod="cert-manager/cert-manager-webhook-587ccfb98-s242x"
May 28 19:47:29.631476 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.631402    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25634532-ff11-43e4-a01f-9b166f3c1d08-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-s242x\" (UID: \"25634532-ff11-43e4-a01f-9b166f3c1d08\") " pod="cert-manager/cert-manager-webhook-587ccfb98-s242x"
May 28 19:47:29.732146 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.732125    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjctt\" (UniqueName: \"kubernetes.io/projected/25634532-ff11-43e4-a01f-9b166f3c1d08-kube-api-access-qjctt\") pod \"cert-manager-webhook-587ccfb98-s242x\" (UID: \"25634532-ff11-43e4-a01f-9b166f3c1d08\") " pod="cert-manager/cert-manager-webhook-587ccfb98-s242x"
May 28 19:47:29.732231 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.732167    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25634532-ff11-43e4-a01f-9b166f3c1d08-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-s242x\" (UID: \"25634532-ff11-43e4-a01f-9b166f3c1d08\") " pod="cert-manager/cert-manager-webhook-587ccfb98-s242x"
May 28 19:47:29.740146 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.740122    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25634532-ff11-43e4-a01f-9b166f3c1d08-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-s242x\" (UID: \"25634532-ff11-43e4-a01f-9b166f3c1d08\") " pod="cert-manager/cert-manager-webhook-587ccfb98-s242x"
May 28 19:47:29.740464 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.740447    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjctt\" (UniqueName: \"kubernetes.io/projected/25634532-ff11-43e4-a01f-9b166f3c1d08-kube-api-access-qjctt\") pod \"cert-manager-webhook-587ccfb98-s242x\" (UID: \"25634532-ff11-43e4-a01f-9b166f3c1d08\") " pod="cert-manager/cert-manager-webhook-587ccfb98-s242x"
May 28 19:47:29.872031 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.871975    2564 generic.go:358] "Generic (PLEG): container finished" podID="ce66d9e6-08dd-47b3-9574-f51954a7672b" containerID="866536f7a26af3b430b776d6972a840adb47cacc44446d0a5dfb5800fe6b5775" exitCode=0
May 28 19:47:29.872308 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.872047    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p" event={"ID":"ce66d9e6-08dd-47b3-9574-f51954a7672b","Type":"ContainerDied","Data":"866536f7a26af3b430b776d6972a840adb47cacc44446d0a5dfb5800fe6b5775"}
May 28 19:47:29.872308 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.872073    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p" event={"ID":"ce66d9e6-08dd-47b3-9574-f51954a7672b","Type":"ContainerStarted","Data":"0ecb314f8b9026bef433bcb203cb554d98485d45f856f1220f067d75ca619b87"}
May 28 19:47:29.882805 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:29.882783    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-s242x"
May 28 19:47:30.013746 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:30.013725    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-s242x"]
May 28 19:47:30.016274 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:47:30.016247    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25634532_ff11_43e4_a01f_9b166f3c1d08.slice/crio-c16dd2619f357ef832f8181abbc6153e654568ceb3efa3e50483c8d8f405fa8b WatchSource:0}: Error finding container c16dd2619f357ef832f8181abbc6153e654568ceb3efa3e50483c8d8f405fa8b: Status 404 returned error can't find the container with id c16dd2619f357ef832f8181abbc6153e654568ceb3efa3e50483c8d8f405fa8b
May 28 19:47:30.876989 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:30.876924    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-s242x" event={"ID":"25634532-ff11-43e4-a01f-9b166f3c1d08","Type":"ContainerStarted","Data":"c16dd2619f357ef832f8181abbc6153e654568ceb3efa3e50483c8d8f405fa8b"}
May 28 19:47:33.890741 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:33.890698    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-s242x" event={"ID":"25634532-ff11-43e4-a01f-9b166f3c1d08","Type":"ContainerStarted","Data":"52843f19b2a06f28d23a07f098e5b4a2c29dda6cda62719d3fa83045bb2af751"}
May 28 19:47:33.891188 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:33.890754    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-s242x"
May 28 19:47:33.892210 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:33.892179    2564 generic.go:358] "Generic (PLEG): container finished" podID="ce66d9e6-08dd-47b3-9574-f51954a7672b" containerID="3d4de912285d3ad8038d3bbe2ef03004fed3bbceb14d22a42dfdc104199ecc78" exitCode=0
May 28 19:47:33.892329 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:33.892241    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p" event={"ID":"ce66d9e6-08dd-47b3-9574-f51954a7672b","Type":"ContainerDied","Data":"3d4de912285d3ad8038d3bbe2ef03004fed3bbceb14d22a42dfdc104199ecc78"}
May 28 19:47:33.971318 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:33.971272    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-s242x" podStartSLOduration=2.06422372 podStartE2EDuration="4.971259068s" podCreationTimestamp="2026-05-28 19:47:29 +0000 UTC" firstStartedPulling="2026-05-28 19:47:30.018052079 +0000 UTC m=+254.628776717" lastFinishedPulling="2026-05-28 19:47:32.925087428 +0000 UTC m=+257.535812065" observedRunningTime="2026-05-28 19:47:33.956850467 +0000 UTC m=+258.567575137" watchObservedRunningTime="2026-05-28 19:47:33.971259068 +0000 UTC m=+258.581983727"
May 28 19:47:34.897645 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:34.897611    2564 generic.go:358] "Generic (PLEG): container finished" podID="ce66d9e6-08dd-47b3-9574-f51954a7672b" containerID="dbd73996835eb94e6614ffb0b38528280edeb117ee11d669ffab0a69c8ffcaa1" exitCode=0
May 28 19:47:34.898089 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:34.897691    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p" event={"ID":"ce66d9e6-08dd-47b3-9574-f51954a7672b","Type":"ContainerDied","Data":"dbd73996835eb94e6614ffb0b38528280edeb117ee11d669ffab0a69c8ffcaa1"}
May 28 19:47:36.021470 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:36.021449    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p"
May 28 19:47:36.076637 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:36.076609    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce66d9e6-08dd-47b3-9574-f51954a7672b-util\") pod \"ce66d9e6-08dd-47b3-9574-f51954a7672b\" (UID: \"ce66d9e6-08dd-47b3-9574-f51954a7672b\") "
May 28 19:47:36.076767 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:36.076665    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce66d9e6-08dd-47b3-9574-f51954a7672b-bundle\") pod \"ce66d9e6-08dd-47b3-9574-f51954a7672b\" (UID: \"ce66d9e6-08dd-47b3-9574-f51954a7672b\") "
May 28 19:47:36.076767 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:36.076694    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxvmf\" (UniqueName: \"kubernetes.io/projected/ce66d9e6-08dd-47b3-9574-f51954a7672b-kube-api-access-kxvmf\") pod \"ce66d9e6-08dd-47b3-9574-f51954a7672b\" (UID: \"ce66d9e6-08dd-47b3-9574-f51954a7672b\") "
May 28 19:47:36.077136 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:36.077085    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce66d9e6-08dd-47b3-9574-f51954a7672b-bundle" (OuterVolumeSpecName: "bundle") pod "ce66d9e6-08dd-47b3-9574-f51954a7672b" (UID: "ce66d9e6-08dd-47b3-9574-f51954a7672b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:47:36.078661 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:36.078638    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce66d9e6-08dd-47b3-9574-f51954a7672b-kube-api-access-kxvmf" (OuterVolumeSpecName: "kube-api-access-kxvmf") pod "ce66d9e6-08dd-47b3-9574-f51954a7672b" (UID: "ce66d9e6-08dd-47b3-9574-f51954a7672b"). InnerVolumeSpecName "kube-api-access-kxvmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:47:36.080848 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:36.080830    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce66d9e6-08dd-47b3-9574-f51954a7672b-util" (OuterVolumeSpecName: "util") pod "ce66d9e6-08dd-47b3-9574-f51954a7672b" (UID: "ce66d9e6-08dd-47b3-9574-f51954a7672b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:47:36.177876 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:36.177819    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce66d9e6-08dd-47b3-9574-f51954a7672b-bundle\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:47:36.177876 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:36.177843    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxvmf\" (UniqueName: \"kubernetes.io/projected/ce66d9e6-08dd-47b3-9574-f51954a7672b-kube-api-access-kxvmf\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:47:36.177876 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:36.177856    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce66d9e6-08dd-47b3-9574-f51954a7672b-util\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:47:36.906417 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:36.906371    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p" event={"ID":"ce66d9e6-08dd-47b3-9574-f51954a7672b","Type":"ContainerDied","Data":"0ecb314f8b9026bef433bcb203cb554d98485d45f856f1220f067d75ca619b87"}
May 28 19:47:36.906417 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:36.906413    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ecb314f8b9026bef433bcb203cb554d98485d45f856f1220f067d75ca619b87"
May 28 19:47:36.906609 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:36.906442    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftjj9p"
May 28 19:47:39.900265 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:39.900236    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-s242x"
May 28 19:47:42.043946 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.043914    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-splfb"]
May 28 19:47:42.044356 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.044179    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce66d9e6-08dd-47b3-9574-f51954a7672b" containerName="pull"
May 28 19:47:42.044356 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.044190    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce66d9e6-08dd-47b3-9574-f51954a7672b" containerName="pull"
May 28 19:47:42.044356 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.044209    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce66d9e6-08dd-47b3-9574-f51954a7672b" containerName="util"
May 28 19:47:42.044356 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.044216    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce66d9e6-08dd-47b3-9574-f51954a7672b" containerName="util"
May 28 19:47:42.044356 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.044224    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce66d9e6-08dd-47b3-9574-f51954a7672b" containerName="extract"
May 28 19:47:42.044356 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.044229    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce66d9e6-08dd-47b3-9574-f51954a7672b" containerName="extract"
May 28 19:47:42.044356 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.044268    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="ce66d9e6-08dd-47b3-9574-f51954a7672b" containerName="extract"
May 28 19:47:42.071230 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.071202    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-splfb"]
May 28 19:47:42.071363 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.071318    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-splfb"
May 28 19:47:42.077185 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.077159    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-w2g8q\""
May 28 19:47:42.078115 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.078081    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 28 19:47:42.078264 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.078120    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 28 19:47:42.117051 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.117029    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31f124f7-3c83-4abd-aa1d-b6ab880882ef-tmp\") pod \"openshift-lws-operator-bfc7f696d-splfb\" (UID: \"31f124f7-3c83-4abd-aa1d-b6ab880882ef\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-splfb"
May 28 19:47:42.117157 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.117081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw8v6\" (UniqueName: \"kubernetes.io/projected/31f124f7-3c83-4abd-aa1d-b6ab880882ef-kube-api-access-sw8v6\") pod \"openshift-lws-operator-bfc7f696d-splfb\" (UID: \"31f124f7-3c83-4abd-aa1d-b6ab880882ef\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-splfb"
May 28 19:47:42.217964 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.217937    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31f124f7-3c83-4abd-aa1d-b6ab880882ef-tmp\") pod \"openshift-lws-operator-bfc7f696d-splfb\" (UID: \"31f124f7-3c83-4abd-aa1d-b6ab880882ef\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-splfb"
May 28 19:47:42.218062 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.218006    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sw8v6\" (UniqueName: \"kubernetes.io/projected/31f124f7-3c83-4abd-aa1d-b6ab880882ef-kube-api-access-sw8v6\") pod \"openshift-lws-operator-bfc7f696d-splfb\" (UID: \"31f124f7-3c83-4abd-aa1d-b6ab880882ef\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-splfb"
May 28 19:47:42.218308 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.218285    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31f124f7-3c83-4abd-aa1d-b6ab880882ef-tmp\") pod \"openshift-lws-operator-bfc7f696d-splfb\" (UID: \"31f124f7-3c83-4abd-aa1d-b6ab880882ef\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-splfb"
May 28 19:47:42.226065 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.226046    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw8v6\" (UniqueName: \"kubernetes.io/projected/31f124f7-3c83-4abd-aa1d-b6ab880882ef-kube-api-access-sw8v6\") pod \"openshift-lws-operator-bfc7f696d-splfb\" (UID: \"31f124f7-3c83-4abd-aa1d-b6ab880882ef\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-splfb"
May 28 19:47:42.380548 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.380491    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-splfb"
May 28 19:47:42.504325 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.504299    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-splfb"]
May 28 19:47:42.506871 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:47:42.506844    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31f124f7_3c83_4abd_aa1d_b6ab880882ef.slice/crio-0242028abe34c01da09f1eb5b85596bdd64d821d88ae45781848d4d1c57bc915 WatchSource:0}: Error finding container 0242028abe34c01da09f1eb5b85596bdd64d821d88ae45781848d4d1c57bc915: Status 404 returned error can't find the container with id 0242028abe34c01da09f1eb5b85596bdd64d821d88ae45781848d4d1c57bc915
May 28 19:47:42.925360 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:42.925327    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-splfb" event={"ID":"31f124f7-3c83-4abd-aa1d-b6ab880882ef","Type":"ContainerStarted","Data":"0242028abe34c01da09f1eb5b85596bdd64d821d88ae45781848d4d1c57bc915"}
May 28 19:47:44.933289 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:44.932631    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-splfb" event={"ID":"31f124f7-3c83-4abd-aa1d-b6ab880882ef","Type":"ContainerStarted","Data":"fb8cff73bc54c7853130e6f27e5c46a22a984ce92f627d5268dbd7c2faa2f161"}
May 28 19:47:45.952061 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:45.952009    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-splfb" podStartSLOduration=1.634766985 podStartE2EDuration="3.951995982s" podCreationTimestamp="2026-05-28 19:47:42 +0000 UTC" firstStartedPulling="2026-05-28 19:47:42.508235333 +0000 UTC m=+267.118959971" lastFinishedPulling="2026-05-28 19:47:44.825464327 +0000 UTC m=+269.436188968" observedRunningTime="2026-05-28 19:47:45.950706995 +0000 UTC m=+270.561431652" watchObservedRunningTime="2026-05-28 19:47:45.951995982 +0000 UTC m=+270.562720641"
May 28 19:47:48.140528 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.140495    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6"]
May 28 19:47:48.147074 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.147044    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6"
May 28 19:47:48.149308 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.149284    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 19:47:48.150055 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.150013    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-228sc\""
May 28 19:47:48.150055 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.150038    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 19:47:48.152036 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.152017    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6"]
May 28 19:47:48.268604 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.268576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmxrs\" (UniqueName: \"kubernetes.io/projected/665aa13a-b2de-4339-9ab5-a72a7fa2db92-kube-api-access-bmxrs\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6\" (UID: \"665aa13a-b2de-4339-9ab5-a72a7fa2db92\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6"
May 28 19:47:48.268731 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.268642    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/665aa13a-b2de-4339-9ab5-a72a7fa2db92-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6\" (UID: \"665aa13a-b2de-4339-9ab5-a72a7fa2db92\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6"
May 28 19:47:48.268731 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.268675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/665aa13a-b2de-4339-9ab5-a72a7fa2db92-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6\" (UID: \"665aa13a-b2de-4339-9ab5-a72a7fa2db92\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6"
May 28 19:47:48.368901 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.368876    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmxrs\" (UniqueName: \"kubernetes.io/projected/665aa13a-b2de-4339-9ab5-a72a7fa2db92-kube-api-access-bmxrs\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6\" (UID: \"665aa13a-b2de-4339-9ab5-a72a7fa2db92\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6"
May 28 19:47:48.369007 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.368916    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/665aa13a-b2de-4339-9ab5-a72a7fa2db92-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6\" (UID: \"665aa13a-b2de-4339-9ab5-a72a7fa2db92\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6"
May 28 19:47:48.369007 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.368936    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/665aa13a-b2de-4339-9ab5-a72a7fa2db92-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6\" (UID: \"665aa13a-b2de-4339-9ab5-a72a7fa2db92\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6"
May 28 19:47:48.369301 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.369284    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/665aa13a-b2de-4339-9ab5-a72a7fa2db92-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6\" (UID: \"665aa13a-b2de-4339-9ab5-a72a7fa2db92\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6"
May 28 19:47:48.369344 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.369307    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/665aa13a-b2de-4339-9ab5-a72a7fa2db92-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6\" (UID: \"665aa13a-b2de-4339-9ab5-a72a7fa2db92\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6"
May 28 19:47:48.376777 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.376757    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmxrs\" (UniqueName: \"kubernetes.io/projected/665aa13a-b2de-4339-9ab5-a72a7fa2db92-kube-api-access-bmxrs\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6\" (UID: \"665aa13a-b2de-4339-9ab5-a72a7fa2db92\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6"
May 28 19:47:48.457271 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.457251    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6"
May 28 19:47:48.581016 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.580994    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6"]
May 28 19:47:48.584290 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:47:48.584252    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod665aa13a_b2de_4339_9ab5_a72a7fa2db92.slice/crio-7f720fdf9b56d8eb08d00500211d449a1a5dcafe6185027f638c0e800851b2e6 WatchSource:0}: Error finding container 7f720fdf9b56d8eb08d00500211d449a1a5dcafe6185027f638c0e800851b2e6: Status 404 returned error can't find the container with id 7f720fdf9b56d8eb08d00500211d449a1a5dcafe6185027f638c0e800851b2e6
May 28 19:47:48.946749 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.946716    2564 generic.go:358] "Generic (PLEG): container finished" podID="665aa13a-b2de-4339-9ab5-a72a7fa2db92" containerID="ff997c77a28590428f42364f2a4e32d34fbfc7433b1acb5cae1ddbe8ffd4152b" exitCode=0
May 28 19:47:48.946854 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.946767    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6" event={"ID":"665aa13a-b2de-4339-9ab5-a72a7fa2db92","Type":"ContainerDied","Data":"ff997c77a28590428f42364f2a4e32d34fbfc7433b1acb5cae1ddbe8ffd4152b"}
May 28 19:47:48.946854 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:48.946792    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6" event={"ID":"665aa13a-b2de-4339-9ab5-a72a7fa2db92","Type":"ContainerStarted","Data":"7f720fdf9b56d8eb08d00500211d449a1a5dcafe6185027f638c0e800851b2e6"}
May 28 19:47:49.951357 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:49.951320    2564 generic.go:358] "Generic (PLEG): container finished" podID="665aa13a-b2de-4339-9ab5-a72a7fa2db92" containerID="651f448bbf19b891b5b2b6e663149dad669a99686278e5d894a17ee2e90da152" exitCode=0
May 28 19:47:49.951795 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:49.951406    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6" event={"ID":"665aa13a-b2de-4339-9ab5-a72a7fa2db92","Type":"ContainerDied","Data":"651f448bbf19b891b5b2b6e663149dad669a99686278e5d894a17ee2e90da152"}
May 28 19:47:50.956838 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:50.956802    2564 generic.go:358] "Generic (PLEG): container finished" podID="665aa13a-b2de-4339-9ab5-a72a7fa2db92" containerID="556be8e2e98d94dff2050fdedb92e939975b282276129438d9e398891218f4a5" exitCode=0
May 28 19:47:50.957209 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:50.956870    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6" event={"ID":"665aa13a-b2de-4339-9ab5-a72a7fa2db92","Type":"ContainerDied","Data":"556be8e2e98d94dff2050fdedb92e939975b282276129438d9e398891218f4a5"}
May 28 19:47:52.084819 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:52.084794    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6"
May 28 19:47:52.202667 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:52.202629    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmxrs\" (UniqueName: \"kubernetes.io/projected/665aa13a-b2de-4339-9ab5-a72a7fa2db92-kube-api-access-bmxrs\") pod \"665aa13a-b2de-4339-9ab5-a72a7fa2db92\" (UID: \"665aa13a-b2de-4339-9ab5-a72a7fa2db92\") "
May 28 19:47:52.202801 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:52.202723    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/665aa13a-b2de-4339-9ab5-a72a7fa2db92-bundle\") pod \"665aa13a-b2de-4339-9ab5-a72a7fa2db92\" (UID: \"665aa13a-b2de-4339-9ab5-a72a7fa2db92\") "
May 28 19:47:52.202801 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:52.202786    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/665aa13a-b2de-4339-9ab5-a72a7fa2db92-util\") pod \"665aa13a-b2de-4339-9ab5-a72a7fa2db92\" (UID: \"665aa13a-b2de-4339-9ab5-a72a7fa2db92\") "
May 28 19:47:52.203451 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:52.203423    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/665aa13a-b2de-4339-9ab5-a72a7fa2db92-bundle" (OuterVolumeSpecName: "bundle") pod "665aa13a-b2de-4339-9ab5-a72a7fa2db92" (UID: "665aa13a-b2de-4339-9ab5-a72a7fa2db92"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:47:52.204654 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:52.204628    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/665aa13a-b2de-4339-9ab5-a72a7fa2db92-kube-api-access-bmxrs" (OuterVolumeSpecName: "kube-api-access-bmxrs") pod "665aa13a-b2de-4339-9ab5-a72a7fa2db92" (UID: "665aa13a-b2de-4339-9ab5-a72a7fa2db92"). InnerVolumeSpecName "kube-api-access-bmxrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:47:52.208745 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:52.208720    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/665aa13a-b2de-4339-9ab5-a72a7fa2db92-util" (OuterVolumeSpecName: "util") pod "665aa13a-b2de-4339-9ab5-a72a7fa2db92" (UID: "665aa13a-b2de-4339-9ab5-a72a7fa2db92"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:47:52.303872 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:52.303819    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/665aa13a-b2de-4339-9ab5-a72a7fa2db92-bundle\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:47:52.303872 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:52.303839    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/665aa13a-b2de-4339-9ab5-a72a7fa2db92-util\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:47:52.303872 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:52.303850    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmxrs\" (UniqueName: \"kubernetes.io/projected/665aa13a-b2de-4339-9ab5-a72a7fa2db92-kube-api-access-bmxrs\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:47:52.965175 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:52.965143    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6" event={"ID":"665aa13a-b2de-4339-9ab5-a72a7fa2db92","Type":"ContainerDied","Data":"7f720fdf9b56d8eb08d00500211d449a1a5dcafe6185027f638c0e800851b2e6"}
May 28 19:47:52.965175 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:52.965176    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f720fdf9b56d8eb08d00500211d449a1a5dcafe6185027f638c0e800851b2e6"
May 28 19:47:52.965353 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:47:52.965240    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5d5cm6"
May 28 19:48:02.122872 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.122839    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm"]
May 28 19:48:02.123297 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.123107    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="665aa13a-b2de-4339-9ab5-a72a7fa2db92" containerName="pull"
May 28 19:48:02.123297 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.123119    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="665aa13a-b2de-4339-9ab5-a72a7fa2db92" containerName="pull"
May 28 19:48:02.123297 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.123127    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="665aa13a-b2de-4339-9ab5-a72a7fa2db92" containerName="util"
May 28 19:48:02.123297 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.123132    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="665aa13a-b2de-4339-9ab5-a72a7fa2db92" containerName="util"
May 28 19:48:02.123297 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.123139    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="665aa13a-b2de-4339-9ab5-a72a7fa2db92" containerName="extract"
May 28 19:48:02.123297 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.123144    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="665aa13a-b2de-4339-9ab5-a72a7fa2db92" containerName="extract"
May 28 19:48:02.123297 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.123187    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="665aa13a-b2de-4339-9ab5-a72a7fa2db92" containerName="extract"
May 28 19:48:02.125754 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.125735    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm"
May 28 19:48:02.128420 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.128396    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 28 19:48:02.128713 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.128530    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 28 19:48:02.128804 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.128579    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jbt6w\""
May 28 19:48:02.128804 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.128608    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 28 19:48:02.128804 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.128609    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 28 19:48:02.145885 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.145865    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm"]
May 28 19:48:02.265672 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.265643    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqmfs\" (UniqueName: \"kubernetes.io/projected/809ca0d7-c818-489d-af69-346a5cef891e-kube-api-access-nqmfs\") pod \"opendatahub-operator-controller-manager-69568b6749-jnxrm\" (UID: \"809ca0d7-c818-489d-af69-346a5cef891e\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm"
May 28 19:48:02.265804 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.265694    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/809ca0d7-c818-489d-af69-346a5cef891e-webhook-cert\") pod \"opendatahub-operator-controller-manager-69568b6749-jnxrm\" (UID: \"809ca0d7-c818-489d-af69-346a5cef891e\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm"
May 28 19:48:02.265804 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.265718    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/809ca0d7-c818-489d-af69-346a5cef891e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69568b6749-jnxrm\" (UID: \"809ca0d7-c818-489d-af69-346a5cef891e\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm"
May 28 19:48:02.366023 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.365994    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nqmfs\" (UniqueName: \"kubernetes.io/projected/809ca0d7-c818-489d-af69-346a5cef891e-kube-api-access-nqmfs\") pod \"opendatahub-operator-controller-manager-69568b6749-jnxrm\" (UID: \"809ca0d7-c818-489d-af69-346a5cef891e\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm"
May 28 19:48:02.366149 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.366060    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/809ca0d7-c818-489d-af69-346a5cef891e-webhook-cert\") pod \"opendatahub-operator-controller-manager-69568b6749-jnxrm\" (UID: \"809ca0d7-c818-489d-af69-346a5cef891e\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm"
May 28 19:48:02.366149 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.366086    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/809ca0d7-c818-489d-af69-346a5cef891e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69568b6749-jnxrm\" (UID: \"809ca0d7-c818-489d-af69-346a5cef891e\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm"
May 28 19:48:02.368478 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.368453    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/809ca0d7-c818-489d-af69-346a5cef891e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69568b6749-jnxrm\" (UID: \"809ca0d7-c818-489d-af69-346a5cef891e\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm"
May 28 19:48:02.368568 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.368480    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/809ca0d7-c818-489d-af69-346a5cef891e-webhook-cert\") pod \"opendatahub-operator-controller-manager-69568b6749-jnxrm\" (UID: \"809ca0d7-c818-489d-af69-346a5cef891e\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm"
May 28 19:48:02.373842 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.373788    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqmfs\" (UniqueName: \"kubernetes.io/projected/809ca0d7-c818-489d-af69-346a5cef891e-kube-api-access-nqmfs\") pod \"opendatahub-operator-controller-manager-69568b6749-jnxrm\" (UID: \"809ca0d7-c818-489d-af69-346a5cef891e\") " pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm"
May 28 19:48:02.436187 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.436164    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm"
May 28 19:48:02.553794 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.553766    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww"]
May 28 19:48:02.556916 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.556899    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww"
May 28 19:48:02.559266 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.559238    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 19:48:02.559368 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.559238    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 19:48:02.559368 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.559279    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-228sc\""
May 28 19:48:02.565405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.565384    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww"]
May 28 19:48:02.569535 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.569512    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm"]
May 28 19:48:02.572604 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:48:02.572584    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod809ca0d7_c818_489d_af69_346a5cef891e.slice/crio-bb43f12c30ea1f1043022be80efa09a137b97bf4efd3d019d31d3406300c5bb0 WatchSource:0}: Error finding container bb43f12c30ea1f1043022be80efa09a137b97bf4efd3d019d31d3406300c5bb0: Status 404 returned error can't find the container with id bb43f12c30ea1f1043022be80efa09a137b97bf4efd3d019d31d3406300c5bb0
May 28 19:48:02.668172 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.668148    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccm98\" (UniqueName: \"kubernetes.io/projected/0d517494-bba7-429f-991b-ab900a8b0560-kube-api-access-ccm98\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww\" (UID: \"0d517494-bba7-429f-991b-ab900a8b0560\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww"
May 28 19:48:02.668286 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.668182    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d517494-bba7-429f-991b-ab900a8b0560-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww\" (UID: \"0d517494-bba7-429f-991b-ab900a8b0560\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww"
May 28 19:48:02.668286 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.668212    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d517494-bba7-429f-991b-ab900a8b0560-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww\" (UID: \"0d517494-bba7-429f-991b-ab900a8b0560\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww"
May 28 19:48:02.768852 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.768827    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d517494-bba7-429f-991b-ab900a8b0560-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww\" (UID: \"0d517494-bba7-429f-991b-ab900a8b0560\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww"
May 28 19:48:02.768961 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.768863    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d517494-bba7-429f-991b-ab900a8b0560-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww\" (UID: \"0d517494-bba7-429f-991b-ab900a8b0560\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww"
May 28 19:48:02.768961 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.768903    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ccm98\" (UniqueName: \"kubernetes.io/projected/0d517494-bba7-429f-991b-ab900a8b0560-kube-api-access-ccm98\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww\" (UID: \"0d517494-bba7-429f-991b-ab900a8b0560\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww"
May 28 19:48:02.769253 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.769234    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d517494-bba7-429f-991b-ab900a8b0560-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww\" (UID: \"0d517494-bba7-429f-991b-ab900a8b0560\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww"
May 28 19:48:02.769320 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.769266    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d517494-bba7-429f-991b-ab900a8b0560-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww\" (UID: \"0d517494-bba7-429f-991b-ab900a8b0560\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww"
May 28 19:48:02.777020 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.777002    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccm98\" (UniqueName: \"kubernetes.io/projected/0d517494-bba7-429f-991b-ab900a8b0560-kube-api-access-ccm98\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww\" (UID: \"0d517494-bba7-429f-991b-ab900a8b0560\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww"
May 28 19:48:02.867178 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.867157    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww"
May 28 19:48:02.991783 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:02.991751    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww"]
May 28 19:48:02.995149 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:48:02.995122    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d517494_bba7_429f_991b_ab900a8b0560.slice/crio-f188e31f6b8228fec0813e811487715c8df01353dc710417e5ba0a1a19835f81 WatchSource:0}: Error finding container f188e31f6b8228fec0813e811487715c8df01353dc710417e5ba0a1a19835f81: Status 404 returned error can't find the container with id f188e31f6b8228fec0813e811487715c8df01353dc710417e5ba0a1a19835f81
May 28 19:48:03.001424 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:03.001391    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm" event={"ID":"809ca0d7-c818-489d-af69-346a5cef891e","Type":"ContainerStarted","Data":"bb43f12c30ea1f1043022be80efa09a137b97bf4efd3d019d31d3406300c5bb0"}
May 28 19:48:03.002388 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:03.002367    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww" event={"ID":"0d517494-bba7-429f-991b-ab900a8b0560","Type":"ContainerStarted","Data":"f188e31f6b8228fec0813e811487715c8df01353dc710417e5ba0a1a19835f81"}
May 28 19:48:04.007417 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:04.007384    2564 generic.go:358] "Generic (PLEG): container finished" podID="0d517494-bba7-429f-991b-ab900a8b0560" containerID="0aa74fda9f28728cd6db0aec24922ae669ae73e0c4c8878b5c35cc24f08efd8b" exitCode=0
May 28 19:48:04.007852 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:04.007449    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww" event={"ID":"0d517494-bba7-429f-991b-ab900a8b0560","Type":"ContainerDied","Data":"0aa74fda9f28728cd6db0aec24922ae669ae73e0c4c8878b5c35cc24f08efd8b"}
May 28 19:48:06.013792 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:06.013756    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm" event={"ID":"809ca0d7-c818-489d-af69-346a5cef891e","Type":"ContainerStarted","Data":"1d88001bf2d285c18aa35425c9043056c3ead516198a10ea7e5e07384a016947"}
May 28 19:48:06.014217 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:06.013880    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm"
May 28 19:48:06.015260 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:06.015235    2564 generic.go:358] "Generic (PLEG): container finished" podID="0d517494-bba7-429f-991b-ab900a8b0560" containerID="39c5696d3eef289d43d4d09c8f746ae56f588c63f29066e76a1b4a5c22fb7e74" exitCode=0
May 28 19:48:06.015356 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:06.015273    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww" event={"ID":"0d517494-bba7-429f-991b-ab900a8b0560","Type":"ContainerDied","Data":"39c5696d3eef289d43d4d09c8f746ae56f588c63f29066e76a1b4a5c22fb7e74"}
May 28 19:48:06.040403 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:06.040361    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm" podStartSLOduration=1.3442703 podStartE2EDuration="4.040349883s" podCreationTimestamp="2026-05-28 19:48:02 +0000 UTC" firstStartedPulling="2026-05-28 19:48:02.574207185 +0000 UTC m=+287.184931827" lastFinishedPulling="2026-05-28 19:48:05.27028676 +0000 UTC m=+289.881011410" observedRunningTime="2026-05-28 19:48:06.039460156 +0000 UTC m=+290.650184816" watchObservedRunningTime="2026-05-28 19:48:06.040349883 +0000 UTC m=+290.651074543"
May 28 19:48:07.020758 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:07.020721    2564 generic.go:358] "Generic (PLEG): container finished" podID="0d517494-bba7-429f-991b-ab900a8b0560" containerID="6ce4e5bd4db7c177df16cb84c3c9da8421c84ab03af83449214d2a02750e89e0" exitCode=0
May 28 19:48:07.021202 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:07.020794    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww" event={"ID":"0d517494-bba7-429f-991b-ab900a8b0560","Type":"ContainerDied","Data":"6ce4e5bd4db7c177df16cb84c3c9da8421c84ab03af83449214d2a02750e89e0"}
May 28 19:48:08.148465 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:08.148440    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww"
May 28 19:48:08.211765 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:08.211737    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d517494-bba7-429f-991b-ab900a8b0560-util\") pod \"0d517494-bba7-429f-991b-ab900a8b0560\" (UID: \"0d517494-bba7-429f-991b-ab900a8b0560\") "
May 28 19:48:08.211885 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:08.211788    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccm98\" (UniqueName: \"kubernetes.io/projected/0d517494-bba7-429f-991b-ab900a8b0560-kube-api-access-ccm98\") pod \"0d517494-bba7-429f-991b-ab900a8b0560\" (UID: \"0d517494-bba7-429f-991b-ab900a8b0560\") "
May 28 19:48:08.211885 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:08.211812    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d517494-bba7-429f-991b-ab900a8b0560-bundle\") pod \"0d517494-bba7-429f-991b-ab900a8b0560\" (UID: \"0d517494-bba7-429f-991b-ab900a8b0560\") "
May 28 19:48:08.212841 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:08.212807    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d517494-bba7-429f-991b-ab900a8b0560-bundle" (OuterVolumeSpecName: "bundle") pod "0d517494-bba7-429f-991b-ab900a8b0560" (UID: "0d517494-bba7-429f-991b-ab900a8b0560"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:48:08.213752 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:08.213731    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d517494-bba7-429f-991b-ab900a8b0560-kube-api-access-ccm98" (OuterVolumeSpecName: "kube-api-access-ccm98") pod "0d517494-bba7-429f-991b-ab900a8b0560" (UID: "0d517494-bba7-429f-991b-ab900a8b0560"). InnerVolumeSpecName "kube-api-access-ccm98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:48:08.217150 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:08.217130    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d517494-bba7-429f-991b-ab900a8b0560-util" (OuterVolumeSpecName: "util") pod "0d517494-bba7-429f-991b-ab900a8b0560" (UID: "0d517494-bba7-429f-991b-ab900a8b0560"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:48:08.313061 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:08.313000    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccm98\" (UniqueName: \"kubernetes.io/projected/0d517494-bba7-429f-991b-ab900a8b0560-kube-api-access-ccm98\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:48:08.313061 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:08.313022    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d517494-bba7-429f-991b-ab900a8b0560-bundle\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:48:08.313061 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:08.313031    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d517494-bba7-429f-991b-ab900a8b0560-util\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:48:09.028934 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:09.028888    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww" event={"ID":"0d517494-bba7-429f-991b-ab900a8b0560","Type":"ContainerDied","Data":"f188e31f6b8228fec0813e811487715c8df01353dc710417e5ba0a1a19835f81"}
May 28 19:48:09.028934 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:09.028924    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f188e31f6b8228fec0813e811487715c8df01353dc710417e5ba0a1a19835f81"
May 28 19:48:09.028934 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:09.028928    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9b8gww"
May 28 19:48:15.919144 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:15.919119    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 19:48:15.919702 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:15.919682    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 19:48:15.925558 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:15.925541    2564 kubelet.go:1628] "Image garbage collection succeeded"
May 28 19:48:17.022793 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:17.022762    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69568b6749-jnxrm"
May 28 19:48:20.677378 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.677346    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-58474d499-7t8v7"]
May 28 19:48:20.677811 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.677624    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d517494-bba7-429f-991b-ab900a8b0560" containerName="util"
May 28 19:48:20.677811 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.677635    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d517494-bba7-429f-991b-ab900a8b0560" containerName="util"
May 28 19:48:20.677811 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.677657    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d517494-bba7-429f-991b-ab900a8b0560" containerName="pull"
May 28 19:48:20.677811 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.677664    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d517494-bba7-429f-991b-ab900a8b0560" containerName="pull"
May 28 19:48:20.677811 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.677671    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d517494-bba7-429f-991b-ab900a8b0560" containerName="extract"
May 28 19:48:20.677811 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.677676    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d517494-bba7-429f-991b-ab900a8b0560" containerName="extract"
May 28 19:48:20.677811 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.677726    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d517494-bba7-429f-991b-ab900a8b0560" containerName="extract"
May 28 19:48:20.687538 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.687510    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58474d499-7t8v7"
May 28 19:48:20.690837 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.690808    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 28 19:48:20.691528 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.691509    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 19:48:20.691642 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.691530    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pqf79\""
May 28 19:48:20.691642 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.691545    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 28 19:48:20.691957 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.691939    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 19:48:20.698022 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.698000    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58474d499-7t8v7"]
May 28 19:48:20.797627 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.797597    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfhn5\" (UniqueName: \"kubernetes.io/projected/a20cc52b-e66b-420a-b0d7-399b4d09e8c3-kube-api-access-nfhn5\") pod \"kube-auth-proxy-58474d499-7t8v7\" (UID: \"a20cc52b-e66b-420a-b0d7-399b4d09e8c3\") " pod="openshift-ingress/kube-auth-proxy-58474d499-7t8v7"
May 28 19:48:20.797776 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.797638    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a20cc52b-e66b-420a-b0d7-399b4d09e8c3-tmp\") pod \"kube-auth-proxy-58474d499-7t8v7\" (UID: \"a20cc52b-e66b-420a-b0d7-399b4d09e8c3\") " pod="openshift-ingress/kube-auth-proxy-58474d499-7t8v7"
May 28 19:48:20.797776 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.797674    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a20cc52b-e66b-420a-b0d7-399b4d09e8c3-tls-certs\") pod \"kube-auth-proxy-58474d499-7t8v7\" (UID: \"a20cc52b-e66b-420a-b0d7-399b4d09e8c3\") " pod="openshift-ingress/kube-auth-proxy-58474d499-7t8v7"
May 28 19:48:20.898368 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.898332    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfhn5\" (UniqueName: \"kubernetes.io/projected/a20cc52b-e66b-420a-b0d7-399b4d09e8c3-kube-api-access-nfhn5\") pod \"kube-auth-proxy-58474d499-7t8v7\" (UID: \"a20cc52b-e66b-420a-b0d7-399b4d09e8c3\") " pod="openshift-ingress/kube-auth-proxy-58474d499-7t8v7"
May 28 19:48:20.898368 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.898371    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a20cc52b-e66b-420a-b0d7-399b4d09e8c3-tmp\") pod \"kube-auth-proxy-58474d499-7t8v7\" (UID: \"a20cc52b-e66b-420a-b0d7-399b4d09e8c3\") " pod="openshift-ingress/kube-auth-proxy-58474d499-7t8v7"
May 28 19:48:20.898584 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.898408    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a20cc52b-e66b-420a-b0d7-399b4d09e8c3-tls-certs\") pod \"kube-auth-proxy-58474d499-7t8v7\" (UID: \"a20cc52b-e66b-420a-b0d7-399b4d09e8c3\") " pod="openshift-ingress/kube-auth-proxy-58474d499-7t8v7"
May 28 19:48:20.900559 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.900535    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a20cc52b-e66b-420a-b0d7-399b4d09e8c3-tmp\") pod \"kube-auth-proxy-58474d499-7t8v7\" (UID: \"a20cc52b-e66b-420a-b0d7-399b4d09e8c3\") " pod="openshift-ingress/kube-auth-proxy-58474d499-7t8v7"
May 28 19:48:20.900874 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.900852    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a20cc52b-e66b-420a-b0d7-399b4d09e8c3-tls-certs\") pod \"kube-auth-proxy-58474d499-7t8v7\" (UID: \"a20cc52b-e66b-420a-b0d7-399b4d09e8c3\") " pod="openshift-ingress/kube-auth-proxy-58474d499-7t8v7"
May 28 19:48:20.906814 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.906790    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfhn5\" (UniqueName: \"kubernetes.io/projected/a20cc52b-e66b-420a-b0d7-399b4d09e8c3-kube-api-access-nfhn5\") pod \"kube-auth-proxy-58474d499-7t8v7\" (UID: \"a20cc52b-e66b-420a-b0d7-399b4d09e8c3\") " pod="openshift-ingress/kube-auth-proxy-58474d499-7t8v7"
May 28 19:48:20.997022 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:20.996963    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58474d499-7t8v7"
May 28 19:48:21.126857 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.126836    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58474d499-7t8v7"]
May 28 19:48:21.129013 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:48:21.128986    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20cc52b_e66b_420a_b0d7_399b4d09e8c3.slice/crio-3b852c57d16c74085b3da3b96a18492778e61fb8477dca5f5259a1d07a733fe0 WatchSource:0}: Error finding container 3b852c57d16c74085b3da3b96a18492778e61fb8477dca5f5259a1d07a733fe0: Status 404 returned error can't find the container with id 3b852c57d16c74085b3da3b96a18492778e61fb8477dca5f5259a1d07a733fe0
May 28 19:48:21.131142 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.131089    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 19:48:21.549053 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.549022    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk"]
May 28 19:48:21.554908 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.554890    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk"
May 28 19:48:21.557365 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.557344    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 19:48:21.558133 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.558114    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-228sc\""
May 28 19:48:21.558258 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.558143    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 19:48:21.562732 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.562708    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk"]
May 28 19:48:21.703978 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.703897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1035e35-19b8-44a1-9f41-c41ae673e16b-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk\" (UID: \"e1035e35-19b8-44a1-9f41-c41ae673e16b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk"
May 28 19:48:21.703978 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.703963    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6ppv\" (UniqueName: \"kubernetes.io/projected/e1035e35-19b8-44a1-9f41-c41ae673e16b-kube-api-access-g6ppv\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk\" (UID: \"e1035e35-19b8-44a1-9f41-c41ae673e16b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk"
May 28 19:48:21.704461 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.704003    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1035e35-19b8-44a1-9f41-c41ae673e16b-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk\" (UID: \"e1035e35-19b8-44a1-9f41-c41ae673e16b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk"
May 28 19:48:21.804656 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.804562    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g6ppv\" (UniqueName: \"kubernetes.io/projected/e1035e35-19b8-44a1-9f41-c41ae673e16b-kube-api-access-g6ppv\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk\" (UID: \"e1035e35-19b8-44a1-9f41-c41ae673e16b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk"
May 28 19:48:21.804656 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.804618    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1035e35-19b8-44a1-9f41-c41ae673e16b-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk\" (UID: \"e1035e35-19b8-44a1-9f41-c41ae673e16b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk"
May 28 19:48:21.804875 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.804694    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1035e35-19b8-44a1-9f41-c41ae673e16b-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk\" (UID: \"e1035e35-19b8-44a1-9f41-c41ae673e16b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk"
May 28 19:48:21.805156 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.805133    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1035e35-19b8-44a1-9f41-c41ae673e16b-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk\" (UID: \"e1035e35-19b8-44a1-9f41-c41ae673e16b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk"
May 28 19:48:21.805314 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.805288    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1035e35-19b8-44a1-9f41-c41ae673e16b-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk\" (UID: \"e1035e35-19b8-44a1-9f41-c41ae673e16b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk"
May 28 19:48:21.822055 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.822027    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6ppv\" (UniqueName: \"kubernetes.io/projected/e1035e35-19b8-44a1-9f41-c41ae673e16b-kube-api-access-g6ppv\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk\" (UID: \"e1035e35-19b8-44a1-9f41-c41ae673e16b\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk"
May 28 19:48:21.868135 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.867940    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk"
May 28 19:48:21.967497 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.966437    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"]
May 28 19:48:21.971763 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.971744    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"
May 28 19:48:21.975774 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.975191    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-m2qrp\""
May 28 19:48:21.984290 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.983173    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 28 19:48:21.984290 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.983267    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 28 19:48:21.984290 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.983456    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 28 19:48:21.987466 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:21.987021    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"]
May 28 19:48:22.049575 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.049534    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk"]
May 28 19:48:22.053209 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:48:22.053177    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1035e35_19b8_44a1_9f41_c41ae673e16b.slice/crio-3471f00f1683a232ed481e25bdf647a4ee218a145583a1f333834320ac06458d WatchSource:0}: Error finding container 3471f00f1683a232ed481e25bdf647a4ee218a145583a1f333834320ac06458d: Status 404 returned error can't find the container with id 3471f00f1683a232ed481e25bdf647a4ee218a145583a1f333834320ac06458d
May 28 19:48:22.074755 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.074681    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk" event={"ID":"e1035e35-19b8-44a1-9f41-c41ae673e16b","Type":"ContainerStarted","Data":"3471f00f1683a232ed481e25bdf647a4ee218a145583a1f333834320ac06458d"}
May 28 19:48:22.076766 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.076711    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58474d499-7t8v7" event={"ID":"a20cc52b-e66b-420a-b0d7-399b4d09e8c3","Type":"ContainerStarted","Data":"3b852c57d16c74085b3da3b96a18492778e61fb8477dca5f5259a1d07a733fe0"}
May 28 19:48:22.108866 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.108838    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xc5f\" (UniqueName: \"kubernetes.io/projected/58932f97-deee-4200-ad75-f48da52403e2-kube-api-access-2xc5f\") pod \"lws-controller-manager-9cd786b7b-jndv7\" (UID: \"58932f97-deee-4200-ad75-f48da52403e2\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"
May 28 19:48:22.108992 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.108882    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58932f97-deee-4200-ad75-f48da52403e2-cert\") pod \"lws-controller-manager-9cd786b7b-jndv7\" (UID: \"58932f97-deee-4200-ad75-f48da52403e2\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"
May 28 19:48:22.108992 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.108913    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58932f97-deee-4200-ad75-f48da52403e2-manager-config\") pod \"lws-controller-manager-9cd786b7b-jndv7\" (UID: \"58932f97-deee-4200-ad75-f48da52403e2\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"
May 28 19:48:22.108992 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.108980    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58932f97-deee-4200-ad75-f48da52403e2-metrics-cert\") pod \"lws-controller-manager-9cd786b7b-jndv7\" (UID: \"58932f97-deee-4200-ad75-f48da52403e2\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"
May 28 19:48:22.210399 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.210365    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xc5f\" (UniqueName: \"kubernetes.io/projected/58932f97-deee-4200-ad75-f48da52403e2-kube-api-access-2xc5f\") pod \"lws-controller-manager-9cd786b7b-jndv7\" (UID: \"58932f97-deee-4200-ad75-f48da52403e2\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"
May 28 19:48:22.210530 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.210424    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58932f97-deee-4200-ad75-f48da52403e2-cert\") pod \"lws-controller-manager-9cd786b7b-jndv7\" (UID: \"58932f97-deee-4200-ad75-f48da52403e2\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"
May 28 19:48:22.210530 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.210457    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58932f97-deee-4200-ad75-f48da52403e2-manager-config\") pod \"lws-controller-manager-9cd786b7b-jndv7\" (UID: \"58932f97-deee-4200-ad75-f48da52403e2\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"
May 28 19:48:22.210640 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.210542    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58932f97-deee-4200-ad75-f48da52403e2-metrics-cert\") pod \"lws-controller-manager-9cd786b7b-jndv7\" (UID: \"58932f97-deee-4200-ad75-f48da52403e2\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"
May 28 19:48:22.211425 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.211371    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58932f97-deee-4200-ad75-f48da52403e2-manager-config\") pod \"lws-controller-manager-9cd786b7b-jndv7\" (UID: \"58932f97-deee-4200-ad75-f48da52403e2\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"
May 28 19:48:22.213574 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.213530    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58932f97-deee-4200-ad75-f48da52403e2-metrics-cert\") pod \"lws-controller-manager-9cd786b7b-jndv7\" (UID: \"58932f97-deee-4200-ad75-f48da52403e2\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"
May 28 19:48:22.213717 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.213694    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58932f97-deee-4200-ad75-f48da52403e2-cert\") pod \"lws-controller-manager-9cd786b7b-jndv7\" (UID: \"58932f97-deee-4200-ad75-f48da52403e2\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"
May 28 19:48:22.220620 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.220577    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xc5f\" (UniqueName: \"kubernetes.io/projected/58932f97-deee-4200-ad75-f48da52403e2-kube-api-access-2xc5f\") pod \"lws-controller-manager-9cd786b7b-jndv7\" (UID: \"58932f97-deee-4200-ad75-f48da52403e2\") " pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"
May 28 19:48:22.292558 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.292528    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"
May 28 19:48:22.445881 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:22.445854    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"]
May 28 19:48:23.082691 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:23.082637    2564 generic.go:358] "Generic (PLEG): container finished" podID="e1035e35-19b8-44a1-9f41-c41ae673e16b" containerID="14f6523b0b9356be2f2339391f05cb1328623e32f309d851cf4f8628121d9da0" exitCode=0
May 28 19:48:23.083297 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:23.082720    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk" event={"ID":"e1035e35-19b8-44a1-9f41-c41ae673e16b","Type":"ContainerDied","Data":"14f6523b0b9356be2f2339391f05cb1328623e32f309d851cf4f8628121d9da0"}
May 28 19:48:23.830491 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:48:23.830461    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58932f97_deee_4200_ad75_f48da52403e2.slice/crio-41fc96d8f3e1fc3cc0738ac20b33bcfbf348fabe487e9c29235d5a495d1d1dc1 WatchSource:0}: Error finding container 41fc96d8f3e1fc3cc0738ac20b33bcfbf348fabe487e9c29235d5a495d1d1dc1: Status 404 returned error can't find the container with id 41fc96d8f3e1fc3cc0738ac20b33bcfbf348fabe487e9c29235d5a495d1d1dc1
May 28 19:48:24.086958 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:24.086871    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58474d499-7t8v7" event={"ID":"a20cc52b-e66b-420a-b0d7-399b4d09e8c3","Type":"ContainerStarted","Data":"6bce2fe6e1c565c356e79dfcf0cc1b83aa320962d1227e25ec0524b882bdef72"}
May 28 19:48:24.087945 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:24.087917    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7" event={"ID":"58932f97-deee-4200-ad75-f48da52403e2","Type":"ContainerStarted","Data":"41fc96d8f3e1fc3cc0738ac20b33bcfbf348fabe487e9c29235d5a495d1d1dc1"}
May 28 19:48:24.116523 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:24.116470    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-58474d499-7t8v7" podStartSLOduration=1.35808165 podStartE2EDuration="4.116454998s" podCreationTimestamp="2026-05-28 19:48:20 +0000 UTC" firstStartedPulling="2026-05-28 19:48:21.131288252 +0000 UTC m=+305.742012891" lastFinishedPulling="2026-05-28 19:48:23.889661591 +0000 UTC m=+308.500386239" observedRunningTime="2026-05-28 19:48:24.114477 +0000 UTC m=+308.725201660" watchObservedRunningTime="2026-05-28 19:48:24.116454998 +0000 UTC m=+308.727179659"
May 28 19:48:25.094295 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:25.094258    2564 generic.go:358] "Generic (PLEG): container finished" podID="e1035e35-19b8-44a1-9f41-c41ae673e16b" containerID="eeb3f3328e4833614543e9e4606fff4cf7fb36b5d9bcbc5a71f21421b4400832" exitCode=0
May 28 19:48:25.094751 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:25.094349    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk" event={"ID":"e1035e35-19b8-44a1-9f41-c41ae673e16b","Type":"ContainerDied","Data":"eeb3f3328e4833614543e9e4606fff4cf7fb36b5d9bcbc5a71f21421b4400832"}
May 28 19:48:26.098516 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:26.098481    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7" event={"ID":"58932f97-deee-4200-ad75-f48da52403e2","Type":"ContainerStarted","Data":"d78c77c0276c969d815e064d5b35507cb6c5378089974bd04a20a731ff9b1a92"}
May 28 19:48:26.098952 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:26.098553    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"
May 28 19:48:26.100295 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:26.100264    2564 generic.go:358] "Generic (PLEG): container finished" podID="e1035e35-19b8-44a1-9f41-c41ae673e16b" containerID="e3948ccd5b220e1235acfc727c8574cf7ead7b8da3cc833cc02595b531dbe97a" exitCode=0
May 28 19:48:26.100413 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:26.100334    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk" event={"ID":"e1035e35-19b8-44a1-9f41-c41ae673e16b","Type":"ContainerDied","Data":"e3948ccd5b220e1235acfc727c8574cf7ead7b8da3cc833cc02595b531dbe97a"}
May 28 19:48:26.117849 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:26.117808    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7" podStartSLOduration=3.54421195 podStartE2EDuration="5.117794543s" podCreationTimestamp="2026-05-28 19:48:21 +0000 UTC" firstStartedPulling="2026-05-28 19:48:23.832341743 +0000 UTC m=+308.443066381" lastFinishedPulling="2026-05-28 19:48:25.405924336 +0000 UTC m=+310.016648974" observedRunningTime="2026-05-28 19:48:26.116447398 +0000 UTC m=+310.727172060" watchObservedRunningTime="2026-05-28 19:48:26.117794543 +0000 UTC m=+310.728519202"
May 28 19:48:27.223393 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:27.223368    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk"
May 28 19:48:27.353223 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:27.353193    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1035e35-19b8-44a1-9f41-c41ae673e16b-util\") pod \"e1035e35-19b8-44a1-9f41-c41ae673e16b\" (UID: \"e1035e35-19b8-44a1-9f41-c41ae673e16b\") "
May 28 19:48:27.353351 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:27.353230    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1035e35-19b8-44a1-9f41-c41ae673e16b-bundle\") pod \"e1035e35-19b8-44a1-9f41-c41ae673e16b\" (UID: \"e1035e35-19b8-44a1-9f41-c41ae673e16b\") "
May 28 19:48:27.353351 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:27.353298    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6ppv\" (UniqueName: \"kubernetes.io/projected/e1035e35-19b8-44a1-9f41-c41ae673e16b-kube-api-access-g6ppv\") pod \"e1035e35-19b8-44a1-9f41-c41ae673e16b\" (UID: \"e1035e35-19b8-44a1-9f41-c41ae673e16b\") "
May 28 19:48:27.354464 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:27.354400    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1035e35-19b8-44a1-9f41-c41ae673e16b-bundle" (OuterVolumeSpecName: "bundle") pod "e1035e35-19b8-44a1-9f41-c41ae673e16b" (UID: "e1035e35-19b8-44a1-9f41-c41ae673e16b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:48:27.355307 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:27.355287    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1035e35-19b8-44a1-9f41-c41ae673e16b-kube-api-access-g6ppv" (OuterVolumeSpecName: "kube-api-access-g6ppv") pod "e1035e35-19b8-44a1-9f41-c41ae673e16b" (UID: "e1035e35-19b8-44a1-9f41-c41ae673e16b"). InnerVolumeSpecName "kube-api-access-g6ppv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:48:27.361492 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:27.361466    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1035e35-19b8-44a1-9f41-c41ae673e16b-util" (OuterVolumeSpecName: "util") pod "e1035e35-19b8-44a1-9f41-c41ae673e16b" (UID: "e1035e35-19b8-44a1-9f41-c41ae673e16b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:48:27.454565 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:27.454534    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6ppv\" (UniqueName: \"kubernetes.io/projected/e1035e35-19b8-44a1-9f41-c41ae673e16b-kube-api-access-g6ppv\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:48:27.454565 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:27.454562    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1035e35-19b8-44a1-9f41-c41ae673e16b-util\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:48:27.454732 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:27.454576    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1035e35-19b8-44a1-9f41-c41ae673e16b-bundle\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:48:28.114741 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:28.114701    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk" event={"ID":"e1035e35-19b8-44a1-9f41-c41ae673e16b","Type":"ContainerDied","Data":"3471f00f1683a232ed481e25bdf647a4ee218a145583a1f333834320ac06458d"}
May 28 19:48:28.114741 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:28.114744    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3471f00f1683a232ed481e25bdf647a4ee218a145583a1f333834320ac06458d"
May 28 19:48:28.114942 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:28.114769    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835n6znk"
May 28 19:48:36.035345 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.035311    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9"]
May 28 19:48:36.035722 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.035575    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1035e35-19b8-44a1-9f41-c41ae673e16b" containerName="pull"
May 28 19:48:36.035722 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.035585    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1035e35-19b8-44a1-9f41-c41ae673e16b" containerName="pull"
May 28 19:48:36.035722 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.035596    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1035e35-19b8-44a1-9f41-c41ae673e16b" containerName="extract"
May 28 19:48:36.035722 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.035602    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1035e35-19b8-44a1-9f41-c41ae673e16b" containerName="extract"
May 28 19:48:36.035722 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.035615    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1035e35-19b8-44a1-9f41-c41ae673e16b" containerName="util"
May 28 19:48:36.035722 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.035621    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1035e35-19b8-44a1-9f41-c41ae673e16b" containerName="util"
May 28 19:48:36.035722 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.035673    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="e1035e35-19b8-44a1-9f41-c41ae673e16b" containerName="extract"
May 28 19:48:36.038350 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.038334    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9"
May 28 19:48:36.041789 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.041742    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 19:48:36.042738 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.042716    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-228sc\""
May 28 19:48:36.043171 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.043149    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 19:48:36.058141 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.058119    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9"]
May 28 19:48:36.222768 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.222743    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd9b4\" (UniqueName: \"kubernetes.io/projected/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-kube-api-access-xd9b4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9\" (UID: \"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9"
May 28 19:48:36.222909 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.222806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9\" (UID: \"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9"
May 28 19:48:36.222909 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.222836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9\" (UID: \"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9"
May 28 19:48:36.323400 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.323333    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9\" (UID: \"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9"
May 28 19:48:36.323400 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.323370    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9\" (UID: \"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9"
May 28 19:48:36.323548 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.323425    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xd9b4\" (UniqueName: \"kubernetes.io/projected/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-kube-api-access-xd9b4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9\" (UID: \"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9"
May 28 19:48:36.323762 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.323743    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9\" (UID: \"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9"
May 28 19:48:36.323797 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.323757    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9\" (UID: \"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9"
May 28 19:48:36.336836 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.336817    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd9b4\" (UniqueName: \"kubernetes.io/projected/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-kube-api-access-xd9b4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9\" (UID: \"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9"
May 28 19:48:36.348185 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.348169    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9"
May 28 19:48:36.486919 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:36.486862    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9"]
May 28 19:48:36.490682 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:48:36.490638    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec7e2a3_35e9_46d4_bb5a_7e2374995ae5.slice/crio-9870b0aac23aa4eb638a856dd546de8e22612e84e58573e2b5d6482b958211fa WatchSource:0}: Error finding container 9870b0aac23aa4eb638a856dd546de8e22612e84e58573e2b5d6482b958211fa: Status 404 returned error can't find the container with id 9870b0aac23aa4eb638a856dd546de8e22612e84e58573e2b5d6482b958211fa
May 28 19:48:37.106006 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:37.105975    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9cd786b7b-jndv7"
May 28 19:48:37.143682 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:37.143641    2564 generic.go:358] "Generic (PLEG): container finished" podID="5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5" containerID="8fe9ba3df5ec8d3869bb1965889f72ace70bb73c03aab764abcf36ee8f4c9d48" exitCode=0
May 28 19:48:37.143837 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:37.143728    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9" event={"ID":"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5","Type":"ContainerDied","Data":"8fe9ba3df5ec8d3869bb1965889f72ace70bb73c03aab764abcf36ee8f4c9d48"}
May 28 19:48:37.143837 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:37.143769    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9" event={"ID":"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5","Type":"ContainerStarted","Data":"9870b0aac23aa4eb638a856dd546de8e22612e84e58573e2b5d6482b958211fa"}
May 28 19:48:38.149392 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:38.149363    2564 generic.go:358] "Generic (PLEG): container finished" podID="5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5" containerID="f1e15aca65c273ed2bf90985047483aeb13d59fc2853d0e7f18bca3bdae85536" exitCode=0
May 28 19:48:38.149715 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:38.149445    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9" event={"ID":"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5","Type":"ContainerDied","Data":"f1e15aca65c273ed2bf90985047483aeb13d59fc2853d0e7f18bca3bdae85536"}
May 28 19:48:39.155250 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:39.155221    2564 generic.go:358] "Generic (PLEG): container finished" podID="5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5" containerID="9f1b556f3fcf363adae0a39b7c3c161a3761457c32f5f439eb3f954a1603c2d0" exitCode=0
May 28 19:48:39.155696 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:39.155305    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9" event={"ID":"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5","Type":"ContainerDied","Data":"9f1b556f3fcf363adae0a39b7c3c161a3761457c32f5f439eb3f954a1603c2d0"}
May 28 19:48:40.280427 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:40.280404    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9"
May 28 19:48:40.351405 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:40.351382    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-bundle\") pod \"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5\" (UID: \"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5\") "
May 28 19:48:40.351528 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:40.351433    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xd9b4\" (UniqueName: \"kubernetes.io/projected/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-kube-api-access-xd9b4\") pod \"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5\" (UID: \"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5\") "
May 28 19:48:40.351528 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:40.351491    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-util\") pod \"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5\" (UID: \"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5\") "
May 28 19:48:40.352309 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:40.352284    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-bundle" (OuterVolumeSpecName: "bundle") pod "5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5" (UID: "5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:48:40.353539 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:40.353516    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-kube-api-access-xd9b4" (OuterVolumeSpecName: "kube-api-access-xd9b4") pod "5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5" (UID: "5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5"). InnerVolumeSpecName "kube-api-access-xd9b4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:48:40.356863 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:40.356825    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-util" (OuterVolumeSpecName: "util") pod "5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5" (UID: "5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:48:40.452166 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:40.452117    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-bundle\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:48:40.452166 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:40.452137    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xd9b4\" (UniqueName: \"kubernetes.io/projected/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-kube-api-access-xd9b4\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:48:40.452166 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:40.452146    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5-util\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:48:41.162748 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:41.162721    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9"
May 28 19:48:41.162748 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:41.162727    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762abh5p9" event={"ID":"5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5","Type":"ContainerDied","Data":"9870b0aac23aa4eb638a856dd546de8e22612e84e58573e2b5d6482b958211fa"}
May 28 19:48:41.162748 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:48:41.162757    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9870b0aac23aa4eb638a856dd546de8e22612e84e58573e2b5d6482b958211fa"
May 28 19:49:35.873138 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:35.873050    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq"]
May 28 19:49:35.873564 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:35.873358    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5" containerName="util"
May 28 19:49:35.873564 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:35.873370    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5" containerName="util"
May 28 19:49:35.873564 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:35.873380    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5" containerName="pull"
May 28 19:49:35.873564 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:35.873386    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5" containerName="pull"
May 28 19:49:35.873564 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:35.873402    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5" containerName="extract"
May 28 19:49:35.873564 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:35.873408    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5" containerName="extract"
May 28 19:49:35.873564 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:35.873453    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ec7e2a3-35e9-46d4-bb5a-7e2374995ae5" containerName="extract"
May 28 19:49:35.876302 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:35.876285    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq"
May 28 19:49:35.878654 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:35.878630    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 19:49:35.879427 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:35.879409    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gh5fm\""
May 28 19:49:35.879528 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:35.879447    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 19:49:35.884155 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:35.884136    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq"]
May 28 19:49:35.935790 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:35.935766    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfbkw\" (UniqueName: \"kubernetes.io/projected/9f93b052-ed83-4f97-bd45-958cb28d3d35-kube-api-access-cfbkw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq\" (UID: \"9f93b052-ed83-4f97-bd45-958cb28d3d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq"
May 28 19:49:35.935874 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:35.935797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f93b052-ed83-4f97-bd45-958cb28d3d35-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq\" (UID: \"9f93b052-ed83-4f97-bd45-958cb28d3d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq"
May 28 19:49:35.935874 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:35.935815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f93b052-ed83-4f97-bd45-958cb28d3d35-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq\" (UID: \"9f93b052-ed83-4f97-bd45-958cb28d3d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq"
May 28 19:49:36.036323 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.036298    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cfbkw\" (UniqueName: \"kubernetes.io/projected/9f93b052-ed83-4f97-bd45-958cb28d3d35-kube-api-access-cfbkw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq\" (UID: \"9f93b052-ed83-4f97-bd45-958cb28d3d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq"
May 28 19:49:36.036420 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.036331    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f93b052-ed83-4f97-bd45-958cb28d3d35-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq\" (UID: \"9f93b052-ed83-4f97-bd45-958cb28d3d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq"
May 28 19:49:36.036420 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.036348    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f93b052-ed83-4f97-bd45-958cb28d3d35-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq\" (UID: \"9f93b052-ed83-4f97-bd45-958cb28d3d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq"
May 28 19:49:36.036650 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.036635    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f93b052-ed83-4f97-bd45-958cb28d3d35-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq\" (UID: \"9f93b052-ed83-4f97-bd45-958cb28d3d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq"
May 28 19:49:36.036698 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.036667    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f93b052-ed83-4f97-bd45-958cb28d3d35-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq\" (UID: \"9f93b052-ed83-4f97-bd45-958cb28d3d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq"
May 28 19:49:36.045089 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.045066    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfbkw\" (UniqueName: \"kubernetes.io/projected/9f93b052-ed83-4f97-bd45-958cb28d3d35-kube-api-access-cfbkw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq\" (UID: \"9f93b052-ed83-4f97-bd45-958cb28d3d35\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq"
May 28 19:49:36.186491 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.186472    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq"
May 28 19:49:36.469029 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.468958    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7"]
May 28 19:49:36.473216 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.473197    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7"
May 28 19:49:36.481171 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.481149    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7"]
May 28 19:49:36.518084 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.518062    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq"]
May 28 19:49:36.520575 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:49:36.520554    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f93b052_ed83_4f97_bd45_958cb28d3d35.slice/crio-7e0e0d846cab70ae036e21425760a21b53086860925f63c10172a3a267a7752a WatchSource:0}: Error finding container 7e0e0d846cab70ae036e21425760a21b53086860925f63c10172a3a267a7752a: Status 404 returned error can't find the container with id 7e0e0d846cab70ae036e21425760a21b53086860925f63c10172a3a267a7752a
May 28 19:49:36.541407 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.541377    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl8fp\" (UniqueName: \"kubernetes.io/projected/80032370-ecdd-4772-8871-9eccb24a54de-kube-api-access-zl8fp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7\" (UID: \"80032370-ecdd-4772-8871-9eccb24a54de\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7"
May 28 19:49:36.541491 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.541414    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80032370-ecdd-4772-8871-9eccb24a54de-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7\" (UID: \"80032370-ecdd-4772-8871-9eccb24a54de\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7"
May 28 19:49:36.541491 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.541447    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80032370-ecdd-4772-8871-9eccb24a54de-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7\" (UID: \"80032370-ecdd-4772-8871-9eccb24a54de\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7"
May 28 19:49:36.642381 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.642355    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zl8fp\" (UniqueName: \"kubernetes.io/projected/80032370-ecdd-4772-8871-9eccb24a54de-kube-api-access-zl8fp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7\" (UID: \"80032370-ecdd-4772-8871-9eccb24a54de\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7"
May 28 19:49:36.642481 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.642389    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80032370-ecdd-4772-8871-9eccb24a54de-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7\" (UID: \"80032370-ecdd-4772-8871-9eccb24a54de\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7"
May 28 19:49:36.642481 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.642411    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80032370-ecdd-4772-8871-9eccb24a54de-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7\" (UID: \"80032370-ecdd-4772-8871-9eccb24a54de\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7"
May 28 19:49:36.642698 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.642684    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80032370-ecdd-4772-8871-9eccb24a54de-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7\" (UID: \"80032370-ecdd-4772-8871-9eccb24a54de\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7"
May 28 19:49:36.642742 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.642726    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80032370-ecdd-4772-8871-9eccb24a54de-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7\" (UID: \"80032370-ecdd-4772-8871-9eccb24a54de\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7"
May 28 19:49:36.650414 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.650390    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl8fp\" (UniqueName: \"kubernetes.io/projected/80032370-ecdd-4772-8871-9eccb24a54de-kube-api-access-zl8fp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7\" (UID: \"80032370-ecdd-4772-8871-9eccb24a54de\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7"
May 28 19:49:36.782512 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.782459    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7"
May 28 19:49:36.868346 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.868313    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924"]
May 28 19:49:36.873390 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.873365    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924"
May 28 19:49:36.880203 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.880042    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924"]
May 28 19:49:36.909237 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.909217    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7"]
May 28 19:49:36.910961 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:49:36.910939    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80032370_ecdd_4772_8871_9eccb24a54de.slice/crio-2b70caeb248e6f556e63087818e453a543b6d7559a595b10053b91c090dce86a WatchSource:0}: Error finding container 2b70caeb248e6f556e63087818e453a543b6d7559a595b10053b91c090dce86a: Status 404 returned error can't find the container with id 2b70caeb248e6f556e63087818e453a543b6d7559a595b10053b91c090dce86a
May 28 19:49:36.945623 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.945599    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r2gf\" (UniqueName: \"kubernetes.io/projected/9349269c-4538-4cf1-983c-41ba29ff3391-kube-api-access-4r2gf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924\" (UID: \"9349269c-4538-4cf1-983c-41ba29ff3391\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924"
May 28 19:49:36.945721 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.945643    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9349269c-4538-4cf1-983c-41ba29ff3391-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924\" (UID: \"9349269c-4538-4cf1-983c-41ba29ff3391\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924"
May 28 19:49:36.945782 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:36.945738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9349269c-4538-4cf1-983c-41ba29ff3391-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924\" (UID: \"9349269c-4538-4cf1-983c-41ba29ff3391\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924"
May 28 19:49:37.046931 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.046868    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9349269c-4538-4cf1-983c-41ba29ff3391-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924\" (UID: \"9349269c-4538-4cf1-983c-41ba29ff3391\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924"
May 28 19:49:37.047051 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.046937    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9349269c-4538-4cf1-983c-41ba29ff3391-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924\" (UID: \"9349269c-4538-4cf1-983c-41ba29ff3391\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924"
May 28 19:49:37.047051 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.046995    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4r2gf\" (UniqueName: \"kubernetes.io/projected/9349269c-4538-4cf1-983c-41ba29ff3391-kube-api-access-4r2gf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924\" (UID: \"9349269c-4538-4cf1-983c-41ba29ff3391\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924"
May 28 19:49:37.047218 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.047198    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9349269c-4538-4cf1-983c-41ba29ff3391-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924\" (UID: \"9349269c-4538-4cf1-983c-41ba29ff3391\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924"
May 28 19:49:37.047275 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.047264    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9349269c-4538-4cf1-983c-41ba29ff3391-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924\" (UID: \"9349269c-4538-4cf1-983c-41ba29ff3391\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924"
May 28 19:49:37.055489 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.055468    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r2gf\" (UniqueName: \"kubernetes.io/projected/9349269c-4538-4cf1-983c-41ba29ff3391-kube-api-access-4r2gf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924\" (UID: \"9349269c-4538-4cf1-983c-41ba29ff3391\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924"
May 28 19:49:37.185357 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.185330    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924"
May 28 19:49:37.313595 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.313565    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924"]
May 28 19:49:37.314400 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:49:37.314368    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9349269c_4538_4cf1_983c_41ba29ff3391.slice/crio-d70ce26acb249a884175769bd5a35f551f5f38504df5099aa88a1679a6518b49 WatchSource:0}: Error finding container d70ce26acb249a884175769bd5a35f551f5f38504df5099aa88a1679a6518b49: Status 404 returned error can't find the container with id d70ce26acb249a884175769bd5a35f551f5f38504df5099aa88a1679a6518b49
May 28 19:49:37.340136 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.340090    2564 generic.go:358] "Generic (PLEG): container finished" podID="9f93b052-ed83-4f97-bd45-958cb28d3d35" containerID="962e754809bfa563a183ae4b2c66e2cd3722feff3f8502ad1ff7c39cda474dc1" exitCode=0
May 28 19:49:37.340136 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.340122    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq" event={"ID":"9f93b052-ed83-4f97-bd45-958cb28d3d35","Type":"ContainerDied","Data":"962e754809bfa563a183ae4b2c66e2cd3722feff3f8502ad1ff7c39cda474dc1"}
May 28 19:49:37.340279 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.340158    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq" event={"ID":"9f93b052-ed83-4f97-bd45-958cb28d3d35","Type":"ContainerStarted","Data":"7e0e0d846cab70ae036e21425760a21b53086860925f63c10172a3a267a7752a"}
May 28 19:49:37.341509 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.341485    2564 generic.go:358] "Generic (PLEG): container finished" podID="80032370-ecdd-4772-8871-9eccb24a54de" containerID="24bca32d3c675373f1f02b7d5fd4700b11775bc547962994d712200d805d2325" exitCode=0
May 28 19:49:37.341605 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.341549    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7" event={"ID":"80032370-ecdd-4772-8871-9eccb24a54de","Type":"ContainerDied","Data":"24bca32d3c675373f1f02b7d5fd4700b11775bc547962994d712200d805d2325"}
May 28 19:49:37.341605 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.341574    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7" event={"ID":"80032370-ecdd-4772-8871-9eccb24a54de","Type":"ContainerStarted","Data":"2b70caeb248e6f556e63087818e453a543b6d7559a595b10053b91c090dce86a"}
May 28 19:49:37.342656 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.342634    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924" event={"ID":"9349269c-4538-4cf1-983c-41ba29ff3391","Type":"ContainerStarted","Data":"d70ce26acb249a884175769bd5a35f551f5f38504df5099aa88a1679a6518b49"}
May 28 19:49:37.472135 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.472087    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt"]
May 28 19:49:37.477295 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.477270    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt"
May 28 19:49:37.480960 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.480932    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt"]
May 28 19:49:37.551867 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.551841    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1d96e71-b305-41c9-8ef5-a091411e92dc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt\" (UID: \"c1d96e71-b305-41c9-8ef5-a091411e92dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt"
May 28 19:49:37.551867 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.551876    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwqq2\" (UniqueName: \"kubernetes.io/projected/c1d96e71-b305-41c9-8ef5-a091411e92dc-kube-api-access-fwqq2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt\" (UID: \"c1d96e71-b305-41c9-8ef5-a091411e92dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt"
May 28 19:49:37.552068 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.551906    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1d96e71-b305-41c9-8ef5-a091411e92dc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt\" (UID: \"c1d96e71-b305-41c9-8ef5-a091411e92dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt"
May 28 19:49:37.652699 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.652672    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwqq2\" (UniqueName: \"kubernetes.io/projected/c1d96e71-b305-41c9-8ef5-a091411e92dc-kube-api-access-fwqq2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt\" (UID: \"c1d96e71-b305-41c9-8ef5-a091411e92dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt"
May 28 19:49:37.652802 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.652714    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1d96e71-b305-41c9-8ef5-a091411e92dc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt\" (UID: \"c1d96e71-b305-41c9-8ef5-a091411e92dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt"
May 28 19:49:37.652802 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.652758    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1d96e71-b305-41c9-8ef5-a091411e92dc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt\" (UID: \"c1d96e71-b305-41c9-8ef5-a091411e92dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt"
May 28 19:49:37.653043 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.653026    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1d96e71-b305-41c9-8ef5-a091411e92dc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt\" (UID: \"c1d96e71-b305-41c9-8ef5-a091411e92dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt"
May 28 19:49:37.653196 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.653176    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1d96e71-b305-41c9-8ef5-a091411e92dc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt\" (UID: \"c1d96e71-b305-41c9-8ef5-a091411e92dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt"
May 28 19:49:37.661240 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.661216    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwqq2\" (UniqueName: \"kubernetes.io/projected/c1d96e71-b305-41c9-8ef5-a091411e92dc-kube-api-access-fwqq2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt\" (UID: \"c1d96e71-b305-41c9-8ef5-a091411e92dc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt"
May 28 19:49:37.787311 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.787291    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt"
May 28 19:49:37.911753 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:37.911730    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt"]
May 28 19:49:37.916744 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:49:37.916715    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d96e71_b305_41c9_8ef5_a091411e92dc.slice/crio-6d51290bd9a7e20c79df6beeadf8af755855bc50b6e50d7df21804b2c7c90aec WatchSource:0}: Error finding container 6d51290bd9a7e20c79df6beeadf8af755855bc50b6e50d7df21804b2c7c90aec: Status 404 returned error can't find the container with id 6d51290bd9a7e20c79df6beeadf8af755855bc50b6e50d7df21804b2c7c90aec
May 28 19:49:38.347521 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:38.347492    2564 generic.go:358] "Generic (PLEG): container finished" podID="c1d96e71-b305-41c9-8ef5-a091411e92dc" containerID="24aa0bea707b09908a14f7c047984ea4b4063e4620ffa3de9fce32c5225fc4d0" exitCode=0
May 28 19:49:38.347636 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:38.347575    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt" event={"ID":"c1d96e71-b305-41c9-8ef5-a091411e92dc","Type":"ContainerDied","Data":"24aa0bea707b09908a14f7c047984ea4b4063e4620ffa3de9fce32c5225fc4d0"}
May 28 19:49:38.347636 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:38.347620    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt" event={"ID":"c1d96e71-b305-41c9-8ef5-a091411e92dc","Type":"ContainerStarted","Data":"6d51290bd9a7e20c79df6beeadf8af755855bc50b6e50d7df21804b2c7c90aec"}
May 28 19:49:38.349269 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:38.349243    2564 generic.go:358] "Generic (PLEG): container finished" podID="9f93b052-ed83-4f97-bd45-958cb28d3d35" containerID="3c6b33ce1e8b3f7b0250ea8a0873a79898963c1c255919f33e261bd528621a84" exitCode=0
May 28 19:49:38.349369 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:38.349337    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq" event={"ID":"9f93b052-ed83-4f97-bd45-958cb28d3d35","Type":"ContainerDied","Data":"3c6b33ce1e8b3f7b0250ea8a0873a79898963c1c255919f33e261bd528621a84"}
May 28 19:49:38.350940 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:38.350921    2564 generic.go:358] "Generic (PLEG): container finished" podID="80032370-ecdd-4772-8871-9eccb24a54de" containerID="5ed913272eb231c1056d6f1d4693da257bfac55bfab7547c8c778e4fae1aba14" exitCode=0
May 28 19:49:38.351028 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:38.351003    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7" event={"ID":"80032370-ecdd-4772-8871-9eccb24a54de","Type":"ContainerDied","Data":"5ed913272eb231c1056d6f1d4693da257bfac55bfab7547c8c778e4fae1aba14"}
May 28 19:49:38.352455 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:38.352415    2564 generic.go:358] "Generic (PLEG): container finished" podID="9349269c-4538-4cf1-983c-41ba29ff3391" containerID="835b523891591415f2ed3ee429fa49ccf7c56073b9b9fcdf3e5f093bf1475c9a" exitCode=0
May 28 19:49:38.352548 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:38.352491    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924" event={"ID":"9349269c-4538-4cf1-983c-41ba29ff3391","Type":"ContainerDied","Data":"835b523891591415f2ed3ee429fa49ccf7c56073b9b9fcdf3e5f093bf1475c9a"}
May 28 19:49:39.360482 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:39.360412    2564 generic.go:358] "Generic (PLEG): container finished" podID="80032370-ecdd-4772-8871-9eccb24a54de" containerID="f9117ca4947d4e2a05d7ccaa7630d56b00d62523d62ce36415070637376f1daa" exitCode=0
May 28 19:49:39.360831 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:39.360500    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7" event={"ID":"80032370-ecdd-4772-8871-9eccb24a54de","Type":"ContainerDied","Data":"f9117ca4947d4e2a05d7ccaa7630d56b00d62523d62ce36415070637376f1daa"}
May 28 19:49:39.361859 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:39.361840    2564 generic.go:358] "Generic (PLEG): container finished" podID="9349269c-4538-4cf1-983c-41ba29ff3391" containerID="8d43ed5426ffd444e306f51387cbf6a1e4c43427c4e8b2faedaa0b5c26b05e3b" exitCode=0
May 28 19:49:39.361958 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:39.361921    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924" event={"ID":"9349269c-4538-4cf1-983c-41ba29ff3391","Type":"ContainerDied","Data":"8d43ed5426ffd444e306f51387cbf6a1e4c43427c4e8b2faedaa0b5c26b05e3b"}
May 28 19:49:39.363534 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:39.363430    2564 generic.go:358] "Generic (PLEG): container finished" podID="c1d96e71-b305-41c9-8ef5-a091411e92dc" containerID="1c178c05b10ca4780937c27c4c1b16feafd31d2dfd81053855fd6c827d18e76e" exitCode=0
May 28 19:49:39.363534 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:39.363456    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt" event={"ID":"c1d96e71-b305-41c9-8ef5-a091411e92dc","Type":"ContainerDied","Data":"1c178c05b10ca4780937c27c4c1b16feafd31d2dfd81053855fd6c827d18e76e"}
May 28 19:49:39.365473 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:39.365455    2564 generic.go:358] "Generic (PLEG): container finished" podID="9f93b052-ed83-4f97-bd45-958cb28d3d35" containerID="207cd5f917fdbe7f0d3552b3703077d428a57372339ce42854d97687f168fdcf" exitCode=0
May 28 19:49:39.365538 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:39.365505    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq" event={"ID":"9f93b052-ed83-4f97-bd45-958cb28d3d35","Type":"ContainerDied","Data":"207cd5f917fdbe7f0d3552b3703077d428a57372339ce42854d97687f168fdcf"}
May 28 19:49:40.371165 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.371054    2564 generic.go:358] "Generic (PLEG): container finished" podID="c1d96e71-b305-41c9-8ef5-a091411e92dc" containerID="45b3acdbf658acef96675867ae8b13c4dcd5b9cecb5605490c1e3f82ecf29593" exitCode=0
May 28 19:49:40.371165 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.371135    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt" event={"ID":"c1d96e71-b305-41c9-8ef5-a091411e92dc","Type":"ContainerDied","Data":"45b3acdbf658acef96675867ae8b13c4dcd5b9cecb5605490c1e3f82ecf29593"}
May 28 19:49:40.373003 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.372981    2564 generic.go:358] "Generic (PLEG): container finished" podID="9349269c-4538-4cf1-983c-41ba29ff3391" containerID="d75034cc7515a73f050bd341968b94d0d4d62c5e6fa55a9292b67e8cf17d66a5" exitCode=0
May 28 19:49:40.373058 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.373016    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924" event={"ID":"9349269c-4538-4cf1-983c-41ba29ff3391","Type":"ContainerDied","Data":"d75034cc7515a73f050bd341968b94d0d4d62c5e6fa55a9292b67e8cf17d66a5"}
May 28 19:49:40.528108 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.528070    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq"
May 28 19:49:40.531068 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.531053    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7"
May 28 19:49:40.576799 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.576779    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80032370-ecdd-4772-8871-9eccb24a54de-bundle\") pod \"80032370-ecdd-4772-8871-9eccb24a54de\" (UID: \"80032370-ecdd-4772-8871-9eccb24a54de\") "
May 28 19:49:40.576894 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.576811    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f93b052-ed83-4f97-bd45-958cb28d3d35-bundle\") pod \"9f93b052-ed83-4f97-bd45-958cb28d3d35\" (UID: \"9f93b052-ed83-4f97-bd45-958cb28d3d35\") "
May 28 19:49:40.576894 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.576848    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl8fp\" (UniqueName: \"kubernetes.io/projected/80032370-ecdd-4772-8871-9eccb24a54de-kube-api-access-zl8fp\") pod \"80032370-ecdd-4772-8871-9eccb24a54de\" (UID: \"80032370-ecdd-4772-8871-9eccb24a54de\") "
May 28 19:49:40.576894 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.576870    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80032370-ecdd-4772-8871-9eccb24a54de-util\") pod \"80032370-ecdd-4772-8871-9eccb24a54de\" (UID: \"80032370-ecdd-4772-8871-9eccb24a54de\") "
May 28 19:49:40.576894 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.576886    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfbkw\" (UniqueName: \"kubernetes.io/projected/9f93b052-ed83-4f97-bd45-958cb28d3d35-kube-api-access-cfbkw\") pod \"9f93b052-ed83-4f97-bd45-958cb28d3d35\" (UID: \"9f93b052-ed83-4f97-bd45-958cb28d3d35\") "
May 28 19:49:40.577123 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.576925    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f93b052-ed83-4f97-bd45-958cb28d3d35-util\") pod \"9f93b052-ed83-4f97-bd45-958cb28d3d35\" (UID: \"9f93b052-ed83-4f97-bd45-958cb28d3d35\") "
May 28 19:49:40.577421 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.577392    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80032370-ecdd-4772-8871-9eccb24a54de-bundle" (OuterVolumeSpecName: "bundle") pod "80032370-ecdd-4772-8871-9eccb24a54de" (UID: "80032370-ecdd-4772-8871-9eccb24a54de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:49:40.577565 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.577538    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f93b052-ed83-4f97-bd45-958cb28d3d35-bundle" (OuterVolumeSpecName: "bundle") pod "9f93b052-ed83-4f97-bd45-958cb28d3d35" (UID: "9f93b052-ed83-4f97-bd45-958cb28d3d35"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:49:40.579696 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.579668    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80032370-ecdd-4772-8871-9eccb24a54de-kube-api-access-zl8fp" (OuterVolumeSpecName: "kube-api-access-zl8fp") pod "80032370-ecdd-4772-8871-9eccb24a54de" (UID: "80032370-ecdd-4772-8871-9eccb24a54de"). InnerVolumeSpecName "kube-api-access-zl8fp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:49:40.579795 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.579727    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f93b052-ed83-4f97-bd45-958cb28d3d35-kube-api-access-cfbkw" (OuterVolumeSpecName: "kube-api-access-cfbkw") pod "9f93b052-ed83-4f97-bd45-958cb28d3d35" (UID: "9f93b052-ed83-4f97-bd45-958cb28d3d35"). InnerVolumeSpecName "kube-api-access-cfbkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:49:40.582867 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.582843    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80032370-ecdd-4772-8871-9eccb24a54de-util" (OuterVolumeSpecName: "util") pod "80032370-ecdd-4772-8871-9eccb24a54de" (UID: "80032370-ecdd-4772-8871-9eccb24a54de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:49:40.582957 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.582939    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f93b052-ed83-4f97-bd45-958cb28d3d35-util" (OuterVolumeSpecName: "util") pod "9f93b052-ed83-4f97-bd45-958cb28d3d35" (UID: "9f93b052-ed83-4f97-bd45-958cb28d3d35"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:49:40.678086 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.678063    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80032370-ecdd-4772-8871-9eccb24a54de-bundle\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:49:40.678086 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.678088    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f93b052-ed83-4f97-bd45-958cb28d3d35-bundle\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:49:40.678249 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.678112    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl8fp\" (UniqueName: \"kubernetes.io/projected/80032370-ecdd-4772-8871-9eccb24a54de-kube-api-access-zl8fp\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:49:40.678249 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.678122    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80032370-ecdd-4772-8871-9eccb24a54de-util\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:49:40.678249 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.678131    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfbkw\" (UniqueName: \"kubernetes.io/projected/9f93b052-ed83-4f97-bd45-958cb28d3d35-kube-api-access-cfbkw\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:49:40.678249 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:40.678143    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f93b052-ed83-4f97-bd45-958cb28d3d35-util\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:49:41.377560 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.377528    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq" event={"ID":"9f93b052-ed83-4f97-bd45-958cb28d3d35","Type":"ContainerDied","Data":"7e0e0d846cab70ae036e21425760a21b53086860925f63c10172a3a267a7752a"}
May 28 19:49:41.378069 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.377567    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e0e0d846cab70ae036e21425760a21b53086860925f63c10172a3a267a7752a"
May 28 19:49:41.378069 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.377542    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq"
May 28 19:49:41.379197 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.379178    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7"
May 28 19:49:41.379298 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.379182    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7" event={"ID":"80032370-ecdd-4772-8871-9eccb24a54de","Type":"ContainerDied","Data":"2b70caeb248e6f556e63087818e453a543b6d7559a595b10053b91c090dce86a"}
May 28 19:49:41.379298 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.379293    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b70caeb248e6f556e63087818e453a543b6d7559a595b10053b91c090dce86a"
May 28 19:49:41.531858 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.531838    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924"
May 28 19:49:41.534800 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.534781    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt"
May 28 19:49:41.585931 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.585909    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4r2gf\" (UniqueName: \"kubernetes.io/projected/9349269c-4538-4cf1-983c-41ba29ff3391-kube-api-access-4r2gf\") pod \"9349269c-4538-4cf1-983c-41ba29ff3391\" (UID: \"9349269c-4538-4cf1-983c-41ba29ff3391\") "
May 28 19:49:41.586052 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.585941    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1d96e71-b305-41c9-8ef5-a091411e92dc-bundle\") pod \"c1d96e71-b305-41c9-8ef5-a091411e92dc\" (UID: \"c1d96e71-b305-41c9-8ef5-a091411e92dc\") "
May 28 19:49:41.586052 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.586000    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwqq2\" (UniqueName: \"kubernetes.io/projected/c1d96e71-b305-41c9-8ef5-a091411e92dc-kube-api-access-fwqq2\") pod \"c1d96e71-b305-41c9-8ef5-a091411e92dc\" (UID: \"c1d96e71-b305-41c9-8ef5-a091411e92dc\") "
May 28 19:49:41.586052 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.586018    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1d96e71-b305-41c9-8ef5-a091411e92dc-util\") pod \"c1d96e71-b305-41c9-8ef5-a091411e92dc\" (UID: \"c1d96e71-b305-41c9-8ef5-a091411e92dc\") "
May 28 19:49:41.586238 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.586062    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9349269c-4538-4cf1-983c-41ba29ff3391-util\") pod \"9349269c-4538-4cf1-983c-41ba29ff3391\" (UID: \"9349269c-4538-4cf1-983c-41ba29ff3391\") "
May 28 19:49:41.586238 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.586122    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9349269c-4538-4cf1-983c-41ba29ff3391-bundle\") pod \"9349269c-4538-4cf1-983c-41ba29ff3391\" (UID: \"9349269c-4538-4cf1-983c-41ba29ff3391\") "
May 28 19:49:41.586661 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.586630    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d96e71-b305-41c9-8ef5-a091411e92dc-bundle" (OuterVolumeSpecName: "bundle") pod "c1d96e71-b305-41c9-8ef5-a091411e92dc" (UID: "c1d96e71-b305-41c9-8ef5-a091411e92dc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:49:41.586878 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.586833    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9349269c-4538-4cf1-983c-41ba29ff3391-bundle" (OuterVolumeSpecName: "bundle") pod "9349269c-4538-4cf1-983c-41ba29ff3391" (UID: "9349269c-4538-4cf1-983c-41ba29ff3391"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:49:41.588430 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.588404    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1d96e71-b305-41c9-8ef5-a091411e92dc-kube-api-access-fwqq2" (OuterVolumeSpecName: "kube-api-access-fwqq2") pod "c1d96e71-b305-41c9-8ef5-a091411e92dc" (UID: "c1d96e71-b305-41c9-8ef5-a091411e92dc"). InnerVolumeSpecName "kube-api-access-fwqq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:49:41.588780 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.588759    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9349269c-4538-4cf1-983c-41ba29ff3391-kube-api-access-4r2gf" (OuterVolumeSpecName: "kube-api-access-4r2gf") pod "9349269c-4538-4cf1-983c-41ba29ff3391" (UID: "9349269c-4538-4cf1-983c-41ba29ff3391"). InnerVolumeSpecName "kube-api-access-4r2gf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:49:41.595300 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.595273    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9349269c-4538-4cf1-983c-41ba29ff3391-util" (OuterVolumeSpecName: "util") pod "9349269c-4538-4cf1-983c-41ba29ff3391" (UID: "9349269c-4538-4cf1-983c-41ba29ff3391"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:49:41.595375 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.595278    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1d96e71-b305-41c9-8ef5-a091411e92dc-util" (OuterVolumeSpecName: "util") pod "c1d96e71-b305-41c9-8ef5-a091411e92dc" (UID: "c1d96e71-b305-41c9-8ef5-a091411e92dc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 19:49:41.687123 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.687084    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1d96e71-b305-41c9-8ef5-a091411e92dc-util\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:49:41.687123 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.687121    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9349269c-4538-4cf1-983c-41ba29ff3391-util\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:49:41.687251 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.687134    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9349269c-4538-4cf1-983c-41ba29ff3391-bundle\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:49:41.687251 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.687147    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4r2gf\" (UniqueName: \"kubernetes.io/projected/9349269c-4538-4cf1-983c-41ba29ff3391-kube-api-access-4r2gf\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:49:41.687251 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.687161    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1d96e71-b305-41c9-8ef5-a091411e92dc-bundle\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:49:41.687251 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:41.687173    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwqq2\" (UniqueName: \"kubernetes.io/projected/c1d96e71-b305-41c9-8ef5-a091411e92dc-kube-api-access-fwqq2\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:49:42.384541 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:42.384467    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt"
May 28 19:49:42.384541 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:42.384485    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt" event={"ID":"c1d96e71-b305-41c9-8ef5-a091411e92dc","Type":"ContainerDied","Data":"6d51290bd9a7e20c79df6beeadf8af755855bc50b6e50d7df21804b2c7c90aec"}
May 28 19:49:42.384541 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:42.384518    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d51290bd9a7e20c79df6beeadf8af755855bc50b6e50d7df21804b2c7c90aec"
May 28 19:49:42.386235 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:42.386210    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924" event={"ID":"9349269c-4538-4cf1-983c-41ba29ff3391","Type":"ContainerDied","Data":"d70ce26acb249a884175769bd5a35f551f5f38504df5099aa88a1679a6518b49"}
May 28 19:49:42.386235 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:42.386235    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d70ce26acb249a884175769bd5a35f551f5f38504df5099aa88a1679a6518b49"
May 28 19:49:42.386403 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:49:42.386240    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924"
May 28 19:50:03.282955 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.282920    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852"]
May 28 19:50:03.283396 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283318    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f93b052-ed83-4f97-bd45-958cb28d3d35" containerName="extract"
May 28 19:50:03.283396 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283333    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f93b052-ed83-4f97-bd45-958cb28d3d35" containerName="extract"
May 28 19:50:03.283396 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283343    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80032370-ecdd-4772-8871-9eccb24a54de" containerName="extract"
May 28 19:50:03.283396 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283352    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="80032370-ecdd-4772-8871-9eccb24a54de" containerName="extract"
May 28 19:50:03.283396 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283365    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1d96e71-b305-41c9-8ef5-a091411e92dc" containerName="util"
May 28 19:50:03.283396 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283374    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1d96e71-b305-41c9-8ef5-a091411e92dc" containerName="util"
May 28 19:50:03.283396 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283384    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9349269c-4538-4cf1-983c-41ba29ff3391" containerName="extract"
May 28 19:50:03.283396 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283392    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9349269c-4538-4cf1-983c-41ba29ff3391" containerName="extract"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283402    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1d96e71-b305-41c9-8ef5-a091411e92dc" containerName="pull"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283410    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1d96e71-b305-41c9-8ef5-a091411e92dc" containerName="pull"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283421    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f93b052-ed83-4f97-bd45-958cb28d3d35" containerName="util"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283429    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f93b052-ed83-4f97-bd45-958cb28d3d35" containerName="util"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283440    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80032370-ecdd-4772-8871-9eccb24a54de" containerName="util"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283447    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="80032370-ecdd-4772-8871-9eccb24a54de" containerName="util"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283465    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9349269c-4538-4cf1-983c-41ba29ff3391" containerName="util"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283472    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9349269c-4538-4cf1-983c-41ba29ff3391" containerName="util"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283479    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9349269c-4538-4cf1-983c-41ba29ff3391" containerName="pull"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283487    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9349269c-4538-4cf1-983c-41ba29ff3391" containerName="pull"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283496    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1d96e71-b305-41c9-8ef5-a091411e92dc" containerName="extract"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283503    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1d96e71-b305-41c9-8ef5-a091411e92dc" containerName="extract"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283518    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f93b052-ed83-4f97-bd45-958cb28d3d35" containerName="pull"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283526    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f93b052-ed83-4f97-bd45-958cb28d3d35" containerName="pull"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283538    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80032370-ecdd-4772-8871-9eccb24a54de" containerName="pull"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283545    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="80032370-ecdd-4772-8871-9eccb24a54de" containerName="pull"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283606    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="80032370-ecdd-4772-8871-9eccb24a54de" containerName="extract"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283617    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="9f93b052-ed83-4f97-bd45-958cb28d3d35" containerName="extract"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283626    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="c1d96e71-b305-41c9-8ef5-a091411e92dc" containerName="extract"
May 28 19:50:03.283630 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.283637    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="9349269c-4538-4cf1-983c-41ba29ff3391" containerName="extract"
May 28 19:50:03.288108 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.288078    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852"
May 28 19:50:03.291196 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.291167    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
May 28 19:50:03.291301 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.291220    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
May 28 19:50:03.291576 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.291167    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gh5fm\""
May 28 19:50:03.291576 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.291464    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 19:50:03.291576 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.291492    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 19:50:03.293800 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.293779    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852"]
May 28 19:50:03.434889 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.434866    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac09a470-2cc5-4864-9ca0-b2b4c652fe4e-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-hd852\" (UID: \"ac09a470-2cc5-4864-9ca0-b2b4c652fe4e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852"
May 28 19:50:03.435015 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.434897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd4wm\" (UniqueName: \"kubernetes.io/projected/ac09a470-2cc5-4864-9ca0-b2b4c652fe4e-kube-api-access-rd4wm\") pod \"kuadrant-console-plugin-6cb54b5c86-hd852\" (UID: \"ac09a470-2cc5-4864-9ca0-b2b4c652fe4e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852"
May 28 19:50:03.435015 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.434930    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac09a470-2cc5-4864-9ca0-b2b4c652fe4e-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-hd852\" (UID: \"ac09a470-2cc5-4864-9ca0-b2b4c652fe4e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852"
May 28 19:50:03.535441 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.535382    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac09a470-2cc5-4864-9ca0-b2b4c652fe4e-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-hd852\" (UID: \"ac09a470-2cc5-4864-9ca0-b2b4c652fe4e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852"
May 28 19:50:03.535441 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.535416    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rd4wm\" (UniqueName: \"kubernetes.io/projected/ac09a470-2cc5-4864-9ca0-b2b4c652fe4e-kube-api-access-rd4wm\") pod \"kuadrant-console-plugin-6cb54b5c86-hd852\" (UID: \"ac09a470-2cc5-4864-9ca0-b2b4c652fe4e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852"
May 28 19:50:03.535572 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.535450    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac09a470-2cc5-4864-9ca0-b2b4c652fe4e-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-hd852\" (UID: \"ac09a470-2cc5-4864-9ca0-b2b4c652fe4e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852"
May 28 19:50:03.536079 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.536061    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac09a470-2cc5-4864-9ca0-b2b4c652fe4e-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-hd852\" (UID: \"ac09a470-2cc5-4864-9ca0-b2b4c652fe4e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852"
May 28 19:50:03.538000 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.537979    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac09a470-2cc5-4864-9ca0-b2b4c652fe4e-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-hd852\" (UID: \"ac09a470-2cc5-4864-9ca0-b2b4c652fe4e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852"
May 28 19:50:03.544190 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.544157    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd4wm\" (UniqueName: \"kubernetes.io/projected/ac09a470-2cc5-4864-9ca0-b2b4c652fe4e-kube-api-access-rd4wm\") pod \"kuadrant-console-plugin-6cb54b5c86-hd852\" (UID: \"ac09a470-2cc5-4864-9ca0-b2b4c652fe4e\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852"
May 28 19:50:03.599013 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.598992    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852"
May 28 19:50:03.728216 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:03.728191    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852"]
May 28 19:50:03.730062 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:50:03.730035    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac09a470_2cc5_4864_9ca0_b2b4c652fe4e.slice/crio-8cbf5235bc5d637863b7e945ab6ac5a352c356857cf6bdf60a0e3ebfd4ed2a8a WatchSource:0}: Error finding container 8cbf5235bc5d637863b7e945ab6ac5a352c356857cf6bdf60a0e3ebfd4ed2a8a: Status 404 returned error can't find the container with id 8cbf5235bc5d637863b7e945ab6ac5a352c356857cf6bdf60a0e3ebfd4ed2a8a
May 28 19:50:04.467853 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:04.467812    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852" event={"ID":"ac09a470-2cc5-4864-9ca0-b2b4c652fe4e","Type":"ContainerStarted","Data":"8cbf5235bc5d637863b7e945ab6ac5a352c356857cf6bdf60a0e3ebfd4ed2a8a"}
May 28 19:50:25.550929 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:25.550894    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852" event={"ID":"ac09a470-2cc5-4864-9ca0-b2b4c652fe4e","Type":"ContainerStarted","Data":"ca6a8d3bfab1dc0729fca116b6839dd29c390df6215ae9f87eb5d63ddbecb1a0"}
May 28 19:50:25.568614 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:25.568566    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-hd852" podStartSLOduration=1.167426452 podStartE2EDuration="22.568552299s" podCreationTimestamp="2026-05-28 19:50:03 +0000 UTC" firstStartedPulling="2026-05-28 19:50:03.731417842 +0000 UTC m=+408.342142480" lastFinishedPulling="2026-05-28 19:50:25.132543687 +0000 UTC m=+429.743268327" observedRunningTime="2026-05-28 19:50:25.566346039 +0000 UTC m=+430.177070701" watchObservedRunningTime="2026-05-28 19:50:25.568552299 +0000 UTC m=+430.179276958"
May 28 19:50:57.743571 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:57.743532    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gxfbg"]
May 28 19:50:57.800568 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:57.800531    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gxfbg"]
May 28 19:50:57.800729 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:57.800655    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-gxfbg"
May 28 19:50:57.803060 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:57.803038    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-p5zc4\""
May 28 19:50:57.835710 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:57.835680    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vfn4\" (UniqueName: \"kubernetes.io/projected/50029492-2a47-4690-a467-5e004a309c47-kube-api-access-5vfn4\") pod \"authorino-f99f4b5cd-gxfbg\" (UID: \"50029492-2a47-4690-a467-5e004a309c47\") " pod="kuadrant-system/authorino-f99f4b5cd-gxfbg"
May 28 19:50:57.865429 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:57.865398    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-t6n7b"]
May 28 19:50:57.868573 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:57.868558    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-t6n7b"
May 28 19:50:57.879004 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:57.878971    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-t6n7b"]
May 28 19:50:57.936608 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:57.936578    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vfn4\" (UniqueName: \"kubernetes.io/projected/50029492-2a47-4690-a467-5e004a309c47-kube-api-access-5vfn4\") pod \"authorino-f99f4b5cd-gxfbg\" (UID: \"50029492-2a47-4690-a467-5e004a309c47\") " pod="kuadrant-system/authorino-f99f4b5cd-gxfbg"
May 28 19:50:57.936757 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:57.936620    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47mrl\" (UniqueName: \"kubernetes.io/projected/7d7d4c54-a86b-40a5-a886-a09fecc247ac-kube-api-access-47mrl\") pod \"authorino-7498df8756-t6n7b\" (UID: \"7d7d4c54-a86b-40a5-a886-a09fecc247ac\") " pod="kuadrant-system/authorino-7498df8756-t6n7b"
May 28 19:50:57.944907 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:57.944877    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vfn4\" (UniqueName: \"kubernetes.io/projected/50029492-2a47-4690-a467-5e004a309c47-kube-api-access-5vfn4\") pod \"authorino-f99f4b5cd-gxfbg\" (UID: \"50029492-2a47-4690-a467-5e004a309c47\") " pod="kuadrant-system/authorino-f99f4b5cd-gxfbg"
May 28 19:50:58.037714 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:58.037657    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47mrl\" (UniqueName: \"kubernetes.io/projected/7d7d4c54-a86b-40a5-a886-a09fecc247ac-kube-api-access-47mrl\") pod \"authorino-7498df8756-t6n7b\" (UID: \"7d7d4c54-a86b-40a5-a886-a09fecc247ac\") " pod="kuadrant-system/authorino-7498df8756-t6n7b"
May 28 19:50:58.056830 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:58.056802    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47mrl\" (UniqueName: \"kubernetes.io/projected/7d7d4c54-a86b-40a5-a886-a09fecc247ac-kube-api-access-47mrl\") pod \"authorino-7498df8756-t6n7b\" (UID: \"7d7d4c54-a86b-40a5-a886-a09fecc247ac\") " pod="kuadrant-system/authorino-7498df8756-t6n7b"
May 28 19:50:58.109156 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:58.109134    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-gxfbg"
May 28 19:50:58.184251 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:58.183918    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-t6n7b"
May 28 19:50:58.241258 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:58.241210    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gxfbg"]
May 28 19:50:58.242981 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:50:58.242949    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50029492_2a47_4690_a467_5e004a309c47.slice/crio-65c87da3ebfd1b60511880359fc688c07b78acf0f6588b00c84b2f4c63ac84b3 WatchSource:0}: Error finding container 65c87da3ebfd1b60511880359fc688c07b78acf0f6588b00c84b2f4c63ac84b3: Status 404 returned error can't find the container with id 65c87da3ebfd1b60511880359fc688c07b78acf0f6588b00c84b2f4c63ac84b3
May 28 19:50:58.308011 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:58.307988    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-t6n7b"]
May 28 19:50:58.309339 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:50:58.309309    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d7d4c54_a86b_40a5_a886_a09fecc247ac.slice/crio-10467303957d8febe2736512a1e175ef4dbea06dd1e02f14d91a8b40c7ccbf6e WatchSource:0}: Error finding container 10467303957d8febe2736512a1e175ef4dbea06dd1e02f14d91a8b40c7ccbf6e: Status 404 returned error can't find the container with id 10467303957d8febe2736512a1e175ef4dbea06dd1e02f14d91a8b40c7ccbf6e
May 28 19:50:58.675123 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:58.675076    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-t6n7b" event={"ID":"7d7d4c54-a86b-40a5-a886-a09fecc247ac","Type":"ContainerStarted","Data":"10467303957d8febe2736512a1e175ef4dbea06dd1e02f14d91a8b40c7ccbf6e"}
May 28 19:50:58.676353 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:50:58.676328    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-gxfbg" event={"ID":"50029492-2a47-4690-a467-5e004a309c47","Type":"ContainerStarted","Data":"65c87da3ebfd1b60511880359fc688c07b78acf0f6588b00c84b2f4c63ac84b3"}
May 28 19:51:02.700301 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:02.700267    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-t6n7b" event={"ID":"7d7d4c54-a86b-40a5-a886-a09fecc247ac","Type":"ContainerStarted","Data":"606b8559e65b0c167534dac6e36cfce4963127f7b8929aab063c5b2a80a7cf53"}
May 28 19:51:02.701579 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:02.701554    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-gxfbg" event={"ID":"50029492-2a47-4690-a467-5e004a309c47","Type":"ContainerStarted","Data":"c206bcd9043771c3f24341eca9a09ca1fd7221d8c1a1cc031a7ef8eac7f710f7"}
May 28 19:51:02.717653 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:02.717609    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-t6n7b" podStartSLOduration=2.28531457 podStartE2EDuration="5.717595971s" podCreationTimestamp="2026-05-28 19:50:57 +0000 UTC" firstStartedPulling="2026-05-28 19:50:58.310531854 +0000 UTC m=+462.921256491" lastFinishedPulling="2026-05-28 19:51:01.742813255 +0000 UTC m=+466.353537892" observedRunningTime="2026-05-28 19:51:02.716135549 +0000 UTC m=+467.326860210" watchObservedRunningTime="2026-05-28 19:51:02.717595971 +0000 UTC m=+467.328320683"
May 28 19:51:02.730624 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:02.730579    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-gxfbg" podStartSLOduration=2.220182225 podStartE2EDuration="5.730566249s" podCreationTimestamp="2026-05-28 19:50:57 +0000 UTC" firstStartedPulling="2026-05-28 19:50:58.244408198 +0000 UTC m=+462.855132839" lastFinishedPulling="2026-05-28 19:51:01.754792226 +0000 UTC m=+466.365516863" observedRunningTime="2026-05-28 19:51:02.728711714 +0000 UTC m=+467.339436373" watchObservedRunningTime="2026-05-28 19:51:02.730566249 +0000 UTC m=+467.341290908"
May 28 19:51:02.760629 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:02.760599    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gxfbg"]
May 28 19:51:04.709218 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:04.709155    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-gxfbg" podUID="50029492-2a47-4690-a467-5e004a309c47" containerName="authorino" containerID="cri-o://c206bcd9043771c3f24341eca9a09ca1fd7221d8c1a1cc031a7ef8eac7f710f7" gracePeriod=30
May 28 19:51:04.934140 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:04.934117    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-gxfbg"
May 28 19:51:04.987001 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:04.986933    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vfn4\" (UniqueName: \"kubernetes.io/projected/50029492-2a47-4690-a467-5e004a309c47-kube-api-access-5vfn4\") pod \"50029492-2a47-4690-a467-5e004a309c47\" (UID: \"50029492-2a47-4690-a467-5e004a309c47\") "
May 28 19:51:04.988905 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:04.988874    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50029492-2a47-4690-a467-5e004a309c47-kube-api-access-5vfn4" (OuterVolumeSpecName: "kube-api-access-5vfn4") pod "50029492-2a47-4690-a467-5e004a309c47" (UID: "50029492-2a47-4690-a467-5e004a309c47"). InnerVolumeSpecName "kube-api-access-5vfn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:51:05.087487 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:05.087463    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vfn4\" (UniqueName: \"kubernetes.io/projected/50029492-2a47-4690-a467-5e004a309c47-kube-api-access-5vfn4\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:51:05.713328 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:05.713297    2564 generic.go:358] "Generic (PLEG): container finished" podID="50029492-2a47-4690-a467-5e004a309c47" containerID="c206bcd9043771c3f24341eca9a09ca1fd7221d8c1a1cc031a7ef8eac7f710f7" exitCode=0
May 28 19:51:05.713695 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:05.713364    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-gxfbg"
May 28 19:51:05.713695 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:05.713376    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-gxfbg" event={"ID":"50029492-2a47-4690-a467-5e004a309c47","Type":"ContainerDied","Data":"c206bcd9043771c3f24341eca9a09ca1fd7221d8c1a1cc031a7ef8eac7f710f7"}
May 28 19:51:05.713695 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:05.713418    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-gxfbg" event={"ID":"50029492-2a47-4690-a467-5e004a309c47","Type":"ContainerDied","Data":"65c87da3ebfd1b60511880359fc688c07b78acf0f6588b00c84b2f4c63ac84b3"}
May 28 19:51:05.713695 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:05.713439    2564 scope.go:117] "RemoveContainer" containerID="c206bcd9043771c3f24341eca9a09ca1fd7221d8c1a1cc031a7ef8eac7f710f7"
May 28 19:51:05.721842 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:05.721826    2564 scope.go:117] "RemoveContainer" containerID="c206bcd9043771c3f24341eca9a09ca1fd7221d8c1a1cc031a7ef8eac7f710f7"
May 28 19:51:05.722086 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:51:05.722067    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c206bcd9043771c3f24341eca9a09ca1fd7221d8c1a1cc031a7ef8eac7f710f7\": container with ID starting with c206bcd9043771c3f24341eca9a09ca1fd7221d8c1a1cc031a7ef8eac7f710f7 not found: ID does not exist" containerID="c206bcd9043771c3f24341eca9a09ca1fd7221d8c1a1cc031a7ef8eac7f710f7"
May 28 19:51:05.722169 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:05.722113    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c206bcd9043771c3f24341eca9a09ca1fd7221d8c1a1cc031a7ef8eac7f710f7"} err="failed to get container status \"c206bcd9043771c3f24341eca9a09ca1fd7221d8c1a1cc031a7ef8eac7f710f7\": rpc error: code = NotFound desc = could not find container \"c206bcd9043771c3f24341eca9a09ca1fd7221d8c1a1cc031a7ef8eac7f710f7\": container with ID starting with c206bcd9043771c3f24341eca9a09ca1fd7221d8c1a1cc031a7ef8eac7f710f7 not found: ID does not exist"
May 28 19:51:05.738404 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:05.738350    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gxfbg"]
May 28 19:51:05.740557 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:05.740538    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-gxfbg"]
May 28 19:51:06.000489 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:06.000421    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50029492-2a47-4690-a467-5e004a309c47" path="/var/lib/kubelet/pods/50029492-2a47-4690-a467-5e004a309c47/volumes"
May 28 19:51:26.832963 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:26.832933    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bct8g"]
May 28 19:51:26.833346 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:26.833240    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50029492-2a47-4690-a467-5e004a309c47" containerName="authorino"
May 28 19:51:26.833346 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:26.833252    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="50029492-2a47-4690-a467-5e004a309c47" containerName="authorino"
May 28 19:51:26.833346 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:26.833302    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="50029492-2a47-4690-a467-5e004a309c47" containerName="authorino"
May 28 19:51:26.835556 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:26.835540    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-bct8g"
May 28 19:51:26.838107 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:26.838061    2564 status_manager.go:895] "Failed to get status for pod" podUID="e0508d9d-0ff0-48bb-a09c-0a7f6434be62" pod="kuadrant-system/authorino-8b475cf9f-bct8g" err="pods \"authorino-8b475cf9f-bct8g\" is forbidden: User \"system:node:ip-10-0-138-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-85.ec2.internal' and this object"
May 28 19:51:26.871520 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:26.871497    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bct8g"]
May 28 19:51:26.927376 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:26.927357    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rflk\" (UniqueName: \"kubernetes.io/projected/e0508d9d-0ff0-48bb-a09c-0a7f6434be62-kube-api-access-2rflk\") pod \"authorino-8b475cf9f-bct8g\" (UID: \"e0508d9d-0ff0-48bb-a09c-0a7f6434be62\") " pod="kuadrant-system/authorino-8b475cf9f-bct8g"
May 28 19:51:27.028646 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.028623    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rflk\" (UniqueName: \"kubernetes.io/projected/e0508d9d-0ff0-48bb-a09c-0a7f6434be62-kube-api-access-2rflk\") pod \"authorino-8b475cf9f-bct8g\" (UID: \"e0508d9d-0ff0-48bb-a09c-0a7f6434be62\") " pod="kuadrant-system/authorino-8b475cf9f-bct8g"
May 28 19:51:27.037973 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.037948    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rflk\" (UniqueName: \"kubernetes.io/projected/e0508d9d-0ff0-48bb-a09c-0a7f6434be62-kube-api-access-2rflk\") pod \"authorino-8b475cf9f-bct8g\" (UID: \"e0508d9d-0ff0-48bb-a09c-0a7f6434be62\") " pod="kuadrant-system/authorino-8b475cf9f-bct8g"
May 28 19:51:27.051662 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.051639    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bct8g"]
May 28 19:51:27.051799 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.051788    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-bct8g"
May 28 19:51:27.083197 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.083145    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-bf579bcbf-bkb8t"]
May 28 19:51:27.085696 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.085681    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bf579bcbf-bkb8t"
May 28 19:51:27.096352 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.096330    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bf579bcbf-bkb8t"]
May 28 19:51:27.130224 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.130022    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd56c\" (UniqueName: \"kubernetes.io/projected/cc94397d-043a-4c31-8165-00c22894e902-kube-api-access-fd56c\") pod \"authorino-bf579bcbf-bkb8t\" (UID: \"cc94397d-043a-4c31-8165-00c22894e902\") " pod="kuadrant-system/authorino-bf579bcbf-bkb8t"
May 28 19:51:27.158293 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.158268    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-bf579bcbf-bkb8t"]
May 28 19:51:27.158495 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:51:27.158477    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-fd56c], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-bf579bcbf-bkb8t" podUID="cc94397d-043a-4c31-8165-00c22894e902"
May 28 19:51:27.186385 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.186358    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bct8g"]
May 28 19:51:27.189052 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:51:27.189024    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0508d9d_0ff0_48bb_a09c_0a7f6434be62.slice/crio-971ea152a64f5ceab4b73f57ab4fa438eccf6d8c9d9a927619c0b2ff75ea8d89 WatchSource:0}: Error finding container 971ea152a64f5ceab4b73f57ab4fa438eccf6d8c9d9a927619c0b2ff75ea8d89: Status 404 returned error can't find the container with id 971ea152a64f5ceab4b73f57ab4fa438eccf6d8c9d9a927619c0b2ff75ea8d89
May 28 19:51:27.194327 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.194309    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-794b468bcc-x8wz9"]
May 28 19:51:27.196688 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.196673    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-794b468bcc-x8wz9"
May 28 19:51:27.199086 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.199070    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 28 19:51:27.207293 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.207270    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-794b468bcc-x8wz9"]
May 28 19:51:27.230517 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.230498    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fd56c\" (UniqueName: \"kubernetes.io/projected/cc94397d-043a-4c31-8165-00c22894e902-kube-api-access-fd56c\") pod \"authorino-bf579bcbf-bkb8t\" (UID: \"cc94397d-043a-4c31-8165-00c22894e902\") " pod="kuadrant-system/authorino-bf579bcbf-bkb8t"
May 28 19:51:27.238974 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.238955    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd56c\" (UniqueName: \"kubernetes.io/projected/cc94397d-043a-4c31-8165-00c22894e902-kube-api-access-fd56c\") pod \"authorino-bf579bcbf-bkb8t\" (UID: \"cc94397d-043a-4c31-8165-00c22894e902\") " pod="kuadrant-system/authorino-bf579bcbf-bkb8t"
May 28 19:51:27.331215 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.331187    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk7vh\" (UniqueName: \"kubernetes.io/projected/59a336b4-a04c-45fc-bd5b-5088eb62d7c0-kube-api-access-bk7vh\") pod \"authorino-794b468bcc-x8wz9\" (UID: \"59a336b4-a04c-45fc-bd5b-5088eb62d7c0\") " pod="kuadrant-system/authorino-794b468bcc-x8wz9"
May 28 19:51:27.331319 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.331226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/59a336b4-a04c-45fc-bd5b-5088eb62d7c0-tls-cert\") pod \"authorino-794b468bcc-x8wz9\" (UID: \"59a336b4-a04c-45fc-bd5b-5088eb62d7c0\") " pod="kuadrant-system/authorino-794b468bcc-x8wz9"
May 28 19:51:27.431816 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.431791    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bk7vh\" (UniqueName: \"kubernetes.io/projected/59a336b4-a04c-45fc-bd5b-5088eb62d7c0-kube-api-access-bk7vh\") pod \"authorino-794b468bcc-x8wz9\" (UID: \"59a336b4-a04c-45fc-bd5b-5088eb62d7c0\") " pod="kuadrant-system/authorino-794b468bcc-x8wz9"
May 28 19:51:27.431916 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.431817    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/59a336b4-a04c-45fc-bd5b-5088eb62d7c0-tls-cert\") pod \"authorino-794b468bcc-x8wz9\" (UID: \"59a336b4-a04c-45fc-bd5b-5088eb62d7c0\") " pod="kuadrant-system/authorino-794b468bcc-x8wz9"
May 28 19:51:27.434044 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.434026    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/59a336b4-a04c-45fc-bd5b-5088eb62d7c0-tls-cert\") pod \"authorino-794b468bcc-x8wz9\" (UID: \"59a336b4-a04c-45fc-bd5b-5088eb62d7c0\") " pod="kuadrant-system/authorino-794b468bcc-x8wz9"
May 28 19:51:27.441698 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.441679    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk7vh\" (UniqueName: \"kubernetes.io/projected/59a336b4-a04c-45fc-bd5b-5088eb62d7c0-kube-api-access-bk7vh\") pod \"authorino-794b468bcc-x8wz9\" (UID: \"59a336b4-a04c-45fc-bd5b-5088eb62d7c0\") " pod="kuadrant-system/authorino-794b468bcc-x8wz9"
May 28 19:51:27.505139 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.505114    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-794b468bcc-x8wz9"
May 28 19:51:27.645500 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.645477    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-794b468bcc-x8wz9"]
May 28 19:51:27.647968 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:51:27.647932    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59a336b4_a04c_45fc_bd5b_5088eb62d7c0.slice/crio-bdebe79457cec014fb7924bd8a95bbd84ffdfa431e08cc409f6ed29115b1a795 WatchSource:0}: Error finding container bdebe79457cec014fb7924bd8a95bbd84ffdfa431e08cc409f6ed29115b1a795: Status 404 returned error can't find the container with id bdebe79457cec014fb7924bd8a95bbd84ffdfa431e08cc409f6ed29115b1a795
May 28 19:51:27.792190 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.792082    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-794b468bcc-x8wz9" event={"ID":"59a336b4-a04c-45fc-bd5b-5088eb62d7c0","Type":"ContainerStarted","Data":"bdebe79457cec014fb7924bd8a95bbd84ffdfa431e08cc409f6ed29115b1a795"}
May 28 19:51:27.793296 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.793267    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-bct8g" event={"ID":"e0508d9d-0ff0-48bb-a09c-0a7f6434be62","Type":"ContainerStarted","Data":"e4550d1c5575ee8a0749e229ace1a3f78f5cb516d797712eceb031b781beb61d"}
May 28 19:51:27.793296 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.793291    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bf579bcbf-bkb8t"
May 28 19:51:27.793443 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.793301    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-bct8g" event={"ID":"e0508d9d-0ff0-48bb-a09c-0a7f6434be62","Type":"ContainerStarted","Data":"971ea152a64f5ceab4b73f57ab4fa438eccf6d8c9d9a927619c0b2ff75ea8d89"}
May 28 19:51:27.793443 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.793353    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-bct8g" podUID="e0508d9d-0ff0-48bb-a09c-0a7f6434be62" containerName="authorino" containerID="cri-o://e4550d1c5575ee8a0749e229ace1a3f78f5cb516d797712eceb031b781beb61d" gracePeriod=30
May 28 19:51:27.797921 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.797891    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bf579bcbf-bkb8t"
May 28 19:51:27.810371 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.810324    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-bct8g" podStartSLOduration=1.482454562 podStartE2EDuration="1.810313712s" podCreationTimestamp="2026-05-28 19:51:26 +0000 UTC" firstStartedPulling="2026-05-28 19:51:27.190725611 +0000 UTC m=+491.801450249" lastFinishedPulling="2026-05-28 19:51:27.518584747 +0000 UTC m=+492.129309399" observedRunningTime="2026-05-28 19:51:27.808525196 +0000 UTC m=+492.419249853" watchObservedRunningTime="2026-05-28 19:51:27.810313712 +0000 UTC m=+492.421038390"
May 28 19:51:27.936042 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.936013    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd56c\" (UniqueName: \"kubernetes.io/projected/cc94397d-043a-4c31-8165-00c22894e902-kube-api-access-fd56c\") pod \"cc94397d-043a-4c31-8165-00c22894e902\" (UID: \"cc94397d-043a-4c31-8165-00c22894e902\") "
May 28 19:51:27.938009 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:27.937982    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc94397d-043a-4c31-8165-00c22894e902-kube-api-access-fd56c" (OuterVolumeSpecName: "kube-api-access-fd56c") pod "cc94397d-043a-4c31-8165-00c22894e902" (UID: "cc94397d-043a-4c31-8165-00c22894e902"). InnerVolumeSpecName "kube-api-access-fd56c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:51:28.015198 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.015176    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-bct8g"
May 28 19:51:28.037492 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.037465    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd56c\" (UniqueName: \"kubernetes.io/projected/cc94397d-043a-4c31-8165-00c22894e902-kube-api-access-fd56c\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:51:28.138135 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.138108    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rflk\" (UniqueName: \"kubernetes.io/projected/e0508d9d-0ff0-48bb-a09c-0a7f6434be62-kube-api-access-2rflk\") pod \"e0508d9d-0ff0-48bb-a09c-0a7f6434be62\" (UID: \"e0508d9d-0ff0-48bb-a09c-0a7f6434be62\") "
May 28 19:51:28.139901 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.139870    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0508d9d-0ff0-48bb-a09c-0a7f6434be62-kube-api-access-2rflk" (OuterVolumeSpecName: "kube-api-access-2rflk") pod "e0508d9d-0ff0-48bb-a09c-0a7f6434be62" (UID: "e0508d9d-0ff0-48bb-a09c-0a7f6434be62"). InnerVolumeSpecName "kube-api-access-2rflk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:51:28.239165 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.239132    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rflk\" (UniqueName: \"kubernetes.io/projected/e0508d9d-0ff0-48bb-a09c-0a7f6434be62-kube-api-access-2rflk\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:51:28.799052 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.799016    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-794b468bcc-x8wz9" event={"ID":"59a336b4-a04c-45fc-bd5b-5088eb62d7c0","Type":"ContainerStarted","Data":"e2990188eb4d8b20081d2b6d09e47a6a07a21289214532531955bf12e57445a0"}
May 28 19:51:28.800165 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.800137    2564 generic.go:358] "Generic (PLEG): container finished" podID="e0508d9d-0ff0-48bb-a09c-0a7f6434be62" containerID="e4550d1c5575ee8a0749e229ace1a3f78f5cb516d797712eceb031b781beb61d" exitCode=0
May 28 19:51:28.800270 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.800179    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-bct8g"
May 28 19:51:28.800270 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.800230    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-bct8g" event={"ID":"e0508d9d-0ff0-48bb-a09c-0a7f6434be62","Type":"ContainerDied","Data":"e4550d1c5575ee8a0749e229ace1a3f78f5cb516d797712eceb031b781beb61d"}
May 28 19:51:28.800270 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.800257    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-bct8g" event={"ID":"e0508d9d-0ff0-48bb-a09c-0a7f6434be62","Type":"ContainerDied","Data":"971ea152a64f5ceab4b73f57ab4fa438eccf6d8c9d9a927619c0b2ff75ea8d89"}
May 28 19:51:28.800382 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.800272    2564 scope.go:117] "RemoveContainer" containerID="e4550d1c5575ee8a0749e229ace1a3f78f5cb516d797712eceb031b781beb61d"
May 28 19:51:28.800382 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.800351    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bf579bcbf-bkb8t"
May 28 19:51:28.809157 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.809136    2564 scope.go:117] "RemoveContainer" containerID="e4550d1c5575ee8a0749e229ace1a3f78f5cb516d797712eceb031b781beb61d"
May 28 19:51:28.809411 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:51:28.809394    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4550d1c5575ee8a0749e229ace1a3f78f5cb516d797712eceb031b781beb61d\": container with ID starting with e4550d1c5575ee8a0749e229ace1a3f78f5cb516d797712eceb031b781beb61d not found: ID does not exist" containerID="e4550d1c5575ee8a0749e229ace1a3f78f5cb516d797712eceb031b781beb61d"
May 28 19:51:28.809469 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.809417    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4550d1c5575ee8a0749e229ace1a3f78f5cb516d797712eceb031b781beb61d"} err="failed to get container status \"e4550d1c5575ee8a0749e229ace1a3f78f5cb516d797712eceb031b781beb61d\": rpc error: code = NotFound desc = could not find container \"e4550d1c5575ee8a0749e229ace1a3f78f5cb516d797712eceb031b781beb61d\": container with ID starting with e4550d1c5575ee8a0749e229ace1a3f78f5cb516d797712eceb031b781beb61d not found: ID does not exist"
May 28 19:51:28.819372 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.819329    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-794b468bcc-x8wz9" podStartSLOduration=1.416621062 podStartE2EDuration="1.819317882s" podCreationTimestamp="2026-05-28 19:51:27 +0000 UTC" firstStartedPulling="2026-05-28 19:51:27.650204522 +0000 UTC m=+492.260929160" lastFinishedPulling="2026-05-28 19:51:28.052901328 +0000 UTC m=+492.663625980" observedRunningTime="2026-05-28 19:51:28.81718375 +0000 UTC m=+493.427908410" watchObservedRunningTime="2026-05-28 19:51:28.819317882 +0000 UTC m=+493.430042542"
May 28 19:51:28.836331 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.836302    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bct8g"]
May 28 19:51:28.845161 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.845138    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-bct8g"]
May 28 19:51:28.852498 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.852478    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-t6n7b"]
May 28 19:51:28.852689 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.852668    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-t6n7b" podUID="7d7d4c54-a86b-40a5-a886-a09fecc247ac" containerName="authorino" containerID="cri-o://606b8559e65b0c167534dac6e36cfce4963127f7b8929aab063c5b2a80a7cf53" gracePeriod=30
May 28 19:51:28.869708 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.869682    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-bf579bcbf-bkb8t"]
May 28 19:51:28.875750 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:28.875724    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-bf579bcbf-bkb8t"]
May 28 19:51:29.097194 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:29.097174    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-t6n7b"
May 28 19:51:29.144856 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:29.144831    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47mrl\" (UniqueName: \"kubernetes.io/projected/7d7d4c54-a86b-40a5-a886-a09fecc247ac-kube-api-access-47mrl\") pod \"7d7d4c54-a86b-40a5-a886-a09fecc247ac\" (UID: \"7d7d4c54-a86b-40a5-a886-a09fecc247ac\") "
May 28 19:51:29.146838 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:29.146810    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d7d4c54-a86b-40a5-a886-a09fecc247ac-kube-api-access-47mrl" (OuterVolumeSpecName: "kube-api-access-47mrl") pod "7d7d4c54-a86b-40a5-a886-a09fecc247ac" (UID: "7d7d4c54-a86b-40a5-a886-a09fecc247ac"). InnerVolumeSpecName "kube-api-access-47mrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 19:51:29.245637 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:29.245611    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47mrl\" (UniqueName: \"kubernetes.io/projected/7d7d4c54-a86b-40a5-a886-a09fecc247ac-kube-api-access-47mrl\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 19:51:29.805014 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:29.804984    2564 generic.go:358] "Generic (PLEG): container finished" podID="7d7d4c54-a86b-40a5-a886-a09fecc247ac" containerID="606b8559e65b0c167534dac6e36cfce4963127f7b8929aab063c5b2a80a7cf53" exitCode=0
May 28 19:51:29.805188 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:29.805039    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-t6n7b"
May 28 19:51:29.805188 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:29.805083    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-t6n7b" event={"ID":"7d7d4c54-a86b-40a5-a886-a09fecc247ac","Type":"ContainerDied","Data":"606b8559e65b0c167534dac6e36cfce4963127f7b8929aab063c5b2a80a7cf53"}
May 28 19:51:29.805188 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:29.805142    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-t6n7b" event={"ID":"7d7d4c54-a86b-40a5-a886-a09fecc247ac","Type":"ContainerDied","Data":"10467303957d8febe2736512a1e175ef4dbea06dd1e02f14d91a8b40c7ccbf6e"}
May 28 19:51:29.805188 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:29.805168    2564 scope.go:117] "RemoveContainer" containerID="606b8559e65b0c167534dac6e36cfce4963127f7b8929aab063c5b2a80a7cf53"
May 28 19:51:29.813561 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:29.813546    2564 scope.go:117] "RemoveContainer" containerID="606b8559e65b0c167534dac6e36cfce4963127f7b8929aab063c5b2a80a7cf53"
May 28 19:51:29.813770 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:51:29.813753    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"606b8559e65b0c167534dac6e36cfce4963127f7b8929aab063c5b2a80a7cf53\": container with ID starting with 606b8559e65b0c167534dac6e36cfce4963127f7b8929aab063c5b2a80a7cf53 not found: ID does not exist" containerID="606b8559e65b0c167534dac6e36cfce4963127f7b8929aab063c5b2a80a7cf53"
May 28 19:51:29.813816 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:29.813777    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"606b8559e65b0c167534dac6e36cfce4963127f7b8929aab063c5b2a80a7cf53"} err="failed to get container status \"606b8559e65b0c167534dac6e36cfce4963127f7b8929aab063c5b2a80a7cf53\": rpc error: code = NotFound desc = could not find container \"606b8559e65b0c167534dac6e36cfce4963127f7b8929aab063c5b2a80a7cf53\": container with ID starting with 606b8559e65b0c167534dac6e36cfce4963127f7b8929aab063c5b2a80a7cf53 not found: ID does not exist"
May 28 19:51:29.836031 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:29.836012    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-t6n7b"]
May 28 19:51:29.839987 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:29.839970    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-t6n7b"]
May 28 19:51:30.000227 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:30.000204    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d7d4c54-a86b-40a5-a886-a09fecc247ac" path="/var/lib/kubelet/pods/7d7d4c54-a86b-40a5-a886-a09fecc247ac/volumes"
May 28 19:51:30.000499 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:30.000487    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc94397d-043a-4c31-8165-00c22894e902" path="/var/lib/kubelet/pods/cc94397d-043a-4c31-8165-00c22894e902/volumes"
May 28 19:51:30.000672 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:30.000661    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0508d9d-0ff0-48bb-a09c-0a7f6434be62" path="/var/lib/kubelet/pods/e0508d9d-0ff0-48bb-a09c-0a7f6434be62/volumes"
May 28 19:51:32.111433 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.111403    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74fcdff59d-jxm72"]
May 28 19:51:32.111775 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.111664    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0508d9d-0ff0-48bb-a09c-0a7f6434be62" containerName="authorino"
May 28 19:51:32.111775 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.111675    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0508d9d-0ff0-48bb-a09c-0a7f6434be62" containerName="authorino"
May 28 19:51:32.111775 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.111685    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d7d4c54-a86b-40a5-a886-a09fecc247ac" containerName="authorino"
May 28 19:51:32.111775 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.111690    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d7d4c54-a86b-40a5-a886-a09fecc247ac" containerName="authorino"
May 28 19:51:32.111775 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.111747    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="e0508d9d-0ff0-48bb-a09c-0a7f6434be62" containerName="authorino"
May 28 19:51:32.111775 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.111756    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d7d4c54-a86b-40a5-a886-a09fecc247ac" containerName="authorino"
May 28 19:51:32.116619 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.116600    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74fcdff59d-jxm72"
May 28 19:51:32.119313 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.119295    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 28 19:51:32.119418 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.119322    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jbls5\""
May 28 19:51:32.123903 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.123883    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74fcdff59d-jxm72"]
May 28 19:51:32.167981 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.167954    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px6jb\" (UniqueName: \"kubernetes.io/projected/8f076e7e-d748-46c3-ad5c-f2a3e53bbe8b-kube-api-access-px6jb\") pod \"maas-controller-74fcdff59d-jxm72\" (UID: \"8f076e7e-d748-46c3-ad5c-f2a3e53bbe8b\") " pod="opendatahub/maas-controller-74fcdff59d-jxm72"
May 28 19:51:32.269157 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.269127    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-px6jb\" (UniqueName: \"kubernetes.io/projected/8f076e7e-d748-46c3-ad5c-f2a3e53bbe8b-kube-api-access-px6jb\") pod \"maas-controller-74fcdff59d-jxm72\" (UID: \"8f076e7e-d748-46c3-ad5c-f2a3e53bbe8b\") " pod="opendatahub/maas-controller-74fcdff59d-jxm72"
May 28 19:51:32.277760 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.277735    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px6jb\" (UniqueName: \"kubernetes.io/projected/8f076e7e-d748-46c3-ad5c-f2a3e53bbe8b-kube-api-access-px6jb\") pod \"maas-controller-74fcdff59d-jxm72\" (UID: \"8f076e7e-d748-46c3-ad5c-f2a3e53bbe8b\") " pod="opendatahub/maas-controller-74fcdff59d-jxm72"
May 28 19:51:32.428020 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.427996    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74fcdff59d-jxm72"
May 28 19:51:32.551524 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.551501    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74fcdff59d-jxm72"]
May 28 19:51:32.553519 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:51:32.553488    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f076e7e_d748_46c3_ad5c_f2a3e53bbe8b.slice/crio-542cd9b7ce21c88af5d380ce81bd545135b5c1ee5c284509abd03ba4323bd74f WatchSource:0}: Error finding container 542cd9b7ce21c88af5d380ce81bd545135b5c1ee5c284509abd03ba4323bd74f: Status 404 returned error can't find the container with id 542cd9b7ce21c88af5d380ce81bd545135b5c1ee5c284509abd03ba4323bd74f
May 28 19:51:32.818506 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:32.818437    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74fcdff59d-jxm72" event={"ID":"8f076e7e-d748-46c3-ad5c-f2a3e53bbe8b","Type":"ContainerStarted","Data":"542cd9b7ce21c88af5d380ce81bd545135b5c1ee5c284509abd03ba4323bd74f"}
May 28 19:51:34.829113 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:34.829061    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74fcdff59d-jxm72" event={"ID":"8f076e7e-d748-46c3-ad5c-f2a3e53bbe8b","Type":"ContainerStarted","Data":"310dbef20dde1e92d338c9e4cfdec89304aa3dd9188143b936598bdb088609a9"}
May 28 19:51:34.829427 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:34.829154    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74fcdff59d-jxm72"
May 28 19:51:34.850042 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:34.850001    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-74fcdff59d-jxm72" podStartSLOduration=0.654612567 podStartE2EDuration="2.849988354s" podCreationTimestamp="2026-05-28 19:51:32 +0000 UTC" firstStartedPulling="2026-05-28 19:51:32.554703313 +0000 UTC m=+497.165427951" lastFinishedPulling="2026-05-28 19:51:34.750079097 +0000 UTC m=+499.360803738" observedRunningTime="2026-05-28 19:51:34.847756901 +0000 UTC m=+499.458481561" watchObservedRunningTime="2026-05-28 19:51:34.849988354 +0000 UTC m=+499.460713028"
May 28 19:51:45.838821 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:51:45.838788    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74fcdff59d-jxm72"
May 28 19:52:06.136119 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.136036    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-85b79b9b4f-bz9q8"]
May 28 19:52:06.139385 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.139361    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:52:06.141929 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.141906    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-mvrvv\""
May 28 19:52:06.142106 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.142080    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 28 19:52:06.157387 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.157361    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-85b79b9b4f-bz9q8"]
May 28 19:52:06.305433 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.305401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de1ac9d-8862-4274-9a85-428de4ec64d0-maas-api-tls\") pod \"maas-api-85b79b9b4f-bz9q8\" (UID: \"6de1ac9d-8862-4274-9a85-428de4ec64d0\") " pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:52:06.305564 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.305477    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jvwk\" (UniqueName: \"kubernetes.io/projected/6de1ac9d-8862-4274-9a85-428de4ec64d0-kube-api-access-4jvwk\") pod \"maas-api-85b79b9b4f-bz9q8\" (UID: \"6de1ac9d-8862-4274-9a85-428de4ec64d0\") " pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:52:06.406646 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.406620    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jvwk\" (UniqueName: \"kubernetes.io/projected/6de1ac9d-8862-4274-9a85-428de4ec64d0-kube-api-access-4jvwk\") pod \"maas-api-85b79b9b4f-bz9q8\" (UID: \"6de1ac9d-8862-4274-9a85-428de4ec64d0\") " pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:52:06.406773 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.406668    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de1ac9d-8862-4274-9a85-428de4ec64d0-maas-api-tls\") pod \"maas-api-85b79b9b4f-bz9q8\" (UID: \"6de1ac9d-8862-4274-9a85-428de4ec64d0\") " pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:52:06.406831 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:52:06.406806    2564 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
May 28 19:52:06.406887 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:52:06.406862    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de1ac9d-8862-4274-9a85-428de4ec64d0-maas-api-tls podName:6de1ac9d-8862-4274-9a85-428de4ec64d0 nodeName:}" failed. No retries permitted until 2026-05-28 19:52:06.906847111 +0000 UTC m=+531.517571749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6de1ac9d-8862-4274-9a85-428de4ec64d0-maas-api-tls") pod "maas-api-85b79b9b4f-bz9q8" (UID: "6de1ac9d-8862-4274-9a85-428de4ec64d0") : secret "maas-api-serving-cert" not found
May 28 19:52:06.425181 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.425157    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jvwk\" (UniqueName: \"kubernetes.io/projected/6de1ac9d-8862-4274-9a85-428de4ec64d0-kube-api-access-4jvwk\") pod \"maas-api-85b79b9b4f-bz9q8\" (UID: \"6de1ac9d-8862-4274-9a85-428de4ec64d0\") " pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:52:06.621858 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.621829    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-66qp5"]
May 28 19:52:06.625069 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.625054    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-66qp5"
May 28 19:52:06.627808 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.627785    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-dp46j\""
May 28 19:52:06.627895 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.627796    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 28 19:52:06.634786 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.634767    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-66qp5"]
May 28 19:52:06.710178 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.710105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctn55\" (UniqueName: \"kubernetes.io/projected/e1cefbe0-b07a-4c32-a512-d91940686fd0-kube-api-access-ctn55\") pod \"payload-processing-58b6c8fdc7-66qp5\" (UID: \"e1cefbe0-b07a-4c32-a512-d91940686fd0\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-66qp5"
May 28 19:52:06.811613 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.811577    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ctn55\" (UniqueName: \"kubernetes.io/projected/e1cefbe0-b07a-4c32-a512-d91940686fd0-kube-api-access-ctn55\") pod \"payload-processing-58b6c8fdc7-66qp5\" (UID: \"e1cefbe0-b07a-4c32-a512-d91940686fd0\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-66qp5"
May 28 19:52:06.821302 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.821280    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctn55\" (UniqueName: \"kubernetes.io/projected/e1cefbe0-b07a-4c32-a512-d91940686fd0-kube-api-access-ctn55\") pod \"payload-processing-58b6c8fdc7-66qp5\" (UID: \"e1cefbe0-b07a-4c32-a512-d91940686fd0\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-66qp5"
May 28 19:52:06.912289 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.912265    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de1ac9d-8862-4274-9a85-428de4ec64d0-maas-api-tls\") pod \"maas-api-85b79b9b4f-bz9q8\" (UID: \"6de1ac9d-8862-4274-9a85-428de4ec64d0\") " pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:52:06.914578 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.914557    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de1ac9d-8862-4274-9a85-428de4ec64d0-maas-api-tls\") pod \"maas-api-85b79b9b4f-bz9q8\" (UID: \"6de1ac9d-8862-4274-9a85-428de4ec64d0\") " pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:52:06.937572 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:06.937549    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-66qp5"
May 28 19:52:07.050504 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:07.050475    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:52:07.061051 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:07.061031    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-66qp5"]
May 28 19:52:07.063355 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:52:07.063327    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1cefbe0_b07a_4c32_a512_d91940686fd0.slice/crio-da7c9f7393745eef69f57869bff085d6692da62ebe4c7e9bde42614cb2cdab72 WatchSource:0}: Error finding container da7c9f7393745eef69f57869bff085d6692da62ebe4c7e9bde42614cb2cdab72: Status 404 returned error can't find the container with id da7c9f7393745eef69f57869bff085d6692da62ebe4c7e9bde42614cb2cdab72
May 28 19:52:07.182603 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:07.182579    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-85b79b9b4f-bz9q8"]
May 28 19:52:07.184568 ip-10-0-138-85 kubenswrapper[2564]: W0528 19:52:07.184528    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de1ac9d_8862_4274_9a85_428de4ec64d0.slice/crio-33ba9b1df4572d0ce4bba33c4034d695760ca5d1ad084c8775d5f143accac875 WatchSource:0}: Error finding container 33ba9b1df4572d0ce4bba33c4034d695760ca5d1ad084c8775d5f143accac875: Status 404 returned error can't find the container with id 33ba9b1df4572d0ce4bba33c4034d695760ca5d1ad084c8775d5f143accac875
May 28 19:52:07.954932 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:07.954884    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerStarted","Data":"33ba9b1df4572d0ce4bba33c4034d695760ca5d1ad084c8775d5f143accac875"}
May 28 19:52:07.956799 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:07.956767    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-66qp5" event={"ID":"e1cefbe0-b07a-4c32-a512-d91940686fd0","Type":"ContainerStarted","Data":"da7c9f7393745eef69f57869bff085d6692da62ebe4c7e9bde42614cb2cdab72"}
May 28 19:52:09.967259 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:09.967180    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerStarted","Data":"4a15ed81b9af154d4f3f87cbe0e00fea0915d5776d253197d424ada002661007"}
May 28 19:52:09.967676 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:09.967336    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:52:09.968946 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:09.968900    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-66qp5" event={"ID":"e1cefbe0-b07a-4c32-a512-d91940686fd0","Type":"ContainerStarted","Data":"d6060e9696ccee575ef654540f516a2b2d7e3ed0be8d0bcf253e8741161b2aff"}
May 28 19:52:09.968946 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:09.968943    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-66qp5"
May 28 19:52:09.987919 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:09.987864    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podStartSLOduration=1.499595872 podStartE2EDuration="3.987852128s" podCreationTimestamp="2026-05-28 19:52:06 +0000 UTC" firstStartedPulling="2026-05-28 19:52:07.185823306 +0000 UTC m=+531.796547945" lastFinishedPulling="2026-05-28 19:52:09.674079559 +0000 UTC m=+534.284804201" observedRunningTime="2026-05-28 19:52:09.985314195 +0000 UTC m=+534.596038856" watchObservedRunningTime="2026-05-28 19:52:09.987852128 +0000 UTC m=+534.598576788"
May 28 19:52:10.004481 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:10.004443    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-66qp5" podStartSLOduration=1.394229743 podStartE2EDuration="4.004431633s" podCreationTimestamp="2026-05-28 19:52:06 +0000 UTC" firstStartedPulling="2026-05-28 19:52:07.065456339 +0000 UTC m=+531.676180976" lastFinishedPulling="2026-05-28 19:52:09.675658229 +0000 UTC m=+534.286382866" observedRunningTime="2026-05-28 19:52:10.002237474 +0000 UTC m=+534.612962133" watchObservedRunningTime="2026-05-28 19:52:10.004431633 +0000 UTC m=+534.615156293"
May 28 19:52:15.977808 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:15.977775    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:52:20.976609 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:20.976569    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:52:20.978064 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:20.978033    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-66qp5"
May 28 19:52:25.977113 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:25.977047    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:52:30.977061 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:30.977011    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:52:35.976330 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:35.976292    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:52:40.976885 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:40.976843    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:52:45.977154 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:45.977083    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:52:47.051014 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:47.050972    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:52:50.976845 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:50.976804    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:52:55.977284 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:55.977245    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:52:57.051474 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:52:57.051437    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:00.976519 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:00.976477    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:05.976984 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:05.976937    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:07.050932 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:07.050899    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:07.051518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:07.050973    2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:53:07.051518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:07.051398    2564 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"4a15ed81b9af154d4f3f87cbe0e00fea0915d5776d253197d424ada002661007"} pod="opendatahub/maas-api-85b79b9b4f-bz9q8" containerMessage="Container maas-api failed liveness probe, will be restarted"
May 28 19:53:07.051518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:07.051444    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" containerID="cri-o://4a15ed81b9af154d4f3f87cbe0e00fea0915d5776d253197d424ada002661007" gracePeriod=30
May 28 19:53:07.051518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:07.051478    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:07.177796 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:07.177771    2564 generic.go:358] "Generic (PLEG): container finished" podID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerID="4a15ed81b9af154d4f3f87cbe0e00fea0915d5776d253197d424ada002661007" exitCode=2
May 28 19:53:07.177884 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:07.177832    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerDied","Data":"4a15ed81b9af154d4f3f87cbe0e00fea0915d5776d253197d424ada002661007"}
May 28 19:53:08.182910 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:08.182875    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerStarted","Data":"409e6cba8416ec8a850682528ff850b947866f76e28a32736ac643f630faf7d6"}
May 28 19:53:08.183336 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:08.182982    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:53:14.187698 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:14.187656    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:15.947421 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:15.947396    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 19:53:15.947837 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:15.947455    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 19:53:19.187606 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:19.187564    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:24.187315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:24.187273    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:29.187730 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:29.187692    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:34.187822 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:34.187783    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:37.051437 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:37.051358    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:39.187650 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:39.187613    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:44.187469 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:44.187421    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:47.051793 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:47.051753    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:49.187501 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:49.187452    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:54.187022 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:54.186984    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:57.051714 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:57.051674    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:57.052241 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:57.051729    2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:53:57.052241 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:57.052046    2564 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"409e6cba8416ec8a850682528ff850b947866f76e28a32736ac643f630faf7d6"} pod="opendatahub/maas-api-85b79b9b4f-bz9q8" containerMessage="Container maas-api failed liveness probe, will be restarted"
May 28 19:53:57.052241 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:57.052078    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" containerID="cri-o://409e6cba8416ec8a850682528ff850b947866f76e28a32736ac643f630faf7d6" gracePeriod=30
May 28 19:53:57.052241 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:57.052184    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:53:57.163197 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:57.163180    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 19:53:57.359700 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:57.359633    2564 generic.go:358] "Generic (PLEG): container finished" podID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerID="409e6cba8416ec8a850682528ff850b947866f76e28a32736ac643f630faf7d6" exitCode=2
May 28 19:53:57.359806 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:57.359705    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerDied","Data":"409e6cba8416ec8a850682528ff850b947866f76e28a32736ac643f630faf7d6"}
May 28 19:53:57.359806 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:57.359745    2564 scope.go:117] "RemoveContainer" containerID="4a15ed81b9af154d4f3f87cbe0e00fea0915d5776d253197d424ada002661007"
May 28 19:53:58.366144 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:58.366087    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerStarted","Data":"156b86d5bb7dc8e692efd1a1cd09b822bec1ac1d2eb108c30783488ee407d6f2"}
May 28 19:53:58.366633 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:53:58.366233    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:54:04.370281 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:04.370239    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:54:09.370260 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:09.370216    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:54:14.370518 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:14.370474    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:54:19.370284 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:19.370242    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:54:24.369774 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:24.369723    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:54:27.051005 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:27.050959    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:54:29.370153 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:29.370114    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:54:34.370683 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:34.370635    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:54:37.051495 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:37.051446    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:54:39.370442 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:39.370397    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:54:44.370175 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:44.370088    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:54:47.051181 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:47.051140    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:54:47.051647 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:47.051224    2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:54:47.051732 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:47.051706    2564 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"156b86d5bb7dc8e692efd1a1cd09b822bec1ac1d2eb108c30783488ee407d6f2"} pod="opendatahub/maas-api-85b79b9b4f-bz9q8" containerMessage="Container maas-api failed liveness probe, will be restarted"
May 28 19:54:47.051794 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:47.051720    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:54:47.051794 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:47.051754    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" containerID="cri-o://156b86d5bb7dc8e692efd1a1cd09b822bec1ac1d2eb108c30783488ee407d6f2" gracePeriod=30
May 28 19:54:47.543195 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:47.543169    2564 generic.go:358] "Generic (PLEG): container finished" podID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerID="156b86d5bb7dc8e692efd1a1cd09b822bec1ac1d2eb108c30783488ee407d6f2" exitCode=2
May 28 19:54:47.543323 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:47.543244    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerDied","Data":"156b86d5bb7dc8e692efd1a1cd09b822bec1ac1d2eb108c30783488ee407d6f2"}
May 28 19:54:47.543323 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:47.543285    2564 scope.go:117] "RemoveContainer" containerID="409e6cba8416ec8a850682528ff850b947866f76e28a32736ac643f630faf7d6"
May 28 19:54:48.548668 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:48.548636    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerStarted","Data":"7a279e1b54a5f0347d82c744152fb8affcd62a7f5bde29164122804309117bcf"}
May 28 19:54:48.549040 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:48.548772    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:54:54.552609 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:54.552570    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:54:59.553046 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:54:59.553001    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:55:04.553421 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:04.553378    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:55:09.553506 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:09.553418    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:55:14.553145 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:14.553083    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:55:17.051599 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:17.051561    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:55:19.552917 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:19.552880    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:55:24.552681 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:24.552634    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:55:27.051549 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:27.051504    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:55:29.552726 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:29.552688    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:55:34.553425 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:34.553385    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:55:37.051476 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:37.051437    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:55:37.051908 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:37.051504    2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:55:37.051908 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:37.051883    2564 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"7a279e1b54a5f0347d82c744152fb8affcd62a7f5bde29164122804309117bcf"} pod="opendatahub/maas-api-85b79b9b4f-bz9q8" containerMessage="Container maas-api failed liveness probe, will be restarted"
May 28 19:55:37.051984 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:37.051913    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:55:37.051984 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:37.051924    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" containerID="cri-o://7a279e1b54a5f0347d82c744152fb8affcd62a7f5bde29164122804309117bcf" gracePeriod=30
May 28 19:55:37.725735 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:37.725702    2564 generic.go:358] "Generic (PLEG): container finished" podID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerID="7a279e1b54a5f0347d82c744152fb8affcd62a7f5bde29164122804309117bcf" exitCode=2
May 28 19:55:37.725880 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:37.725750    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerDied","Data":"7a279e1b54a5f0347d82c744152fb8affcd62a7f5bde29164122804309117bcf"}
May 28 19:55:37.725880 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:37.725784    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerStarted","Data":"5d6d2ddd5cea942bee92340a86624d3968d164ae51f3447552bfe383ddb2ba25"}
May 28 19:55:37.725880 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:37.725807    2564 scope.go:117] "RemoveContainer" containerID="156b86d5bb7dc8e692efd1a1cd09b822bec1ac1d2eb108c30783488ee407d6f2"
May 28 19:55:37.726014 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:37.725946    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:55:43.732645 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:43.732605    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:55:48.732490 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:48.732446    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:55:53.732242 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:53.732198    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:55:58.732317 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:55:58.732272    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:56:03.732997 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:03.732953    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:56:07.051633 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:07.051591    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:56:08.733082 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:08.733036    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:56:13.732315 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:13.732274    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:56:17.050971 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:17.050923    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:56:18.732443 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:18.732399    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:56:23.732894 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:23.732850    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:56:27.051311 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:27.051273    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:56:27.051655 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:27.051337    2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:56:27.051655 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:27.051638    2564 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"5d6d2ddd5cea942bee92340a86624d3968d164ae51f3447552bfe383ddb2ba25"} pod="opendatahub/maas-api-85b79b9b4f-bz9q8" containerMessage="Container maas-api failed liveness probe, will be restarted"
May 28 19:56:27.051729 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:27.051664    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" containerID="cri-o://5d6d2ddd5cea942bee92340a86624d3968d164ae51f3447552bfe383ddb2ba25" gracePeriod=30
May 28 19:56:27.051729 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:27.051676    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:56:27.913281 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:27.913246    2564 generic.go:358] "Generic (PLEG): container finished" podID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerID="5d6d2ddd5cea942bee92340a86624d3968d164ae51f3447552bfe383ddb2ba25" exitCode=2
May 28 19:56:27.913451 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:27.913291    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerDied","Data":"5d6d2ddd5cea942bee92340a86624d3968d164ae51f3447552bfe383ddb2ba25"}
May 28 19:56:27.913451 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:27.913315    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerStarted","Data":"ff9e55f118be730d09478ba38acf72ed1daedd6ae96ed7626619e6ec0b8d333c"}
May 28 19:56:27.913451 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:27.913329    2564 scope.go:117] "RemoveContainer" containerID="7a279e1b54a5f0347d82c744152fb8affcd62a7f5bde29164122804309117bcf"
May 28 19:56:27.913616 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:27.913474    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:56:33.920172 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:33.920128    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:56:38.920588 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:38.920480    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:56:43.920111 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:43.920057    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:56:48.919778 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:48.919726    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:56:53.920301 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:53.920261    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:56:57.051539 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:57.051494    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:56:58.919929 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:56:58.919881    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:57:03.919947 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:57:03.919910    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:57:07.050787 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:57:07.050749    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:57:08.919977 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:57:08.919934    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:57:13.919879 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:57:13.919837    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:57:17.051194 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:57:17.051156    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:57:17.051757 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:57:17.051231    2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:57:17.051757 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:57:17.051558    2564 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"ff9e55f118be730d09478ba38acf72ed1daedd6ae96ed7626619e6ec0b8d333c"} pod="opendatahub/maas-api-85b79b9b4f-bz9q8" containerMessage="Container maas-api failed liveness probe, will be restarted"
May 28 19:57:17.051757 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:57:17.051593    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" containerID="cri-o://ff9e55f118be730d09478ba38acf72ed1daedd6ae96ed7626619e6ec0b8d333c" gracePeriod=30
May 28 19:57:17.051757 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:57:17.051696    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:57:17.163546 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:57:17.163523    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 19:57:18.098685 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:57:18.098637    2564 generic.go:358] "Generic (PLEG): container finished" podID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerID="ff9e55f118be730d09478ba38acf72ed1daedd6ae96ed7626619e6ec0b8d333c" exitCode=2
May 28 19:57:18.099144 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:57:18.098710    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerDied","Data":"ff9e55f118be730d09478ba38acf72ed1daedd6ae96ed7626619e6ec0b8d333c"}
May 28 19:57:18.099144 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:57:18.098754    2564 scope.go:117] "RemoveContainer" containerID="5d6d2ddd5cea942bee92340a86624d3968d164ae51f3447552bfe383ddb2ba25"
May 28 19:57:18.099144 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:57:18.099086    2564 scope.go:117] "RemoveContainer" containerID="ff9e55f118be730d09478ba38acf72ed1daedd6ae96ed7626619e6ec0b8d333c"
May 28 19:57:18.099347 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:57:18.099327    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 19:57:32.995642 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:57:32.995603    2564 scope.go:117] "RemoveContainer" containerID="ff9e55f118be730d09478ba38acf72ed1daedd6ae96ed7626619e6ec0b8d333c"
May 28 19:57:32.996199 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:57:32.995806    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 19:57:47.996064 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:57:47.996034    2564 scope.go:117] "RemoveContainer" containerID="ff9e55f118be730d09478ba38acf72ed1daedd6ae96ed7626619e6ec0b8d333c"
May 28 19:57:47.996456 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:57:47.996274    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 19:58:00.996539 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:58:00.996506    2564 scope.go:117] "RemoveContainer" containerID="ff9e55f118be730d09478ba38acf72ed1daedd6ae96ed7626619e6ec0b8d333c"
May 28 19:58:00.997141 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:58:00.996685    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 19:58:13.996382 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:58:13.996348    2564 scope.go:117] "RemoveContainer" containerID="ff9e55f118be730d09478ba38acf72ed1daedd6ae96ed7626619e6ec0b8d333c"
May 28 19:58:13.996761 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:58:13.996519    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 19:58:15.977888 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:58:15.977861    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 19:58:15.978298 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:58:15.977871    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 19:58:26.996379 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:58:26.996348    2564 scope.go:117] "RemoveContainer" containerID="ff9e55f118be730d09478ba38acf72ed1daedd6ae96ed7626619e6ec0b8d333c"
May 28 19:58:26.998699 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:58:26.996575    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 19:58:41.995763 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:58:41.995731    2564 scope.go:117] "RemoveContainer" containerID="ff9e55f118be730d09478ba38acf72ed1daedd6ae96ed7626619e6ec0b8d333c"
May 28 19:58:43.405840 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:58:43.405810    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerStarted","Data":"11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"}
May 28 19:58:43.406233 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:58:43.406014    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:58:49.411155 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:58:49.411116    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:58:54.410001 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:58:54.409952    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:58:59.409845 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:58:59.409802    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:59:04.409734 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:04.409689    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:59:09.410276 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:09.410232    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:59:14.410205 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:14.410167    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:59:17.051049 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:17.051003    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:59:19.410668 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:19.410615    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:59:24.410210 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:24.410165    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:59:27.050989 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:27.050955    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:59:29.410629 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:29.410582    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:59:34.409985 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:34.409946    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:59:37.051591 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:37.051494    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:59:37.051945 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:37.051590    2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 19:59:37.052019 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:37.051993    2564 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"} pod="opendatahub/maas-api-85b79b9b4f-bz9q8" containerMessage="Container maas-api failed liveness probe, will be restarted"
May 28 19:59:37.052064 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:37.052032    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 19:59:37.052064 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:37.052043    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" containerID="cri-o://11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24" gracePeriod=30
May 28 19:59:37.168787 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:59:37.168765    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 19:59:37.613914 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:37.613883    2564 generic.go:358] "Generic (PLEG): container finished" podID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerID="11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24" exitCode=2
May 28 19:59:37.614083 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:37.613931    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerDied","Data":"11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"}
May 28 19:59:37.614083 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:37.613964    2564 scope.go:117] "RemoveContainer" containerID="ff9e55f118be730d09478ba38acf72ed1daedd6ae96ed7626619e6ec0b8d333c"
May 28 19:59:37.614268 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:37.614251    2564 scope.go:117] "RemoveContainer" containerID="11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"
May 28 19:59:37.614445 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:59:37.614427    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 19:59:50.996351 ip-10-0-138-85 kubenswrapper[2564]: I0528 19:59:50.996312    2564 scope.go:117] "RemoveContainer" containerID="11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"
May 28 19:59:50.996863 ip-10-0-138-85 kubenswrapper[2564]: E0528 19:59:50.996549    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:00:01.996253 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:00:01.996223    2564 scope.go:117] "RemoveContainer" containerID="11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"
May 28 20:00:01.996623 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:00:01.996385    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:00:14.996499 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:00:14.996468    2564 scope.go:117] "RemoveContainer" containerID="11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"
May 28 20:00:14.996872 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:00:14.996632    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:00:27.996312 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:00:27.996278    2564 scope.go:117] "RemoveContainer" containerID="11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"
May 28 20:00:27.996739 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:00:27.996520    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:00:38.996268 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:00:38.996236    2564 scope.go:117] "RemoveContainer" containerID="11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"
May 28 20:00:38.996665 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:00:38.996410    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:00:52.995674 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:00:52.995644    2564 scope.go:117] "RemoveContainer" containerID="11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"
May 28 20:00:52.996047 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:00:52.995818    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:01:04.995937 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:01:04.995904    2564 scope.go:117] "RemoveContainer" containerID="11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"
May 28 20:01:04.996531 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:01:04.996064    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:01:18.996297 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:01:18.996263    2564 scope.go:117] "RemoveContainer" containerID="11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"
May 28 20:01:18.996660 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:01:18.996442    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:01:33.995931 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:01:33.995903    2564 scope.go:117] "RemoveContainer" containerID="11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"
May 28 20:01:33.996325 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:01:33.996136    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:01:44.995767 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:01:44.995739    2564 scope.go:117] "RemoveContainer" containerID="11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"
May 28 20:01:44.996244 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:01:44.995917    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:01:55.998675 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:01:55.998642    2564 scope.go:117] "RemoveContainer" containerID="11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"
May 28 20:01:55.999087 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:01:55.998815    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:02:09.995840 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:02:09.995808    2564 scope.go:117] "RemoveContainer" containerID="11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"
May 28 20:02:09.996227 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:02:09.995967    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:02:23.995604 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:02:23.995574    2564 scope.go:117] "RemoveContainer" containerID="11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"
May 28 20:02:23.996062 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:02:23.995845    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 20:02:25.235748 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:02:25.235711    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerStarted","Data":"8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"}
May 28 20:02:25.236137 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:02:25.235910    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 20:02:31.241261 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:02:31.241220    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:02:36.240241 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:02:36.240160    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:02:41.239670 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:02:41.239626    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:02:46.239743 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:02:46.239705    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:02:51.240317 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:02:51.240278    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:02:56.240262 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:02:56.240222    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:02:57.051325 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:02:57.051284    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:03:01.239339 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:01.239300    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:03:06.240006 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:06.239965    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:03:07.051848 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:07.051802    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:03:11.239546 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:11.239503    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:03:16.007478 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:16.007451    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 20:03:16.008952 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:16.008925    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 20:03:16.240306 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:16.240272    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:03:17.051802 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:17.051761    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:03:17.052187 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:17.051842    2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 20:03:17.052288 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:17.052270    2564 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"} pod="opendatahub/maas-api-85b79b9b4f-bz9q8" containerMessage="Container maas-api failed liveness probe, will be restarted"
May 28 20:03:17.052332 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:17.052308    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" containerID="cri-o://8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057" gracePeriod=30
May 28 20:03:17.052374 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:17.052350    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:03:17.168480 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:03:17.168457    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:03:17.422667 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:17.422628    2564 generic.go:358] "Generic (PLEG): container finished" podID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057" exitCode=2
May 28 20:03:17.422809 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:17.422703    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerDied","Data":"8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"}
May 28 20:03:17.422809 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:17.422754    2564 scope.go:117] "RemoveContainer" containerID="11c2f7fe259c50cfa0f15eeecb4219b9524492e8b81a0b6b815f051e23b09f24"
May 28 20:03:17.423030 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:17.423011    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:03:17.423266 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:03:17.423247    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:03:29.996203 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:29.996171    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:03:30.003625 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:03:29.996397    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:03:42.996690 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:42.996663    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:03:42.997048 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:03:42.996839    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:03:55.999357 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:03:55.999327    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:03:55.999779 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:03:55.999494    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:04:09.996339 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:04:09.996249    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:04:09.996921 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:04:09.996537    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:04:21.995491 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:04:21.995460    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:04:21.995855 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:04:21.995647    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:04:36.995660 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:04:36.995629    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:04:36.996004 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:04:36.995787    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:04:49.995718 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:04:49.995674    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:04:49.996338 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:04:49.995929    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:05:00.996178 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:05:00.996146    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:05:00.996604 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:05:00.996375    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:05:13.996071 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:05:13.996028    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:05:13.996590 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:05:13.996324    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:05:25.998632 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:05:25.998599    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:05:25.999266 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:05:25.998764    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:05:38.996437 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:05:38.996366    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:05:38.996877 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:05:38.996554    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:05:49.995851 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:05:49.995818    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:05:49.996281 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:05:49.996023    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:06:04.996292 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:06:04.996260    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:06:04.996768 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:06:04.996445    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:06:19.996382 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:06:19.996347    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:06:19.996763 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:06:19.996505    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:06:33.995754 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:06:33.995720    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:06:33.996165 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:06:33.995893    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:06:48.995406 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:06:48.995377    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:06:48.995862 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:06:48.995554    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:07:02.995788 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:07:02.995752    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:07:02.996225 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:07:02.995958    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:07:17.996588 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:07:17.996501    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:07:17.997033 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:07:17.996768    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:07:28.996317 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:07:28.996286    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:07:28.996771 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:07:28.996450    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:07:39.996410 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:07:39.996371    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:07:39.996951 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:07:39.996626    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:07:50.996372 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:07:50.996343    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:07:50.996728 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:07:50.996503    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:08:05.998280 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:08:05.998248    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:08:05.998758 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:08:05.998480    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:08:16.033835 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:08:16.033802    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 20:08:16.040020 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:08:16.039998    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 20:08:19.996509 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:08:19.996469    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:08:19.996915 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:08:19.996891    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 20:08:20.541131 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:08:20.541087    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerStarted","Data":"1d304866fcd79d59dd73d951a327c13b9b77fc7dbdf108c97c33b4d9128d669e"}
May 28 20:08:20.541335 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:08:20.541308    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 20:08:26.547317 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:08:26.547271    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:08:31.547066 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:08:31.547030    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:08:36.547193 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:08:36.547087    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:08:41.546634 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:08:41.546591    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:08:46.547405 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:08:46.547363    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:08:51.547325 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:08:51.547278    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:08:56.547430 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:08:56.547385    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:08:57.051385 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:08:57.051346    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:01.547169 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:01.547127    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:06.546863 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:06.546815    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:07.051368 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:07.051332    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:11.547127 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:11.547067    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:16.547310 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:16.547272    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:17.051473 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:17.051430    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:17.051647 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:17.051510    2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 20:09:17.051913 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:17.051894    2564 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"1d304866fcd79d59dd73d951a327c13b9b77fc7dbdf108c97c33b4d9128d669e"} pod="opendatahub/maas-api-85b79b9b4f-bz9q8" containerMessage="Container maas-api failed liveness probe, will be restarted"
May 28 20:09:17.051949 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:17.051929    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" containerID="cri-o://1d304866fcd79d59dd73d951a327c13b9b77fc7dbdf108c97c33b4d9128d669e" gracePeriod=30
May 28 20:09:17.051984 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:17.051939    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:17.757658 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:17.757573    2564 generic.go:358] "Generic (PLEG): container finished" podID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerID="1d304866fcd79d59dd73d951a327c13b9b77fc7dbdf108c97c33b4d9128d669e" exitCode=2
May 28 20:09:17.757658 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:17.757620    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerDied","Data":"1d304866fcd79d59dd73d951a327c13b9b77fc7dbdf108c97c33b4d9128d669e"}
May 28 20:09:17.757658 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:17.757656    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerStarted","Data":"23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"}
May 28 20:09:17.758161 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:17.757675    2564 scope.go:117] "RemoveContainer" containerID="8757e99090d3abc5328e85376051d187019464a9d3cd811db3aec2c8f2414057"
May 28 20:09:17.758161 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:17.757823    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 20:09:23.764928 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:23.764878    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:28.763902 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:28.763863    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:33.764882 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:33.764835    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:38.764416 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:38.764376    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:43.764157 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:43.764077    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:47.051278 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:47.051235    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:48.764187 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:48.764151    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:53.764573 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:53.764532    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:57.051121 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:57.051051    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:09:58.764659 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:09:58.764623    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:10:03.764800 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:10:03.764757    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:10:07.051650 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:10:07.051573    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:10:07.051650 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:10:07.051639    2564 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 20:10:07.052128 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:10:07.051967    2564 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"} pod="opendatahub/maas-api-85b79b9b4f-bz9q8" containerMessage="Container maas-api failed liveness probe, will be restarted"
May 28 20:10:07.052128 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:10:07.051997    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" containerID="cri-o://23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338" gracePeriod=30
May 28 20:10:07.052128 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:10:07.052069    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:10:07.168188 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:10:07.168158    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:10:07.941509 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:10:07.941476    2564 generic.go:358] "Generic (PLEG): container finished" podID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338" exitCode=2
May 28 20:10:07.941694 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:10:07.941514    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerDied","Data":"23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"}
May 28 20:10:07.941694 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:10:07.941545    2564 scope.go:117] "RemoveContainer" containerID="1d304866fcd79d59dd73d951a327c13b9b77fc7dbdf108c97c33b4d9128d669e"
May 28 20:10:07.941895 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:10:07.941876    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:10:07.942109 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:10:07.942071    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:10:19.995744 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:10:19.995716    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:10:19.996217 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:10:19.995885    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:10:34.995923 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:10:34.995889    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:10:34.996366 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:10:34.996052    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:10:46.996160 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:10:46.996127    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:10:46.996614 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:10:46.996372    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:11:00.995868 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:11:00.995838    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:11:00.996330 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:11:00.996028    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:11:14.000831 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:11:14.000800    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:11:14.001231 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:11:14.000979    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:11:28.995889 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:11:28.995861    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:11:28.996316 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:11:28.996048    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:11:40.995946 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:11:40.995862    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:11:40.996469 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:11:40.996081    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:11:51.996264 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:11:51.996234    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:11:51.996701 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:11:51.996429    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:12:05.998927 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:05.998875    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:12:05.999547 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:12:05.999082    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:12:10.455297 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.455259    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"]
May 28 20:12:10.458534 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.458508    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.462146 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.462126    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 28 20:12:10.462146 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.462136    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vqc2b\""
May 28 20:12:10.462310 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.462127    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 28 20:12:10.462310 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.462128    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 28 20:12:10.471698 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.471676    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"]
May 28 20:12:10.579303 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.579280    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11a54bac-17bb-40f8-9d07-82c2a28d7b50-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.579431 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.579330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11a54bac-17bb-40f8-9d07-82c2a28d7b50-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.579431 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.579349    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlk9v\" (UniqueName: \"kubernetes.io/projected/11a54bac-17bb-40f8-9d07-82c2a28d7b50-kube-api-access-tlk9v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.579431 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.579367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11a54bac-17bb-40f8-9d07-82c2a28d7b50-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.579431 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.579397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11a54bac-17bb-40f8-9d07-82c2a28d7b50-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.579431 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.579413    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/11a54bac-17bb-40f8-9d07-82c2a28d7b50-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.680011 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.679971    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11a54bac-17bb-40f8-9d07-82c2a28d7b50-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.680176 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.680018    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tlk9v\" (UniqueName: \"kubernetes.io/projected/11a54bac-17bb-40f8-9d07-82c2a28d7b50-kube-api-access-tlk9v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.680176 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.680049    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11a54bac-17bb-40f8-9d07-82c2a28d7b50-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.680176 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.680134    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11a54bac-17bb-40f8-9d07-82c2a28d7b50-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.680176 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.680166    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/11a54bac-17bb-40f8-9d07-82c2a28d7b50-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.680392 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.680198    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11a54bac-17bb-40f8-9d07-82c2a28d7b50-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.680456 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.680397    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11a54bac-17bb-40f8-9d07-82c2a28d7b50-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.680514 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.680492    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11a54bac-17bb-40f8-9d07-82c2a28d7b50-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.680582 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.680559    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/11a54bac-17bb-40f8-9d07-82c2a28d7b50-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.682302 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.682282    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11a54bac-17bb-40f8-9d07-82c2a28d7b50-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.682555 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.682539    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11a54bac-17bb-40f8-9d07-82c2a28d7b50-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.688826 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.688806    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlk9v\" (UniqueName: \"kubernetes.io/projected/11a54bac-17bb-40f8-9d07-82c2a28d7b50-kube-api-access-tlk9v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk\" (UID: \"11a54bac-17bb-40f8-9d07-82c2a28d7b50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.768582 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.768527    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:10.912133 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:10.912109    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"]
May 28 20:12:10.914186 ip-10-0-138-85 kubenswrapper[2564]: W0528 20:12:10.914162    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a54bac_17bb_40f8_9d07_82c2a28d7b50.slice/crio-0e455944cb46015ac26754c4d76506d38271d0ce4ad6c5274aaf63510405dfe4 WatchSource:0}: Error finding container 0e455944cb46015ac26754c4d76506d38271d0ce4ad6c5274aaf63510405dfe4: Status 404 returned error can't find the container with id 0e455944cb46015ac26754c4d76506d38271d0ce4ad6c5274aaf63510405dfe4
May 28 20:12:11.401935 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:11.401901    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk" event={"ID":"11a54bac-17bb-40f8-9d07-82c2a28d7b50","Type":"ContainerStarted","Data":"0e455944cb46015ac26754c4d76506d38271d0ce4ad6c5274aaf63510405dfe4"}
May 28 20:12:16.424778 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:16.424733    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk" event={"ID":"11a54bac-17bb-40f8-9d07-82c2a28d7b50","Type":"ContainerStarted","Data":"526889275b9b13889cc9b290b57906039bb0a928525066ff0f53c1ed1637cb16"}
May 28 20:12:18.995462 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:18.995428    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:12:18.995926 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:12:18.995595    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:12:21.445450 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:21.445416    2564 generic.go:358] "Generic (PLEG): container finished" podID="11a54bac-17bb-40f8-9d07-82c2a28d7b50" containerID="526889275b9b13889cc9b290b57906039bb0a928525066ff0f53c1ed1637cb16" exitCode=0
May 28 20:12:21.445765 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:21.445492    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk" event={"ID":"11a54bac-17bb-40f8-9d07-82c2a28d7b50","Type":"ContainerDied","Data":"526889275b9b13889cc9b290b57906039bb0a928525066ff0f53c1ed1637cb16"}
May 28 20:12:23.455389 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:23.455359    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk" event={"ID":"11a54bac-17bb-40f8-9d07-82c2a28d7b50","Type":"ContainerStarted","Data":"dd1fcac7d25f9692c1083a655d616669943c002b7572f8c89802ecf2743e5eeb"}
May 28 20:12:23.455737 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:23.455550    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:23.476601 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:23.476559    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk" podStartSLOduration=1.694449753 podStartE2EDuration="13.476548138s" podCreationTimestamp="2026-05-28 20:12:10 +0000 UTC" firstStartedPulling="2026-05-28 20:12:10.915945935 +0000 UTC m=+1735.526670572" lastFinishedPulling="2026-05-28 20:12:22.698044314 +0000 UTC m=+1747.308768957" observedRunningTime="2026-05-28 20:12:23.47491635 +0000 UTC m=+1748.085641023" watchObservedRunningTime="2026-05-28 20:12:23.476548138 +0000 UTC m=+1748.087272797"
May 28 20:12:31.995728 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:31.995698    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:12:31.996081 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:12:31.995879    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:12:34.471292 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:34.471259    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk"
May 28 20:12:44.996116 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:44.996060    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:12:44.996664 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:12:44.996326    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:12:57.996558 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:12:57.996529    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:12:57.997005 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:12:57.996713    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:13:00.852697 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:00.852664    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"]
May 28 20:13:00.855778 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:00.855758    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:00.858501 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:00.858483    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 28 20:13:00.871072 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:00.871049    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"]
May 28 20:13:00.963327 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:00.963307    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9894314-8bb6-4299-a9d3-ae61dec09c82-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:00.963427 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:00.963338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9894314-8bb6-4299-a9d3-ae61dec09c82-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:00.963427 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:00.963363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9894314-8bb6-4299-a9d3-ae61dec09c82-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:00.963504 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:00.963433    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9894314-8bb6-4299-a9d3-ae61dec09c82-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:00.963541 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:00.963500    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cqs9\" (UniqueName: \"kubernetes.io/projected/d9894314-8bb6-4299-a9d3-ae61dec09c82-kube-api-access-7cqs9\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:00.963541 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:00.963525    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9894314-8bb6-4299-a9d3-ae61dec09c82-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:01.064677 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:01.064653    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9894314-8bb6-4299-a9d3-ae61dec09c82-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:01.064772 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:01.064687    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9894314-8bb6-4299-a9d3-ae61dec09c82-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:01.064827 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:01.064809    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9894314-8bb6-4299-a9d3-ae61dec09c82-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:01.064870 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:01.064857    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9894314-8bb6-4299-a9d3-ae61dec09c82-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:01.064910 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:01.064892    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7cqs9\" (UniqueName: \"kubernetes.io/projected/d9894314-8bb6-4299-a9d3-ae61dec09c82-kube-api-access-7cqs9\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:01.064944 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:01.064920    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9894314-8bb6-4299-a9d3-ae61dec09c82-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:01.065173 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:01.065149    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9894314-8bb6-4299-a9d3-ae61dec09c82-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:01.065270 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:01.065176    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d9894314-8bb6-4299-a9d3-ae61dec09c82-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:01.065315 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:01.065267    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9894314-8bb6-4299-a9d3-ae61dec09c82-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:01.066974 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:01.066954    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9894314-8bb6-4299-a9d3-ae61dec09c82-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:01.067253 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:01.067236    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9894314-8bb6-4299-a9d3-ae61dec09c82-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:01.073900 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:01.073877    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cqs9\" (UniqueName: \"kubernetes.io/projected/d9894314-8bb6-4299-a9d3-ae61dec09c82-kube-api-access-7cqs9\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-xdqt7\" (UID: \"d9894314-8bb6-4299-a9d3-ae61dec09c82\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:01.166075 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:01.166040    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:01.301901 ip-10-0-138-85 kubenswrapper[2564]: W0528 20:13:01.301871    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9894314_8bb6_4299_a9d3_ae61dec09c82.slice/crio-f760fc43077ed09ce0ed1811e5576595b468dd52574af1518983fb0c639e716d WatchSource:0}: Error finding container f760fc43077ed09ce0ed1811e5576595b468dd52574af1518983fb0c639e716d: Status 404 returned error can't find the container with id f760fc43077ed09ce0ed1811e5576595b468dd52574af1518983fb0c639e716d
May 28 20:13:01.303488 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:01.303465    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"]
May 28 20:13:01.594807 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:01.594710    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7" event={"ID":"d9894314-8bb6-4299-a9d3-ae61dec09c82","Type":"ContainerStarted","Data":"82e4b0183370716c8d9493ea96a3f04fa2c229d91dd59106a6d36f65484ea801"}
May 28 20:13:01.594807 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:01.594767    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7" event={"ID":"d9894314-8bb6-4299-a9d3-ae61dec09c82","Type":"ContainerStarted","Data":"f760fc43077ed09ce0ed1811e5576595b468dd52574af1518983fb0c639e716d"}
May 28 20:13:02.156921 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:02.156885    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f55474548-v2wsp"]
May 28 20:13:02.159804 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:02.159782    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f55474548-v2wsp"
May 28 20:13:02.183436 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:02.183411    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f55474548-v2wsp"]
May 28 20:13:02.275376 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:02.275344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e61c2662-6af3-47d6-8b9a-665c5428b11f-tls-cert\") pod \"authorino-6f55474548-v2wsp\" (UID: \"e61c2662-6af3-47d6-8b9a-665c5428b11f\") " pod="kuadrant-system/authorino-6f55474548-v2wsp"
May 28 20:13:02.275521 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:02.275465    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktrr4\" (UniqueName: \"kubernetes.io/projected/e61c2662-6af3-47d6-8b9a-665c5428b11f-kube-api-access-ktrr4\") pod \"authorino-6f55474548-v2wsp\" (UID: \"e61c2662-6af3-47d6-8b9a-665c5428b11f\") " pod="kuadrant-system/authorino-6f55474548-v2wsp"
May 28 20:13:02.375790 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:02.375760    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e61c2662-6af3-47d6-8b9a-665c5428b11f-tls-cert\") pod \"authorino-6f55474548-v2wsp\" (UID: \"e61c2662-6af3-47d6-8b9a-665c5428b11f\") " pod="kuadrant-system/authorino-6f55474548-v2wsp"
May 28 20:13:02.375947 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:02.375832    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ktrr4\" (UniqueName: \"kubernetes.io/projected/e61c2662-6af3-47d6-8b9a-665c5428b11f-kube-api-access-ktrr4\") pod \"authorino-6f55474548-v2wsp\" (UID: \"e61c2662-6af3-47d6-8b9a-665c5428b11f\") " pod="kuadrant-system/authorino-6f55474548-v2wsp"
May 28 20:13:02.378251 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:02.378219    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e61c2662-6af3-47d6-8b9a-665c5428b11f-tls-cert\") pod \"authorino-6f55474548-v2wsp\" (UID: \"e61c2662-6af3-47d6-8b9a-665c5428b11f\") " pod="kuadrant-system/authorino-6f55474548-v2wsp"
May 28 20:13:02.384455 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:02.384438    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktrr4\" (UniqueName: \"kubernetes.io/projected/e61c2662-6af3-47d6-8b9a-665c5428b11f-kube-api-access-ktrr4\") pod \"authorino-6f55474548-v2wsp\" (UID: \"e61c2662-6af3-47d6-8b9a-665c5428b11f\") " pod="kuadrant-system/authorino-6f55474548-v2wsp"
May 28 20:13:02.468512 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:02.468442    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f55474548-v2wsp"
May 28 20:13:02.624056 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:02.624027    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f55474548-v2wsp"]
May 28 20:13:02.625238 ip-10-0-138-85 kubenswrapper[2564]: W0528 20:13:02.625217    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode61c2662_6af3_47d6_8b9a_665c5428b11f.slice/crio-dad358de505050b15261a4b8cf7ae881ed1baf6e12ffb2f7293e5a2521bcdf51 WatchSource:0}: Error finding container dad358de505050b15261a4b8cf7ae881ed1baf6e12ffb2f7293e5a2521bcdf51: Status 404 returned error can't find the container with id dad358de505050b15261a4b8cf7ae881ed1baf6e12ffb2f7293e5a2521bcdf51
May 28 20:13:03.606167 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:03.606125    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f55474548-v2wsp" event={"ID":"e61c2662-6af3-47d6-8b9a-665c5428b11f","Type":"ContainerStarted","Data":"531929d16430ded761129b98dc88b0f1e939328501c07e396faf74aa83c98928"}
May 28 20:13:03.606167 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:03.606174    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f55474548-v2wsp" event={"ID":"e61c2662-6af3-47d6-8b9a-665c5428b11f","Type":"ContainerStarted","Data":"dad358de505050b15261a4b8cf7ae881ed1baf6e12ffb2f7293e5a2521bcdf51"}
May 28 20:13:03.636001 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:03.635944    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6f55474548-v2wsp" podStartSLOduration=1.260330467 podStartE2EDuration="1.635924346s" podCreationTimestamp="2026-05-28 20:13:02 +0000 UTC" firstStartedPulling="2026-05-28 20:13:02.626472204 +0000 UTC m=+1787.237196842" lastFinishedPulling="2026-05-28 20:13:03.002066084 +0000 UTC m=+1787.612790721" observedRunningTime="2026-05-28 20:13:03.633070334 +0000 UTC m=+1788.243794998" watchObservedRunningTime="2026-05-28 20:13:03.635924346 +0000 UTC m=+1788.246649005"
May 28 20:13:03.689926 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:03.689211    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-794b468bcc-x8wz9"]
May 28 20:13:03.689926 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:03.689456    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-794b468bcc-x8wz9" podUID="59a336b4-a04c-45fc-bd5b-5088eb62d7c0" containerName="authorino" containerID="cri-o://e2990188eb4d8b20081d2b6d09e47a6a07a21289214532531955bf12e57445a0" gracePeriod=30
May 28 20:13:03.943630 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:03.943608    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-794b468bcc-x8wz9"
May 28 20:13:03.990993 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:03.990964    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/59a336b4-a04c-45fc-bd5b-5088eb62d7c0-tls-cert\") pod \"59a336b4-a04c-45fc-bd5b-5088eb62d7c0\" (UID: \"59a336b4-a04c-45fc-bd5b-5088eb62d7c0\") "
May 28 20:13:03.991216 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:03.991009    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bk7vh\" (UniqueName: \"kubernetes.io/projected/59a336b4-a04c-45fc-bd5b-5088eb62d7c0-kube-api-access-bk7vh\") pod \"59a336b4-a04c-45fc-bd5b-5088eb62d7c0\" (UID: \"59a336b4-a04c-45fc-bd5b-5088eb62d7c0\") "
May 28 20:13:03.993700 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:03.993671    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59a336b4-a04c-45fc-bd5b-5088eb62d7c0-kube-api-access-bk7vh" (OuterVolumeSpecName: "kube-api-access-bk7vh") pod "59a336b4-a04c-45fc-bd5b-5088eb62d7c0" (UID: "59a336b4-a04c-45fc-bd5b-5088eb62d7c0"). InnerVolumeSpecName "kube-api-access-bk7vh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 20:13:04.004427 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:04.004380    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59a336b4-a04c-45fc-bd5b-5088eb62d7c0-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "59a336b4-a04c-45fc-bd5b-5088eb62d7c0" (UID: "59a336b4-a04c-45fc-bd5b-5088eb62d7c0"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 20:13:04.092332 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:04.092300    2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/59a336b4-a04c-45fc-bd5b-5088eb62d7c0-tls-cert\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 20:13:04.092332 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:04.092334    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk7vh\" (UniqueName: \"kubernetes.io/projected/59a336b4-a04c-45fc-bd5b-5088eb62d7c0-kube-api-access-bk7vh\") on node \"ip-10-0-138-85.ec2.internal\" DevicePath \"\""
May 28 20:13:04.611527 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:04.611485    2564 generic.go:358] "Generic (PLEG): container finished" podID="59a336b4-a04c-45fc-bd5b-5088eb62d7c0" containerID="e2990188eb4d8b20081d2b6d09e47a6a07a21289214532531955bf12e57445a0" exitCode=0
May 28 20:13:04.611958 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:04.611551    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-794b468bcc-x8wz9"
May 28 20:13:04.611958 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:04.611582    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-794b468bcc-x8wz9" event={"ID":"59a336b4-a04c-45fc-bd5b-5088eb62d7c0","Type":"ContainerDied","Data":"e2990188eb4d8b20081d2b6d09e47a6a07a21289214532531955bf12e57445a0"}
May 28 20:13:04.611958 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:04.611632    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-794b468bcc-x8wz9" event={"ID":"59a336b4-a04c-45fc-bd5b-5088eb62d7c0","Type":"ContainerDied","Data":"bdebe79457cec014fb7924bd8a95bbd84ffdfa431e08cc409f6ed29115b1a795"}
May 28 20:13:04.611958 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:04.611655    2564 scope.go:117] "RemoveContainer" containerID="e2990188eb4d8b20081d2b6d09e47a6a07a21289214532531955bf12e57445a0"
May 28 20:13:04.620667 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:04.620651    2564 scope.go:117] "RemoveContainer" containerID="e2990188eb4d8b20081d2b6d09e47a6a07a21289214532531955bf12e57445a0"
May 28 20:13:04.620923 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:13:04.620905    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2990188eb4d8b20081d2b6d09e47a6a07a21289214532531955bf12e57445a0\": container with ID starting with e2990188eb4d8b20081d2b6d09e47a6a07a21289214532531955bf12e57445a0 not found: ID does not exist" containerID="e2990188eb4d8b20081d2b6d09e47a6a07a21289214532531955bf12e57445a0"
May 28 20:13:04.620991 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:04.620935    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2990188eb4d8b20081d2b6d09e47a6a07a21289214532531955bf12e57445a0"} err="failed to get container status \"e2990188eb4d8b20081d2b6d09e47a6a07a21289214532531955bf12e57445a0\": rpc error: code = NotFound desc = could not find container \"e2990188eb4d8b20081d2b6d09e47a6a07a21289214532531955bf12e57445a0\": container with ID starting with e2990188eb4d8b20081d2b6d09e47a6a07a21289214532531955bf12e57445a0 not found: ID does not exist"
May 28 20:13:04.632961 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:04.632939    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-794b468bcc-x8wz9"]
May 28 20:13:04.642407 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:04.642384    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-794b468bcc-x8wz9"]
May 28 20:13:06.000019 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:05.999929    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59a336b4-a04c-45fc-bd5b-5088eb62d7c0" path="/var/lib/kubelet/pods/59a336b4-a04c-45fc-bd5b-5088eb62d7c0/volumes"
May 28 20:13:07.624257 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:07.624220    2564 generic.go:358] "Generic (PLEG): container finished" podID="d9894314-8bb6-4299-a9d3-ae61dec09c82" containerID="82e4b0183370716c8d9493ea96a3f04fa2c229d91dd59106a6d36f65484ea801" exitCode=0
May 28 20:13:07.624617 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:07.624291    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7" event={"ID":"d9894314-8bb6-4299-a9d3-ae61dec09c82","Type":"ContainerDied","Data":"82e4b0183370716c8d9493ea96a3f04fa2c229d91dd59106a6d36f65484ea801"}
May 28 20:13:08.629609 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:08.629575    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7" event={"ID":"d9894314-8bb6-4299-a9d3-ae61dec09c82","Type":"ContainerStarted","Data":"17fc188de7afffd3cdeacdf076df9f39edd15be3281fb7f4f3bced8eda8fd252"}
May 28 20:13:08.630042 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:08.629801    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:08.652676 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:08.652630    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7" podStartSLOduration=8.196813192 podStartE2EDuration="8.652618312s" podCreationTimestamp="2026-05-28 20:13:00 +0000 UTC" firstStartedPulling="2026-05-28 20:13:07.624893994 +0000 UTC m=+1792.235618632" lastFinishedPulling="2026-05-28 20:13:08.080699098 +0000 UTC m=+1792.691423752" observedRunningTime="2026-05-28 20:13:08.652073967 +0000 UTC m=+1793.262798627" watchObservedRunningTime="2026-05-28 20:13:08.652618312 +0000 UTC m=+1793.263342976"
May 28 20:13:10.995749 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:10.995712    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:13:10.996174 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:13:10.995896    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:13:16.067253 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:16.067227    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 20:13:16.070218 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:16.070194    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 20:13:19.646314 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:19.646289    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-xdqt7"
May 28 20:13:23.996497 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:23.996465    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:13:23.996884 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:13:23.996642    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:13:34.996468 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:34.996436    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:13:34.998856 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:13:34.996607    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:13:46.995812 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:46.995785    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:13:46.996222 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:13:46.995958    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:13:57.995596 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:13:57.995565    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:13:57.995967 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:13:57.995770    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:14:08.995746 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:14:08.995716    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:14:08.996213 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:14:08.995880    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:14:22.996456 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:14:22.996423    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:14:22.996828 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:14:22.996594    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:14:36.000009 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:14:35.999936    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:14:36.000415 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:14:36.000174    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:14:46.995749 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:14:46.995718    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:14:46.996229 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:14:46.995887    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:15:01.999124 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:01.996760    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:15:01.999124 ip-10-0-138-85 kubenswrapper[2564]: E0528 20:15:01.997620    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-85b79b9b4f-bz9q8_opendatahub(6de1ac9d-8862-4274-9a85-428de4ec64d0)\"" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0"
May 28 20:15:13.420246 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:13.420214    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f55474548-v2wsp_e61c2662-6af3-47d6-8b9a-665c5428b11f/authorino/0.log"
May 28 20:15:14.996579 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:14.996550    2564 scope.go:117] "RemoveContainer" containerID="23429f670dd08a69c929ed555e244755db760eb8ed79f3f3865b45e725530338"
May 28 20:15:14.996942 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:14.996831    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 20:15:16.105714 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:16.105676    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" event={"ID":"6de1ac9d-8862-4274-9a85-428de4ec64d0","Type":"ContainerStarted","Data":"394ee723538cfd9863bc9b55cc3425385f9c6920e98767895b908c49fce36d43"}
May 28 20:15:16.106166 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:16.105926    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-85b79b9b4f-bz9q8"
May 28 20:15:17.797956 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:17.797925    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-85b79b9b4f-bz9q8_6de1ac9d-8862-4274-9a85-428de4ec64d0/maas-api/10.log"
May 28 20:15:18.006904 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:18.006830    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74fcdff59d-jxm72_8f076e7e-d748-46c3-ad5c-f2a3e53bbe8b/manager/0.log"
May 28 20:15:18.336854 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:18.336784    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69568b6749-jnxrm_809ca0d7-c818-489d-af69-346a5cef891e/manager/0.log"
May 28 20:15:19.288792 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:19.288768    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7_80032370-ecdd-4772-8871-9eccb24a54de/util/0.log"
May 28 20:15:19.294478 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:19.294449    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7_80032370-ecdd-4772-8871-9eccb24a54de/pull/0.log"
May 28 20:15:19.300822 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:19.300802    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7_80032370-ecdd-4772-8871-9eccb24a54de/extract/0.log"
May 28 20:15:19.408050 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:19.408024    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt_c1d96e71-b305-41c9-8ef5-a091411e92dc/util/0.log"
May 28 20:15:19.413241 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:19.413224    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt_c1d96e71-b305-41c9-8ef5-a091411e92dc/pull/0.log"
May 28 20:15:19.418262 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:19.418248    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt_c1d96e71-b305-41c9-8ef5-a091411e92dc/extract/0.log"
May 28 20:15:19.523232 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:19.523205    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924_9349269c-4538-4cf1-983c-41ba29ff3391/pull/0.log"
May 28 20:15:19.528684 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:19.528665    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924_9349269c-4538-4cf1-983c-41ba29ff3391/extract/0.log"
May 28 20:15:19.533783 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:19.533763    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924_9349269c-4538-4cf1-983c-41ba29ff3391/util/0.log"
May 28 20:15:19.642958 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:19.642877    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq_9f93b052-ed83-4f97-bd45-958cb28d3d35/util/0.log"
May 28 20:15:19.648193 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:19.648163    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq_9f93b052-ed83-4f97-bd45-958cb28d3d35/pull/0.log"
May 28 20:15:19.652999 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:19.652982    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq_9f93b052-ed83-4f97-bd45-958cb28d3d35/extract/0.log"
May 28 20:15:19.759351 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:19.759328    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f55474548-v2wsp_e61c2662-6af3-47d6-8b9a-665c5428b11f/authorino/0.log"
May 28 20:15:20.071730 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:20.071702    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-hd852_ac09a470-2cc5-4864-9ca0-b2b4c652fe4e/kuadrant-console-plugin/0.log"
May 28 20:15:21.060856 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:21.060822    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58474d499-7t8v7_a20cc52b-e66b-420a-b0d7-399b4d09e8c3/kube-auth-proxy/0.log"
May 28 20:15:21.389284 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:21.389215    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-66qp5_e1cefbe0-b07a-4c32-a512-d91940686fd0/payload-processing/0.log"
May 28 20:15:22.045547 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:22.045518    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-xdqt7_d9894314-8bb6-4299-a9d3-ae61dec09c82/main/0.log"
May 28 20:15:22.051613 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:22.051586    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-xdqt7_d9894314-8bb6-4299-a9d3-ae61dec09c82/storage-initializer/0.log"
May 28 20:15:22.111239 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:22.111212    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:15:22.159257 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:22.159231    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk_11a54bac-17bb-40f8-9d07-82c2a28d7b50/main/0.log"
May 28 20:15:22.165145 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:22.165121    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7ptpk_11a54bac-17bb-40f8-9d07-82c2a28d7b50/storage-initializer/0.log"
May 28 20:15:26.808728 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:26.808689    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-74sxj/must-gather-rvzz9"]
May 28 20:15:26.809210 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:26.809182    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59a336b4-a04c-45fc-bd5b-5088eb62d7c0" containerName="authorino"
May 28 20:15:26.809210 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:26.809202    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="59a336b4-a04c-45fc-bd5b-5088eb62d7c0" containerName="authorino"
May 28 20:15:26.809356 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:26.809296    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="59a336b4-a04c-45fc-bd5b-5088eb62d7c0" containerName="authorino"
May 28 20:15:26.813685 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:26.813659    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-74sxj/must-gather-rvzz9"
May 28 20:15:26.816045 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:26.816021    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-74sxj\"/\"openshift-service-ca.crt\""
May 28 20:15:26.816180 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:26.816044    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-74sxj\"/\"default-dockercfg-tqdrh\""
May 28 20:15:26.816180 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:26.816070    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-74sxj\"/\"kube-root-ca.crt\""
May 28 20:15:26.821356 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:26.821338    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-74sxj/must-gather-rvzz9"]
May 28 20:15:26.910285 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:26.910262    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cb388f8e-ea6e-40ce-b487-95c07ad7bf50-must-gather-output\") pod \"must-gather-rvzz9\" (UID: \"cb388f8e-ea6e-40ce-b487-95c07ad7bf50\") " pod="openshift-must-gather-74sxj/must-gather-rvzz9"
May 28 20:15:26.910388 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:26.910309    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlxlg\" (UniqueName: \"kubernetes.io/projected/cb388f8e-ea6e-40ce-b487-95c07ad7bf50-kube-api-access-jlxlg\") pod \"must-gather-rvzz9\" (UID: \"cb388f8e-ea6e-40ce-b487-95c07ad7bf50\") " pod="openshift-must-gather-74sxj/must-gather-rvzz9"
May 28 20:15:27.010988 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:27.010963    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cb388f8e-ea6e-40ce-b487-95c07ad7bf50-must-gather-output\") pod \"must-gather-rvzz9\" (UID: \"cb388f8e-ea6e-40ce-b487-95c07ad7bf50\") " pod="openshift-must-gather-74sxj/must-gather-rvzz9"
May 28 20:15:27.011088 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:27.011009    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jlxlg\" (UniqueName: \"kubernetes.io/projected/cb388f8e-ea6e-40ce-b487-95c07ad7bf50-kube-api-access-jlxlg\") pod \"must-gather-rvzz9\" (UID: \"cb388f8e-ea6e-40ce-b487-95c07ad7bf50\") " pod="openshift-must-gather-74sxj/must-gather-rvzz9"
May 28 20:15:27.011348 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:27.011330    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cb388f8e-ea6e-40ce-b487-95c07ad7bf50-must-gather-output\") pod \"must-gather-rvzz9\" (UID: \"cb388f8e-ea6e-40ce-b487-95c07ad7bf50\") " pod="openshift-must-gather-74sxj/must-gather-rvzz9"
May 28 20:15:27.018392 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:27.018362    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlxlg\" (UniqueName: \"kubernetes.io/projected/cb388f8e-ea6e-40ce-b487-95c07ad7bf50-kube-api-access-jlxlg\") pod \"must-gather-rvzz9\" (UID: \"cb388f8e-ea6e-40ce-b487-95c07ad7bf50\") " pod="openshift-must-gather-74sxj/must-gather-rvzz9"
May 28 20:15:27.110319 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:27.110238    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:15:27.123456 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:27.123437    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-74sxj/must-gather-rvzz9"
May 28 20:15:27.249257 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:27.249230    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-74sxj/must-gather-rvzz9"]
May 28 20:15:28.156813 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:28.156783    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74sxj/must-gather-rvzz9" event={"ID":"cb388f8e-ea6e-40ce-b487-95c07ad7bf50","Type":"ContainerStarted","Data":"9a6267685d63b6e69a7c20ce4eedada751ff5dd6c4159e83b6ac255c58502c07"}
May 28 20:15:29.163728 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:29.162887    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74sxj/must-gather-rvzz9" event={"ID":"cb388f8e-ea6e-40ce-b487-95c07ad7bf50","Type":"ContainerStarted","Data":"3530d1cfede2740dca750431af08275e98f79bb627445b4ef86aa0a4f67124df"}
May 28 20:15:29.163728 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:29.162933    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74sxj/must-gather-rvzz9" event={"ID":"cb388f8e-ea6e-40ce-b487-95c07ad7bf50","Type":"ContainerStarted","Data":"2b35bac628da1dbeb946c9fd62b764e35fa771be7fdf7c8f6152addfe745a3d5"}
May 28 20:15:29.803424 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:29.803392    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rm9gg_7de14915-8fec-4966-a17f-864b31d61a92/global-pull-secret-syncer/0.log"
May 28 20:15:29.876203 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:29.876161    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g8kcf_a2dd6a90-6627-48f5-8eed-d36d6564fe2d/konnectivity-agent/0.log"
May 28 20:15:29.977581 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:29.977551    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-85.ec2.internal_baeefc9190e426e2957710d584028c12/haproxy/0.log"
May 28 20:15:32.110832 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:32.110778    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:15:33.208116 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:33.208046    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7_80032370-ecdd-4772-8871-9eccb24a54de/extract/0.log"
May 28 20:15:33.238876 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:33.238851    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7_80032370-ecdd-4772-8871-9eccb24a54de/util/0.log"
May 28 20:15:33.272707 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:33.272682    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7596gzs7_80032370-ecdd-4772-8871-9eccb24a54de/pull/0.log"
May 28 20:15:33.307160 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:33.307131    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt_c1d96e71-b305-41c9-8ef5-a091411e92dc/extract/0.log"
May 28 20:15:33.328959 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:33.328929    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt_c1d96e71-b305-41c9-8ef5-a091411e92dc/util/0.log"
May 28 20:15:33.351076 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:33.351040    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0brzbt_c1d96e71-b305-41c9-8ef5-a091411e92dc/pull/0.log"
May 28 20:15:33.380949 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:33.380923    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924_9349269c-4538-4cf1-983c-41ba29ff3391/extract/0.log"
May 28 20:15:33.401722 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:33.401699    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924_9349269c-4538-4cf1-983c-41ba29ff3391/util/0.log"
May 28 20:15:33.420194 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:33.420153    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732p924_9349269c-4538-4cf1-983c-41ba29ff3391/pull/0.log"
May 28 20:15:33.451772 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:33.451700    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq_9f93b052-ed83-4f97-bd45-958cb28d3d35/extract/0.log"
May 28 20:15:33.472569 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:33.472473    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq_9f93b052-ed83-4f97-bd45-958cb28d3d35/util/0.log"
May 28 20:15:33.495642 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:33.495596    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ldzfq_9f93b052-ed83-4f97-bd45-958cb28d3d35/pull/0.log"
May 28 20:15:33.529288 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:33.529259    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f55474548-v2wsp_e61c2662-6af3-47d6-8b9a-665c5428b11f/authorino/0.log"
May 28 20:15:33.600906 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:33.600874    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-hd852_ac09a470-2cc5-4864-9ca0-b2b4c652fe4e/kuadrant-console-plugin/0.log"
May 28 20:15:35.167749 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:35.167723    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-79fdd8cd76-f97jn_bbd155f4-f415-417f-952f-36cdb2dc983b/metrics-server/0.log"
May 28 20:15:35.202181 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:35.202139    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-gxdhf_83d8c2a9-173f-4889-a5c5-167da0e7e7a5/monitoring-plugin/0.log"
May 28 20:15:35.242128 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:35.242084    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-csr9t_8ab00694-4463-46ca-a691-18023eea0e9b/node-exporter/0.log"
May 28 20:15:35.272781 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:35.272753    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-csr9t_8ab00694-4463-46ca-a691-18023eea0e9b/kube-rbac-proxy/0.log"
May 28 20:15:35.289039 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:35.289016    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-csr9t_8ab00694-4463-46ca-a691-18023eea0e9b/init-textfile/0.log"
May 28 20:15:35.775713 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:35.775535    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-629g4_f65847cf-f3b8-4ade-9d21-cb52e9908388/prometheus-operator-admission-webhook/0.log"
May 28 20:15:37.110612 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:37.110561    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:15:37.211148 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:37.211119    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-w8sv2_ae20f3b7-0d46-4792-b2cf-1ec397c0644b/networking-console-plugin/0.log"
May 28 20:15:38.236975 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.236948    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-lkbg4_d4071f1d-7d2b-4deb-86ea-a15623271352/download-server/0.log"
May 28 20:15:38.691637 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.691576    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-74sxj/must-gather-rvzz9" podStartSLOduration=11.731387169 podStartE2EDuration="12.691560533s" podCreationTimestamp="2026-05-28 20:15:26 +0000 UTC" firstStartedPulling="2026-05-28 20:15:27.253900701 +0000 UTC m=+1931.864625340" lastFinishedPulling="2026-05-28 20:15:28.214074063 +0000 UTC m=+1932.824798704" observedRunningTime="2026-05-28 20:15:29.180243027 +0000 UTC m=+1933.790967712" watchObservedRunningTime="2026-05-28 20:15:38.691560533 +0000 UTC m=+1943.302285195"
May 28 20:15:38.694461 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.694426    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"]
May 28 20:15:38.701187 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.701165    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:38.706134 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.706089    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"]
May 28 20:15:38.825007 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.824975    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8057adff-ecdc-41aa-a904-1c6d25540ba4-lib-modules\") pod \"perf-node-gather-daemonset-7rbkt\" (UID: \"8057adff-ecdc-41aa-a904-1c6d25540ba4\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:38.825343 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.825327    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8057adff-ecdc-41aa-a904-1c6d25540ba4-podres\") pod \"perf-node-gather-daemonset-7rbkt\" (UID: \"8057adff-ecdc-41aa-a904-1c6d25540ba4\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:38.825489 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.825474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vqns\" (UniqueName: \"kubernetes.io/projected/8057adff-ecdc-41aa-a904-1c6d25540ba4-kube-api-access-5vqns\") pod \"perf-node-gather-daemonset-7rbkt\" (UID: \"8057adff-ecdc-41aa-a904-1c6d25540ba4\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:38.825613 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.825600    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8057adff-ecdc-41aa-a904-1c6d25540ba4-sys\") pod \"perf-node-gather-daemonset-7rbkt\" (UID: \"8057adff-ecdc-41aa-a904-1c6d25540ba4\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:38.825723 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.825712    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8057adff-ecdc-41aa-a904-1c6d25540ba4-proc\") pod \"perf-node-gather-daemonset-7rbkt\" (UID: \"8057adff-ecdc-41aa-a904-1c6d25540ba4\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:38.927206 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.927173    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8057adff-ecdc-41aa-a904-1c6d25540ba4-lib-modules\") pod \"perf-node-gather-daemonset-7rbkt\" (UID: \"8057adff-ecdc-41aa-a904-1c6d25540ba4\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:38.927421 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.927228    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8057adff-ecdc-41aa-a904-1c6d25540ba4-podres\") pod \"perf-node-gather-daemonset-7rbkt\" (UID: \"8057adff-ecdc-41aa-a904-1c6d25540ba4\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:38.927421 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.927249    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vqns\" (UniqueName: \"kubernetes.io/projected/8057adff-ecdc-41aa-a904-1c6d25540ba4-kube-api-access-5vqns\") pod \"perf-node-gather-daemonset-7rbkt\" (UID: \"8057adff-ecdc-41aa-a904-1c6d25540ba4\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:38.927421 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.927267    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8057adff-ecdc-41aa-a904-1c6d25540ba4-sys\") pod \"perf-node-gather-daemonset-7rbkt\" (UID: \"8057adff-ecdc-41aa-a904-1c6d25540ba4\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:38.927421 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.927286    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8057adff-ecdc-41aa-a904-1c6d25540ba4-proc\") pod \"perf-node-gather-daemonset-7rbkt\" (UID: \"8057adff-ecdc-41aa-a904-1c6d25540ba4\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:38.927421 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.927365    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8057adff-ecdc-41aa-a904-1c6d25540ba4-podres\") pod \"perf-node-gather-daemonset-7rbkt\" (UID: \"8057adff-ecdc-41aa-a904-1c6d25540ba4\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:38.927690 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.927365    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8057adff-ecdc-41aa-a904-1c6d25540ba4-lib-modules\") pod \"perf-node-gather-daemonset-7rbkt\" (UID: \"8057adff-ecdc-41aa-a904-1c6d25540ba4\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:38.927690 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.927376    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8057adff-ecdc-41aa-a904-1c6d25540ba4-sys\") pod \"perf-node-gather-daemonset-7rbkt\" (UID: \"8057adff-ecdc-41aa-a904-1c6d25540ba4\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:38.927690 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.927441    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8057adff-ecdc-41aa-a904-1c6d25540ba4-proc\") pod \"perf-node-gather-daemonset-7rbkt\" (UID: \"8057adff-ecdc-41aa-a904-1c6d25540ba4\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:38.934500 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:38.934475    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vqns\" (UniqueName: \"kubernetes.io/projected/8057adff-ecdc-41aa-a904-1c6d25540ba4-kube-api-access-5vqns\") pod \"perf-node-gather-daemonset-7rbkt\" (UID: \"8057adff-ecdc-41aa-a904-1c6d25540ba4\") " pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:39.015515 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:39.015444    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:39.172924 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:39.172865    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"]
May 28 20:15:39.231173 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:39.231120    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt" event={"ID":"8057adff-ecdc-41aa-a904-1c6d25540ba4","Type":"ContainerStarted","Data":"f522f486fcbeeb704c9fdd869f1a249cd77a216e24268e2b5c43d4f268b2fd5b"}
May 28 20:15:39.721595 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:39.721570    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g948k_dde5c672-a941-41fc-b588-b9336531bd03/dns/0.log"
May 28 20:15:39.740493 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:39.740465    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g948k_dde5c672-a941-41fc-b588-b9336531bd03/kube-rbac-proxy/0.log"
May 28 20:15:39.827812 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:39.827769    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vwv8g_825b4d5d-7813-44d3-9882-e4d91ccb3e8d/dns-node-resolver/0.log"
May 28 20:15:40.238112 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:40.238064    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt" event={"ID":"8057adff-ecdc-41aa-a904-1c6d25540ba4","Type":"ContainerStarted","Data":"293c4ee2b9445684c3b51f715f5eea0400a927b59fceed7e37290997924faecc"}
May 28 20:15:40.238355 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:40.238333    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:40.257484 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:40.257443    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt" podStartSLOduration=2.257429954 podStartE2EDuration="2.257429954s" podCreationTimestamp="2026-05-28 20:15:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 20:15:40.255384663 +0000 UTC m=+1944.866109322" watchObservedRunningTime="2026-05-28 20:15:40.257429954 +0000 UTC m=+1944.868154613"
May 28 20:15:40.339312 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:40.339283    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d96df59fd-wxrh7_d85afd8b-d1f4-40ff-8919-7b5ec37f7115/registry/0.log"
May 28 20:15:40.357144 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:40.357123    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-65m5l_736956bd-c76a-4005-9901-94e77eac247e/node-ca/0.log"
May 28 20:15:41.286055 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:41.285999    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58474d499-7t8v7_a20cc52b-e66b-420a-b0d7-399b4d09e8c3/kube-auth-proxy/0.log"
May 28 20:15:41.402112 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:41.402073    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-66qp5_e1cefbe0-b07a-4c32-a512-d91940686fd0/payload-processing/0.log"
May 28 20:15:41.995730 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:41.995707    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s5dcl_fd4eb1f4-fa6f-4929-8b84-c23031f62f83/serve-healthcheck-canary/0.log"
May 28 20:15:42.110898 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:42.110861    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:15:42.533013 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:42.532986    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q9z4j_46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e/kube-rbac-proxy/0.log"
May 28 20:15:42.554315 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:42.554291    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q9z4j_46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e/exporter/0.log"
May 28 20:15:42.579195 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:42.579171    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q9z4j_46fd38b6-2d92-4c6c-8cf8-0eebdb71a22e/extractor/0.log"
May 28 20:15:44.457756 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:44.457727    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-85b79b9b4f-bz9q8_6de1ac9d-8862-4274-9a85-428de4ec64d0/maas-api/10.log"
May 28 20:15:44.457756 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:44.457740    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-85b79b9b4f-bz9q8_6de1ac9d-8862-4274-9a85-428de4ec64d0/maas-api/9.log"
May 28 20:15:44.483444 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:44.483417    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74fcdff59d-jxm72_8f076e7e-d748-46c3-ad5c-f2a3e53bbe8b/manager/0.log"
May 28 20:15:44.574521 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:44.574469    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69568b6749-jnxrm_809ca0d7-c818-489d-af69-346a5cef891e/manager/0.log"
May 28 20:15:45.702141 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:45.702114    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9cd786b7b-jndv7_58932f97-deee-4200-ad75-f48da52403e2/manager/0.log"
May 28 20:15:45.729753 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:45.729735    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-splfb_31f124f7-3c83-4abd-aa1d-b6ab880882ef/openshift-lws-operator/0.log"
May 28 20:15:46.252645 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:46.252617    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-74sxj/perf-node-gather-daemonset-7rbkt"
May 28 20:15:47.051329 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:47.051298    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:15:47.110470 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:47.110440    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:15:50.037355 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:50.037324    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-97ht6_928ba040-e175-4a27-a69f-823d313539b3/migrator/0.log"
May 28 20:15:50.055404 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:50.055374    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-97ht6_928ba040-e175-4a27-a69f-823d313539b3/graceful-termination/0.log"
May 28 20:15:51.640733 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:51.640704    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z2rbf_88ec1a61-1657-45c9-baa3-a6cb36ac6417/kube-multus-additional-cni-plugins/0.log"
May 28 20:15:51.659312 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:51.659284    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z2rbf_88ec1a61-1657-45c9-baa3-a6cb36ac6417/egress-router-binary-copy/0.log"
May 28 20:15:51.678407 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:51.678387    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z2rbf_88ec1a61-1657-45c9-baa3-a6cb36ac6417/cni-plugins/0.log"
May 28 20:15:51.696378 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:51.696354    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z2rbf_88ec1a61-1657-45c9-baa3-a6cb36ac6417/bond-cni-plugin/0.log"
May 28 20:15:51.715232 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:51.715215    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z2rbf_88ec1a61-1657-45c9-baa3-a6cb36ac6417/routeoverride-cni/0.log"
May 28 20:15:51.733705 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:51.733683    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z2rbf_88ec1a61-1657-45c9-baa3-a6cb36ac6417/whereabouts-cni-bincopy/0.log"
May 28 20:15:51.752479 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:51.752456    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z2rbf_88ec1a61-1657-45c9-baa3-a6cb36ac6417/whereabouts-cni/0.log"
May 28 20:15:51.786033 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:51.786012    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-br7kt_85ed5fce-971a-4650-945f-16d8518cd573/kube-multus/0.log"
May 28 20:15:51.861233 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:51.861212    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8nltt_9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f/network-metrics-daemon/0.log"
May 28 20:15:51.878598 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:51.878579    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8nltt_9aa5d2a8-a7df-4cb7-9520-a873fa05ea6f/kube-rbac-proxy/0.log"
May 28 20:15:52.110805 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:52.110766    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-85b79b9b4f-bz9q8" podUID="6de1ac9d-8862-4274-9a85-428de4ec64d0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
May 28 20:15:52.743794 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:52.743764    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-controller/0.log"
May 28 20:15:52.760651 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:52.760619    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/0.log"
May 28 20:15:52.775278 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:52.775229    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovn-acl-logging/1.log"
May 28 20:15:52.791117 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:52.791086    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/kube-rbac-proxy-node/0.log"
May 28 20:15:52.808885 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:52.808862    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/kube-rbac-proxy-ovn-metrics/0.log"
May 28 20:15:52.826498 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:52.826477    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/northd/0.log"
May 28 20:15:52.845823 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:52.845802    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/nbdb/0.log"
May 28 20:15:52.863605 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:52.863586    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/sbdb/0.log"
May 28 20:15:52.980610 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:52.980588    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9hmkh_de3d3227-c930-454d-a166-00fc73e8e4c8/ovnkube-controller/0.log"
May 28 20:15:54.635528 ip-10-0-138-85 kubenswrapper[2564]: I0528 20:15:54.635489    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-96qfr_de068191-ba48-4ec7-abc0-681b1ee42f3c/network-check-target-container/0.log"