Jun 06 20:46:23.451799 ip-10-0-129-66 systemd[1]: Starting Kubernetes Kubelet...
Jun 06 20:46:23.891688 ip-10-0-129-66 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 06 20:46:23.891688 ip-10-0-129-66 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 06 20:46:23.891688 ip-10-0-129-66 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 06 20:46:23.891688 ip-10-0-129-66 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 06 20:46:23.891688 ip-10-0-129-66 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 06 20:46:23.893616 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.893522    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 06 20:46:23.899003 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.898985    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 20:46:23.899003 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899003    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899008    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899011    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899015    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899018    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899021    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899023    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899026    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899029    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899032    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899034    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899037    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899040    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899043    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899045    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899048    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899051    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899053    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899059    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 20:46:23.899076 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899062    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899067    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899070    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899073    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899076    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899079    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899082    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899085    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899088    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899091    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899093    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899096    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899099    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899102    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899104    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899107    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899110    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899112    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899115    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899118    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 20:46:23.899543 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899120    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899123    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899126    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899128    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899131    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899133    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899136    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899138    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899141    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899143    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899146    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899148    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899151    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899153    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899157    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899160    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899163    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899166    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899168    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899171    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 20:46:23.900032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899174    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899176    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899179    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899182    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899184    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899187    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899189    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899192    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899194    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899197    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899199    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899208    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899211    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899213    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899216    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899218    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899220    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899223    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899226    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899228    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 20:46:23.900544 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899231    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899233    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899236    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899239    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899241    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899244    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899248    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899251    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899256    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899259    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899261    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899264    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899266    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899269    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899271    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899275    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899278    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899282    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.899286    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 20:46:23.901027 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900037    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900043    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900046    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900049    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900053    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900057    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900060    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900063    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900066    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900068    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900071    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900074    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900076    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900079    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900082    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900084    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900087    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900089    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900092    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900096    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 20:46:23.901502 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900099    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900101    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900105    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900107    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900110    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900113    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900115    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900118    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900121    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900123    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900127    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900130    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900133    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900136    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900139    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900141    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900144    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900147    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900150    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900152    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 20:46:23.901991 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900155    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900158    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900160    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900163    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900166    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900168    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900171    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900173    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900176    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900179    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900181    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900185    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900188    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900190    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900193    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900196    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900199    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900202    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900205    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 20:46:23.902492 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900208    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900210    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900213    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900215    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900218    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900221    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900223    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900225    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900237    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900240    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900245    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900248    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900252    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900255    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900258    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900261    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900264    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900266    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900269    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900271    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 20:46:23.902966 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900274    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900277    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900281    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900284    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900287    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900292    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900310    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900314    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900316    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900319    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900322    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900325    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900327    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900330    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900333    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900335    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900338    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900340    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900343    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 20:46:23.903471 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900346    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900789    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900797    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900801    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900804    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900808    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900811    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900814    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900817    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900819    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900822    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900824    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900827    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900830    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900833    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900836    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900838    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900841    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900844    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900846    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 20:46:23.903934 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900849    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900852    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900856    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900859    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900862    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900865    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900868    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900871    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900873    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900876    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900879    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900881    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900884    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900886    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900889    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900891    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900894    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900896    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900900    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900902    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 20:46:23.904477 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900905    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900908    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900910    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900913    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900915    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900918    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900920    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900923    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900927    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900930    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900933    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900935    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900938    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900941    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900943    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900946    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900948    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900951    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900953    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900956    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 20:46:23.904960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900958    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900961    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900963    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900966    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900968    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900971    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900973    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900977    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900980    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900983    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900986    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900989    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900993    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.900997    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901000    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901003    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901005    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901008    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901010    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 20:46:23.905550 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901013    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901016    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901021    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901024    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901026    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901029    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901032    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901035    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901038    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901041    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901044    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901046    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901049    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901051    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901054    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901057    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901059    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901062    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901065    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901067    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 20:46:23.906050 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901070    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901142    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901149    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901156    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901162    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901169    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901175    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901182    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901186    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901190    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901193    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901196    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901200    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901203    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901211    2577 flags.go:64] FLAG: --cgroup-root=""
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901214    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901217    2577 flags.go:64] FLAG: --client-ca-file=""
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901220    2577 flags.go:64] FLAG: --cloud-provider="external"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901223    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901228    2577 flags.go:64] FLAG: --cluster-domain=""
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901231    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901235    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901238    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901242    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jun 06 20:46:23.906564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901245    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901248    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901251    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901255    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901258    2577 flags.go:64] FLAG: --contention-profiling="false"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901261    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901264    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901267    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901270    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901275    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901278    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901280    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901283    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901287    2577 flags.go:64] FLAG: --enable-server="true"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901290    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901306    2577 flags.go:64] FLAG: --event-burst="100"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901310    2577 flags.go:64] FLAG: --event-qps="50"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901313    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901316    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901319    2577 flags.go:64] FLAG: --eviction-hard=""
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901326    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901329    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901333    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901337    2577 flags.go:64] FLAG: --eviction-soft=""
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901340    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 06 20:46:23.907137 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901343    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901346    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901349    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901352    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901355    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901357    2577 flags.go:64] FLAG: --feature-gates=""
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901361    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901365    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901368    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901371    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901374    2577 flags.go:64] FLAG: --healthz-port="10248"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901377    2577 flags.go:64] FLAG: --help="false"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901380    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-129-66.ec2.internal"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901383    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901386    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901389    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901393    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901396    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901398    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901401    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901404    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901407    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901410    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901413    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jun 06 20:46:23.907771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901416    2577 flags.go:64] FLAG: --kube-reserved=""
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901419    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901422    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901426    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901429    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901433    2577 flags.go:64] FLAG: --lock-file=""
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901436    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901439    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901442    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901448    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901451    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901454    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901457    2577 flags.go:64] FLAG: --logging-format="text"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901460    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901463    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901466    2577 flags.go:64] FLAG: --manifest-url=""
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901469    2577 flags.go:64] FLAG: --manifest-url-header=""
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901474    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901477    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901481    2577 flags.go:64] FLAG: --max-pods="110"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901484    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901487    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901490    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901493    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901496    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 06 20:46:23.908447 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901499    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901501    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901509    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901512    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901515    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901518    2577 flags.go:64] FLAG: --pod-cidr=""
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901521    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901527    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901530    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901533    2577 flags.go:64] FLAG: --pods-per-core="0"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901536    2577 flags.go:64] FLAG: --port="10250"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901540    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901545    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c971fa10e29f3165"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901548    2577 flags.go:64] FLAG: --qos-reserved=""
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901551    2577 flags.go:64] FLAG: --read-only-port="10255"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901554    2577 flags.go:64] FLAG: --register-node="true"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901557    2577 flags.go:64] FLAG: --register-with-taints=""
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901561    2577 flags.go:64] FLAG: --registry-burst="10"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901563    2577 flags.go:64] FLAG: --registry-qps="5"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901566    2577 flags.go:64] FLAG: --reserved-cpus=""
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901569    2577 flags.go:64] FLAG: --reserved-memory=""
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901573    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901576    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901579    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901582    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 06 20:46:23.909544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901585    2577 flags.go:64] FLAG: --runonce="false"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901588    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901591    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901593    2577 flags.go:64] FLAG: --seccomp-default="false"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901596    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901599    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901602    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901605    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901608    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901611    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901614    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901617    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901619    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901622    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901626    2577 flags.go:64] FLAG: --system-cgroups=""
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901629    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901634    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901637    2577 flags.go:64] FLAG: --tls-cert-file=""
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901642    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901649    2577 flags.go:64] FLAG: --tls-min-version=""
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901652    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901655    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901658    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901661    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901664    2577 flags.go:64] FLAG: --v="2"
Jun 06 20:46:23.910622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901668    2577 flags.go:64] FLAG: --version="false"
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901672    2577 flags.go:64] FLAG: --vmodule=""
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901676    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.901680    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901802    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901805    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901809    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901812    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901815    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901817    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901820    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901823    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901825    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901828    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901830    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901833    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901835    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901838    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901841    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901844    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 20:46:23.911371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901847    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901850    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901853    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901855    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901858    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901862    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901866    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901868    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901871    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901874    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901876    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901879    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901881    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901884    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901886    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901889    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901891    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901894    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901896    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901899    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 20:46:23.911935 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901902    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901905    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901907    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901910    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901912    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901915    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901917    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901920    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901924    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901927    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901930    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901933    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901935    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901938    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901940    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901943    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901946    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901950    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901954    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 20:46:23.912877 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901957    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901959    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901962    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901964    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901967    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901969    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901972    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901975    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901979    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901981    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901984    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901987    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901989    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901992    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901994    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.901997    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902000    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902003    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902005    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 20:46:23.913556 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902008    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902011    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902013    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902016    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902018    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902022    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902025    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902028    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902031    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902033    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902036    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902041    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902045    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902047    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902050    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902053    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902055    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902058    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902060    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 20:46:23.914152 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902063    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 20:46:23.914963 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902065    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 20:46:23.914963 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902068    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 20:46:23.914963 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902070    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 20:46:23.914963 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902073    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 20:46:23.914963 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.902075    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 20:46:23.914963 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.903158    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 06 20:46:23.914963 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.910728    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 06 20:46:23.914963 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.910747    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 06 20:46:23.914963 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.911764    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 06 20:46:23.914963 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.911779    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 06 20:46:23.914963 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911871    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 20:46:23.914963 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911880    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 20:46:23.914963 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911886    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 20:46:23.914963 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911892    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 20:46:23.914963 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911897    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911902    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911906    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911913    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911919    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911924    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911928    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911933    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911939    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911943    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911947    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911951    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911955    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911959    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911964    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911968    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911972    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911977    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911981    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911986    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 20:46:23.915522 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911990    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911994    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.911998    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912003    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912008    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912012    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912016    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912022    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912026    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912030    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912035    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912039    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912043    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912047    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912052    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912056    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912061    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912065    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912069    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912074    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 20:46:23.916014 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912079    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912085    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912089    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912094    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912098    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912103    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912109    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912115    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912119    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912126    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912131    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912136    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912140    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912145    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912149    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912153    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912158    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912163    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912168    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 20:46:23.916592 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912172    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912176    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912181    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912185    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912189    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912193    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912198    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912202    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912206    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912210    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912214    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912219    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912223    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912236    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912241    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912247    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912251    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912256    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912260    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912264    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 20:46:23.917223 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912268    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 20:46:23.917775 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912273    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 20:46:23.917775 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912278    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 20:46:23.917775 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912282    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 20:46:23.917775 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912286    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 20:46:23.917775 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912290    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 20:46:23.917775 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912311    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 20:46:23.917775 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912316    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 20:46:23.917775 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912321    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 20:46:23.917775 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912327    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 20:46:23.917775 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912332    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 20:46:23.917775 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912337    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 20:46:23.917775 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912341    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 20:46:23.917775 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912346    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 20:46:23.917775 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912351    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 20:46:23.917775 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912355    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 20:46:23.918153 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.912363    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 06 20:46:23.918153 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912554    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 06 20:46:23.918153 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912563    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 06 20:46:23.918153 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912568    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 06 20:46:23.918153 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912572    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 06 20:46:23.918153 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912576    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 06 20:46:23.918153 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912581    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 06 20:46:23.918153 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912586    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 06 20:46:23.918153 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912590    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 06 20:46:23.918153 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912595    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 06 20:46:23.918153 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912599    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 06 20:46:23.918153 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912603    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 06 20:46:23.918153 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912608    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 06 20:46:23.918153 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912613    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 06 20:46:23.918153 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912617    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912623    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912629    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912634    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912639    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912644    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912649    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912653    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912657    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912661    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912666    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912671    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912675    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912679    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912684    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912688    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912693    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912697    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912701    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 06 20:46:23.918594 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912705    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912710    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912714    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912718    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912722    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912726    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912730    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912735    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912739    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912744    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912750    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912754    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912759    2577 feature_gate.go:328] unrecognized feature gate: Example
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912764    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912768    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912773    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912778    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912782    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912786    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912790    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 06 20:46:23.919120 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912794    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912798    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912804    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912808    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912813    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912817    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912821    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912825    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912830    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912835    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912839    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912843    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912849    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912854    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912858    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912863    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912867    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912872    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912876    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912879    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 06 20:46:23.919857 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912883    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912887    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912891    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912895    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912900    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912905    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912909    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912916    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912921    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912926    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912930    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912935    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912939    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912943    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912948    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912952    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912958    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912962    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912966    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 06 20:46:23.920380 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912970    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 06 20:46:23.921041 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912974    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 06 20:46:23.921041 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912979    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 06 20:46:23.921041 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912983    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 06 20:46:23.921041 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912987    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 06 20:46:23.921041 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912992    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 06 20:46:23.921041 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.912996    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 06 20:46:23.921041 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:23.913000    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 06 20:46:23.921041 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.913009    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 06 20:46:23.921041 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.913181    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 06 20:46:23.921041 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.916796    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 06 20:46:23.921041 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.918245    2577 server.go:1019] "Starting client certificate rotation"
Jun 06 20:46:23.921041 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.918361    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 06 20:46:23.921041 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.918403    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 06 20:46:23.922466 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.922441    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 06 20:46:23.927709 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.927687    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 06 20:46:23.938768 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.938750    2577 log.go:25] "Validated CRI v1 runtime API"
Jun 06 20:46:23.942426 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.942409    2577 log.go:25] "Validated CRI v1 image API"
Jun 06 20:46:23.942801 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.942783    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 06 20:46:23.943270 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.943254    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 06 20:46:23.946590 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.946571    2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a6221b91-1c2f-49b3-a97f-f17cae4ec828:/dev/nvme0n1p3 b2da416d-8c3e-48fd-b4a4-e01a8725930f:/dev/nvme0n1p4]
Jun 06 20:46:23.946637 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.946590    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 06 20:46:23.951753 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.951632    2577 manager.go:216] Machine: {Timestamp:2026-06-06 20:46:23.950321798 +0000 UTC m=+0.367133706 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099456 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26bd82c41709f2ab2aa65e009ff128 SystemUUID:ec26bd82-c417-09f2-ab2a-a65e009ff128 BootID:3afc3630-288c-4091-9efa-017b70e2c30b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6f:cc:db:46:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6f:cc:db:46:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:71:ff:58:9b:02 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 06 20:46:23.951753 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.951748    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 06 20:46:23.951862 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.951832    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 06 20:46:23.955120 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.955092    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 06 20:46:23.955259 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.955123    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-66.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 06 20:46:23.955796 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.955786    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jun 06 20:46:23.955828 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.955799    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jun 06 20:46:23.955828 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.955811    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 06 20:46:23.956237 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.956220    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 06 20:46:23.957080 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.957070    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 06 20:46:23.961144 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.961131    2577 state_mem.go:36] "Initialized new in-memory state store"
Jun 06 20:46:23.961256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.961247    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 06 20:46:23.961294 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.961278    2577 kubelet.go:486] "Attempting to sync node with API server"
Jun 06 20:46:23.961294 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.961289    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 06 20:46:23.961395 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.961315    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 06 20:46:23.961395 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.961326    2577 kubelet.go:398] "Adding apiserver pod source"
Jun 06 20:46:23.961395 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.961335    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 06 20:46:23.961772 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.961760    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 06 20:46:23.961857 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.961780    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 06 20:46:23.964714 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.964694    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 06 20:46:23.966068 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.966046    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 06 20:46:23.966130 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.966093    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 06 20:46:23.966197 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.966184    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-swzvm"
Jun 06 20:46:23.967018 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.967006    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 06 20:46:23.967061 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.967025    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 06 20:46:23.967061 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.967031    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 06 20:46:23.967061 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.967037    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 06 20:46:23.967061 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.967047    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 06 20:46:23.967061 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.967056    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 06 20:46:23.967193 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.967067    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 06 20:46:23.967193 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.967073    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 06 20:46:23.967193 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.967079    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 06 20:46:23.967193 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.967084    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 06 20:46:23.967193 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.967098    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 06 20:46:23.967193 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.967104    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 06 20:46:23.967901 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.967889    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 06 20:46:23.967901 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.967899    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 06 20:46:23.972125 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.972106    2577 server.go:1268] "Started kubelet"
Jun 06 20:46:23.972328 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.972189    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 06 20:46:23.972571 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:23.972546    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-66.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 06 20:46:23.972872 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.972822    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 06 20:46:23.972958 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.972903    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 06 20:46:23.973036 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.973015    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-swzvm"
Jun 06 20:46:23.973155 ip-10-0-129-66 systemd[1]: Started Kubernetes Kubelet.
Jun 06 20:46:23.973737 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.973567    2577 server.go:310] "Adding debug handlers to kubelet server"
Jun 06 20:46:23.974544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.974524    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 06 20:46:23.978689 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.978670    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 06 20:46:23.978689 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.978681    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 06 20:46:23.978970 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:23.978956    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-66.ec2.internal\" not found"
Jun 06 20:46:23.979263 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.979244    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 06 20:46:23.979263 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.979264    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 06 20:46:23.979423 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.979265    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 06 20:46:23.979423 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.979365    2577 reconstruct.go:97] "Volume reconstruction finished"
Jun 06 20:46:23.979423 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.979373    2577 reconciler.go:29] "Reconciler: start to sync state"
Jun 06 20:46:23.979599 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.979583    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 06 20:46:23.979699 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.979599    2577 factory.go:55] Registering systemd factory
Jun 06 20:46:23.979699 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.979609    2577 factory.go:223] Registration of the systemd container factory successfully
Jun 06 20:46:23.979815 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.979803    2577 factory.go:153] Registering CRI-O factory
Jun 06 20:46:23.979921 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.979823    2577 factory.go:223] Registration of the crio container factory successfully
Jun 06 20:46:23.979921 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.979849    2577 factory.go:103] Registering Raw factory
Jun 06 20:46:23.979921 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.979864    2577 manager.go:1196] Started watching for new ooms in manager
Jun 06 20:46:23.980052 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:23.979971    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 06 20:46:23.980315 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.980284    2577 manager.go:349] Starting recovery of all containers
Jun 06 20:46:23.983473 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.983453    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 20:46:23.991244 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.991206    2577 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-66.ec2.internal" not found
Jun 06 20:46:23.991618 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.991591    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 20:46:23.992747 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:23.992720    2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-66.ec2.internal\" not found" node="ip-10-0-129-66.ec2.internal"
Jun 06 20:46:23.993909 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.993894    2577 manager.go:354] Recovery completed
Jun 06 20:46:23.997734 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.997718    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 20:46:23.999482 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.999456    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 20:46:23.999533 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.999490    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 20:46:23.999533 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:23.999501    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasSufficientPID"
Jun 06 20:46:24.000062 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.000048    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 06 20:46:24.000114 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.000061    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 06 20:46:24.000114 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.000079    2577 state_mem.go:36] "Initialized new in-memory state store"
Jun 06 20:46:24.000114 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.000090    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 20:46:24.000792 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.000774    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 20:46:24.000857 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.000802    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 20:46:24.000857 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.000812    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasSufficientPID"
Jun 06 20:46:24.001183 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.001166    2577 policy_none.go:49] "None policy: Start"
Jun 06 20:46:24.001183 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.001185    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 06 20:46:24.001280 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.001194    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 06 20:46:24.002145 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.002135    2577 policy_none.go:47] "Start"
Jun 06 20:46:24.007668 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.007654    2577 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-66.ec2.internal" not found
Jun 06 20:46:24.041960 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.041945    2577 manager.go:337] "Starting Device Plugin manager"
Jun 06 20:46:24.053033 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.042007    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 06 20:46:24.053033 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.042020    2577 server.go:87] "Starting device plugin registration server"
Jun 06 20:46:24.053033 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.042317    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 06 20:46:24.053033 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.042335    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 06 20:46:24.053033 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.042402    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 06 20:46:24.053033 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.042535    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 06 20:46:24.053033 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.042544    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 06 20:46:24.053033 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.043345    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 06 20:46:24.053033 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.043387    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-66.ec2.internal\" not found"
Jun 06 20:46:24.053033 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.051820    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 06 20:46:24.053033 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.053018    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 06 20:46:24.053568 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.053064    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 06 20:46:24.053568 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.053089    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 06 20:46:24.053568 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.053123    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 06 20:46:24.055573 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.055555    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 20:46:24.065951 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.065935    2577 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-66.ec2.internal" not found
Jun 06 20:46:24.143321 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.143225    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 20:46:24.144480 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.144463    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 20:46:24.144571 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.144494    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 20:46:24.144571 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.144506    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasSufficientPID"
Jun 06 20:46:24.144571 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.144531    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.153251 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.153232    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-66.ec2.internal"]
Jun 06 20:46:24.153331 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.153319    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 20:46:24.154321 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.154286    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.154399 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.154328    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-66.ec2.internal\": node \"ip-10-0-129-66.ec2.internal\" not found"
Jun 06 20:46:24.154698 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.154682    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 20:46:24.154767 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.154714    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 20:46:24.154767 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.154729    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasSufficientPID"
Jun 06 20:46:24.155889 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.155870    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 20:46:24.155974 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.155961    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.156024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.155994    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 20:46:24.156588 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.156574    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 20:46:24.156588 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.156586    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 20:46:24.156684 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.156603    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 20:46:24.156684 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.156607    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 20:46:24.156684 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.156616    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasSufficientPID"
Jun 06 20:46:24.156684 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.156622    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasSufficientPID"
Jun 06 20:46:24.157787 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.157773    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.157846 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.157795    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 06 20:46:24.158475 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.158459    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasSufficientMemory"
Jun 06 20:46:24.158556 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.158490    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasNoDiskPressure"
Jun 06 20:46:24.158556 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.158504    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeHasSufficientPID"
Jun 06 20:46:24.171116 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.171089    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-66.ec2.internal\" not found"
Jun 06 20:46:24.186048 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.186029    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-66.ec2.internal\" not found" node="ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.190499 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.190484    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-66.ec2.internal\" not found" node="ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.271764 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.271732    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-66.ec2.internal\" not found"
Jun 06 20:46:24.281022 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.280999    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7aeac4d5e87cfcd67914db9513951415-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal\" (UID: \"7aeac4d5e87cfcd67914db9513951415\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.281110 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.281027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7aeac4d5e87cfcd67914db9513951415-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal\" (UID: \"7aeac4d5e87cfcd67914db9513951415\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.281110 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.281044    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95af39ec743638abd6f8b98dcef4d6d0-config\") pod \"kube-apiserver-proxy-ip-10-0-129-66.ec2.internal\" (UID: \"95af39ec743638abd6f8b98dcef4d6d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.372710 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.372665    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-66.ec2.internal\" not found"
Jun 06 20:46:24.382040 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.382022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7aeac4d5e87cfcd67914db9513951415-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal\" (UID: \"7aeac4d5e87cfcd67914db9513951415\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.382109 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.382049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7aeac4d5e87cfcd67914db9513951415-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal\" (UID: \"7aeac4d5e87cfcd67914db9513951415\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.382109 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.382081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95af39ec743638abd6f8b98dcef4d6d0-config\") pod \"kube-apiserver-proxy-ip-10-0-129-66.ec2.internal\" (UID: \"95af39ec743638abd6f8b98dcef4d6d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.382170 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.382114    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95af39ec743638abd6f8b98dcef4d6d0-config\") pod \"kube-apiserver-proxy-ip-10-0-129-66.ec2.internal\" (UID: \"95af39ec743638abd6f8b98dcef4d6d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.382170 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.382118    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7aeac4d5e87cfcd67914db9513951415-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal\" (UID: \"7aeac4d5e87cfcd67914db9513951415\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.382170 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.382114    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7aeac4d5e87cfcd67914db9513951415-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal\" (UID: \"7aeac4d5e87cfcd67914db9513951415\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.473547 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.473471    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-66.ec2.internal\" not found"
Jun 06 20:46:24.489925 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.489895    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.494571 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.494526    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.574392 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.574346    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-66.ec2.internal\" not found"
Jun 06 20:46:24.674871 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.674827    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-66.ec2.internal\" not found"
Jun 06 20:46:24.775362 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.775329    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-66.ec2.internal\" not found"
Jun 06 20:46:24.818859 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.818822    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 20:46:24.879981 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.879952    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.890126 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.890101    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 06 20:46:24.891281 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.891259    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal"
Jun 06 20:46:24.901752 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.901720    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 06 20:46:24.917918 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.917892    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 06 20:46:24.918104 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.918079    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 06 20:46:24.918104 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.918089    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 06 20:46:24.918236 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.918102    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 06 20:46:24.918236 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.918089    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 06 20:46:24.943260 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:24.943029    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aeac4d5e87cfcd67914db9513951415.slice/crio-4f83016bdb52f1e235a59a905d96048f9c18f1741ba6e1fce49524baa1da0baf WatchSource:0}: Error finding container 4f83016bdb52f1e235a59a905d96048f9c18f1741ba6e1fce49524baa1da0baf: Status 404 returned error can't find the container with id 4f83016bdb52f1e235a59a905d96048f9c18f1741ba6e1fce49524baa1da0baf
Jun 06 20:46:24.943578 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:24.943556    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95af39ec743638abd6f8b98dcef4d6d0.slice/crio-878ed0b09d91ad45b369e8fcd9c44c11ae0680ba090a59ed4aa9f59b4ee73555 WatchSource:0}: Error finding container 878ed0b09d91ad45b369e8fcd9c44c11ae0680ba090a59ed4aa9f59b4ee73555: Status 404 returned error can't find the container with id 878ed0b09d91ad45b369e8fcd9c44c11ae0680ba090a59ed4aa9f59b4ee73555
Jun 06 20:46:24.949562 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.949542    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 06 20:46:24.962375 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.962356    2577 apiserver.go:52] "Watching apiserver"
Jun 06 20:46:24.970542 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.970520    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 06 20:46:24.972238 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.971777    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-wlzv5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal","openshift-multus/multus-additional-cni-plugins-89fxb","openshift-network-diagnostics/network-check-target-xdz66","kube-system/global-pull-secret-syncer-gr6fv","openshift-cluster-node-tuning-operator/tuned-p4tf9","openshift-multus/multus-zqf2v","openshift-multus/network-metrics-daemon-4lgs6","openshift-network-operator/iptables-alerter-qlrjz","openshift-ovn-kubernetes/ovnkube-node-f47nm","kube-system/konnectivity-agent-rkrcj","kube-system/kube-apiserver-proxy-ip-10-0-129-66.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf","openshift-dns/node-resolver-wx7qf"]
Jun 06 20:46:24.974086 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.974068    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wlzv5"
Jun 06 20:46:24.975183 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.975164    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:24.976132 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.976111    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:24.976241 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.976185    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:24.976540 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.976523    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 06 20:46:24.976619 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.976526    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-prpcd\""
Jun 06 20:46:24.976673 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.976648    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 06 20:46:24.976982 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.976962    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 06 20:46:24.977073 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.977044    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:24.977135 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.977110    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:24.977605 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.977585    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 06 20:46:24.977709 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.977645    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hdpqc\""
Jun 06 20:46:24.977709 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.977653    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 06 20:46:24.977896 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.977879    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 06 20:46:24.977896 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.977891    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 06 20:46:24.978371 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.978352    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 06 20:46:24.978522 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.978466    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-05 20:41:23 +0000 UTC" deadline="2028-01-31 16:30:01.897469556 +0000 UTC"
Jun 06 20:46:24.978606 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.978522    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14491h43m36.918950577s"
Jun 06 20:46:24.978678 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.978641    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:24.978831 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.978811    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 06 20:46:24.979801 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.979782    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.980779 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.980751    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-whdd6\""
Jun 06 20:46:24.980895 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.980816    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 06 20:46:24.981013 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.980995    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 06 20:46:24.981069 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.981048    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:24.981413 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:24.981114    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:24.981801 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.981769    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 06 20:46:24.982048 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.982035    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rcbvw\""
Jun 06 20:46:24.982363 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.982343    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qlrjz"
Jun 06 20:46:24.983727 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.983693    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:24.984682 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.984662    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 06 20:46:24.984787 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.984772    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wsnjm\""
Jun 06 20:46:24.984864 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.984806    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 06 20:46:24.984909 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.984871    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 06 20:46:24.985115 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985097    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rkrcj"
Jun 06 20:46:24.985364 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985345    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65pq8\" (UniqueName: \"kubernetes.io/projected/ee039af8-9795-4768-a9f3-e84e68fa3119-kube-api-access-65pq8\") pod \"node-ca-wlzv5\" (UID: \"ee039af8-9795-4768-a9f3-e84e68fa3119\") " pod="openshift-image-registry/node-ca-wlzv5"
Jun 06 20:46:24.985438 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985371    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-kubernetes\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:24.985438 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985391    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-multus-cni-dir\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.985438 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985414    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-multus-socket-dir-parent\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.985591 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985444    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-var-lib-kubelet\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.985591 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985479    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/909f3c74-4924-486d-b0ec-f256d44d4ae7-os-release\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:24.985591 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985526    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dtr4\" (UniqueName: \"kubernetes.io/projected/909f3c74-4924-486d-b0ec-f256d44d4ae7-kube-api-access-7dtr4\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:24.985591 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985556    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b5f56b4d-6637-4296-9138-3b407b3c6737-dbus\") pod \"global-pull-secret-syncer-gr6fv\" (UID: \"b5f56b4d-6637-4296-9138-3b407b3c6737\") " pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:24.985591 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985588    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret\") pod \"global-pull-secret-syncer-gr6fv\" (UID: \"b5f56b4d-6637-4296-9138-3b407b3c6737\") " pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:24.985824 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-systemd\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:24.985824 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985636    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grwg6\" (UniqueName: \"kubernetes.io/projected/df347c8e-0a99-4696-a204-711236d2ceae-kube-api-access-grwg6\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:24.985824 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985660    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-var-lib-cni-multus\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.985824 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-multus-conf-dir\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.985824 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985722    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/984f3c68-db04-4590-abfb-4a1e4fe904ba-multus-daemon-config\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.985824 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985743    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/909f3c74-4924-486d-b0ec-f256d44d4ae7-cnibin\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:24.985824 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/909f3c74-4924-486d-b0ec-f256d44d4ae7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:24.985824 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985792    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/909f3c74-4924-486d-b0ec-f256d44d4ae7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:24.986103 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985831    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-lib-modules\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:24.986103 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985867    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-host\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:24.986103 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985891    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-os-release\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.986103 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985936    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee039af8-9795-4768-a9f3-e84e68fa3119-serviceca\") pod \"node-ca-wlzv5\" (UID: \"ee039af8-9795-4768-a9f3-e84e68fa3119\") " pod="openshift-image-registry/node-ca-wlzv5"
Jun 06 20:46:24.986103 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985969    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/909f3c74-4924-486d-b0ec-f256d44d4ae7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:24.986103 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.985972    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 06 20:46:24.986103 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986050    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-sysctl-d\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:24.986103 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986088    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-sysctl-conf\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:24.986484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986112    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-run-k8s-cni-cncf-io\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.986484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-run-netns\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.986484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986143    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 06 20:46:24.986484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-sysconfig\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:24.986484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986137    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 06 20:46:24.986484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-run\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:24.986484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-sys\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:24.986484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986244    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-var-lib-kubelet\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:24.986484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986260    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df347c8e-0a99-4696-a204-711236d2ceae-tmp\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:24.986484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986271    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2th5g\""
Jun 06 20:46:24.986484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986274    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-etc-kubernetes\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.986484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee039af8-9795-4768-a9f3-e84e68fa3119-host\") pod \"node-ca-wlzv5\" (UID: \"ee039af8-9795-4768-a9f3-e84e68fa3119\") " pod="openshift-image-registry/node-ca-wlzv5"
Jun 06 20:46:24.986484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986409    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/909f3c74-4924-486d-b0ec-f256d44d4ae7-system-cni-dir\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:24.986484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986430    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-modprobe-d\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:24.986484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986467    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-system-cni-dir\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.987090 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986514    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:24.987090 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986563    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-cnibin\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.987090 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986587    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4dcs\" (UniqueName: \"kubernetes.io/projected/984f3c68-db04-4590-abfb-4a1e4fe904ba-kube-api-access-s4dcs\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.987090 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986603    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/909f3c74-4924-486d-b0ec-f256d44d4ae7-cni-binary-copy\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:24.987090 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df347c8e-0a99-4696-a204-711236d2ceae-etc-tuned\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:24.987090 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986632    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/984f3c68-db04-4590-abfb-4a1e4fe904ba-cni-binary-copy\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.987090 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986655    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-var-lib-cni-bin\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.987090 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986681    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-hostroot\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.987090 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986714    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-run-multus-certs\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:24.987090 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986740    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s8xj\" (UniqueName: \"kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj\") pod \"network-check-target-xdz66\" (UID: \"2903038a-8636-4ffc-b799-46bea55ec8ba\") " pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:24.987090 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.986779    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b5f56b4d-6637-4296-9138-3b407b3c6737-kubelet-config\") pod \"global-pull-secret-syncer-gr6fv\" (UID: \"b5f56b4d-6637-4296-9138-3b407b3c6737\") " pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:24.987571 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.987269    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 06 20:46:24.987571 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.987328    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 06 20:46:24.987571 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.987333    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 06 20:46:24.987571 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.987533    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 06 20:46:24.987571 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.987537    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-89j2r\""
Jun 06 20:46:24.987764 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.987693    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 06 20:46:24.988696 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.988607    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c8cfm\""
Jun 06 20:46:24.989322 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.989103    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 06 20:46:24.990520 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.989366    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 06 20:46:24.990520 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.990114    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wx7qf"
Jun 06 20:46:24.990520 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.990169    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 06 20:46:24.990520 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.990278    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 06 20:46:24.992855 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.992831    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 06 20:46:24.992962 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.992943    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 06 20:46:24.993062 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:24.992943    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rhcpf\""
Jun 06 20:46:25.010579 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.010557    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k4hgd"
Jun 06 20:46:25.018065 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.018048    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k4hgd"
Jun 06 20:46:25.057229 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.057181    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal" event={"ID":"7aeac4d5e87cfcd67914db9513951415","Type":"ContainerStarted","Data":"4f83016bdb52f1e235a59a905d96048f9c18f1741ba6e1fce49524baa1da0baf"}
Jun 06 20:46:25.058411 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.058365    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-66.ec2.internal" event={"ID":"95af39ec743638abd6f8b98dcef4d6d0","Type":"ContainerStarted","Data":"878ed0b09d91ad45b369e8fcd9c44c11ae0680ba090a59ed4aa9f59b4ee73555"}
Jun 06 20:46:25.079916 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.079893    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 06 20:46:25.087669 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.087650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-kubernetes\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.087765 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.087676    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-multus-cni-dir\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.087765 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.087693    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/909f3c74-4924-486d-b0ec-f256d44d4ae7-os-release\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.087765 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.087711    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e0286ab0-38a1-4800-8e7f-e8574c4e24b0-iptables-alerter-script\") pod \"iptables-alerter-qlrjz\" (UID: \"e0286ab0-38a1-4800-8e7f-e8574c4e24b0\") " pod="openshift-network-operator/iptables-alerter-qlrjz"
Jun 06 20:46:25.087765 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.087741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-run-netns\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.087765 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.087766    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-ovnkube-config\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.087970 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.087788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-systemd\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.087970 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.087794    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-kubernetes\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.087970 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.087806    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grwg6\" (UniqueName: \"kubernetes.io/projected/df347c8e-0a99-4696-a204-711236d2ceae-kube-api-access-grwg6\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.087970 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.087865    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-multus-cni-dir\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.087970 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.087886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-var-lib-cni-multus\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.087970 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.087886    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/909f3c74-4924-486d-b0ec-f256d44d4ae7-os-release\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.087970 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.087915    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-systemd\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.088274 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.087983    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-multus-conf-dir\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.088274 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.087999    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-var-lib-cni-multus\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.088274 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088046    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/909f3c74-4924-486d-b0ec-f256d44d4ae7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.088274 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088075    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-multus-conf-dir\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.088274 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/909f3c74-4924-486d-b0ec-f256d44d4ae7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.088274 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088153    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-run-openvswitch\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.088274 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088216    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-cni-bin\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.088274 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-host\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.088274 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-os-release\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088286    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-slash\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088285    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/909f3c74-4924-486d-b0ec-f256d44d4ae7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088317    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-run-systemd\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088343    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-os-release\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088354    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-host\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088346    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-sysctl-d\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088438    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-run-k8s-cni-cncf-io\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088460    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-run-netns\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088475    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-sysctl-d\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088479    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-env-overrides\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088499    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-ovn-node-metrics-cert\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088509    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-run-k8s-cni-cncf-io\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088521    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-sysconfig\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088527    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-run-netns\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-var-lib-kubelet\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.088878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088570    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-sysconfig\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088576    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df347c8e-0a99-4696-a204-711236d2ceae-tmp\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee039af8-9795-4768-a9f3-e84e68fa3119-host\") pod \"node-ca-wlzv5\" (UID: \"ee039af8-9795-4768-a9f3-e84e68fa3119\") " pod="openshift-image-registry/node-ca-wlzv5"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088615    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-var-lib-kubelet\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/909f3c74-4924-486d-b0ec-f256d44d4ae7-system-cni-dir\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088638    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/909f3c74-4924-486d-b0ec-f256d44d4ae7-system-cni-dir\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088642    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-sys-fs\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088638    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee039af8-9795-4768-a9f3-e84e68fa3119-host\") pod \"node-ca-wlzv5\" (UID: \"ee039af8-9795-4768-a9f3-e84e68fa3119\") " pod="openshift-image-registry/node-ca-wlzv5"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-modprobe-d\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088692    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-system-cni-dir\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088716    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs\") pod \"network-metrics-daemon-4lgs6\" (UID: \"896e1cee-2420-4fa5-b96b-40d4639695dc\") " pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088734    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-modprobe-d\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/984f3c68-db04-4590-abfb-4a1e4fe904ba-cni-binary-copy\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088747    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-system-cni-dir\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-var-lib-cni-bin\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088782    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/909f3c74-4924-486d-b0ec-f256d44d4ae7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088853    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-run-multus-certs\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.089484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088880    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-var-lib-cni-bin\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088910    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s8xj\" (UniqueName: \"kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj\") pod \"network-check-target-xdz66\" (UID: \"2903038a-8636-4ffc-b799-46bea55ec8ba\") " pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088920    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-run-multus-certs\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088950    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-etc-selinux\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.088979    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd4d2\" (UniqueName: \"kubernetes.io/projected/67260f7f-1f82-4f8f-b940-feb80fa3f644-kube-api-access-bd4d2\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089023    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-node-log\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089096    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-log-socket\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089122    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65pq8\" (UniqueName: \"kubernetes.io/projected/ee039af8-9795-4768-a9f3-e84e68fa3119-kube-api-access-65pq8\") pod \"node-ca-wlzv5\" (UID: \"ee039af8-9795-4768-a9f3-e84e68fa3119\") " pod="openshift-image-registry/node-ca-wlzv5"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089190    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/984f3c68-db04-4590-abfb-4a1e4fe904ba-cni-binary-copy\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089215    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-socket-dir\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089243    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-device-dir\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089266    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-var-lib-openvswitch\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089311    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-multus-socket-dir-parent\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089343    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-var-lib-kubelet\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089367    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dtr4\" (UniqueName: \"kubernetes.io/projected/909f3c74-4924-486d-b0ec-f256d44d4ae7-kube-api-access-7dtr4\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089435    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-host-var-lib-kubelet\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.090256 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089442    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-multus-socket-dir-parent\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089459    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b5f56b4d-6637-4296-9138-3b407b3c6737-dbus\") pod \"global-pull-secret-syncer-gr6fv\" (UID: \"b5f56b4d-6637-4296-9138-3b407b3c6737\") " pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089486    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret\") pod \"global-pull-secret-syncer-gr6fv\" (UID: \"b5f56b4d-6637-4296-9138-3b407b3c6737\") " pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/984f3c68-db04-4590-abfb-4a1e4fe904ba-multus-daemon-config\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089534    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/909f3c74-4924-486d-b0ec-f256d44d4ae7-cnibin\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089575    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/909f3c74-4924-486d-b0ec-f256d44d4ae7-cnibin\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089596    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b5f56b4d-6637-4296-9138-3b407b3c6737-dbus\") pod \"global-pull-secret-syncer-gr6fv\" (UID: \"b5f56b4d-6637-4296-9138-3b407b3c6737\") " pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:25.089608    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089631    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd6a7ac9-3f6d-403f-bb25-9ec8dc131337-agent-certs\") pod \"konnectivity-agent-rkrcj\" (UID: \"dd6a7ac9-3f6d-403f-bb25-9ec8dc131337\") " pod="kube-system/konnectivity-agent-rkrcj"
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:25.089669    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret podName:b5f56b4d-6637-4296-9138-3b407b3c6737 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:25.589649237 +0000 UTC m=+2.006461151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret") pod "global-pull-secret-syncer-gr6fv" (UID: "b5f56b4d-6637-4296-9138-3b407b3c6737") : object "kube-system"/"original-pull-secret" not registered
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089691    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-lib-modules\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089734    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee039af8-9795-4768-a9f3-e84e68fa3119-serviceca\") pod \"node-ca-wlzv5\" (UID: \"ee039af8-9795-4768-a9f3-e84e68fa3119\") " pod="openshift-image-registry/node-ca-wlzv5"
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089758    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/909f3c74-4924-486d-b0ec-f256d44d4ae7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089757    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-lib-modules\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089782    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-sysctl-conf\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089809    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a3a545a-09f9-43df-a03d-452a58df3e9e-tmp-dir\") pod \"node-resolver-wx7qf\" (UID: \"7a3a545a-09f9-43df-a03d-452a58df3e9e\") " pod="openshift-dns/node-resolver-wx7qf"
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089851    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-ovnkube-script-lib\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.090821 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089876    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd6a7ac9-3f6d-403f-bb25-9ec8dc131337-konnectivity-ca\") pod \"konnectivity-agent-rkrcj\" (UID: \"dd6a7ac9-3f6d-403f-bb25-9ec8dc131337\") " pod="kube-system/konnectivity-agent-rkrcj"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089901    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-run\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-sys\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089964    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-etc-kubernetes\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/909f3c74-4924-486d-b0ec-f256d44d4ae7-cni-binary-copy\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089936    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-etc-sysctl-conf\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.089995    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-run\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090038    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-etc-kubernetes\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090074    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/984f3c68-db04-4590-abfb-4a1e4fe904ba-multus-daemon-config\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090055    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df347c8e-0a99-4696-a204-711236d2ceae-sys\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090182    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee039af8-9795-4768-a9f3-e84e68fa3119-serviceca\") pod \"node-ca-wlzv5\" (UID: \"ee039af8-9795-4768-a9f3-e84e68fa3119\") " pod="openshift-image-registry/node-ca-wlzv5"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-registration-dir\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090551    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-etc-openvswitch\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-run-ovn\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090601    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-cni-netd\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090627    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-cnibin\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090653    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4dcs\" (UniqueName: \"kubernetes.io/projected/984f3c68-db04-4590-abfb-4a1e4fe904ba-kube-api-access-s4dcs\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090659    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/909f3c74-4924-486d-b0ec-f256d44d4ae7-cni-binary-copy\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.091446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090678    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a3a545a-09f9-43df-a03d-452a58df3e9e-hosts-file\") pod \"node-resolver-wx7qf\" (UID: \"7a3a545a-09f9-43df-a03d-452a58df3e9e\") " pod="openshift-dns/node-resolver-wx7qf"
Jun 06 20:46:25.091929 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090722    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-cnibin\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.091929 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090789    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/909f3c74-4924-486d-b0ec-f256d44d4ae7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.091929 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090791    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb64m\" (UniqueName: \"kubernetes.io/projected/7a3a545a-09f9-43df-a03d-452a58df3e9e-kube-api-access-vb64m\") pod \"node-resolver-wx7qf\" (UID: \"7a3a545a-09f9-43df-a03d-452a58df3e9e\") " pod="openshift-dns/node-resolver-wx7qf"
Jun 06 20:46:25.091929 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090837    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0286ab0-38a1-4800-8e7f-e8574c4e24b0-host-slash\") pod \"iptables-alerter-qlrjz\" (UID: \"e0286ab0-38a1-4800-8e7f-e8574c4e24b0\") " pod="openshift-network-operator/iptables-alerter-qlrjz"
Jun 06 20:46:25.091929 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090861    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-kubelet\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.091929 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090885    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-systemd-units\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.091929 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090904    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df347c8e-0a99-4696-a204-711236d2ceae-etc-tuned\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.091929 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-hostroot\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.091929 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090936    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b5f56b4d-6637-4296-9138-3b407b3c6737-kubelet-config\") pod \"global-pull-secret-syncer-gr6fv\" (UID: \"b5f56b4d-6637-4296-9138-3b407b3c6737\") " pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:25.091929 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090953    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkbt8\" (UniqueName: \"kubernetes.io/projected/e0286ab0-38a1-4800-8e7f-e8574c4e24b0-kube-api-access-jkbt8\") pod \"iptables-alerter-qlrjz\" (UID: \"e0286ab0-38a1-4800-8e7f-e8574c4e24b0\") " pod="openshift-network-operator/iptables-alerter-qlrjz"
Jun 06 20:46:25.091929 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090979    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4vts\" (UniqueName: \"kubernetes.io/projected/896e1cee-2420-4fa5-b96b-40d4639695dc-kube-api-access-h4vts\") pod \"network-metrics-daemon-4lgs6\" (UID: \"896e1cee-2420-4fa5-b96b-40d4639695dc\") " pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:25.091929 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090983    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/984f3c68-db04-4590-abfb-4a1e4fe904ba-hostroot\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.091929 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.090999    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-run-ovn-kubernetes\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.091929 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.091012    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b5f56b4d-6637-4296-9138-3b407b3c6737-kubelet-config\") pod \"global-pull-secret-syncer-gr6fv\" (UID: \"b5f56b4d-6637-4296-9138-3b407b3c6737\") " pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:25.091929 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.091017    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wppx\" (UniqueName: \"kubernetes.io/projected/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-kube-api-access-5wppx\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.091929 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.091892    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df347c8e-0a99-4696-a204-711236d2ceae-tmp\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.092863 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.092842    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df347c8e-0a99-4696-a204-711236d2ceae-etc-tuned\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.097048 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:25.096556    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 20:46:25.097048 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:25.096583    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 20:46:25.097048 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:25.096598    2577 projected.go:196] Error preparing data for projected volume kube-api-access-6s8xj for pod openshift-network-diagnostics/network-check-target-xdz66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 20:46:25.097048 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:25.096684    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj podName:2903038a-8636-4ffc-b799-46bea55ec8ba nodeName:}" failed. No retries permitted until 2026-06-06 20:46:25.596665004 +0000 UTC m=+2.013476919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6s8xj" (UniqueName: "kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj") pod "network-check-target-xdz66" (UID: "2903038a-8636-4ffc-b799-46bea55ec8ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 20:46:25.097362 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.097078    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grwg6\" (UniqueName: \"kubernetes.io/projected/df347c8e-0a99-4696-a204-711236d2ceae-kube-api-access-grwg6\") pod \"tuned-p4tf9\" (UID: \"df347c8e-0a99-4696-a204-711236d2ceae\") " pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.099577 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.097695    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65pq8\" (UniqueName: \"kubernetes.io/projected/ee039af8-9795-4768-a9f3-e84e68fa3119-kube-api-access-65pq8\") pod \"node-ca-wlzv5\" (UID: \"ee039af8-9795-4768-a9f3-e84e68fa3119\") " pod="openshift-image-registry/node-ca-wlzv5"
Jun 06 20:46:25.099577 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.098903    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dtr4\" (UniqueName: \"kubernetes.io/projected/909f3c74-4924-486d-b0ec-f256d44d4ae7-kube-api-access-7dtr4\") pod \"multus-additional-cni-plugins-89fxb\" (UID: \"909f3c74-4924-486d-b0ec-f256d44d4ae7\") " pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.101313 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.101270    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4dcs\" (UniqueName: \"kubernetes.io/projected/984f3c68-db04-4590-abfb-4a1e4fe904ba-kube-api-access-s4dcs\") pod \"multus-zqf2v\" (UID: \"984f3c68-db04-4590-abfb-4a1e4fe904ba\") " pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.191549 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191513    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-log-socket\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.191549 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.191762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191574    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-socket-dir\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.191762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191597    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-device-dir\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.191762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191621    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-var-lib-openvswitch\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.191762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191622    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-log-socket\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.191762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191660    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-var-lib-openvswitch\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.191762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191664    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.191762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191684    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-device-dir\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.191762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191734    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-socket-dir\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.191762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd6a7ac9-3f6d-403f-bb25-9ec8dc131337-agent-certs\") pod \"konnectivity-agent-rkrcj\" (UID: \"dd6a7ac9-3f6d-403f-bb25-9ec8dc131337\") " pod="kube-system/konnectivity-agent-rkrcj"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191776    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a3a545a-09f9-43df-a03d-452a58df3e9e-tmp-dir\") pod \"node-resolver-wx7qf\" (UID: \"7a3a545a-09f9-43df-a03d-452a58df3e9e\") " pod="openshift-dns/node-resolver-wx7qf"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191803    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-ovnkube-script-lib\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191829    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd6a7ac9-3f6d-403f-bb25-9ec8dc131337-konnectivity-ca\") pod \"konnectivity-agent-rkrcj\" (UID: \"dd6a7ac9-3f6d-403f-bb25-9ec8dc131337\") " pod="kube-system/konnectivity-agent-rkrcj"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-registration-dir\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191880    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-etc-openvswitch\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191903    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-run-ovn\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-cni-netd\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a3a545a-09f9-43df-a03d-452a58df3e9e-hosts-file\") pod \"node-resolver-wx7qf\" (UID: \"7a3a545a-09f9-43df-a03d-452a58df3e9e\") " pod="openshift-dns/node-resolver-wx7qf"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191958    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-registration-dir\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191974    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb64m\" (UniqueName: \"kubernetes.io/projected/7a3a545a-09f9-43df-a03d-452a58df3e9e-kube-api-access-vb64m\") pod \"node-resolver-wx7qf\" (UID: \"7a3a545a-09f9-43df-a03d-452a58df3e9e\") " pod="openshift-dns/node-resolver-wx7qf"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.191999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0286ab0-38a1-4800-8e7f-e8574c4e24b0-host-slash\") pod \"iptables-alerter-qlrjz\" (UID: \"e0286ab0-38a1-4800-8e7f-e8574c4e24b0\") " pod="openshift-network-operator/iptables-alerter-qlrjz"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192008    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-cni-netd\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192008    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-etc-openvswitch\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-kubelet\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192065    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-run-ovn\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192068    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-systemd-units\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.192218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkbt8\" (UniqueName: \"kubernetes.io/projected/e0286ab0-38a1-4800-8e7f-e8574c4e24b0-kube-api-access-jkbt8\") pod \"iptables-alerter-qlrjz\" (UID: \"e0286ab0-38a1-4800-8e7f-e8574c4e24b0\") " pod="openshift-network-operator/iptables-alerter-qlrjz"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4vts\" (UniqueName: \"kubernetes.io/projected/896e1cee-2420-4fa5-b96b-40d4639695dc-kube-api-access-h4vts\") pod \"network-metrics-daemon-4lgs6\" (UID: \"896e1cee-2420-4fa5-b96b-40d4639695dc\") " pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192149    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0286ab0-38a1-4800-8e7f-e8574c4e24b0-host-slash\") pod \"iptables-alerter-qlrjz\" (UID: \"e0286ab0-38a1-4800-8e7f-e8574c4e24b0\") " pod="openshift-network-operator/iptables-alerter-qlrjz"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192153    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a3a545a-09f9-43df-a03d-452a58df3e9e-tmp-dir\") pod \"node-resolver-wx7qf\" (UID: \"7a3a545a-09f9-43df-a03d-452a58df3e9e\") " pod="openshift-dns/node-resolver-wx7qf"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-run-ovn-kubernetes\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192113    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-systemd-units\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192195    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-kubelet\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wppx\" (UniqueName: \"kubernetes.io/projected/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-kube-api-access-5wppx\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192237    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e0286ab0-38a1-4800-8e7f-e8574c4e24b0-iptables-alerter-script\") pod \"iptables-alerter-qlrjz\" (UID: \"e0286ab0-38a1-4800-8e7f-e8574c4e24b0\") " pod="openshift-network-operator/iptables-alerter-qlrjz"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192271    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-run-netns\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192314    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-ovnkube-config\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192330    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a3a545a-09f9-43df-a03d-452a58df3e9e-hosts-file\") pod \"node-resolver-wx7qf\" (UID: \"7a3a545a-09f9-43df-a03d-452a58df3e9e\") " pod="openshift-dns/node-resolver-wx7qf"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192347    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-run-openvswitch\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192377    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-run-netns\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192395    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-run-openvswitch\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192460    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-ovnkube-script-lib\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192475    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-run-ovn-kubernetes\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192484    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-cni-bin\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192461    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dd6a7ac9-3f6d-403f-bb25-9ec8dc131337-konnectivity-ca\") pod \"konnectivity-agent-rkrcj\" (UID: \"dd6a7ac9-3f6d-403f-bb25-9ec8dc131337\") " pod="kube-system/konnectivity-agent-rkrcj"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192520    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-slash\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192522    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-cni-bin\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-run-systemd\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192575    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-slash\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-env-overrides\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192614    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-run-systemd\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192620    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-ovn-node-metrics-cert\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-sys-fs\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192697    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs\") pod \"network-metrics-daemon-4lgs6\" (UID: \"896e1cee-2420-4fa5-b96b-40d4639695dc\") " pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192625    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192741    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-etc-selinux\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd4d2\" (UniqueName: \"kubernetes.io/projected/67260f7f-1f82-4f8f-b940-feb80fa3f644-kube-api-access-bd4d2\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192774    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-sys-fs\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-node-log\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.193567 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192823    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/67260f7f-1f82-4f8f-b940-feb80fa3f644-etc-selinux\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.194035 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192853    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-node-log\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.194035 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:25.192910    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 20:46:25.194035 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:25.192976    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs podName:896e1cee-2420-4fa5-b96b-40d4639695dc nodeName:}" failed. No retries permitted until 2026-06-06 20:46:25.692958425 +0000 UTC m=+2.109770327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs") pod "network-metrics-daemon-4lgs6" (UID: "896e1cee-2420-4fa5-b96b-40d4639695dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 20:46:25.194035 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192988    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-ovnkube-config\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.194035 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.192995    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e0286ab0-38a1-4800-8e7f-e8574c4e24b0-iptables-alerter-script\") pod \"iptables-alerter-qlrjz\" (UID: \"e0286ab0-38a1-4800-8e7f-e8574c4e24b0\") " pod="openshift-network-operator/iptables-alerter-qlrjz"
Jun 06 20:46:25.194035 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.193017    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-env-overrides\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.194244 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.194228    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dd6a7ac9-3f6d-403f-bb25-9ec8dc131337-agent-certs\") pod \"konnectivity-agent-rkrcj\" (UID: \"dd6a7ac9-3f6d-403f-bb25-9ec8dc131337\") " pod="kube-system/konnectivity-agent-rkrcj"
Jun 06 20:46:25.194707 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.194689    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-ovn-node-metrics-cert\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.201253 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.201225    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkbt8\" (UniqueName: \"kubernetes.io/projected/e0286ab0-38a1-4800-8e7f-e8574c4e24b0-kube-api-access-jkbt8\") pod \"iptables-alerter-qlrjz\" (UID: \"e0286ab0-38a1-4800-8e7f-e8574c4e24b0\") " pod="openshift-network-operator/iptables-alerter-qlrjz"
Jun 06 20:46:25.201443 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.201375    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb64m\" (UniqueName: \"kubernetes.io/projected/7a3a545a-09f9-43df-a03d-452a58df3e9e-kube-api-access-vb64m\") pod \"node-resolver-wx7qf\" (UID: \"7a3a545a-09f9-43df-a03d-452a58df3e9e\") " pod="openshift-dns/node-resolver-wx7qf"
Jun 06 20:46:25.201700 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.201681    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd4d2\" (UniqueName: \"kubernetes.io/projected/67260f7f-1f82-4f8f-b940-feb80fa3f644-kube-api-access-bd4d2\") pod \"aws-ebs-csi-driver-node-jf7sf\" (UID: \"67260f7f-1f82-4f8f-b940-feb80fa3f644\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.201912 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.201895    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4vts\" (UniqueName: \"kubernetes.io/projected/896e1cee-2420-4fa5-b96b-40d4639695dc-kube-api-access-h4vts\") pod \"network-metrics-daemon-4lgs6\" (UID: \"896e1cee-2420-4fa5-b96b-40d4639695dc\") " pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:25.202028 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.202014    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wppx\" (UniqueName: \"kubernetes.io/projected/3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2-kube-api-access-5wppx\") pod \"ovnkube-node-f47nm\" (UID: \"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2\") " pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.284333 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.284222    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wlzv5"
Jun 06 20:46:25.293037 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.292990    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-89fxb"
Jun 06 20:46:25.294002 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:25.293974    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee039af8_9795_4768_a9f3_e84e68fa3119.slice/crio-6aa62471d666c13b4c63ee566f00bf9d960783bc09fc9fb609c1c357809bd1a7 WatchSource:0}: Error finding container 6aa62471d666c13b4c63ee566f00bf9d960783bc09fc9fb609c1c357809bd1a7: Status 404 returned error can't find the container with id 6aa62471d666c13b4c63ee566f00bf9d960783bc09fc9fb609c1c357809bd1a7
Jun 06 20:46:25.299777 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.299758    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p4tf9"
Jun 06 20:46:25.301595 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:25.301570    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909f3c74_4924_486d_b0ec_f256d44d4ae7.slice/crio-88e5e21aa4380a3b4b8db49911cc3417d033e9ae4c950fac78d409353abeb9d2 WatchSource:0}: Error finding container 88e5e21aa4380a3b4b8db49911cc3417d033e9ae4c950fac78d409353abeb9d2: Status 404 returned error can't find the container with id 88e5e21aa4380a3b4b8db49911cc3417d033e9ae4c950fac78d409353abeb9d2
Jun 06 20:46:25.303157 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.303134    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zqf2v"
Jun 06 20:46:25.309501 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:25.309465    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf347c8e_0a99_4696_a204_711236d2ceae.slice/crio-e6fb53ee1242f4bac71b9daf5255d76eeb94e32a72fa45fd97ee688f63ece09a WatchSource:0}: Error finding container e6fb53ee1242f4bac71b9daf5255d76eeb94e32a72fa45fd97ee688f63ece09a: Status 404 returned error can't find the container with id e6fb53ee1242f4bac71b9daf5255d76eeb94e32a72fa45fd97ee688f63ece09a
Jun 06 20:46:25.309607 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.309527    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qlrjz"
Jun 06 20:46:25.312772 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:25.312747    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod984f3c68_db04_4590_abfb_4a1e4fe904ba.slice/crio-9669925ff93dd80838dd80c0e8018391e60b5c2ac5fd6adf2996de2306408ff3 WatchSource:0}: Error finding container 9669925ff93dd80838dd80c0e8018391e60b5c2ac5fd6adf2996de2306408ff3: Status 404 returned error can't find the container with id 9669925ff93dd80838dd80c0e8018391e60b5c2ac5fd6adf2996de2306408ff3
Jun 06 20:46:25.314621 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.314531    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:25.319607 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:25.319584    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0286ab0_38a1_4800_8e7f_e8574c4e24b0.slice/crio-690de4a6ab8124d6aeef39f69847a51cb668ba786a5c9ad3451f3bdb950fa371 WatchSource:0}: Error finding container 690de4a6ab8124d6aeef39f69847a51cb668ba786a5c9ad3451f3bdb950fa371: Status 404 returned error can't find the container with id 690de4a6ab8124d6aeef39f69847a51cb668ba786a5c9ad3451f3bdb950fa371
Jun 06 20:46:25.320085 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.320065    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rkrcj"
Jun 06 20:46:25.325950 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.325811    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf"
Jun 06 20:46:25.327783 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:25.327756    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e84fe71_ac8f_4694_aacd_0bddfb8ebfd2.slice/crio-e7bcf8a02c5d424a065976abd606047496264df840e8a60e32283223ec6d9a95 WatchSource:0}: Error finding container e7bcf8a02c5d424a065976abd606047496264df840e8a60e32283223ec6d9a95: Status 404 returned error can't find the container with id e7bcf8a02c5d424a065976abd606047496264df840e8a60e32283223ec6d9a95
Jun 06 20:46:25.330163 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.330079    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wx7qf"
Jun 06 20:46:25.333894 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:25.333832    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6a7ac9_3f6d_403f_bb25_9ec8dc131337.slice/crio-0cae7bc74c751a5715a6ed7cbcbf210d51370efa90bcdd9ede5836365d2da220 WatchSource:0}: Error finding container 0cae7bc74c751a5715a6ed7cbcbf210d51370efa90bcdd9ede5836365d2da220: Status 404 returned error can't find the container with id 0cae7bc74c751a5715a6ed7cbcbf210d51370efa90bcdd9ede5836365d2da220
Jun 06 20:46:25.344691 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:46:25.344656    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67260f7f_1f82_4f8f_b940_feb80fa3f644.slice/crio-9c340c214b9f1d08e94be03ebb283dccc254abc6d769a7d4c3f3c304ab82ff54 WatchSource:0}: Error finding container 9c340c214b9f1d08e94be03ebb283dccc254abc6d769a7d4c3f3c304ab82ff54: Status 404 returned error can't find the container with id 9c340c214b9f1d08e94be03ebb283dccc254abc6d769a7d4c3f3c304ab82ff54
Jun 06 20:46:25.595539 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.595448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret\") pod \"global-pull-secret-syncer-gr6fv\" (UID: \"b5f56b4d-6637-4296-9138-3b407b3c6737\") " pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:25.595689 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:25.595644    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 20:46:25.595762 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:25.595742    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret podName:b5f56b4d-6637-4296-9138-3b407b3c6737 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:26.59571914 +0000 UTC m=+3.012531042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret") pod "global-pull-secret-syncer-gr6fv" (UID: "b5f56b4d-6637-4296-9138-3b407b3c6737") : object "kube-system"/"original-pull-secret" not registered
Jun 06 20:46:25.696080 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.696035    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs\") pod \"network-metrics-daemon-4lgs6\" (UID: \"896e1cee-2420-4fa5-b96b-40d4639695dc\") " pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:25.696080 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.696082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s8xj\" (UniqueName: \"kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj\") pod \"network-check-target-xdz66\" (UID: \"2903038a-8636-4ffc-b799-46bea55ec8ba\") " pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:25.696335 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:25.696251    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 20:46:25.696335 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:25.696273    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 20:46:25.696335 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:25.696286    2577 projected.go:196] Error preparing data for projected volume kube-api-access-6s8xj for pod openshift-network-diagnostics/network-check-target-xdz66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 20:46:25.696539 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:25.696366    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj podName:2903038a-8636-4ffc-b799-46bea55ec8ba nodeName:}" failed. No retries permitted until 2026-06-06 20:46:26.696344568 +0000 UTC m=+3.113156466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s8xj" (UniqueName: "kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj") pod "network-check-target-xdz66" (UID: "2903038a-8636-4ffc-b799-46bea55ec8ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 20:46:25.696767 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:25.696749    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 20:46:25.696825 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:25.696801    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs podName:896e1cee-2420-4fa5-b96b-40d4639695dc nodeName:}" failed. No retries permitted until 2026-06-06 20:46:26.696786886 +0000 UTC m=+3.113598786 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs") pod "network-metrics-daemon-4lgs6" (UID: "896e1cee-2420-4fa5-b96b-40d4639695dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 20:46:25.744506 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:25.744283    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 20:46:26.020716 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:26.020654    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 20:41:25 +0000 UTC" deadline="2028-01-01 19:41:08.889667056 +0000 UTC"
Jun 06 20:46:26.020716 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:26.020711    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13774h54m42.868960759s"
Jun 06 20:46:26.065352 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:26.065293    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf" event={"ID":"67260f7f-1f82-4f8f-b940-feb80fa3f644","Type":"ContainerStarted","Data":"9c340c214b9f1d08e94be03ebb283dccc254abc6d769a7d4c3f3c304ab82ff54"}
Jun 06 20:46:26.069961 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:26.069634    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qlrjz" event={"ID":"e0286ab0-38a1-4800-8e7f-e8574c4e24b0","Type":"ContainerStarted","Data":"690de4a6ab8124d6aeef39f69847a51cb668ba786a5c9ad3451f3bdb950fa371"}
Jun 06 20:46:26.090555 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:26.090519    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zqf2v" event={"ID":"984f3c68-db04-4590-abfb-4a1e4fe904ba","Type":"ContainerStarted","Data":"9669925ff93dd80838dd80c0e8018391e60b5c2ac5fd6adf2996de2306408ff3"}
Jun 06 20:46:26.105345 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:26.105309    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p4tf9" event={"ID":"df347c8e-0a99-4696-a204-711236d2ceae","Type":"ContainerStarted","Data":"e6fb53ee1242f4bac71b9daf5255d76eeb94e32a72fa45fd97ee688f63ece09a"}
Jun 06 20:46:26.114254 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:26.114215    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wx7qf" event={"ID":"7a3a545a-09f9-43df-a03d-452a58df3e9e","Type":"ContainerStarted","Data":"53183a66876cb827a143e4b232b6dc502b0826d97e94886aa0286ac7f502e062"}
Jun 06 20:46:26.129959 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:26.129921    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rkrcj" event={"ID":"dd6a7ac9-3f6d-403f-bb25-9ec8dc131337","Type":"ContainerStarted","Data":"0cae7bc74c751a5715a6ed7cbcbf210d51370efa90bcdd9ede5836365d2da220"}
Jun 06 20:46:26.144966 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:26.144815    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm" event={"ID":"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2","Type":"ContainerStarted","Data":"e7bcf8a02c5d424a065976abd606047496264df840e8a60e32283223ec6d9a95"}
Jun 06 20:46:26.152759 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:26.152722    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89fxb" event={"ID":"909f3c74-4924-486d-b0ec-f256d44d4ae7","Type":"ContainerStarted","Data":"88e5e21aa4380a3b4b8db49911cc3417d033e9ae4c950fac78d409353abeb9d2"}
Jun 06 20:46:26.157876 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:26.157842    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wlzv5" event={"ID":"ee039af8-9795-4768-a9f3-e84e68fa3119","Type":"ContainerStarted","Data":"6aa62471d666c13b4c63ee566f00bf9d960783bc09fc9fb609c1c357809bd1a7"}
Jun 06 20:46:26.200399 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:26.200356    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 20:46:26.509129 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:26.509103    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 20:46:26.604333 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:26.604284    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret\") pod \"global-pull-secret-syncer-gr6fv\" (UID: \"b5f56b4d-6637-4296-9138-3b407b3c6737\") " pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:26.604523 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:26.604477    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 20:46:26.604590 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:26.604548    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret podName:b5f56b4d-6637-4296-9138-3b407b3c6737 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:28.604529742 +0000 UTC m=+5.021341642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret") pod "global-pull-secret-syncer-gr6fv" (UID: "b5f56b4d-6637-4296-9138-3b407b3c6737") : object "kube-system"/"original-pull-secret" not registered
Jun 06 20:46:26.705669 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:26.705631    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs\") pod \"network-metrics-daemon-4lgs6\" (UID: \"896e1cee-2420-4fa5-b96b-40d4639695dc\") " pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:26.705843 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:26.705683    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s8xj\" (UniqueName: \"kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj\") pod \"network-check-target-xdz66\" (UID: \"2903038a-8636-4ffc-b799-46bea55ec8ba\") " pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:26.705843 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:26.705777    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 20:46:26.705947 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:26.705854    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs podName:896e1cee-2420-4fa5-b96b-40d4639695dc nodeName:}" failed. No retries permitted until 2026-06-06 20:46:28.705832416 +0000 UTC m=+5.122644327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs") pod "network-metrics-daemon-4lgs6" (UID: "896e1cee-2420-4fa5-b96b-40d4639695dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 20:46:26.705947 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:26.705870    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 20:46:26.705947 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:26.705886    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 20:46:26.705947 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:26.705901    2577 projected.go:196] Error preparing data for projected volume kube-api-access-6s8xj for pod openshift-network-diagnostics/network-check-target-xdz66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 20:46:26.705947 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:26.705947    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj podName:2903038a-8636-4ffc-b799-46bea55ec8ba nodeName:}" failed. No retries permitted until 2026-06-06 20:46:28.705932728 +0000 UTC m=+5.122744626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s8xj" (UniqueName: "kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj") pod "network-check-target-xdz66" (UID: "2903038a-8636-4ffc-b799-46bea55ec8ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 20:46:27.003284 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:27.003252    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 06 20:46:27.021872 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:27.021126    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 20:41:25 +0000 UTC" deadline="2027-12-09 10:05:11.255050074 +0000 UTC"
Jun 06 20:46:27.021872 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:27.021160    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13213h18m44.233894265s"
Jun 06 20:46:27.053621 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:27.053588    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:27.053788 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:27.053724    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:27.053846 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:27.053785    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:27.053893 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:27.053861    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:27.053893 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:27.053887    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:27.054007 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:27.053969    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:28.624606 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:28.624002    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret\") pod \"global-pull-secret-syncer-gr6fv\" (UID: \"b5f56b4d-6637-4296-9138-3b407b3c6737\") " pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:28.624606 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:28.624183    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 20:46:28.624606 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:28.624265    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret podName:b5f56b4d-6637-4296-9138-3b407b3c6737 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:32.624245346 +0000 UTC m=+9.041057243 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret") pod "global-pull-secret-syncer-gr6fv" (UID: "b5f56b4d-6637-4296-9138-3b407b3c6737") : object "kube-system"/"original-pull-secret" not registered
Jun 06 20:46:28.728423 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:28.725131    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs\") pod \"network-metrics-daemon-4lgs6\" (UID: \"896e1cee-2420-4fa5-b96b-40d4639695dc\") " pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:28.728423 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:28.725184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s8xj\" (UniqueName: \"kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj\") pod \"network-check-target-xdz66\" (UID: \"2903038a-8636-4ffc-b799-46bea55ec8ba\") " pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:28.728423 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:28.725592    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 20:46:28.728423 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:28.725631    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 20:46:28.728423 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:28.725648    2577 projected.go:196] Error preparing data for projected volume kube-api-access-6s8xj for pod openshift-network-diagnostics/network-check-target-xdz66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 20:46:28.728423 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:28.725725    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj podName:2903038a-8636-4ffc-b799-46bea55ec8ba nodeName:}" failed. No retries permitted until 2026-06-06 20:46:32.725704484 +0000 UTC m=+9.142516384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s8xj" (UniqueName: "kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj") pod "network-check-target-xdz66" (UID: "2903038a-8636-4ffc-b799-46bea55ec8ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 20:46:28.728863 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:28.728719    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 20:46:28.729359 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:28.729339    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs podName:896e1cee-2420-4fa5-b96b-40d4639695dc nodeName:}" failed. No retries permitted until 2026-06-06 20:46:32.728789565 +0000 UTC m=+9.145601474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs") pod "network-metrics-daemon-4lgs6" (UID: "896e1cee-2420-4fa5-b96b-40d4639695dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 20:46:29.053645 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:29.053611    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:29.053834 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:29.053656    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:29.053834 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:29.053614    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:29.053834 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:29.053741    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:29.053990 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:29.053856    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:29.053990 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:29.053930    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:31.053996 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:31.053953    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:31.054542 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:31.054086    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:31.054542 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:31.054098    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:31.054542 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:31.054117    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:31.054542 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:31.054205    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:31.054542 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:31.054289    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:32.657737 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:32.657164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret\") pod \"global-pull-secret-syncer-gr6fv\" (UID: \"b5f56b4d-6637-4296-9138-3b407b3c6737\") " pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:32.657737 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:32.657338    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 20:46:32.657737 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:32.657411    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret podName:b5f56b4d-6637-4296-9138-3b407b3c6737 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:40.657390696 +0000 UTC m=+17.074202597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret") pod "global-pull-secret-syncer-gr6fv" (UID: "b5f56b4d-6637-4296-9138-3b407b3c6737") : object "kube-system"/"original-pull-secret" not registered
Jun 06 20:46:32.759210 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:32.758427    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs\") pod \"network-metrics-daemon-4lgs6\" (UID: \"896e1cee-2420-4fa5-b96b-40d4639695dc\") " pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:32.759210 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:32.758479    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s8xj\" (UniqueName: \"kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj\") pod \"network-check-target-xdz66\" (UID: \"2903038a-8636-4ffc-b799-46bea55ec8ba\") " pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:32.759210 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:32.758648    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 20:46:32.759210 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:32.758664    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 20:46:32.759210 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:32.758676    2577 projected.go:196] Error preparing data for projected volume kube-api-access-6s8xj for pod openshift-network-diagnostics/network-check-target-xdz66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 20:46:32.759210 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:32.758734    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj podName:2903038a-8636-4ffc-b799-46bea55ec8ba nodeName:}" failed. No retries permitted until 2026-06-06 20:46:40.75871467 +0000 UTC m=+17.175526567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s8xj" (UniqueName: "kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj") pod "network-check-target-xdz66" (UID: "2903038a-8636-4ffc-b799-46bea55ec8ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 20:46:32.759210 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:32.759127    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 20:46:32.759210 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:32.759175    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs podName:896e1cee-2420-4fa5-b96b-40d4639695dc nodeName:}" failed. No retries permitted until 2026-06-06 20:46:40.759160161 +0000 UTC m=+17.175972057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs") pod "network-metrics-daemon-4lgs6" (UID: "896e1cee-2420-4fa5-b96b-40d4639695dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 20:46:33.054123 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:33.054043    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:33.054123 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:33.054091    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:33.054388 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:33.054055    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:33.054388 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:33.054217    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:33.054388 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:33.054332    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:33.054560 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:33.054428    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:35.053835 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:35.053682    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:35.053835 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:35.053681    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:35.054398 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:35.053844    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:35.054398 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:35.053887    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:35.054398 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:35.053982    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:35.054398 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:35.054094    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:37.054234 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:37.054192    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:37.054702 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:37.054192    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:37.054702 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:37.054347    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:37.054702 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:37.054202    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:37.054702 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:37.054412    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:37.054702 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:37.054511    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:39.053429 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:39.053398    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:39.053890 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:39.053399    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:39.053890 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:39.053516    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:39.053890 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:39.053398    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:39.053890 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:39.053570    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:39.053890 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:39.053655    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:40.715332 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:40.715234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret\") pod \"global-pull-secret-syncer-gr6fv\" (UID: \"b5f56b4d-6637-4296-9138-3b407b3c6737\") " pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:40.715757 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:40.715374    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 20:46:40.715757 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:40.715450    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret podName:b5f56b4d-6637-4296-9138-3b407b3c6737 nodeName:}" failed. No retries permitted until 2026-06-06 20:46:56.71543069 +0000 UTC m=+33.132242590 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret") pod "global-pull-secret-syncer-gr6fv" (UID: "b5f56b4d-6637-4296-9138-3b407b3c6737") : object "kube-system"/"original-pull-secret" not registered
Jun 06 20:46:40.815810 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:40.815778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs\") pod \"network-metrics-daemon-4lgs6\" (UID: \"896e1cee-2420-4fa5-b96b-40d4639695dc\") " pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:40.815810 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:40.815815    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s8xj\" (UniqueName: \"kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj\") pod \"network-check-target-xdz66\" (UID: \"2903038a-8636-4ffc-b799-46bea55ec8ba\") " pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:40.816035 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:40.815938    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 20:46:40.816035 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:40.816017    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs podName:896e1cee-2420-4fa5-b96b-40d4639695dc nodeName:}" failed. No retries permitted until 2026-06-06 20:46:56.815994912 +0000 UTC m=+33.232806830 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs") pod "network-metrics-daemon-4lgs6" (UID: "896e1cee-2420-4fa5-b96b-40d4639695dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 20:46:40.816130 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:40.815946    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 20:46:40.816130 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:40.816058    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 20:46:40.816130 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:40.816069    2577 projected.go:196] Error preparing data for projected volume kube-api-access-6s8xj for pod openshift-network-diagnostics/network-check-target-xdz66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 20:46:40.816130 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:40.816116    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj podName:2903038a-8636-4ffc-b799-46bea55ec8ba nodeName:}" failed. No retries permitted until 2026-06-06 20:46:56.816104402 +0000 UTC m=+33.232916296 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s8xj" (UniqueName: "kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj") pod "network-check-target-xdz66" (UID: "2903038a-8636-4ffc-b799-46bea55ec8ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 20:46:41.053350 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:41.053312    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:41.053516 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:41.053314    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:41.053516 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:41.053456    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:41.053516 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:41.053314    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:41.053516 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:41.053504    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:41.053730 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:41.053582    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:43.053825 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:43.053741    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:43.053825 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:43.053788    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:43.053825 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:43.053788    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:43.054361 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:43.053882    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:43.054361 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:43.053941    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:43.054361 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:43.054008    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:45.054108 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:45.054063    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:45.054108 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:45.054087    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:45.054537 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:45.054063    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:45.054537 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:45.054165    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:45.054537 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:45.054251    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:45.054537 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:45.054339    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:46.207778 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.207445    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wx7qf" event={"ID":"7a3a545a-09f9-43df-a03d-452a58df3e9e","Type":"ContainerStarted","Data":"79d3019f15f7d1b34aefc538e1814a9ba777dbb970597165a8f718c4ab922727"}
Jun 06 20:46:46.209282 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.209190    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rkrcj" event={"ID":"dd6a7ac9-3f6d-403f-bb25-9ec8dc131337","Type":"ContainerStarted","Data":"92f0573785cc2d3d80c2eac03ad200582d1e0314fc98f7c48da3dd6a5c117da4"}
Jun 06 20:46:46.211737 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.211711    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 20:46:46.212072 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.212049    2577 generic.go:356] "Generic (PLEG): container finished" podID="3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2" containerID="d5c27b2d103d142d831d3250c0ef2ffb27f7d34d5dc8bd2fe4ae02094571f06f" exitCode=1
Jun 06 20:46:46.212177 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.212118    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm" event={"ID":"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2","Type":"ContainerStarted","Data":"4b637848ff7af9b71608f1ad6587b6bb7c77f35c97f1acf1c54b59cb8c9cd8b8"}
Jun 06 20:46:46.212228 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.212208    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm" event={"ID":"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2","Type":"ContainerStarted","Data":"6be953225f967d806e1218282b81ff3e940110c04440b6022c5d9a66239ccffc"}
Jun 06 20:46:46.212272 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.212254    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm" event={"ID":"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2","Type":"ContainerStarted","Data":"cad262a23c6cc5c14fa9f0791bff38c3e833c92c4959e28ef9dc023b9c732e6c"}
Jun 06 20:46:46.212331 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.212290    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm" event={"ID":"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2","Type":"ContainerDied","Data":"d5c27b2d103d142d831d3250c0ef2ffb27f7d34d5dc8bd2fe4ae02094571f06f"}
Jun 06 20:46:46.212388 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.212349    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm" event={"ID":"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2","Type":"ContainerStarted","Data":"936f6d9e822763189df8a74bdf63737307b8b60a7de0243dfb2186f9e16958db"}
Jun 06 20:46:46.213638 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.213615    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89fxb" event={"ID":"909f3c74-4924-486d-b0ec-f256d44d4ae7","Type":"ContainerStarted","Data":"4acf00ab1bcd83ac18dcf39993ccdedbb035fb387fe1a4f3c630a9a7579433a7"}
Jun 06 20:46:46.216975 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.216875    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wlzv5" event={"ID":"ee039af8-9795-4768-a9f3-e84e68fa3119","Type":"ContainerStarted","Data":"17fb677083fc8446b0a62ad9cfedb6e0d986fc1820f751f90c186814e6e890d9"}
Jun 06 20:46:46.219290 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.219271    2577 generic.go:356] "Generic (PLEG): container finished" podID="7aeac4d5e87cfcd67914db9513951415" containerID="bd74a4d901b0015f813c9b4b20177720a9460e98b84aff23b6bf9d52a215c728" exitCode=0
Jun 06 20:46:46.219399 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.219347    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal" event={"ID":"7aeac4d5e87cfcd67914db9513951415","Type":"ContainerDied","Data":"bd74a4d901b0015f813c9b4b20177720a9460e98b84aff23b6bf9d52a215c728"}
Jun 06 20:46:46.221293 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.221240    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf" event={"ID":"67260f7f-1f82-4f8f-b940-feb80fa3f644","Type":"ContainerStarted","Data":"f14f792bf0f04fdec5ed65398dd0eb1408ff5e85808dde3e1f3e18222e752872"}
Jun 06 20:46:46.222771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.222750    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zqf2v" event={"ID":"984f3c68-db04-4590-abfb-4a1e4fe904ba","Type":"ContainerStarted","Data":"c3d4599b16bc9f83bbd5c45d28794099d3415c060a864a8e99841f91897ab6ee"}
Jun 06 20:46:46.224466 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.224443    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p4tf9" event={"ID":"df347c8e-0a99-4696-a204-711236d2ceae","Type":"ContainerStarted","Data":"19e6f53440d0be661bc25b0dfaf014de312f3e8cb5c566053a4cf4f95d650605"}
Jun 06 20:46:46.225736 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.225719    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-66.ec2.internal" event={"ID":"95af39ec743638abd6f8b98dcef4d6d0","Type":"ContainerStarted","Data":"fe2b9b03aa1f078784d98d2fe37ecae58b3ea12d80d64bab038968d44ddbe17e"}
Jun 06 20:46:46.262857 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.262803    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rkrcj" podStartSLOduration=2.354040121 podStartE2EDuration="22.262788759s" totalImagesPullingTime="19.908748638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:46.248997071 +0000 UTC m=+22.665808988" watchObservedRunningTime="2026-06-06 20:46:46.262788759 +0000 UTC m=+22.679600675"
Jun 06 20:46:46.275626 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.275574    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wx7qf" podStartSLOduration=2.377732879 podStartE2EDuration="22.275551555s" totalImagesPullingTime="19.897818676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:46.262331616 +0000 UTC m=+22.679143530" watchObservedRunningTime="2026-06-06 20:46:46.275551555 +0000 UTC m=+22.692363473"
Jun 06 20:46:46.288111 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.288061    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-66.ec2.internal" podStartSLOduration=22.288043986 podStartE2EDuration="22.288043986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:46.287665782 +0000 UTC m=+22.704477704" watchObservedRunningTime="2026-06-06 20:46:46.288043986 +0000 UTC m=+22.704855903"
Jun 06 20:46:46.302549 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.302507    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wlzv5" podStartSLOduration=2.350908773 podStartE2EDuration="22.30249433s" totalImagesPullingTime="19.951585557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:46.302316565 +0000 UTC m=+22.719128476" watchObservedRunningTime="2026-06-06 20:46:46.30249433 +0000 UTC m=+22.719306247"
Jun 06 20:46:46.334037 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.333975    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p4tf9" podStartSLOduration=2.396566194 podStartE2EDuration="22.333952447s" totalImagesPullingTime="19.937386253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:46.31766492 +0000 UTC m=+22.734476834" watchObservedRunningTime="2026-06-06 20:46:46.333952447 +0000 UTC m=+22.750764365"
Jun 06 20:46:46.334189 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:46.334113    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zqf2v" podStartSLOduration=2.007188392 podStartE2EDuration="22.334104564s" totalImagesPullingTime="20.326916172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:46.33335351 +0000 UTC m=+22.750165427" watchObservedRunningTime="2026-06-06 20:46:46.334104564 +0000 UTC m=+22.750916481"
Jun 06 20:46:47.053686 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:47.053643    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:47.053869 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:47.053643    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:47.053869 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:47.053754    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:47.053869 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:47.053842    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:47.053869 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:47.053646    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:47.054047 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:47.053946    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:47.230695 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:47.230666    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 20:46:47.231086 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:47.231055    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm" event={"ID":"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2","Type":"ContainerStarted","Data":"89d4150d54b75be56cd307d71bf063e14384b317522981a78e308ce0022a7375"}
Jun 06 20:46:47.232366 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:47.232342    2577 generic.go:356] "Generic (PLEG): container finished" podID="909f3c74-4924-486d-b0ec-f256d44d4ae7" containerID="4acf00ab1bcd83ac18dcf39993ccdedbb035fb387fe1a4f3c630a9a7579433a7" exitCode=0
Jun 06 20:46:47.232457 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:47.232413    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89fxb" event={"ID":"909f3c74-4924-486d-b0ec-f256d44d4ae7","Type":"ContainerDied","Data":"4acf00ab1bcd83ac18dcf39993ccdedbb035fb387fe1a4f3c630a9a7579433a7"}
Jun 06 20:46:47.234117 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:47.234096    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal" event={"ID":"7aeac4d5e87cfcd67914db9513951415","Type":"ContainerStarted","Data":"aba288015d21468a49226d01111986be49527d8db99ecccd8ca4dae0e9b03c32"}
Jun 06 20:46:47.235357 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:47.235335    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qlrjz" event={"ID":"e0286ab0-38a1-4800-8e7f-e8574c4e24b0","Type":"ContainerStarted","Data":"cb429f5842251b33ba9c2299d0a00eff96df9acd6fecb4c28fa607564cd7d6d8"}
Jun 06 20:46:47.266046 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:47.266005    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qlrjz" podStartSLOduration=3.340213124 podStartE2EDuration="23.265992094s" totalImagesPullingTime="19.92577897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:47.265719477 +0000 UTC m=+23.682531411" watchObservedRunningTime="2026-06-06 20:46:47.265992094 +0000 UTC m=+23.682804011"
Jun 06 20:46:47.430636 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:47.430461    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 06 20:46:48.055861 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:48.055752    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-06T20:46:47.430619979Z","UUID":"8756abb3-4e72-4e2d-9ca0-c02cdabb2368","Handler":null,"Name":"","Endpoint":""}
Jun 06 20:46:48.057694 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:48.057672    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 06 20:46:48.057826 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:48.057710    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 06 20:46:48.241219 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:48.241178    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf" event={"ID":"67260f7f-1f82-4f8f-b940-feb80fa3f644","Type":"ContainerStarted","Data":"58e7612e8f8f8115de2ed9e38cf981f431fd666a40ed493d31f342f73755ea2e"}
Jun 06 20:46:48.408498 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:48.408416    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rkrcj"
Jun 06 20:46:49.053474 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:49.053444    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:49.053474 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:49.053474    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:49.053762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:49.053473    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:49.053762 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:49.053565    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:49.053762 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:49.053665    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:49.053762 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:49.053728    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:49.248150 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:49.248118    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 20:46:49.248874 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:49.248636    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm" event={"ID":"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2","Type":"ContainerStarted","Data":"e2b0e129a3bd7296e78454b206e27e2ea12ced4e088e1fda729ccd52ff6366db"}
Jun 06 20:46:49.251250 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:49.251203    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf" event={"ID":"67260f7f-1f82-4f8f-b940-feb80fa3f644","Type":"ContainerStarted","Data":"d169ca89dc5b38bf09ef2007b9c4dc16d8d3c57d034bd3cc08afa94e0609d848"}
Jun 06 20:46:49.268629 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:49.268565    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jf7sf" podStartSLOduration=3.01285359 podStartE2EDuration="25.268545225s" totalImagesPullingTime="22.255691635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:49.268378165 +0000 UTC m=+25.685190081" watchObservedRunningTime="2026-06-06 20:46:49.268545225 +0000 UTC m=+25.685357143"
Jun 06 20:46:49.268788 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:49.268764    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-66.ec2.internal" podStartSLOduration=25.26876032 podStartE2EDuration="25.26876032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:47.279031777 +0000 UTC m=+23.695843696" watchObservedRunningTime="2026-06-06 20:46:49.26876032 +0000 UTC m=+25.685572238"
Jun 06 20:46:49.803846 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:49.803815    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rkrcj"
Jun 06 20:46:49.804586 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:49.804565    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rkrcj"
Jun 06 20:46:50.254538 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:50.254509    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rkrcj"
Jun 06 20:46:51.053790 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:51.053754    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:51.053960 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:51.053815    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:51.053960 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:51.053894    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:51.053960 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:51.053916    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:51.054101 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:51.053989    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:51.054101 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:51.054059    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:52.262520 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:52.262360    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 20:46:52.263051 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:52.262849    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm" event={"ID":"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2","Type":"ContainerStarted","Data":"b11cf85799757f6c5f33600b8bd6fd4a52a90a4b909019b2150a8cf1537fed34"}
Jun 06 20:46:52.263129 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:52.263111    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:52.263273 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:52.263258    2577 scope.go:117] "RemoveContainer" containerID="d5c27b2d103d142d831d3250c0ef2ffb27f7d34d5dc8bd2fe4ae02094571f06f"
Jun 06 20:46:52.264789 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:52.264765    2577 generic.go:356] "Generic (PLEG): container finished" podID="909f3c74-4924-486d-b0ec-f256d44d4ae7" containerID="24dcbac23ac722c5de2c371fc022782ef83d0e672935be72590aa02b9a96ab45" exitCode=0
Jun 06 20:46:52.264875 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:52.264798    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89fxb" event={"ID":"909f3c74-4924-486d-b0ec-f256d44d4ae7","Type":"ContainerDied","Data":"24dcbac23ac722c5de2c371fc022782ef83d0e672935be72590aa02b9a96ab45"}
Jun 06 20:46:52.279148 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:52.279131    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:53.053750 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:53.053708    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:53.054006 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:53.053822    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:53.054006 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:53.053825    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:53.054006 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:53.053926    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:53.054006 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:53.053828    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:53.054173 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:53.054037    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:53.271849 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:53.271826    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 20:46:53.272252 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:53.272223    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm" event={"ID":"3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2","Type":"ContainerStarted","Data":"269fae529710a4fe51c790d1626728eba4203a810a868d27185267632fbfe5a3"}
Jun 06 20:46:53.272585 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:53.272559    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:53.272695 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:53.272639    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:53.274783 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:53.274758    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89fxb" event={"ID":"909f3c74-4924-486d-b0ec-f256d44d4ae7","Type":"ContainerStarted","Data":"6dd129f913366a685e780b2c5671e4a3bb1b5d4373d40be8ea86fd9267397859"}
Jun 06 20:46:53.287750 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:53.287723    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:46:53.300227 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:53.300183    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm" podStartSLOduration=9.341825789 podStartE2EDuration="29.300169073s" totalImagesPullingTime="19.958343284s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:46:53.298869773 +0000 UTC m=+29.715681725" watchObservedRunningTime="2026-06-06 20:46:53.300169073 +0000 UTC m=+29.716980991"
Jun 06 20:46:53.685268 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:53.685068    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gr6fv"]
Jun 06 20:46:53.685492 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:53.685374    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:53.685561 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:53.685485    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:53.688699 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:53.688667    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xdz66"]
Jun 06 20:46:53.688825 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:53.688770    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:53.688905 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:53.688880    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:53.689191 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:53.689167    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4lgs6"]
Jun 06 20:46:53.689268 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:53.689252    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:53.689411 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:53.689366    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:54.281574 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:54.281539    2577 generic.go:356] "Generic (PLEG): container finished" podID="909f3c74-4924-486d-b0ec-f256d44d4ae7" containerID="6dd129f913366a685e780b2c5671e4a3bb1b5d4373d40be8ea86fd9267397859" exitCode=0
Jun 06 20:46:54.282221 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:54.281630    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89fxb" event={"ID":"909f3c74-4924-486d-b0ec-f256d44d4ae7","Type":"ContainerDied","Data":"6dd129f913366a685e780b2c5671e4a3bb1b5d4373d40be8ea86fd9267397859"}
Jun 06 20:46:55.053531 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:55.053501    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:55.053531 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:55.053525    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:55.053726 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:55.053620    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:55.053760 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:55.053723    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:56.053742 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:56.053661    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:56.054335 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:56.053776    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:56.288592 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:56.288559    2577 generic.go:356] "Generic (PLEG): container finished" podID="909f3c74-4924-486d-b0ec-f256d44d4ae7" containerID="a5de9daccb2dc13deb1ffd5eb55b6742800829155fbb0d29b36e9fcf7c0473fc" exitCode=0
Jun 06 20:46:56.288592 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:56.288595    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89fxb" event={"ID":"909f3c74-4924-486d-b0ec-f256d44d4ae7","Type":"ContainerDied","Data":"a5de9daccb2dc13deb1ffd5eb55b6742800829155fbb0d29b36e9fcf7c0473fc"}
Jun 06 20:46:56.743050 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:56.743012    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret\") pod \"global-pull-secret-syncer-gr6fv\" (UID: \"b5f56b4d-6637-4296-9138-3b407b3c6737\") " pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:56.743228 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:56.743190    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 06 20:46:56.743311 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:56.743275    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret podName:b5f56b4d-6637-4296-9138-3b407b3c6737 nodeName:}" failed. No retries permitted until 2026-06-06 20:47:28.743254047 +0000 UTC m=+65.160065955 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret") pod "global-pull-secret-syncer-gr6fv" (UID: "b5f56b4d-6637-4296-9138-3b407b3c6737") : object "kube-system"/"original-pull-secret" not registered
Jun 06 20:46:56.843803 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:56.843751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs\") pod \"network-metrics-daemon-4lgs6\" (UID: \"896e1cee-2420-4fa5-b96b-40d4639695dc\") " pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:56.843975 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:56.843818    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s8xj\" (UniqueName: \"kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj\") pod \"network-check-target-xdz66\" (UID: \"2903038a-8636-4ffc-b799-46bea55ec8ba\") " pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:56.843975 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:56.843954    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 20:46:56.844135 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:56.844024    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 06 20:46:56.844135 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:56.844039    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs podName:896e1cee-2420-4fa5-b96b-40d4639695dc nodeName:}" failed. No retries permitted until 2026-06-06 20:47:28.844017945 +0000 UTC m=+65.260829850 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs") pod "network-metrics-daemon-4lgs6" (UID: "896e1cee-2420-4fa5-b96b-40d4639695dc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 06 20:46:56.844135 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:56.844049    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 06 20:46:56.844135 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:56.844064    2577 projected.go:196] Error preparing data for projected volume kube-api-access-6s8xj for pod openshift-network-diagnostics/network-check-target-xdz66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 20:46:56.844135 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:56.844118    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj podName:2903038a-8636-4ffc-b799-46bea55ec8ba nodeName:}" failed. No retries permitted until 2026-06-06 20:47:28.844101093 +0000 UTC m=+65.260913003 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6s8xj" (UniqueName: "kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj") pod "network-check-target-xdz66" (UID: "2903038a-8636-4ffc-b799-46bea55ec8ba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 06 20:46:57.054212 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:57.054125    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:57.054719 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:57.054132    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:57.054719 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:57.054250    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdz66" podUID="2903038a-8636-4ffc-b799-46bea55ec8ba"
Jun 06 20:46:57.054719 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:57.054399    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:46:58.054217 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.053724    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:46:58.054217 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:58.053867    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gr6fv" podUID="b5f56b4d-6637-4296-9138-3b407b3c6737"
Jun 06 20:46:58.375949 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.375871    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-66.ec2.internal" event="NodeReady"
Jun 06 20:46:58.376114 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.376049    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 06 20:46:58.421368 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.421227    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t5svn"]
Jun 06 20:46:58.424851 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.424824    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jmz78"]
Jun 06 20:46:58.425020 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.424950    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t5svn"
Jun 06 20:46:58.427632 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.427481    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9qr76\""
Jun 06 20:46:58.427632 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.427481    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 06 20:46:58.427632 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.427564    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 06 20:46:58.428805 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.428784    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jmz78"
Jun 06 20:46:58.431228 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.431189    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 06 20:46:58.431369 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.431331    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-22d9j\""
Jun 06 20:46:58.431369 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.431348    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 06 20:46:58.431689 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.431660    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 06 20:46:58.434706 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.434650    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t5svn"]
Jun 06 20:46:58.436038 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.436017    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jmz78"]
Jun 06 20:46:58.557551 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.557515    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94831dda-b834-475e-b5f8-7c9a01ce25be-tmp-dir\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:46:58.557551 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.557554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a29988c-1445-4801-9656-a8f6134dcb05-cert\") pod \"ingress-canary-jmz78\" (UID: \"1a29988c-1445-4801-9656-a8f6134dcb05\") " pod="openshift-ingress-canary/ingress-canary-jmz78"
Jun 06 20:46:58.557851 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.557594    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:46:58.557851 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.557673    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94831dda-b834-475e-b5f8-7c9a01ce25be-config-volume\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:46:58.557851 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.557703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj4mk\" (UniqueName: \"kubernetes.io/projected/1a29988c-1445-4801-9656-a8f6134dcb05-kube-api-access-mj4mk\") pod \"ingress-canary-jmz78\" (UID: \"1a29988c-1445-4801-9656-a8f6134dcb05\") " pod="openshift-ingress-canary/ingress-canary-jmz78"
Jun 06 20:46:58.557851 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.557729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s658\" (UniqueName: \"kubernetes.io/projected/94831dda-b834-475e-b5f8-7c9a01ce25be-kube-api-access-9s658\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:46:58.658859 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.658766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:46:58.658859 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.658826    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94831dda-b834-475e-b5f8-7c9a01ce25be-config-volume\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:46:58.658859 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.658852    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj4mk\" (UniqueName: \"kubernetes.io/projected/1a29988c-1445-4801-9656-a8f6134dcb05-kube-api-access-mj4mk\") pod \"ingress-canary-jmz78\" (UID: \"1a29988c-1445-4801-9656-a8f6134dcb05\") " pod="openshift-ingress-canary/ingress-canary-jmz78"
Jun 06 20:46:58.659138 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.658881    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s658\" (UniqueName: \"kubernetes.io/projected/94831dda-b834-475e-b5f8-7c9a01ce25be-kube-api-access-9s658\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:46:58.659138 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.658937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94831dda-b834-475e-b5f8-7c9a01ce25be-tmp-dir\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:46:58.659138 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:58.658946    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 20:46:58.659138 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:58.659021    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls podName:94831dda-b834-475e-b5f8-7c9a01ce25be nodeName:}" failed. No retries permitted until 2026-06-06 20:46:59.15900237 +0000 UTC m=+35.575814266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls") pod "dns-default-t5svn" (UID: "94831dda-b834-475e-b5f8-7c9a01ce25be") : secret "dns-default-metrics-tls" not found
Jun 06 20:46:58.659138 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.658952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a29988c-1445-4801-9656-a8f6134dcb05-cert\") pod \"ingress-canary-jmz78\" (UID: \"1a29988c-1445-4801-9656-a8f6134dcb05\") " pod="openshift-ingress-canary/ingress-canary-jmz78"
Jun 06 20:46:58.659453 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.659433    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94831dda-b834-475e-b5f8-7c9a01ce25be-tmp-dir\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:46:58.659675 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.659642    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/94831dda-b834-475e-b5f8-7c9a01ce25be-config-volume\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:46:58.664042 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.663846    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1a29988c-1445-4801-9656-a8f6134dcb05-cert\") pod \"ingress-canary-jmz78\" (UID: \"1a29988c-1445-4801-9656-a8f6134dcb05\") " pod="openshift-ingress-canary/ingress-canary-jmz78"
Jun 06 20:46:58.667754 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.667726    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj4mk\" (UniqueName: \"kubernetes.io/projected/1a29988c-1445-4801-9656-a8f6134dcb05-kube-api-access-mj4mk\") pod \"ingress-canary-jmz78\" (UID: \"1a29988c-1445-4801-9656-a8f6134dcb05\") " pod="openshift-ingress-canary/ingress-canary-jmz78"
Jun 06 20:46:58.668156 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.668123    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s658\" (UniqueName: \"kubernetes.io/projected/94831dda-b834-475e-b5f8-7c9a01ce25be-kube-api-access-9s658\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:46:58.745148 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:58.745114    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jmz78"
Jun 06 20:46:59.054088 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:59.054055    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:46:59.054280 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:59.054055    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:46:59.057070 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:59.057034    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 06 20:46:59.057512 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:59.057035    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 06 20:46:59.058067 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:59.058035    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 06 20:46:59.058067 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:59.058041    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dltkl\""
Jun 06 20:46:59.058198 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:59.058078    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9xvqt\""
Jun 06 20:46:59.162910 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:46:59.162868    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:46:59.163071 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:59.162987    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 20:46:59.163071 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:46:59.163054    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls podName:94831dda-b834-475e-b5f8-7c9a01ce25be nodeName:}" failed. No retries permitted until 2026-06-06 20:47:00.163032777 +0000 UTC m=+36.579844677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls") pod "dns-default-t5svn" (UID: "94831dda-b834-475e-b5f8-7c9a01ce25be") : secret "dns-default-metrics-tls" not found
Jun 06 20:47:00.054379 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:00.054335    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:47:00.057132 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:00.057108    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 06 20:47:00.172100 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:00.172058    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:47:00.172319 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:47:00.172274    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 20:47:00.172414 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:47:00.172378    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls podName:94831dda-b834-475e-b5f8-7c9a01ce25be nodeName:}" failed. No retries permitted until 2026-06-06 20:47:02.172354432 +0000 UTC m=+38.589166328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls") pod "dns-default-t5svn" (UID: "94831dda-b834-475e-b5f8-7c9a01ce25be") : secret "dns-default-metrics-tls" not found
Jun 06 20:47:00.334335 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:00.333562    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jmz78"]
Jun 06 20:47:00.339004 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:47:00.338968    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a29988c_1445_4801_9656_a8f6134dcb05.slice/crio-32a7820a2d7074fe343ddc071e0dd25f1ff537cc562147d88676951bd5ec3a4f WatchSource:0}: Error finding container 32a7820a2d7074fe343ddc071e0dd25f1ff537cc562147d88676951bd5ec3a4f: Status 404 returned error can't find the container with id 32a7820a2d7074fe343ddc071e0dd25f1ff537cc562147d88676951bd5ec3a4f
Jun 06 20:47:01.304410 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:01.304370    2577 generic.go:356] "Generic (PLEG): container finished" podID="909f3c74-4924-486d-b0ec-f256d44d4ae7" containerID="9377b0b51a522e279416f00783044f9892adce40494150d1943d0bc76b56e15c" exitCode=0
Jun 06 20:47:01.304964 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:01.304451    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89fxb" event={"ID":"909f3c74-4924-486d-b0ec-f256d44d4ae7","Type":"ContainerDied","Data":"9377b0b51a522e279416f00783044f9892adce40494150d1943d0bc76b56e15c"}
Jun 06 20:47:01.305869 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:01.305656    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jmz78" event={"ID":"1a29988c-1445-4801-9656-a8f6134dcb05","Type":"ContainerStarted","Data":"32a7820a2d7074fe343ddc071e0dd25f1ff537cc562147d88676951bd5ec3a4f"}
Jun 06 20:47:02.186388 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:02.186350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:47:02.186561 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:47:02.186482    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 20:47:02.186561 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:47:02.186535    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls podName:94831dda-b834-475e-b5f8-7c9a01ce25be nodeName:}" failed. No retries permitted until 2026-06-06 20:47:06.186521829 +0000 UTC m=+42.603333725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls") pod "dns-default-t5svn" (UID: "94831dda-b834-475e-b5f8-7c9a01ce25be") : secret "dns-default-metrics-tls" not found
Jun 06 20:47:02.310732 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:02.310701    2577 generic.go:356] "Generic (PLEG): container finished" podID="909f3c74-4924-486d-b0ec-f256d44d4ae7" containerID="2a815052c18ca1c44a35d511429b78cf92c82c051d23f3dda9a4e3815d506208" exitCode=0
Jun 06 20:47:02.311383 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:02.310782    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89fxb" event={"ID":"909f3c74-4924-486d-b0ec-f256d44d4ae7","Type":"ContainerDied","Data":"2a815052c18ca1c44a35d511429b78cf92c82c051d23f3dda9a4e3815d506208"}
Jun 06 20:47:02.312353 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:02.312321    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jmz78" event={"ID":"1a29988c-1445-4801-9656-a8f6134dcb05","Type":"ContainerStarted","Data":"487dc74fb16f429365bf31f16571e85860c25c41d54cfc169628111d3afed623"}
Jun 06 20:47:02.346959 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:02.346891    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jmz78" podStartSLOduration=2.70244446 podStartE2EDuration="4.346868408s" totalImagesPullingTime="1.644423948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:47:02.346074333 +0000 UTC m=+38.762886255" watchObservedRunningTime="2026-06-06 20:47:02.346868408 +0000 UTC m=+38.763680327"
Jun 06 20:47:03.318218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:03.318171    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89fxb" event={"ID":"909f3c74-4924-486d-b0ec-f256d44d4ae7","Type":"ContainerStarted","Data":"78609938c51d1683057f1215c980a344be3c0ac14c90afe476ec7b211aa9e8b3"}
Jun 06 20:47:03.339746 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:03.339692    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-89fxb" podStartSLOduration=17.443180456 podStartE2EDuration="39.339676427s" totalImagesPullingTime="21.896495971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:47:03.338476669 +0000 UTC m=+39.755288597" watchObservedRunningTime="2026-06-06 20:47:03.339676427 +0000 UTC m=+39.756488343"
Jun 06 20:47:06.216823 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:06.216778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:47:06.217326 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:47:06.216980    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 20:47:06.217326 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:47:06.217067    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls podName:94831dda-b834-475e-b5f8-7c9a01ce25be nodeName:}" failed. No retries permitted until 2026-06-06 20:47:14.217045102 +0000 UTC m=+50.633857015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls") pod "dns-default-t5svn" (UID: "94831dda-b834-475e-b5f8-7c9a01ce25be") : secret "dns-default-metrics-tls" not found
Jun 06 20:47:14.269569 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:14.269524    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:47:14.270091 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:47:14.269670    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 20:47:14.270091 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:47:14.269734    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls podName:94831dda-b834-475e-b5f8-7c9a01ce25be nodeName:}" failed. No retries permitted until 2026-06-06 20:47:30.269718143 +0000 UTC m=+66.686530038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls") pod "dns-default-t5svn" (UID: "94831dda-b834-475e-b5f8-7c9a01ce25be") : secret "dns-default-metrics-tls" not found
Jun 06 20:47:25.305727 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:25.305700    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f47nm"
Jun 06 20:47:28.772707 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:28.772655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret\") pod \"global-pull-secret-syncer-gr6fv\" (UID: \"b5f56b4d-6637-4296-9138-3b407b3c6737\") " pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:47:28.775452 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:28.775433    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 06 20:47:28.786945 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:28.786912    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f56b4d-6637-4296-9138-3b407b3c6737-original-pull-secret\") pod \"global-pull-secret-syncer-gr6fv\" (UID: \"b5f56b4d-6637-4296-9138-3b407b3c6737\") " pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:47:28.863691 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:28.863664    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gr6fv"
Jun 06 20:47:28.873239 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:28.873213    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs\") pod \"network-metrics-daemon-4lgs6\" (UID: \"896e1cee-2420-4fa5-b96b-40d4639695dc\") " pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:47:28.873375 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:28.873250    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s8xj\" (UniqueName: \"kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj\") pod \"network-check-target-xdz66\" (UID: \"2903038a-8636-4ffc-b799-46bea55ec8ba\") " pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:47:28.875955 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:28.875928    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 06 20:47:28.876075 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:28.876039    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 06 20:47:28.884176 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:47:28.884149    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 06 20:47:28.884320 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:47:28.884227    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs podName:896e1cee-2420-4fa5-b96b-40d4639695dc nodeName:}" failed. No retries permitted until 2026-06-06 20:48:32.884209503 +0000 UTC m=+129.301021402 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs") pod "network-metrics-daemon-4lgs6" (UID: "896e1cee-2420-4fa5-b96b-40d4639695dc") : secret "metrics-daemon-secret" not found
Jun 06 20:47:28.886316 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:28.886283    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 06 20:47:28.897559 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:28.897531    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s8xj\" (UniqueName: \"kubernetes.io/projected/2903038a-8636-4ffc-b799-46bea55ec8ba-kube-api-access-6s8xj\") pod \"network-check-target-xdz66\" (UID: \"2903038a-8636-4ffc-b799-46bea55ec8ba\") " pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:47:28.985057 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:28.985018    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gr6fv"]
Jun 06 20:47:28.991371 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:47:28.991348    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f56b4d_6637_4296_9138_3b407b3c6737.slice/crio-6cbecefc3263634d5e0b817b2614522b7c3e8818f881577017706620af70a4bc WatchSource:0}: Error finding container 6cbecefc3263634d5e0b817b2614522b7c3e8818f881577017706620af70a4bc: Status 404 returned error can't find the container with id 6cbecefc3263634d5e0b817b2614522b7c3e8818f881577017706620af70a4bc
Jun 06 20:47:29.022020 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.021985    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c557b84-mjmsw"]
Jun 06 20:47:29.024235 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.024157    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c557b84-mjmsw"
Jun 06 20:47:29.026598 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.026575    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 06 20:47:29.026696 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.026655    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7lc96\""
Jun 06 20:47:29.027638 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.027622    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 06 20:47:29.027713 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.027642    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 06 20:47:29.027713 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.027688    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jun 06 20:47:29.032362 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.032340    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c557b84-mjmsw"]
Jun 06 20:47:29.068860 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.068833    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dltkl\""
Jun 06 20:47:29.075077 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.075053    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75c557b84-mjmsw\" (UID: \"e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c557b84-mjmsw"
Jun 06 20:47:29.075164 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.075084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bznl\" (UniqueName: \"kubernetes.io/projected/e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1-kube-api-access-6bznl\") pod \"managed-serviceaccount-addon-agent-75c557b84-mjmsw\" (UID: \"e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c557b84-mjmsw"
Jun 06 20:47:29.077088 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.077071    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:47:29.175896 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.175865    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75c557b84-mjmsw\" (UID: \"e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c557b84-mjmsw"
Jun 06 20:47:29.176063 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.175910    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bznl\" (UniqueName: \"kubernetes.io/projected/e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1-kube-api-access-6bznl\") pod \"managed-serviceaccount-addon-agent-75c557b84-mjmsw\" (UID: \"e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c557b84-mjmsw"
Jun 06 20:47:29.178480 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.178455    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-75c557b84-mjmsw\" (UID: \"e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c557b84-mjmsw"
Jun 06 20:47:29.185682 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.185656    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bznl\" (UniqueName: \"kubernetes.io/projected/e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1-kube-api-access-6bznl\") pod \"managed-serviceaccount-addon-agent-75c557b84-mjmsw\" (UID: \"e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c557b84-mjmsw"
Jun 06 20:47:29.193792 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.193769    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xdz66"]
Jun 06 20:47:29.196687 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:47:29.196665    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2903038a_8636_4ffc_b799_46bea55ec8ba.slice/crio-88cf8d975b51e7d935a7dcf6dd1c6722ae73867cbe1caca5bdd2cd819f7acc7f WatchSource:0}: Error finding container 88cf8d975b51e7d935a7dcf6dd1c6722ae73867cbe1caca5bdd2cd819f7acc7f: Status 404 returned error can't find the container with id 88cf8d975b51e7d935a7dcf6dd1c6722ae73867cbe1caca5bdd2cd819f7acc7f
Jun 06 20:47:29.345065 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.344983    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c557b84-mjmsw"
Jun 06 20:47:29.376380 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.376336    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xdz66" event={"ID":"2903038a-8636-4ffc-b799-46bea55ec8ba","Type":"ContainerStarted","Data":"88cf8d975b51e7d935a7dcf6dd1c6722ae73867cbe1caca5bdd2cd819f7acc7f"}
Jun 06 20:47:29.377557 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.377527    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gr6fv" event={"ID":"b5f56b4d-6637-4296-9138-3b407b3c6737","Type":"ContainerStarted","Data":"6cbecefc3263634d5e0b817b2614522b7c3e8818f881577017706620af70a4bc"}
Jun 06 20:47:29.474239 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:29.474204    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c557b84-mjmsw"]
Jun 06 20:47:29.477542 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:47:29.477518    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9f3cafe_0a66_4261_8d95_2f3db9e6ebf1.slice/crio-5e28aa25d06b07bd86f3b73a0755a35aa163c28acf12fd60453a05652ca9ca5d WatchSource:0}: Error finding container 5e28aa25d06b07bd86f3b73a0755a35aa163c28acf12fd60453a05652ca9ca5d: Status 404 returned error can't find the container with id 5e28aa25d06b07bd86f3b73a0755a35aa163c28acf12fd60453a05652ca9ca5d
Jun 06 20:47:30.285067 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:30.284996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:47:30.285569 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:47:30.285159    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 20:47:30.285569 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:47:30.285243    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls podName:94831dda-b834-475e-b5f8-7c9a01ce25be nodeName:}" failed. No retries permitted until 2026-06-06 20:48:02.285219595 +0000 UTC m=+98.702031510 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls") pod "dns-default-t5svn" (UID: "94831dda-b834-475e-b5f8-7c9a01ce25be") : secret "dns-default-metrics-tls" not found
Jun 06 20:47:30.382100 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:30.382059    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c557b84-mjmsw" event={"ID":"e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1","Type":"ContainerStarted","Data":"5e28aa25d06b07bd86f3b73a0755a35aa163c28acf12fd60453a05652ca9ca5d"}
Jun 06 20:47:35.396018 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:35.395924    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gr6fv" event={"ID":"b5f56b4d-6637-4296-9138-3b407b3c6737","Type":"ContainerStarted","Data":"61ba40dc078c5806c943902477439318881666291788fa4942180c2a97af925a"}
Jun 06 20:47:35.397400 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:35.397369    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xdz66" event={"ID":"2903038a-8636-4ffc-b799-46bea55ec8ba","Type":"ContainerStarted","Data":"cd78e00becda21829ff304f0089d8e6cc2b26953b00848f942d69547cf55db93"}
Jun 06 20:47:35.397521 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:35.397505    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:47:35.398728 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:35.398708    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c557b84-mjmsw" event={"ID":"e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1","Type":"ContainerStarted","Data":"dbcb5fb6064efd6b26c34f990b090e30739d30d890856e3004ccf9e207dbf7e5"}
Jun 06 20:47:35.411273 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:35.411217    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gr6fv" podStartSLOduration=65.331440037 podStartE2EDuration="1m11.411204802s" totalImagesPullingTime="6.079764765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:47:35.410801309 +0000 UTC m=+71.827613227" watchObservedRunningTime="2026-06-06 20:47:35.411204802 +0000 UTC m=+71.828016713"
Jun 06 20:47:35.424002 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:35.423940    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c557b84-mjmsw" podStartSLOduration=0.842849788 podStartE2EDuration="6.423921452s" totalImagesPullingTime="5.581071664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:47:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:47:35.423022946 +0000 UTC m=+71.839834868" watchObservedRunningTime="2026-06-06 20:47:35.423921452 +0000 UTC m=+71.840733371"
Jun 06 20:47:35.436040 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:47:35.435992    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xdz66" podStartSLOduration=65.565168658 podStartE2EDuration="1m11.43597791s" totalImagesPullingTime="5.870809252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:47:35.435511369 +0000 UTC m=+71.852323311" watchObservedRunningTime="2026-06-06 20:47:35.43597791 +0000 UTC m=+71.852789826"
Jun 06 20:48:02.307272 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:48:02.307227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:48:02.307782 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:48:02.307393    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 20:48:02.307782 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:48:02.307496    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls podName:94831dda-b834-475e-b5f8-7c9a01ce25be nodeName:}" failed. No retries permitted until 2026-06-06 20:49:06.307478822 +0000 UTC m=+162.724290717 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls") pod "dns-default-t5svn" (UID: "94831dda-b834-475e-b5f8-7c9a01ce25be") : secret "dns-default-metrics-tls" not found
Jun 06 20:48:06.403915 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:48:06.403885    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xdz66"
Jun 06 20:48:32.918318 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:48:32.918252    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs\") pod \"network-metrics-daemon-4lgs6\" (UID: \"896e1cee-2420-4fa5-b96b-40d4639695dc\") " pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:48:32.918797 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:48:32.918406    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 06 20:48:32.918797 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:48:32.918489    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs podName:896e1cee-2420-4fa5-b96b-40d4639695dc nodeName:}" failed. No retries permitted until 2026-06-06 20:50:34.918471082 +0000 UTC m=+251.335282977 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs") pod "network-metrics-daemon-4lgs6" (UID: "896e1cee-2420-4fa5-b96b-40d4639695dc") : secret "metrics-daemon-secret" not found
Jun 06 20:49:01.437094 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:01.437047    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-t5svn" podUID="94831dda-b834-475e-b5f8-7c9a01ce25be"
Jun 06 20:49:01.597611 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:01.597576    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t5svn"
Jun 06 20:49:02.071633 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:02.071598    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4lgs6" podUID="896e1cee-2420-4fa5-b96b-40d4639695dc"
Jun 06 20:49:06.348118 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:06.348066    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:49:06.348539 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:06.348222    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 06 20:49:06.348539 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:06.348321    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls podName:94831dda-b834-475e-b5f8-7c9a01ce25be nodeName:}" failed. No retries permitted until 2026-06-06 20:51:08.348284689 +0000 UTC m=+284.765096584 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls") pod "dns-default-t5svn" (UID: "94831dda-b834-475e-b5f8-7c9a01ce25be") : secret "dns-default-metrics-tls" not found
Jun 06 20:49:14.054266 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:14.054226    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:49:34.930869 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:34.930836    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54f6949f47-6rxkq"]
Jun 06 20:49:34.932513 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:34.932498    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:34.935436 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:34.935400    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jun 06 20:49:34.935653 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:34.935620    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jun 06 20:49:34.935762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:34.935642    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jun 06 20:49:34.935762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:34.935717    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jun 06 20:49:34.935762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:34.935756    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 06 20:49:34.935875 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:34.935755    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bbzg4\""
Jun 06 20:49:34.935875 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:34.935760    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-default-certificate\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:34.935875 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:34.935803    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:34.935875 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:34.935826    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-stats-auth\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:34.935875 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:34.935845    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkvdg\" (UniqueName: \"kubernetes.io/projected/073b123d-ea96-4527-aadb-769c8007858e-kube-api-access-xkvdg\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:34.936096 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:34.935916    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:34.936262 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:34.936246    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 06 20:49:34.946503 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:34.946480    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54f6949f47-6rxkq"]
Jun 06 20:49:35.019368 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.019330    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8"]
Jun 06 20:49:35.020985 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.020970    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8"
Jun 06 20:49:35.023281 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.023259    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tvm6k\""
Jun 06 20:49:35.023403 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.023337    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jun 06 20:49:35.023656 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.023637    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jun 06 20:49:35.026217 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.026197    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"]
Jun 06 20:49:35.027901 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.027884    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9"]
Jun 06 20:49:35.028028 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.028009    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"
Jun 06 20:49:35.029548 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.029503    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66f58777cd-jmj2w"]
Jun 06 20:49:35.029624 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.029614    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9"
Jun 06 20:49:35.030403 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.030378    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jun 06 20:49:35.030558 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.030531    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 06 20:49:35.030640 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.030618    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4wrck\""
Jun 06 20:49:35.030810 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.030796    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 06 20:49:35.031321 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.031289    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.032203 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.032183    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jun 06 20:49:35.032376 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.032287    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-s6fqg\""
Jun 06 20:49:35.032376 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.032368    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jun 06 20:49:35.032483 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.032401    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jun 06 20:49:35.032483 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.032451    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jun 06 20:49:35.033029 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.032992    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jun 06 20:49:35.033696 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.033488    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 06 20:49:35.033696 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.033536    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 06 20:49:35.034206 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.034184    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8"]
Jun 06 20:49:35.034993 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.034975    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xdrjs\""
Jun 06 20:49:35.035331 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.035312    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 06 20:49:35.036315 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-stats-auth\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:35.036409 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036346    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3129661f-60d1-4122-aa60-022b39069b66-ca-trust-extracted\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.036409 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036377    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3129661f-60d1-4122-aa60-022b39069b66-image-registry-private-configuration\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.036518 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036424    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3129661f-60d1-4122-aa60-022b39069b66-trusted-ca\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.036518 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036459    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkvdg\" (UniqueName: \"kubernetes.io/projected/073b123d-ea96-4527-aadb-769c8007858e-kube-api-access-xkvdg\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:35.036518 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036485    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3129661f-60d1-4122-aa60-022b39069b66-installation-pull-secrets\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.036651 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036601    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtfdn\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-kube-api-access-qtfdn\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.036651 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:35.036749 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036664    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32981c32-5985-4796-8a8c-15ef60e6a12b-config\") pod \"service-ca-operator-6bc5ff68f5-fpml9\" (UID: \"32981c32-5985-4796-8a8c-15ef60e6a12b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9"
Jun 06 20:49:35.036749 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036709    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-drjt8\" (UID: \"69a6f7a6-2bc4-41bb-b033-62d122739350\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8"
Jun 06 20:49:35.036749 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036737    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/69a6f7a6-2bc4-41bb-b033-62d122739350-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-drjt8\" (UID: \"69a6f7a6-2bc4-41bb-b033-62d122739350\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8"
Jun 06 20:49:35.037032 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/39469d4f-a471-4585-aa7c-50da5c07e536-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-4xb76\" (UID: \"39469d4f-a471-4585-aa7c-50da5c07e536\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"
Jun 06 20:49:35.037032 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jhxg\" (UniqueName: \"kubernetes.io/projected/32981c32-5985-4796-8a8c-15ef60e6a12b-kube-api-access-6jhxg\") pod \"service-ca-operator-6bc5ff68f5-fpml9\" (UID: \"32981c32-5985-4796-8a8c-15ef60e6a12b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9"
Jun 06 20:49:35.037032 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036817    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdfz8\" (UniqueName: \"kubernetes.io/projected/39469d4f-a471-4585-aa7c-50da5c07e536-kube-api-access-bdfz8\") pod \"cluster-monitoring-operator-74bbf69bbb-4xb76\" (UID: \"39469d4f-a471-4585-aa7c-50da5c07e536\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"
Jun 06 20:49:35.037032 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036845    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:35.037032 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036867    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32981c32-5985-4796-8a8c-15ef60e6a12b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-fpml9\" (UID: \"32981c32-5985-4796-8a8c-15ef60e6a12b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9"
Jun 06 20:49:35.037032 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-default-certificate\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:35.037032 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036916    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-bound-sa-token\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.037032 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.036961    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4xb76\" (UID: \"39469d4f-a471-4585-aa7c-50da5c07e536\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"
Jun 06 20:49:35.037032 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.037008    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3129661f-60d1-4122-aa60-022b39069b66-registry-certificates\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.037539 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.037038    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.037539 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.037085    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 06 20:49:35.037539 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.037158    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs podName:073b123d-ea96-4527-aadb-769c8007858e nodeName:}" failed. No retries permitted until 2026-06-06 20:49:35.537137975 +0000 UTC m=+191.953949885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs") pod "router-default-54f6949f47-6rxkq" (UID: "073b123d-ea96-4527-aadb-769c8007858e") : secret "router-metrics-certs-default" not found
Jun 06 20:49:35.037539 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.037243    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle podName:073b123d-ea96-4527-aadb-769c8007858e nodeName:}" failed. No retries permitted until 2026-06-06 20:49:35.537224482 +0000 UTC m=+191.954036380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle") pod "router-default-54f6949f47-6rxkq" (UID: "073b123d-ea96-4527-aadb-769c8007858e") : configmap references non-existent config key: service-ca.crt
Jun 06 20:49:35.039408 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.039328    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-stats-auth\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:35.040111 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.040092    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-default-certificate\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:35.040587 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.040564    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"]
Jun 06 20:49:35.041184 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.041155    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 06 20:49:35.042842 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.042820    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9"]
Jun 06 20:49:35.047214 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.047181    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66f58777cd-jmj2w"]
Jun 06 20:49:35.051517 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.051408    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkvdg\" (UniqueName: \"kubernetes.io/projected/073b123d-ea96-4527-aadb-769c8007858e-kube-api-access-xkvdg\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:35.137372 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.137344    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4xb76\" (UID: \"39469d4f-a471-4585-aa7c-50da5c07e536\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"
Jun 06 20:49:35.137546 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.137441    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 06 20:49:35.137546 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.137494    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls podName:39469d4f-a471-4585-aa7c-50da5c07e536 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:35.637479053 +0000 UTC m=+192.054290947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-4xb76" (UID: "39469d4f-a471-4585-aa7c-50da5c07e536") : secret "cluster-monitoring-operator-tls" not found
Jun 06 20:49:35.137546 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.137519    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3129661f-60d1-4122-aa60-022b39069b66-registry-certificates\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.137546 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.137538    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.137773 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.137558    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3129661f-60d1-4122-aa60-022b39069b66-ca-trust-extracted\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.137773 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.137586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3129661f-60d1-4122-aa60-022b39069b66-image-registry-private-configuration\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.137773 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.137602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3129661f-60d1-4122-aa60-022b39069b66-trusted-ca\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.137773 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.137621    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3129661f-60d1-4122-aa60-022b39069b66-installation-pull-secrets\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.137773 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.137637    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 06 20:49:35.137773 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.137657    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f58777cd-jmj2w: secret "image-registry-tls" not found
Jun 06 20:49:35.137773 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.137715    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls podName:3129661f-60d1-4122-aa60-022b39069b66 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:35.637697473 +0000 UTC m=+192.054509369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls") pod "image-registry-66f58777cd-jmj2w" (UID: "3129661f-60d1-4122-aa60-022b39069b66") : secret "image-registry-tls" not found
Jun 06 20:49:35.137773 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.137643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtfdn\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-kube-api-access-qtfdn\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.137773 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.137773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32981c32-5985-4796-8a8c-15ef60e6a12b-config\") pod \"service-ca-operator-6bc5ff68f5-fpml9\" (UID: \"32981c32-5985-4796-8a8c-15ef60e6a12b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9"
Jun 06 20:49:35.138214 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.137821    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-drjt8\" (UID: \"69a6f7a6-2bc4-41bb-b033-62d122739350\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8"
Jun 06 20:49:35.138214 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.137853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/69a6f7a6-2bc4-41bb-b033-62d122739350-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-drjt8\" (UID: \"69a6f7a6-2bc4-41bb-b033-62d122739350\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8"
Jun 06 20:49:35.138214 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.137882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/39469d4f-a471-4585-aa7c-50da5c07e536-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-4xb76\" (UID: \"39469d4f-a471-4585-aa7c-50da5c07e536\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"
Jun 06 20:49:35.138214 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.137910    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jhxg\" (UniqueName: \"kubernetes.io/projected/32981c32-5985-4796-8a8c-15ef60e6a12b-kube-api-access-6jhxg\") pod \"service-ca-operator-6bc5ff68f5-fpml9\" (UID: \"32981c32-5985-4796-8a8c-15ef60e6a12b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9"
Jun 06 20:49:35.138214 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.137938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdfz8\" (UniqueName: \"kubernetes.io/projected/39469d4f-a471-4585-aa7c-50da5c07e536-kube-api-access-bdfz8\") pod \"cluster-monitoring-operator-74bbf69bbb-4xb76\" (UID: \"39469d4f-a471-4585-aa7c-50da5c07e536\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"
Jun 06 20:49:35.138214 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.138005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32981c32-5985-4796-8a8c-15ef60e6a12b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-fpml9\" (UID: \"32981c32-5985-4796-8a8c-15ef60e6a12b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9"
Jun 06 20:49:35.138214 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.138042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-bound-sa-token\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.138214 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.138181    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3129661f-60d1-4122-aa60-022b39069b66-registry-certificates\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.138686 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.138266    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 06 20:49:35.138686 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.138333    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert podName:69a6f7a6-2bc4-41bb-b033-62d122739350 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:35.638294272 +0000 UTC m=+192.055106178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-drjt8" (UID: "69a6f7a6-2bc4-41bb-b033-62d122739350") : secret "networking-console-plugin-cert" not found
Jun 06 20:49:35.138686 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.138403    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/32981c32-5985-4796-8a8c-15ef60e6a12b-config\") pod \"service-ca-operator-6bc5ff68f5-fpml9\" (UID: \"32981c32-5985-4796-8a8c-15ef60e6a12b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9"
Jun 06 20:49:35.138686 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.138651    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3129661f-60d1-4122-aa60-022b39069b66-trusted-ca\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.138930 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.138902    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/39469d4f-a471-4585-aa7c-50da5c07e536-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-4xb76\" (UID: \"39469d4f-a471-4585-aa7c-50da5c07e536\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"
Jun 06 20:49:35.139054 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.138908    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3129661f-60d1-4122-aa60-022b39069b66-ca-trust-extracted\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.139054 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.139007    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/69a6f7a6-2bc4-41bb-b033-62d122739350-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-drjt8\" (UID: \"69a6f7a6-2bc4-41bb-b033-62d122739350\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8"
Jun 06 20:49:35.140512 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.140489    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/32981c32-5985-4796-8a8c-15ef60e6a12b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-fpml9\" (UID: \"32981c32-5985-4796-8a8c-15ef60e6a12b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9"
Jun 06 20:49:35.140583 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.140521    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3129661f-60d1-4122-aa60-022b39069b66-image-registry-private-configuration\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.140583 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.140549    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3129661f-60d1-4122-aa60-022b39069b66-installation-pull-secrets\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.149236 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.149215    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-bound-sa-token\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.150654 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.150630    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtfdn\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-kube-api-access-qtfdn\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.150767 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.150695    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jhxg\" (UniqueName: \"kubernetes.io/projected/32981c32-5985-4796-8a8c-15ef60e6a12b-kube-api-access-6jhxg\") pod \"service-ca-operator-6bc5ff68f5-fpml9\" (UID: \"32981c32-5985-4796-8a8c-15ef60e6a12b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9"
Jun 06 20:49:35.151076 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.151056    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdfz8\" (UniqueName: \"kubernetes.io/projected/39469d4f-a471-4585-aa7c-50da5c07e536-kube-api-access-bdfz8\") pod \"cluster-monitoring-operator-74bbf69bbb-4xb76\" (UID: \"39469d4f-a471-4585-aa7c-50da5c07e536\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"
Jun 06 20:49:35.359163 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.359128    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9"
Jun 06 20:49:35.477401 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.477315    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9"]
Jun 06 20:49:35.480922 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:49:35.480895    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32981c32_5985_4796_8a8c_15ef60e6a12b.slice/crio-32ecd1e70b5f84e9ecc12217fa4c1762a82f5e1d92003da235b080bce2207538 WatchSource:0}: Error finding container 32ecd1e70b5f84e9ecc12217fa4c1762a82f5e1d92003da235b080bce2207538: Status 404 returned error can't find the container with id 32ecd1e70b5f84e9ecc12217fa4c1762a82f5e1d92003da235b080bce2207538
Jun 06 20:49:35.541627 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.541578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:35.541781 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.541673    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:35.541781 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.541734    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 06 20:49:35.541854 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.541787    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs podName:073b123d-ea96-4527-aadb-769c8007858e nodeName:}" failed. No retries permitted until 2026-06-06 20:49:36.541773457 +0000 UTC m=+192.958585355 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs") pod "router-default-54f6949f47-6rxkq" (UID: "073b123d-ea96-4527-aadb-769c8007858e") : secret "router-metrics-certs-default" not found
Jun 06 20:49:35.541854 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.541841    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle podName:073b123d-ea96-4527-aadb-769c8007858e nodeName:}" failed. No retries permitted until 2026-06-06 20:49:36.541823655 +0000 UTC m=+192.958635561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle") pod "router-default-54f6949f47-6rxkq" (UID: "073b123d-ea96-4527-aadb-769c8007858e") : configmap references non-existent config key: service-ca.crt
Jun 06 20:49:35.642221 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.642188    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4xb76\" (UID: \"39469d4f-a471-4585-aa7c-50da5c07e536\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"
Jun 06 20:49:35.642393 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.642239    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:35.642393 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.642325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-drjt8\" (UID: \"69a6f7a6-2bc4-41bb-b033-62d122739350\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8"
Jun 06 20:49:35.642393 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.642355    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 06 20:49:35.642502 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.642409    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 06 20:49:35.642502 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.642428    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f58777cd-jmj2w: secret "image-registry-tls" not found
Jun 06 20:49:35.642502 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.642419    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls podName:39469d4f-a471-4585-aa7c-50da5c07e536 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:36.642399064 +0000 UTC m=+193.059210966 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-4xb76" (UID: "39469d4f-a471-4585-aa7c-50da5c07e536") : secret "cluster-monitoring-operator-tls" not found
Jun 06 20:49:35.642502 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.642456    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 06 20:49:35.642502 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.642480    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls podName:3129661f-60d1-4122-aa60-022b39069b66 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:36.642465464 +0000 UTC m=+193.059277361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls") pod "image-registry-66f58777cd-jmj2w" (UID: "3129661f-60d1-4122-aa60-022b39069b66") : secret "image-registry-tls" not found
Jun 06 20:49:35.642653 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:35.642510    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert podName:69a6f7a6-2bc4-41bb-b033-62d122739350 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:36.642496209 +0000 UTC m=+193.059308106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-drjt8" (UID: "69a6f7a6-2bc4-41bb-b033-62d122739350") : secret "networking-console-plugin-cert" not found
Jun 06 20:49:35.681089 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.681061    2577 generic.go:356] "Generic (PLEG): container finished" podID="e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1" containerID="dbcb5fb6064efd6b26c34f990b090e30739d30d890856e3004ccf9e207dbf7e5" exitCode=255
Jun 06 20:49:35.681230 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.681140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c557b84-mjmsw" event={"ID":"e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1","Type":"ContainerDied","Data":"dbcb5fb6064efd6b26c34f990b090e30739d30d890856e3004ccf9e207dbf7e5"}
Jun 06 20:49:35.686177 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.686145    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9" event={"ID":"32981c32-5985-4796-8a8c-15ef60e6a12b","Type":"ContainerStarted","Data":"32ecd1e70b5f84e9ecc12217fa4c1762a82f5e1d92003da235b080bce2207538"}
Jun 06 20:49:35.690273 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:35.690258    2577 scope.go:117] "RemoveContainer" containerID="dbcb5fb6064efd6b26c34f990b090e30739d30d890856e3004ccf9e207dbf7e5"
Jun 06 20:49:36.549483 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:36.549446    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:36.549902 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:36.549535    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:36.549902 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:36.549602    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 06 20:49:36.549902 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:36.549670    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs podName:073b123d-ea96-4527-aadb-769c8007858e nodeName:}" failed. No retries permitted until 2026-06-06 20:49:38.549653465 +0000 UTC m=+194.966465378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs") pod "router-default-54f6949f47-6rxkq" (UID: "073b123d-ea96-4527-aadb-769c8007858e") : secret "router-metrics-certs-default" not found
Jun 06 20:49:36.549902 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:36.549713    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle podName:073b123d-ea96-4527-aadb-769c8007858e nodeName:}" failed. No retries permitted until 2026-06-06 20:49:38.549692288 +0000 UTC m=+194.966504188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle") pod "router-default-54f6949f47-6rxkq" (UID: "073b123d-ea96-4527-aadb-769c8007858e") : configmap references non-existent config key: service-ca.crt
Jun 06 20:49:36.650630 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:36.650584    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4xb76\" (UID: \"39469d4f-a471-4585-aa7c-50da5c07e536\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"
Jun 06 20:49:36.650800 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:36.650646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:36.650800 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:36.650721    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-drjt8\" (UID: \"69a6f7a6-2bc4-41bb-b033-62d122739350\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8"
Jun 06 20:49:36.650800 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:36.650758    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 06 20:49:36.650957 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:36.650813    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 06 20:49:36.650957 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:36.650833    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f58777cd-jmj2w: secret "image-registry-tls" not found
Jun 06 20:49:36.650957 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:36.650861    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls podName:39469d4f-a471-4585-aa7c-50da5c07e536 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:38.650837424 +0000 UTC m=+195.067649320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-4xb76" (UID: "39469d4f-a471-4585-aa7c-50da5c07e536") : secret "cluster-monitoring-operator-tls" not found
Jun 06 20:49:36.650957 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:36.650816    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 06 20:49:36.650957 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:36.650881    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls podName:3129661f-60d1-4122-aa60-022b39069b66 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:38.65087201 +0000 UTC m=+195.067683909 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls") pod "image-registry-66f58777cd-jmj2w" (UID: "3129661f-60d1-4122-aa60-022b39069b66") : secret "image-registry-tls" not found
Jun 06 20:49:36.650957 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:36.650897    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert podName:69a6f7a6-2bc4-41bb-b033-62d122739350 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:38.650888794 +0000 UTC m=+195.067700695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-drjt8" (UID: "69a6f7a6-2bc4-41bb-b033-62d122739350") : secret "networking-console-plugin-cert" not found
Jun 06 20:49:36.691720 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:36.691689    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-75c557b84-mjmsw" event={"ID":"e9f3cafe-0a66-4261-8d95-2f3db9e6ebf1","Type":"ContainerStarted","Data":"e85db7426a578bb644159793add6e8375221853459f0940bd7b6a17490475ec8"}
Jun 06 20:49:37.696460 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:37.696424    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9" event={"ID":"32981c32-5985-4796-8a8c-15ef60e6a12b","Type":"ContainerStarted","Data":"6a3b83c83f6c2380c85b0c9fa6934f89449e9f05842628a45cf5a5247e269d17"}
Jun 06 20:49:37.712571 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:37.712524    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9" podStartSLOduration=0.657341833 podStartE2EDuration="2.712508632s" totalImagesPullingTime="2.055166799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:49:37.711867771 +0000 UTC m=+194.128679681" watchObservedRunningTime="2026-06-06 20:49:37.712508632 +0000 UTC m=+194.129320576"
Jun 06 20:49:38.567806 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:38.567773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:38.568023 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:38.567852    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:38.568023 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:38.567947    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 06 20:49:38.568023 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:38.567966    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle podName:073b123d-ea96-4527-aadb-769c8007858e nodeName:}" failed. No retries permitted until 2026-06-06 20:49:42.567946062 +0000 UTC m=+198.984757960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle") pod "router-default-54f6949f47-6rxkq" (UID: "073b123d-ea96-4527-aadb-769c8007858e") : configmap references non-existent config key: service-ca.crt
Jun 06 20:49:38.568023 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:38.567995    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs podName:073b123d-ea96-4527-aadb-769c8007858e nodeName:}" failed. No retries permitted until 2026-06-06 20:49:42.567984728 +0000 UTC m=+198.984796627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs") pod "router-default-54f6949f47-6rxkq" (UID: "073b123d-ea96-4527-aadb-769c8007858e") : secret "router-metrics-certs-default" not found
Jun 06 20:49:38.668477 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:38.668439    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4xb76\" (UID: \"39469d4f-a471-4585-aa7c-50da5c07e536\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"
Jun 06 20:49:38.668627 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:38.668488    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:38.668627 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:38.668560    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-drjt8\" (UID: \"69a6f7a6-2bc4-41bb-b033-62d122739350\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8"
Jun 06 20:49:38.668627 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:38.668604    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 06 20:49:38.668752 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:38.668649    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 06 20:49:38.668752 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:38.668674    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls podName:39469d4f-a471-4585-aa7c-50da5c07e536 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:42.668653449 +0000 UTC m=+199.085465350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-4xb76" (UID: "39469d4f-a471-4585-aa7c-50da5c07e536") : secret "cluster-monitoring-operator-tls" not found
Jun 06 20:49:38.668752 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:38.668691    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert podName:69a6f7a6-2bc4-41bb-b033-62d122739350 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:42.668683221 +0000 UTC m=+199.085495116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-drjt8" (UID: "69a6f7a6-2bc4-41bb-b033-62d122739350") : secret "networking-console-plugin-cert" not found
Jun 06 20:49:38.668752 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:38.668671    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 06 20:49:38.668752 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:38.668704    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f58777cd-jmj2w: secret "image-registry-tls" not found
Jun 06 20:49:38.668752 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:38.668734    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls podName:3129661f-60d1-4122-aa60-022b39069b66 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:42.6687229 +0000 UTC m=+199.085534796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls") pod "image-registry-66f58777cd-jmj2w" (UID: "3129661f-60d1-4122-aa60-022b39069b66") : secret "image-registry-tls" not found
Jun 06 20:49:41.059715 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.059677    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-mq2qw"]
Jun 06 20:49:41.063029 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.063007    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-mq2qw"
Jun 06 20:49:41.065351 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.065325    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8j9x6\""
Jun 06 20:49:41.065624 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.065609    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jun 06 20:49:41.066320 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.066278    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jun 06 20:49:41.066422 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.066339    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jun 06 20:49:41.066422 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.066367    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jun 06 20:49:41.070945 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.070924    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-mq2qw"]
Jun 06 20:49:41.088740 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.088709    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/87af027d-81b0-469e-9c6a-dd5abcf10e23-signing-key\") pod \"service-ca-7d74d578b8-mq2qw\" (UID: \"87af027d-81b0-469e-9c6a-dd5abcf10e23\") " pod="openshift-service-ca/service-ca-7d74d578b8-mq2qw"
Jun 06 20:49:41.088870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.088752    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr7lt\" (UniqueName: \"kubernetes.io/projected/87af027d-81b0-469e-9c6a-dd5abcf10e23-kube-api-access-kr7lt\") pod \"service-ca-7d74d578b8-mq2qw\" (UID: \"87af027d-81b0-469e-9c6a-dd5abcf10e23\") " pod="openshift-service-ca/service-ca-7d74d578b8-mq2qw"
Jun 06 20:49:41.088870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.088830    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/87af027d-81b0-469e-9c6a-dd5abcf10e23-signing-cabundle\") pod \"service-ca-7d74d578b8-mq2qw\" (UID: \"87af027d-81b0-469e-9c6a-dd5abcf10e23\") " pod="openshift-service-ca/service-ca-7d74d578b8-mq2qw"
Jun 06 20:49:41.190028 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.189993    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/87af027d-81b0-469e-9c6a-dd5abcf10e23-signing-key\") pod \"service-ca-7d74d578b8-mq2qw\" (UID: \"87af027d-81b0-469e-9c6a-dd5abcf10e23\") " pod="openshift-service-ca/service-ca-7d74d578b8-mq2qw"
Jun 06 20:49:41.190187 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.190053    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr7lt\" (UniqueName: \"kubernetes.io/projected/87af027d-81b0-469e-9c6a-dd5abcf10e23-kube-api-access-kr7lt\") pod \"service-ca-7d74d578b8-mq2qw\" (UID: \"87af027d-81b0-469e-9c6a-dd5abcf10e23\") " pod="openshift-service-ca/service-ca-7d74d578b8-mq2qw"
Jun 06 20:49:41.190187 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.190114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/87af027d-81b0-469e-9c6a-dd5abcf10e23-signing-cabundle\") pod \"service-ca-7d74d578b8-mq2qw\" (UID: \"87af027d-81b0-469e-9c6a-dd5abcf10e23\") " pod="openshift-service-ca/service-ca-7d74d578b8-mq2qw"
Jun 06 20:49:41.190852 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.190825    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/87af027d-81b0-469e-9c6a-dd5abcf10e23-signing-cabundle\") pod \"service-ca-7d74d578b8-mq2qw\" (UID: \"87af027d-81b0-469e-9c6a-dd5abcf10e23\") " pod="openshift-service-ca/service-ca-7d74d578b8-mq2qw"
Jun 06 20:49:41.192471 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.192451    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/87af027d-81b0-469e-9c6a-dd5abcf10e23-signing-key\") pod \"service-ca-7d74d578b8-mq2qw\" (UID: \"87af027d-81b0-469e-9c6a-dd5abcf10e23\") " pod="openshift-service-ca/service-ca-7d74d578b8-mq2qw"
Jun 06 20:49:41.199104 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.199082    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr7lt\" (UniqueName: \"kubernetes.io/projected/87af027d-81b0-469e-9c6a-dd5abcf10e23-kube-api-access-kr7lt\") pod \"service-ca-7d74d578b8-mq2qw\" (UID: \"87af027d-81b0-469e-9c6a-dd5abcf10e23\") " pod="openshift-service-ca/service-ca-7d74d578b8-mq2qw"
Jun 06 20:49:41.372544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.372439    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-mq2qw"
Jun 06 20:49:41.496539 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.496506    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-mq2qw"]
Jun 06 20:49:41.499730 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:49:41.499700    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87af027d_81b0_469e_9c6a_dd5abcf10e23.slice/crio-da490022cf893bc2fcdb15bc1f347317332a2cc83f9a3dccf47787efd8e2b0cf WatchSource:0}: Error finding container da490022cf893bc2fcdb15bc1f347317332a2cc83f9a3dccf47787efd8e2b0cf: Status 404 returned error can't find the container with id da490022cf893bc2fcdb15bc1f347317332a2cc83f9a3dccf47787efd8e2b0cf
Jun 06 20:49:41.710683 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.710590    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-mq2qw" event={"ID":"87af027d-81b0-469e-9c6a-dd5abcf10e23","Type":"ContainerStarted","Data":"d08030fd7f6d64d7b6f9082d412e5c914d8dd5c22de5e073d0eac98328ed5d20"}
Jun 06 20:49:41.710683 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.710654    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-mq2qw" event={"ID":"87af027d-81b0-469e-9c6a-dd5abcf10e23","Type":"ContainerStarted","Data":"da490022cf893bc2fcdb15bc1f347317332a2cc83f9a3dccf47787efd8e2b0cf"}
Jun 06 20:49:41.728316 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:41.728255    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-mq2qw" podStartSLOduration=0.728240328 podStartE2EDuration="728.240328ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:49:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:49:41.726796829 +0000 UTC m=+198.143608745" watchObservedRunningTime="2026-06-06 20:49:41.728240328 +0000 UTC m=+198.145052244"
Jun 06 20:49:42.602355 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:42.602293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:42.602805 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:42.602402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:42.602805 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:42.602457    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 06 20:49:42.602805 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:42.602533    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs podName:073b123d-ea96-4527-aadb-769c8007858e nodeName:}" failed. No retries permitted until 2026-06-06 20:49:50.602509908 +0000 UTC m=+207.019321808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs") pod "router-default-54f6949f47-6rxkq" (UID: "073b123d-ea96-4527-aadb-769c8007858e") : secret "router-metrics-certs-default" not found
Jun 06 20:49:42.602805 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:42.602581    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle podName:073b123d-ea96-4527-aadb-769c8007858e nodeName:}" failed. No retries permitted until 2026-06-06 20:49:50.602565666 +0000 UTC m=+207.019377565 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle") pod "router-default-54f6949f47-6rxkq" (UID: "073b123d-ea96-4527-aadb-769c8007858e") : configmap references non-existent config key: service-ca.crt
Jun 06 20:49:42.703808 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:42.703772    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-drjt8\" (UID: \"69a6f7a6-2bc4-41bb-b033-62d122739350\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8"
Jun 06 20:49:42.704005 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:42.703859    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4xb76\" (UID: \"39469d4f-a471-4585-aa7c-50da5c07e536\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"
Jun 06 20:49:42.704005 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:42.703896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:42.704005 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:42.703929    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 06 20:49:42.704005 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:42.703996    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 06 20:49:42.704235 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:42.704010    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f58777cd-jmj2w: secret "image-registry-tls" not found
Jun 06 20:49:42.704235 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:42.704116    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 06 20:49:42.704235 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:42.703999    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert podName:69a6f7a6-2bc4-41bb-b033-62d122739350 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:50.70398031 +0000 UTC m=+207.120792211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-drjt8" (UID: "69a6f7a6-2bc4-41bb-b033-62d122739350") : secret "networking-console-plugin-cert" not found
Jun 06 20:49:42.704235 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:42.704169    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls podName:3129661f-60d1-4122-aa60-022b39069b66 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:50.704151874 +0000 UTC m=+207.120963770 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls") pod "image-registry-66f58777cd-jmj2w" (UID: "3129661f-60d1-4122-aa60-022b39069b66") : secret "image-registry-tls" not found
Jun 06 20:49:42.704235 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:49:42.704184    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls podName:39469d4f-a471-4585-aa7c-50da5c07e536 nodeName:}" failed. No retries permitted until 2026-06-06 20:49:50.704175519 +0000 UTC m=+207.120987421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-4xb76" (UID: "39469d4f-a471-4585-aa7c-50da5c07e536") : secret "cluster-monitoring-operator-tls" not found
Jun 06 20:49:43.250197 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:43.250167    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wx7qf_7a3a545a-09f9-43df-a03d-452a58df3e9e/dns-node-resolver/0.log"
Jun 06 20:49:44.253959 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:44.253931    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wlzv5_ee039af8-9795-4768-a9f3-e84e68fa3119/node-ca/0.log"
Jun 06 20:49:44.650732 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:44.650658    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jmz78_1a29988c-1445-4801-9656-a8f6134dcb05/serve-healthcheck-canary/0.log"
Jun 06 20:49:50.670250 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:50.670206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:50.670664 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:50.670274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:50.670971 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:50.670950    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/073b123d-ea96-4527-aadb-769c8007858e-service-ca-bundle\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:50.672657 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:50.672640    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/073b123d-ea96-4527-aadb-769c8007858e-metrics-certs\") pod \"router-default-54f6949f47-6rxkq\" (UID: \"073b123d-ea96-4527-aadb-769c8007858e\") " pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:50.770731 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:50.770699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4xb76\" (UID: \"39469d4f-a471-4585-aa7c-50da5c07e536\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"
Jun 06 20:49:50.770894 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:50.770741    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:50.770894 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:50.770786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-drjt8\" (UID: \"69a6f7a6-2bc4-41bb-b033-62d122739350\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8"
Jun 06 20:49:50.773113 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:50.773081    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69a6f7a6-2bc4-41bb-b033-62d122739350-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-drjt8\" (UID: \"69a6f7a6-2bc4-41bb-b033-62d122739350\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8"
Jun 06 20:49:50.773362 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:50.773340    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/39469d4f-a471-4585-aa7c-50da5c07e536-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4xb76\" (UID: \"39469d4f-a471-4585-aa7c-50da5c07e536\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"
Jun 06 20:49:50.773413 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:50.773340    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls\") pod \"image-registry-66f58777cd-jmj2w\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") " pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:50.842002 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:50.841970    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:50.930513 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:50.930436    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8"
Jun 06 20:49:50.941194 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:50.941167    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"
Jun 06 20:49:50.963733 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:50.963702    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:50.981712 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:50.981653    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54f6949f47-6rxkq"]
Jun 06 20:49:50.989102 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:49:50.989067    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod073b123d_ea96_4527_aadb_769c8007858e.slice/crio-073ce0bd50a06fe21328f9368723943de1716a0d62e8332229f22a58b1b9c560 WatchSource:0}: Error finding container 073ce0bd50a06fe21328f9368723943de1716a0d62e8332229f22a58b1b9c560: Status 404 returned error can't find the container with id 073ce0bd50a06fe21328f9368723943de1716a0d62e8332229f22a58b1b9c560
Jun 06 20:49:51.086598 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:51.086221    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8"]
Jun 06 20:49:51.090792 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:49:51.090763    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69a6f7a6_2bc4_41bb_b033_62d122739350.slice/crio-1cd7e57ebfa6ba2a59e548157fbe3c5d327edd33604b73b5eff8fefec968d4b7 WatchSource:0}: Error finding container 1cd7e57ebfa6ba2a59e548157fbe3c5d327edd33604b73b5eff8fefec968d4b7: Status 404 returned error can't find the container with id 1cd7e57ebfa6ba2a59e548157fbe3c5d327edd33604b73b5eff8fefec968d4b7
Jun 06 20:49:51.111413 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:51.111254    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76"]
Jun 06 20:49:51.114036 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:49:51.114007    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39469d4f_a471_4585_aa7c_50da5c07e536.slice/crio-1b004d1f8f4ef409807426ad66a14177410e0e0373eb06ccd452fee1e14d1d1d WatchSource:0}: Error finding container 1b004d1f8f4ef409807426ad66a14177410e0e0373eb06ccd452fee1e14d1d1d: Status 404 returned error can't find the container with id 1b004d1f8f4ef409807426ad66a14177410e0e0373eb06ccd452fee1e14d1d1d
Jun 06 20:49:51.137288 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:51.137124    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66f58777cd-jmj2w"]
Jun 06 20:49:51.139906 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:49:51.139882    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3129661f_60d1_4122_aa60_022b39069b66.slice/crio-1d754012925b20c3c2061d2e598b732528bff76e056984d0a929102649e8d811 WatchSource:0}: Error finding container 1d754012925b20c3c2061d2e598b732528bff76e056984d0a929102649e8d811: Status 404 returned error can't find the container with id 1d754012925b20c3c2061d2e598b732528bff76e056984d0a929102649e8d811
Jun 06 20:49:51.743754 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:51.743715    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66f58777cd-jmj2w" event={"ID":"3129661f-60d1-4122-aa60-022b39069b66","Type":"ContainerStarted","Data":"524e8a129714a27256856dc64effcd8a573eeeca6aa983f6863c2fd809ce52bc"}
Jun 06 20:49:51.744250 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:51.743773    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66f58777cd-jmj2w" event={"ID":"3129661f-60d1-4122-aa60-022b39069b66","Type":"ContainerStarted","Data":"1d754012925b20c3c2061d2e598b732528bff76e056984d0a929102649e8d811"}
Jun 06 20:49:51.744250 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:51.743927    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:49:51.745480 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:51.745443    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76" event={"ID":"39469d4f-a471-4585-aa7c-50da5c07e536","Type":"ContainerStarted","Data":"1b004d1f8f4ef409807426ad66a14177410e0e0373eb06ccd452fee1e14d1d1d"}
Jun 06 20:49:51.747388 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:51.747359    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f6949f47-6rxkq" event={"ID":"073b123d-ea96-4527-aadb-769c8007858e","Type":"ContainerStarted","Data":"d1a368508b9df7694f0a349c8f62c643b1405aaa330875c0c4b5cd0c1cf6f18b"}
Jun 06 20:49:51.747492 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:51.747407    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f6949f47-6rxkq" event={"ID":"073b123d-ea96-4527-aadb-769c8007858e","Type":"ContainerStarted","Data":"073ce0bd50a06fe21328f9368723943de1716a0d62e8332229f22a58b1b9c560"}
Jun 06 20:49:51.749338 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:51.749279    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8" event={"ID":"69a6f7a6-2bc4-41bb-b033-62d122739350","Type":"ContainerStarted","Data":"1cd7e57ebfa6ba2a59e548157fbe3c5d327edd33604b73b5eff8fefec968d4b7"}
Jun 06 20:49:51.762959 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:51.762910    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66f58777cd-jmj2w" podStartSLOduration=16.762892389 podStartE2EDuration="16.762892389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:49:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:49:51.761101839 +0000 UTC m=+208.177913763" watchObservedRunningTime="2026-06-06 20:49:51.762892389 +0000 UTC m=+208.179704311"
Jun 06 20:49:51.780621 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:51.779612    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-54f6949f47-6rxkq" podStartSLOduration=17.779599182 podStartE2EDuration="17.779599182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:49:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:49:51.777687924 +0000 UTC m=+208.194499847" watchObservedRunningTime="2026-06-06 20:49:51.779599182 +0000 UTC m=+208.196411100"
Jun 06 20:49:51.842680 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:51.842645    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:51.845818 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:51.845793    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:52.754244 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:52.754206    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8" event={"ID":"69a6f7a6-2bc4-41bb-b033-62d122739350","Type":"ContainerStarted","Data":"73add217d60c9a7b5c4d12c7dfafdf2c57cce97afee59e6b3d3fcb9f436be33b"}
Jun 06 20:49:52.754733 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:52.754704    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:52.755935 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:52.755912    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54f6949f47-6rxkq"
Jun 06 20:49:52.769877 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:52.769825    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-drjt8" podStartSLOduration=16.556712029 podStartE2EDuration="17.769806812s" totalImagesPullingTime="1.213094783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:49:52.769073994 +0000 UTC m=+209.185885912" watchObservedRunningTime="2026-06-06 20:49:52.769806812 +0000 UTC m=+209.186618729"
Jun 06 20:49:53.759022 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:53.758982    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76" event={"ID":"39469d4f-a471-4585-aa7c-50da5c07e536","Type":"ContainerStarted","Data":"b38f3e433fd41ec81a469a2135c59735f9225c596ac4997eaa6a5fe9b89ad1d4"}
Jun 06 20:49:53.775243 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:49:53.775194    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4xb76" podStartSLOduration=16.842352472 podStartE2EDuration="18.775179647s" totalImagesPullingTime="1.932827175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:49:53.773976851 +0000 UTC m=+210.190788769" watchObservedRunningTime="2026-06-06 20:49:53.775179647 +0000 UTC m=+210.191991584"
Jun 06 20:50:02.986265 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:02.986229    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-hd2x6"]
Jun 06 20:50:02.991055 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:02.991036    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-hd2x6"
Jun 06 20:50:02.995485 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:02.995463    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-56jsk\""
Jun 06 20:50:02.995654 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:02.995633    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 06 20:50:02.995731 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:02.995636    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 06 20:50:03.001687 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.001659    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66f58777cd-jmj2w"]
Jun 06 20:50:03.008420 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.008394    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-hd2x6"]
Jun 06 20:50:03.046983 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.046945    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9fhj4"]
Jun 06 20:50:03.050390 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.050365    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-df5d466b8-ppv2k"]
Jun 06 20:50:03.050541 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.050520    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.053218 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.053182    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 06 20:50:03.053401 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.053188    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 06 20:50:03.053401 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.053348    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.053401 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.053354    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 06 20:50:03.053401 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.053379    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-28rxg\""
Jun 06 20:50:03.053627 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.053610    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 06 20:50:03.062915 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.062895    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9fhj4"]
Jun 06 20:50:03.066068 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.066011    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-df5d466b8-ppv2k"]
Jun 06 20:50:03.068789 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.068762    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jntjf\" (UniqueName: \"kubernetes.io/projected/3b4a1f36-dfbc-4006-af93-218d90da10f3-kube-api-access-jntjf\") pod \"downloads-6657875f97-hd2x6\" (UID: \"3b4a1f36-dfbc-4006-af93-218d90da10f3\") " pod="openshift-console/downloads-6657875f97-hd2x6"
Jun 06 20:50:03.169758 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.169725    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdc3bf76-99e9-4b60-b194-96307d04e926-registry-tls\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.169758 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.169758    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bdc3bf76-99e9-4b60-b194-96307d04e926-trusted-ca\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.170014 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.169779    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdc3bf76-99e9-4b60-b194-96307d04e926-bound-sa-token\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.170014 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.169845    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bdc3bf76-99e9-4b60-b194-96307d04e926-image-registry-private-configuration\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.170014 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.169918    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bdc3bf76-99e9-4b60-b194-96307d04e926-installation-pull-secrets\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.170014 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.169951    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cllw\" (UniqueName: \"kubernetes.io/projected/bdc3bf76-99e9-4b60-b194-96307d04e926-kube-api-access-5cllw\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.170014 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.169979    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54e8c74d-add3-475c-a43e-48e4c3e82b70-crio-socket\") pod \"insights-runtime-extractor-9fhj4\" (UID: \"54e8c74d-add3-475c-a43e-48e4c3e82b70\") " pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.170014 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.170005    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54e8c74d-add3-475c-a43e-48e4c3e82b70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9fhj4\" (UID: \"54e8c74d-add3-475c-a43e-48e4c3e82b70\") " pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.170350 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.170045    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjrpn\" (UniqueName: \"kubernetes.io/projected/54e8c74d-add3-475c-a43e-48e4c3e82b70-kube-api-access-qjrpn\") pod \"insights-runtime-extractor-9fhj4\" (UID: \"54e8c74d-add3-475c-a43e-48e4c3e82b70\") " pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.170350 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.170121    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54e8c74d-add3-475c-a43e-48e4c3e82b70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9fhj4\" (UID: \"54e8c74d-add3-475c-a43e-48e4c3e82b70\") " pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.170350 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.170152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jntjf\" (UniqueName: \"kubernetes.io/projected/3b4a1f36-dfbc-4006-af93-218d90da10f3-kube-api-access-jntjf\") pod \"downloads-6657875f97-hd2x6\" (UID: \"3b4a1f36-dfbc-4006-af93-218d90da10f3\") " pod="openshift-console/downloads-6657875f97-hd2x6"
Jun 06 20:50:03.170350 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.170181    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54e8c74d-add3-475c-a43e-48e4c3e82b70-data-volume\") pod \"insights-runtime-extractor-9fhj4\" (UID: \"54e8c74d-add3-475c-a43e-48e4c3e82b70\") " pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.170350 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.170208    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bdc3bf76-99e9-4b60-b194-96307d04e926-registry-certificates\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.170350 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.170251    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bdc3bf76-99e9-4b60-b194-96307d04e926-ca-trust-extracted\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.180240 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.180219    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jntjf\" (UniqueName: \"kubernetes.io/projected/3b4a1f36-dfbc-4006-af93-218d90da10f3-kube-api-access-jntjf\") pod \"downloads-6657875f97-hd2x6\" (UID: \"3b4a1f36-dfbc-4006-af93-218d90da10f3\") " pod="openshift-console/downloads-6657875f97-hd2x6"
Jun 06 20:50:03.271600 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.271568    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bdc3bf76-99e9-4b60-b194-96307d04e926-ca-trust-extracted\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.271717 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.271617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdc3bf76-99e9-4b60-b194-96307d04e926-registry-tls\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.271717 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.271641    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bdc3bf76-99e9-4b60-b194-96307d04e926-trusted-ca\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.271717 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.271669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdc3bf76-99e9-4b60-b194-96307d04e926-bound-sa-token\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.271717 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.271708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bdc3bf76-99e9-4b60-b194-96307d04e926-image-registry-private-configuration\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.271895 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.271761    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bdc3bf76-99e9-4b60-b194-96307d04e926-installation-pull-secrets\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.271895 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.271791    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cllw\" (UniqueName: \"kubernetes.io/projected/bdc3bf76-99e9-4b60-b194-96307d04e926-kube-api-access-5cllw\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.271895 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.271819    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54e8c74d-add3-475c-a43e-48e4c3e82b70-crio-socket\") pod \"insights-runtime-extractor-9fhj4\" (UID: \"54e8c74d-add3-475c-a43e-48e4c3e82b70\") " pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.271895 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.271843    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54e8c74d-add3-475c-a43e-48e4c3e82b70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9fhj4\" (UID: \"54e8c74d-add3-475c-a43e-48e4c3e82b70\") " pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.271895 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.271870    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjrpn\" (UniqueName: \"kubernetes.io/projected/54e8c74d-add3-475c-a43e-48e4c3e82b70-kube-api-access-qjrpn\") pod \"insights-runtime-extractor-9fhj4\" (UID: \"54e8c74d-add3-475c-a43e-48e4c3e82b70\") " pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.272128 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.271917    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54e8c74d-add3-475c-a43e-48e4c3e82b70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9fhj4\" (UID: \"54e8c74d-add3-475c-a43e-48e4c3e82b70\") " pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.272128 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.271949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54e8c74d-add3-475c-a43e-48e4c3e82b70-data-volume\") pod \"insights-runtime-extractor-9fhj4\" (UID: \"54e8c74d-add3-475c-a43e-48e4c3e82b70\") " pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.272128 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.271975    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bdc3bf76-99e9-4b60-b194-96307d04e926-registry-certificates\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.272128 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.272014    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bdc3bf76-99e9-4b60-b194-96307d04e926-ca-trust-extracted\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.272426 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.272405    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54e8c74d-add3-475c-a43e-48e4c3e82b70-crio-socket\") pod \"insights-runtime-extractor-9fhj4\" (UID: \"54e8c74d-add3-475c-a43e-48e4c3e82b70\") " pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.272770 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.272747    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54e8c74d-add3-475c-a43e-48e4c3e82b70-data-volume\") pod \"insights-runtime-extractor-9fhj4\" (UID: \"54e8c74d-add3-475c-a43e-48e4c3e82b70\") " pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.272898 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.272771    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bdc3bf76-99e9-4b60-b194-96307d04e926-trusted-ca\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.273079 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.273061    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54e8c74d-add3-475c-a43e-48e4c3e82b70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9fhj4\" (UID: \"54e8c74d-add3-475c-a43e-48e4c3e82b70\") " pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.273485 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.273463    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bdc3bf76-99e9-4b60-b194-96307d04e926-registry-certificates\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.274818 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.274777    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bdc3bf76-99e9-4b60-b194-96307d04e926-installation-pull-secrets\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.274818 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.274806    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdc3bf76-99e9-4b60-b194-96307d04e926-registry-tls\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.274997 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.274806    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54e8c74d-add3-475c-a43e-48e4c3e82b70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9fhj4\" (UID: \"54e8c74d-add3-475c-a43e-48e4c3e82b70\") " pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.275041 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.275026    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bdc3bf76-99e9-4b60-b194-96307d04e926-image-registry-private-configuration\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.282080 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.282054    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cllw\" (UniqueName: \"kubernetes.io/projected/bdc3bf76-99e9-4b60-b194-96307d04e926-kube-api-access-5cllw\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.282741 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.282695    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjrpn\" (UniqueName: \"kubernetes.io/projected/54e8c74d-add3-475c-a43e-48e4c3e82b70-kube-api-access-qjrpn\") pod \"insights-runtime-extractor-9fhj4\" (UID: \"54e8c74d-add3-475c-a43e-48e4c3e82b70\") " pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.283060 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.283038    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdc3bf76-99e9-4b60-b194-96307d04e926-bound-sa-token\") pod \"image-registry-df5d466b8-ppv2k\" (UID: \"bdc3bf76-99e9-4b60-b194-96307d04e926\") " pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.302086 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.302061    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-hd2x6"
Jun 06 20:50:03.361292 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.361264    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9fhj4"
Jun 06 20:50:03.370539 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.370445    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.457404 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.457286    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-hd2x6"]
Jun 06 20:50:03.461239 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:50:03.461205    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b4a1f36_dfbc_4006_af93_218d90da10f3.slice/crio-da986fad83f0ac152d2091b57b118a2e07342b6fad5354f04b7ea7ef266e177d WatchSource:0}: Error finding container da986fad83f0ac152d2091b57b118a2e07342b6fad5354f04b7ea7ef266e177d: Status 404 returned error can't find the container with id da986fad83f0ac152d2091b57b118a2e07342b6fad5354f04b7ea7ef266e177d
Jun 06 20:50:03.519895 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.519750    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9fhj4"]
Jun 06 20:50:03.522482 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:50:03.522453    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e8c74d_add3_475c_a43e_48e4c3e82b70.slice/crio-0780e15fa08336592753188dbec32870058889b8140106302dd9797c7534b928 WatchSource:0}: Error finding container 0780e15fa08336592753188dbec32870058889b8140106302dd9797c7534b928: Status 404 returned error can't find the container with id 0780e15fa08336592753188dbec32870058889b8140106302dd9797c7534b928
Jun 06 20:50:03.538957 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.538935    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-df5d466b8-ppv2k"]
Jun 06 20:50:03.543365 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:50:03.543340    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc3bf76_99e9_4b60_b194_96307d04e926.slice/crio-92443530b09827a0292f008eb26b0e5aadd9458ae363b5bfa8c7301442f2b3aa WatchSource:0}: Error finding container 92443530b09827a0292f008eb26b0e5aadd9458ae363b5bfa8c7301442f2b3aa: Status 404 returned error can't find the container with id 92443530b09827a0292f008eb26b0e5aadd9458ae363b5bfa8c7301442f2b3aa
Jun 06 20:50:03.793558 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.793470    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9fhj4" event={"ID":"54e8c74d-add3-475c-a43e-48e4c3e82b70","Type":"ContainerStarted","Data":"3b4f8174d6b779ab4e2b6f17c33594acc2130fd6b3a02dca524dc95e61d181af"}
Jun 06 20:50:03.793558 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.793534    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9fhj4" event={"ID":"54e8c74d-add3-475c-a43e-48e4c3e82b70","Type":"ContainerStarted","Data":"0780e15fa08336592753188dbec32870058889b8140106302dd9797c7534b928"}
Jun 06 20:50:03.794648 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.794624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-hd2x6" event={"ID":"3b4a1f36-dfbc-4006-af93-218d90da10f3","Type":"ContainerStarted","Data":"da986fad83f0ac152d2091b57b118a2e07342b6fad5354f04b7ea7ef266e177d"}
Jun 06 20:50:03.796034 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.796011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k" event={"ID":"bdc3bf76-99e9-4b60-b194-96307d04e926","Type":"ContainerStarted","Data":"97c769bdedbe37afc03acf5d642e8596e64183f553898d0e681b6f70c3f2e081"}
Jun 06 20:50:03.796133 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.796046    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k" event={"ID":"bdc3bf76-99e9-4b60-b194-96307d04e926","Type":"ContainerStarted","Data":"92443530b09827a0292f008eb26b0e5aadd9458ae363b5bfa8c7301442f2b3aa"}
Jun 06 20:50:03.796175 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.796138    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:03.814015 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:03.813956    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k" podStartSLOduration=0.813936448 podStartE2EDuration="813.936448ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:50:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:03.813171931 +0000 UTC m=+220.229983870" watchObservedRunningTime="2026-06-06 20:50:03.813936448 +0000 UTC m=+220.230748366"
Jun 06 20:50:04.803595 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:04.803541    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9fhj4" event={"ID":"54e8c74d-add3-475c-a43e-48e4c3e82b70","Type":"ContainerStarted","Data":"9efea0d913a5dadc7444c457c2ea6e6cb03bb76030311ebfb5c45c0ba62ade58"}
Jun 06 20:50:06.813318 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:06.813269    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9fhj4" event={"ID":"54e8c74d-add3-475c-a43e-48e4c3e82b70","Type":"ContainerStarted","Data":"1280749d9bf2c145801e19cf90cbd557c23fc32ba19094c0f57184ac200916a5"}
Jun 06 20:50:06.835429 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:06.835370    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9fhj4" podStartSLOduration=1.5929548439999999 podStartE2EDuration="3.835352629s" totalImagesPullingTime="2.242397785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:50:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:06.833654097 +0000 UTC m=+223.250466015" watchObservedRunningTime="2026-06-06 20:50:06.835352629 +0000 UTC m=+223.252164546"
Jun 06 20:50:10.939318 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:10.934427    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hdphs"]
Jun 06 20:50:10.939942 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:10.939917    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:10.950317 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:10.942874    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 06 20:50:10.950317 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:10.943121    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 06 20:50:10.950317 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:10.943349    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 06 20:50:10.950317 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:10.945820    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 06 20:50:10.950317 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:10.946663    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xcx7p\""
Jun 06 20:50:11.039970 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.039930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/79564215-9370-4efd-a981-a56967d41af5-node-exporter-accelerators-collector-config\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.040158 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.039981    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79564215-9370-4efd-a981-a56967d41af5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.040158 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.040030    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79564215-9370-4efd-a981-a56967d41af5-metrics-client-ca\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.040158 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.040133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79564215-9370-4efd-a981-a56967d41af5-node-exporter-tls\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.040336 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.040177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/79564215-9370-4efd-a981-a56967d41af5-root\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.040336 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.040259    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/79564215-9370-4efd-a981-a56967d41af5-node-exporter-wtmp\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.040443 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.040384    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79564215-9370-4efd-a981-a56967d41af5-sys\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.040443 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.040414    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/79564215-9370-4efd-a981-a56967d41af5-node-exporter-textfile\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.040539 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.040477    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7njv9\" (UniqueName: \"kubernetes.io/projected/79564215-9370-4efd-a981-a56967d41af5-kube-api-access-7njv9\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.141733 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.141694    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79564215-9370-4efd-a981-a56967d41af5-node-exporter-tls\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.141917 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.141747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/79564215-9370-4efd-a981-a56967d41af5-root\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.141917 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.141787    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/79564215-9370-4efd-a981-a56967d41af5-node-exporter-wtmp\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.141917 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.141847    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79564215-9370-4efd-a981-a56967d41af5-sys\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.141917 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.141871    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/79564215-9370-4efd-a981-a56967d41af5-node-exporter-textfile\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.141917 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.141903    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7njv9\" (UniqueName: \"kubernetes.io/projected/79564215-9370-4efd-a981-a56967d41af5-kube-api-access-7njv9\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.142196 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.141929    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/79564215-9370-4efd-a981-a56967d41af5-node-exporter-accelerators-collector-config\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.142196 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.141961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79564215-9370-4efd-a981-a56967d41af5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.142196 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.141998    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79564215-9370-4efd-a981-a56967d41af5-metrics-client-ca\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.142402 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.142378    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79564215-9370-4efd-a981-a56967d41af5-sys\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.142514 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:50:11.142497    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jun 06 20:50:11.142578 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:50:11.142566    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79564215-9370-4efd-a981-a56967d41af5-node-exporter-tls podName:79564215-9370-4efd-a981-a56967d41af5 nodeName:}" failed. No retries permitted until 2026-06-06 20:50:11.642547749 +0000 UTC m=+228.059359658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/79564215-9370-4efd-a981-a56967d41af5-node-exporter-tls") pod "node-exporter-hdphs" (UID: "79564215-9370-4efd-a981-a56967d41af5") : secret "node-exporter-tls" not found
Jun 06 20:50:11.142640 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.142618    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/79564215-9370-4efd-a981-a56967d41af5-node-exporter-wtmp\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.142689 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.142656    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79564215-9370-4efd-a981-a56967d41af5-metrics-client-ca\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.142740 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.142494    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/79564215-9370-4efd-a981-a56967d41af5-root\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.142972 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.142933    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/79564215-9370-4efd-a981-a56967d41af5-node-exporter-textfile\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.143151 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.143112    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/79564215-9370-4efd-a981-a56967d41af5-node-exporter-accelerators-collector-config\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.145586 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.145537    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79564215-9370-4efd-a981-a56967d41af5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.152902 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.152359    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7njv9\" (UniqueName: \"kubernetes.io/projected/79564215-9370-4efd-a981-a56967d41af5-kube-api-access-7njv9\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.648628 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.648589    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79564215-9370-4efd-a981-a56967d41af5-node-exporter-tls\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.651238 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.651211    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/79564215-9370-4efd-a981-a56967d41af5-node-exporter-tls\") pod \"node-exporter-hdphs\" (UID: \"79564215-9370-4efd-a981-a56967d41af5\") " pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.866661 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:11.866627    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hdphs"
Jun 06 20:50:11.881047 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:50:11.881016    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79564215_9370_4efd_a981_a56967d41af5.slice/crio-74e21e281bbd168604d5a7e7217e99098bf53e57f9fd7e9d6a5f606abdebf37e WatchSource:0}: Error finding container 74e21e281bbd168604d5a7e7217e99098bf53e57f9fd7e9d6a5f606abdebf37e: Status 404 returned error can't find the container with id 74e21e281bbd168604d5a7e7217e99098bf53e57f9fd7e9d6a5f606abdebf37e
Jun 06 20:50:12.838634 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:12.838593    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hdphs" event={"ID":"79564215-9370-4efd-a981-a56967d41af5","Type":"ContainerStarted","Data":"74e21e281bbd168604d5a7e7217e99098bf53e57f9fd7e9d6a5f606abdebf37e"}
Jun 06 20:50:13.008949 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:13.008911    2577 patch_prober.go:28] interesting pod/image-registry-66f58777cd-jmj2w container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 06 20:50:13.009121 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:13.008974    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-66f58777cd-jmj2w" podUID="3129661f-60d1-4122-aa60-022b39069b66" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 06 20:50:13.844107 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:13.844070    2577 generic.go:356] "Generic (PLEG): container finished" podID="79564215-9370-4efd-a981-a56967d41af5" containerID="25fba704caabee031eb120217cfb4e9eb66b1884296c5f629019c5e939665b51" exitCode=0
Jun 06 20:50:13.844602 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:13.844162    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hdphs" event={"ID":"79564215-9370-4efd-a981-a56967d41af5","Type":"ContainerDied","Data":"25fba704caabee031eb120217cfb4e9eb66b1884296c5f629019c5e939665b51"}
Jun 06 20:50:16.095676 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.095640    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67b66fc94-hrd4k"]
Jun 06 20:50:16.100173 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.100144    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.102662 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.102586    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jun 06 20:50:16.102662 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.102628    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jun 06 20:50:16.102662 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.102661    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jun 06 20:50:16.102903 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.102667    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jun 06 20:50:16.102903 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.102586    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9tqc2\""
Jun 06 20:50:16.102903 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.102586    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jun 06 20:50:16.108147 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.108107    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jun 06 20:50:16.109343 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.109322    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67b66fc94-hrd4k"]
Jun 06 20:50:16.195836 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.195795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ae7352c7-99e8-4ca6-a827-3350f3adacde-telemeter-client-tls\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.196022 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.195869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae7352c7-99e8-4ca6-a827-3350f3adacde-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.196022 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.195899    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ae7352c7-99e8-4ca6-a827-3350f3adacde-federate-client-tls\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.196022 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.195932    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ae7352c7-99e8-4ca6-a827-3350f3adacde-secret-telemeter-client\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.196022 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.195990    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7352c7-99e8-4ca6-a827-3350f3adacde-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.196248 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.196184    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2t5z\" (UniqueName: \"kubernetes.io/projected/ae7352c7-99e8-4ca6-a827-3350f3adacde-kube-api-access-d2t5z\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.196248 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.196214    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7352c7-99e8-4ca6-a827-3350f3adacde-serving-certs-ca-bundle\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.196248 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.196232    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae7352c7-99e8-4ca6-a827-3350f3adacde-metrics-client-ca\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.296686 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.296648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2t5z\" (UniqueName: \"kubernetes.io/projected/ae7352c7-99e8-4ca6-a827-3350f3adacde-kube-api-access-d2t5z\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.296686 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.296687    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7352c7-99e8-4ca6-a827-3350f3adacde-serving-certs-ca-bundle\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.296931 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.296708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae7352c7-99e8-4ca6-a827-3350f3adacde-metrics-client-ca\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.296931 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.296749    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ae7352c7-99e8-4ca6-a827-3350f3adacde-telemeter-client-tls\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.296931 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.296787    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae7352c7-99e8-4ca6-a827-3350f3adacde-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.296931 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.296839    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ae7352c7-99e8-4ca6-a827-3350f3adacde-federate-client-tls\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.296931 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.296876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ae7352c7-99e8-4ca6-a827-3350f3adacde-secret-telemeter-client\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.296931 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.296902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7352c7-99e8-4ca6-a827-3350f3adacde-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.297558 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.297517    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7352c7-99e8-4ca6-a827-3350f3adacde-serving-certs-ca-bundle\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.297686 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.297596    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae7352c7-99e8-4ca6-a827-3350f3adacde-metrics-client-ca\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.297789 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.297745    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae7352c7-99e8-4ca6-a827-3350f3adacde-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.299780 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.299739    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ae7352c7-99e8-4ca6-a827-3350f3adacde-telemeter-client-tls\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.299917 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.299894    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ae7352c7-99e8-4ca6-a827-3350f3adacde-federate-client-tls\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.299990 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.299896    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae7352c7-99e8-4ca6-a827-3350f3adacde-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.300257 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.300235    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ae7352c7-99e8-4ca6-a827-3350f3adacde-secret-telemeter-client\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.308856 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.308806    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2t5z\" (UniqueName: \"kubernetes.io/projected/ae7352c7-99e8-4ca6-a827-3350f3adacde-kube-api-access-d2t5z\") pod \"telemeter-client-67b66fc94-hrd4k\" (UID: \"ae7352c7-99e8-4ca6-a827-3350f3adacde\") " pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:16.412358 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:16.412264    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k"
Jun 06 20:50:20.303928 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:20.303907    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67b66fc94-hrd4k"]
Jun 06 20:50:20.306125 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:50:20.306101    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7352c7_99e8_4ca6_a827_3350f3adacde.slice/crio-cbc14a9e32c555f2e70b5df6993eb362455e1ee24349375d81c0355a140d3ff8 WatchSource:0}: Error finding container cbc14a9e32c555f2e70b5df6993eb362455e1ee24349375d81c0355a140d3ff8: Status 404 returned error can't find the container with id cbc14a9e32c555f2e70b5df6993eb362455e1ee24349375d81c0355a140d3ff8
Jun 06 20:50:20.872720 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:20.872688    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hdphs" event={"ID":"79564215-9370-4efd-a981-a56967d41af5","Type":"ContainerStarted","Data":"0dfa1e1082fc51764d7ad744a6ec72965c6fd28396262c720c317b0f35b3a196"}
Jun 06 20:50:20.872845 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:20.872753    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hdphs" event={"ID":"79564215-9370-4efd-a981-a56967d41af5","Type":"ContainerStarted","Data":"5bc5fc9baa055c9225f16e7c5c9edf8490b71ce2c0e27717915206ada154dedf"}
Jun 06 20:50:20.873884 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:20.873865    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k" event={"ID":"ae7352c7-99e8-4ca6-a827-3350f3adacde","Type":"ContainerStarted","Data":"cbc14a9e32c555f2e70b5df6993eb362455e1ee24349375d81c0355a140d3ff8"}
Jun 06 20:50:20.893015 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:20.892960    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hdphs" podStartSLOduration=9.831853053 podStartE2EDuration="10.892938179s" totalImagesPullingTime="984.556222ms" totalInitContainerRuntime="76.528904ms" isStatefulPod=true podCreationTimestamp="2026-06-06 20:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:20.890409656 +0000 UTC m=+237.307221584" watchObservedRunningTime="2026-06-06 20:50:20.892938179 +0000 UTC m=+237.309750097"
Jun 06 20:50:21.882943 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:21.882871    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-hd2x6" event={"ID":"3b4a1f36-dfbc-4006-af93-218d90da10f3","Type":"ContainerStarted","Data":"9ccef98fd2b6b28963227a1c7bb9118e108190c741df7043a029f48e979aaecc"}
Jun 06 20:50:21.883638 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:21.883315    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-hd2x6"
Jun 06 20:50:21.895597 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:21.895515    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-hd2x6"
Jun 06 20:50:21.902906 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:21.902720    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-hd2x6" podStartSLOduration=2.540781961 podStartE2EDuration="19.9026997s" totalImagesPullingTime="17.361917739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:21.900046848 +0000 UTC m=+238.316858766" watchObservedRunningTime="2026-06-06 20:50:21.9026997 +0000 UTC m=+238.319511619"
Jun 06 20:50:22.890904 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:22.890863    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k" event={"ID":"ae7352c7-99e8-4ca6-a827-3350f3adacde","Type":"ContainerStarted","Data":"396a201706cf5a8e2d6d85e4230e8cfa55a9f27118c7af46acd644a33ed9a4c8"}
Jun 06 20:50:23.007995 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:23.007949    2577 patch_prober.go:28] interesting pod/image-registry-66f58777cd-jmj2w container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 06 20:50:23.008186 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:23.008014    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-66f58777cd-jmj2w" podUID="3129661f-60d1-4122-aa60-022b39069b66" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 06 20:50:23.378050 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:23.378012    2577 patch_prober.go:28] interesting pod/image-registry-df5d466b8-ppv2k container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 06 20:50:23.378239 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:23.378075    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k" podUID="bdc3bf76-99e9-4b60-b194-96307d04e926" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 06 20:50:23.896384 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:23.896350    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k" event={"ID":"ae7352c7-99e8-4ca6-a827-3350f3adacde","Type":"ContainerStarted","Data":"373affa66fc19c61084f02ac336687151e9fb86772304deedf4a083d25ad61fd"}
Jun 06 20:50:24.808837 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:24.808793    2577 patch_prober.go:28] interesting pod/image-registry-df5d466b8-ppv2k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 06 20:50:24.809104 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:24.808857    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k" podUID="bdc3bf76-99e9-4b60-b194-96307d04e926" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 06 20:50:24.903247 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:24.903210    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k" event={"ID":"ae7352c7-99e8-4ca6-a827-3350f3adacde","Type":"ContainerStarted","Data":"fe2891284905c9b2bdcae7e2370e07a6393ca681499de07c70a8449fb7c07ed2"}
Jun 06 20:50:24.926844 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:24.926782    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67b66fc94-hrd4k" podStartSLOduration=5.578329128 podStartE2EDuration="8.926759062s" totalImagesPullingTime="3.348429934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:50:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:24.925284229 +0000 UTC m=+241.342096182" watchObservedRunningTime="2026-06-06 20:50:24.926759062 +0000 UTC m=+241.343571015"
Jun 06 20:50:28.024500 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.024419    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66f58777cd-jmj2w" podUID="3129661f-60d1-4122-aa60-022b39069b66" containerName="registry" containerID="cri-o://524e8a129714a27256856dc64effcd8a573eeeca6aa983f6863c2fd809ce52bc" gracePeriod=30
Jun 06 20:50:28.314184 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.314153    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:50:28.405468 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.405430    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3129661f-60d1-4122-aa60-022b39069b66-image-registry-private-configuration\") pod \"3129661f-60d1-4122-aa60-022b39069b66\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") "
Jun 06 20:50:28.405662 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.405517    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls\") pod \"3129661f-60d1-4122-aa60-022b39069b66\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") "
Jun 06 20:50:28.405662 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.405572    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-bound-sa-token\") pod \"3129661f-60d1-4122-aa60-022b39069b66\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") "
Jun 06 20:50:28.405662 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.405609    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3129661f-60d1-4122-aa60-022b39069b66-registry-certificates\") pod \"3129661f-60d1-4122-aa60-022b39069b66\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") "
Jun 06 20:50:28.405662 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.405634    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3129661f-60d1-4122-aa60-022b39069b66-installation-pull-secrets\") pod \"3129661f-60d1-4122-aa60-022b39069b66\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") "
Jun 06 20:50:28.405886 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.405669    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtfdn\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-kube-api-access-qtfdn\") pod \"3129661f-60d1-4122-aa60-022b39069b66\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") "
Jun 06 20:50:28.405886 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.405700    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3129661f-60d1-4122-aa60-022b39069b66-trusted-ca\") pod \"3129661f-60d1-4122-aa60-022b39069b66\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") "
Jun 06 20:50:28.405994 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.405935    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3129661f-60d1-4122-aa60-022b39069b66-ca-trust-extracted\") pod \"3129661f-60d1-4122-aa60-022b39069b66\" (UID: \"3129661f-60d1-4122-aa60-022b39069b66\") "
Jun 06 20:50:28.406674 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.406576    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3129661f-60d1-4122-aa60-022b39069b66-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3129661f-60d1-4122-aa60-022b39069b66" (UID: "3129661f-60d1-4122-aa60-022b39069b66"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 20:50:28.408933 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.408522    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3129661f-60d1-4122-aa60-022b39069b66-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3129661f-60d1-4122-aa60-022b39069b66" (UID: "3129661f-60d1-4122-aa60-022b39069b66"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 20:50:28.408933 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.408779    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3129661f-60d1-4122-aa60-022b39069b66-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3129661f-60d1-4122-aa60-022b39069b66" (UID: "3129661f-60d1-4122-aa60-022b39069b66"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 20:50:28.408933 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.408792    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3129661f-60d1-4122-aa60-022b39069b66" (UID: "3129661f-60d1-4122-aa60-022b39069b66"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 20:50:28.409421 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.409384    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3129661f-60d1-4122-aa60-022b39069b66" (UID: "3129661f-60d1-4122-aa60-022b39069b66"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 20:50:28.409523 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.409489    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3129661f-60d1-4122-aa60-022b39069b66-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3129661f-60d1-4122-aa60-022b39069b66" (UID: "3129661f-60d1-4122-aa60-022b39069b66"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 06 20:50:28.410638 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.410607    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-kube-api-access-qtfdn" (OuterVolumeSpecName: "kube-api-access-qtfdn") pod "3129661f-60d1-4122-aa60-022b39069b66" (UID: "3129661f-60d1-4122-aa60-022b39069b66"). InnerVolumeSpecName "kube-api-access-qtfdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 20:50:28.418766 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.418735    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3129661f-60d1-4122-aa60-022b39069b66-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3129661f-60d1-4122-aa60-022b39069b66" (UID: "3129661f-60d1-4122-aa60-022b39069b66"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:50:28.507281 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.507244    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtfdn\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-kube-api-access-qtfdn\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:50:28.507281 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.507279    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3129661f-60d1-4122-aa60-022b39069b66-trusted-ca\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:50:28.507487 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.507294    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3129661f-60d1-4122-aa60-022b39069b66-ca-trust-extracted\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:50:28.507487 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.507323    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3129661f-60d1-4122-aa60-022b39069b66-image-registry-private-configuration\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:50:28.507487 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.507339    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-registry-tls\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:50:28.507487 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.507350    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3129661f-60d1-4122-aa60-022b39069b66-bound-sa-token\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:50:28.507487 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.507358    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3129661f-60d1-4122-aa60-022b39069b66-registry-certificates\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:50:28.507487 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.507370    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3129661f-60d1-4122-aa60-022b39069b66-installation-pull-secrets\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:50:28.924716 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.924679    2577 generic.go:356] "Generic (PLEG): container finished" podID="3129661f-60d1-4122-aa60-022b39069b66" containerID="524e8a129714a27256856dc64effcd8a573eeeca6aa983f6863c2fd809ce52bc" exitCode=0
Jun 06 20:50:28.924889 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.924733    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66f58777cd-jmj2w"
Jun 06 20:50:28.924889 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.924744    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66f58777cd-jmj2w" event={"ID":"3129661f-60d1-4122-aa60-022b39069b66","Type":"ContainerDied","Data":"524e8a129714a27256856dc64effcd8a573eeeca6aa983f6863c2fd809ce52bc"}
Jun 06 20:50:28.924889 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.924789    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66f58777cd-jmj2w" event={"ID":"3129661f-60d1-4122-aa60-022b39069b66","Type":"ContainerDied","Data":"1d754012925b20c3c2061d2e598b732528bff76e056984d0a929102649e8d811"}
Jun 06 20:50:28.924889 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.924831    2577 scope.go:117] "RemoveContainer" containerID="524e8a129714a27256856dc64effcd8a573eeeca6aa983f6863c2fd809ce52bc"
Jun 06 20:50:28.935216 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.935127    2577 scope.go:117] "RemoveContainer" containerID="524e8a129714a27256856dc64effcd8a573eeeca6aa983f6863c2fd809ce52bc"
Jun 06 20:50:28.935513 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:50:28.935487    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"524e8a129714a27256856dc64effcd8a573eeeca6aa983f6863c2fd809ce52bc\": container with ID starting with 524e8a129714a27256856dc64effcd8a573eeeca6aa983f6863c2fd809ce52bc not found: ID does not exist" containerID="524e8a129714a27256856dc64effcd8a573eeeca6aa983f6863c2fd809ce52bc"
Jun 06 20:50:28.935588 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.935522    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"524e8a129714a27256856dc64effcd8a573eeeca6aa983f6863c2fd809ce52bc"} err="failed to get container status \"524e8a129714a27256856dc64effcd8a573eeeca6aa983f6863c2fd809ce52bc\": rpc error: code = NotFound desc = could not find container \"524e8a129714a27256856dc64effcd8a573eeeca6aa983f6863c2fd809ce52bc\": container with ID starting with 524e8a129714a27256856dc64effcd8a573eeeca6aa983f6863c2fd809ce52bc not found: ID does not exist"
Jun 06 20:50:28.947865 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.947834    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66f58777cd-jmj2w"]
Jun 06 20:50:28.950998 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:28.950973    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66f58777cd-jmj2w"]
Jun 06 20:50:30.058123 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:30.058088    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3129661f-60d1-4122-aa60-022b39069b66" path="/var/lib/kubelet/pods/3129661f-60d1-4122-aa60-022b39069b66/volumes"
Jun 06 20:50:33.374965 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:33.374932    2577 patch_prober.go:28] interesting pod/image-registry-df5d466b8-ppv2k container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 06 20:50:33.375433 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:33.374988    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k" podUID="bdc3bf76-99e9-4b60-b194-96307d04e926" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 06 20:50:34.808141 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:34.808052    2577 patch_prober.go:28] interesting pod/image-registry-df5d466b8-ppv2k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 06 20:50:34.808141 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:34.808111    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k" podUID="bdc3bf76-99e9-4b60-b194-96307d04e926" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 06 20:50:34.960414 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:34.960378    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs\") pod \"network-metrics-daemon-4lgs6\" (UID: \"896e1cee-2420-4fa5-b96b-40d4639695dc\") " pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:50:34.962617 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:34.962591    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/896e1cee-2420-4fa5-b96b-40d4639695dc-metrics-certs\") pod \"network-metrics-daemon-4lgs6\" (UID: \"896e1cee-2420-4fa5-b96b-40d4639695dc\") " pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:50:35.057330 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:35.057286    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9xvqt\""
Jun 06 20:50:35.065475 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:35.065417    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lgs6"
Jun 06 20:50:35.202352 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:35.202323    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4lgs6"]
Jun 06 20:50:35.205167 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:50:35.205137    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod896e1cee_2420_4fa5_b96b_40d4639695dc.slice/crio-91cae2a3ce4e80441d07a502eb93b7f1a72bd959920c2f8091a5c2e0b6e517cb WatchSource:0}: Error finding container 91cae2a3ce4e80441d07a502eb93b7f1a72bd959920c2f8091a5c2e0b6e517cb: Status 404 returned error can't find the container with id 91cae2a3ce4e80441d07a502eb93b7f1a72bd959920c2f8091a5c2e0b6e517cb
Jun 06 20:50:35.950978 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:35.950944    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4lgs6" event={"ID":"896e1cee-2420-4fa5-b96b-40d4639695dc","Type":"ContainerStarted","Data":"91cae2a3ce4e80441d07a502eb93b7f1a72bd959920c2f8091a5c2e0b6e517cb"}
Jun 06 20:50:36.956530 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:36.956492    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4lgs6" event={"ID":"896e1cee-2420-4fa5-b96b-40d4639695dc","Type":"ContainerStarted","Data":"b6debd415e099f63722af34e4d316e8c8842909cf10294e09f9969ea0feba21a"}
Jun 06 20:50:36.956907 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:36.956550    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4lgs6" event={"ID":"896e1cee-2420-4fa5-b96b-40d4639695dc","Type":"ContainerStarted","Data":"8bdba77643ea418c8cb71a0cb6ee7cf6c13183ac530c34ec0e8a970718b12e11"}
Jun 06 20:50:36.972911 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:36.972855    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4lgs6" podStartSLOduration=251.657458697 podStartE2EDuration="4m12.972839719s" totalImagesPullingTime="1.315381022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:50:36.971694331 +0000 UTC m=+253.388506248" watchObservedRunningTime="2026-06-06 20:50:36.972839719 +0000 UTC m=+253.389651636"
Jun 06 20:50:43.375154 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:43.375121    2577 patch_prober.go:28] interesting pod/image-registry-df5d466b8-ppv2k container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 06 20:50:43.375540 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:43.375184    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k" podUID="bdc3bf76-99e9-4b60-b194-96307d04e926" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 06 20:50:43.375540 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:43.375224    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:50:43.375711 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:43.375691    2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"97c769bdedbe37afc03acf5d642e8596e64183f553898d0e681b6f70c3f2e081"} pod="openshift-image-registry/image-registry-df5d466b8-ppv2k" containerMessage="Container registry failed liveness probe, will be restarted"
Jun 06 20:50:43.379401 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:43.379372    2577 patch_prober.go:28] interesting pod/image-registry-df5d466b8-ppv2k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 06 20:50:43.379534 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:43.379423    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k" podUID="bdc3bf76-99e9-4b60-b194-96307d04e926" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 06 20:50:53.380707 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:53.380675    2577 patch_prober.go:28] interesting pod/image-registry-df5d466b8-ppv2k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 06 20:50:53.381079 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:50:53.380741    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k" podUID="bdc3bf76-99e9-4b60-b194-96307d04e926" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 06 20:51:03.043321 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:03.043268    2577 generic.go:356] "Generic (PLEG): container finished" podID="32981c32-5985-4796-8a8c-15ef60e6a12b" containerID="6a3b83c83f6c2380c85b0c9fa6934f89449e9f05842628a45cf5a5247e269d17" exitCode=0
Jun 06 20:51:03.043677 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:03.043352    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9" event={"ID":"32981c32-5985-4796-8a8c-15ef60e6a12b","Type":"ContainerDied","Data":"6a3b83c83f6c2380c85b0c9fa6934f89449e9f05842628a45cf5a5247e269d17"}
Jun 06 20:51:03.043721 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:03.043683    2577 scope.go:117] "RemoveContainer" containerID="6a3b83c83f6c2380c85b0c9fa6934f89449e9f05842628a45cf5a5247e269d17"
Jun 06 20:51:03.380233 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:03.380189    2577 patch_prober.go:28] interesting pod/image-registry-df5d466b8-ppv2k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 06 20:51:03.380446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:03.380264    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k" podUID="bdc3bf76-99e9-4b60-b194-96307d04e926" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 06 20:51:04.049923 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:04.049887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-fpml9" event={"ID":"32981c32-5985-4796-8a8c-15ef60e6a12b","Type":"ContainerStarted","Data":"4876dd3ee66eedc6cd2ee965fe6cd2934583e638d005b963b92c39fab77942c6"}
Jun 06 20:51:04.598858 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:51:04.598814    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-t5svn" podUID="94831dda-b834-475e-b5f8-7c9a01ce25be"
Jun 06 20:51:05.053440 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:05.053409    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t5svn"
Jun 06 20:51:08.395064 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:08.395019    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k" podUID="bdc3bf76-99e9-4b60-b194-96307d04e926" containerName="registry" containerID="cri-o://97c769bdedbe37afc03acf5d642e8596e64183f553898d0e681b6f70c3f2e081" gracePeriod=30
Jun 06 20:51:08.443865 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:08.443827    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:51:08.446128 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:08.446100    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/94831dda-b834-475e-b5f8-7c9a01ce25be-metrics-tls\") pod \"dns-default-t5svn\" (UID: \"94831dda-b834-475e-b5f8-7c9a01ce25be\") " pod="openshift-dns/dns-default-t5svn"
Jun 06 20:51:08.657046 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:08.656966    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9qr76\""
Jun 06 20:51:08.664958 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:08.664935    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t5svn"
Jun 06 20:51:08.789292 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:08.789247    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t5svn"]
Jun 06 20:51:08.791168 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:51:08.791139    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94831dda_b834_475e_b5f8_7c9a01ce25be.slice/crio-8952cee07b5aa44f512f38b950c38aa8092fb711d25732e8a13c07139093d07c WatchSource:0}: Error finding container 8952cee07b5aa44f512f38b950c38aa8092fb711d25732e8a13c07139093d07c: Status 404 returned error can't find the container with id 8952cee07b5aa44f512f38b950c38aa8092fb711d25732e8a13c07139093d07c
Jun 06 20:51:09.068499 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:09.068465    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t5svn" event={"ID":"94831dda-b834-475e-b5f8-7c9a01ce25be","Type":"ContainerStarted","Data":"8952cee07b5aa44f512f38b950c38aa8092fb711d25732e8a13c07139093d07c"}
Jun 06 20:51:09.653311 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:09.653273    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-4xb76_39469d4f-a471-4585-aa7c-50da5c07e536/cluster-monitoring-operator/0.log"
Jun 06 20:51:10.073852 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:10.073814    2577 generic.go:356] "Generic (PLEG): container finished" podID="bdc3bf76-99e9-4b60-b194-96307d04e926" containerID="97c769bdedbe37afc03acf5d642e8596e64183f553898d0e681b6f70c3f2e081" exitCode=0
Jun 06 20:51:10.074017 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:10.073888    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k" event={"ID":"bdc3bf76-99e9-4b60-b194-96307d04e926","Type":"ContainerDied","Data":"97c769bdedbe37afc03acf5d642e8596e64183f553898d0e681b6f70c3f2e081"}
Jun 06 20:51:10.074017 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:10.073941    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k" event={"ID":"bdc3bf76-99e9-4b60-b194-96307d04e926","Type":"ContainerStarted","Data":"5dadb619b22893e62b9cdaea8333cf000787d453903cc4ca0c5f5596fcca9c9d"}
Jun 06 20:51:10.074186 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:10.074168    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:51:11.079497 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:11.079458    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t5svn" event={"ID":"94831dda-b834-475e-b5f8-7c9a01ce25be","Type":"ContainerStarted","Data":"00b747e8a9089aaec6ca9c77ec5a7e270eb21cf23120e9f282d9e410cd4f3da4"}
Jun 06 20:51:11.079895 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:11.079524    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t5svn" event={"ID":"94831dda-b834-475e-b5f8-7c9a01ce25be","Type":"ContainerStarted","Data":"43d9e79bcee169d0498410490259785e4fcdc097d1bb9361a1c7b6f1d0fefb77"}
Jun 06 20:51:11.451638 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:11.451563    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hdphs_79564215-9370-4efd-a981-a56967d41af5/init-textfile/0.log"
Jun 06 20:51:11.651877 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:11.651852    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hdphs_79564215-9370-4efd-a981-a56967d41af5/node-exporter/0.log"
Jun 06 20:51:11.851336 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:11.851244    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hdphs_79564215-9370-4efd-a981-a56967d41af5/kube-rbac-proxy/0.log"
Jun 06 20:51:12.083370 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:12.083340    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t5svn"
Jun 06 20:51:15.251898 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:15.251866    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67b66fc94-hrd4k_ae7352c7-99e8-4ca6-a827-3350f3adacde/telemeter-client/0.log"
Jun 06 20:51:15.450630 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:15.450602    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67b66fc94-hrd4k_ae7352c7-99e8-4ca6-a827-3350f3adacde/reload/0.log"
Jun 06 20:51:15.651701 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:15.651626    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67b66fc94-hrd4k_ae7352c7-99e8-4ca6-a827-3350f3adacde/kube-rbac-proxy/0.log"
Jun 06 20:51:17.051160 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:17.051125    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-drjt8_69a6f7a6-2bc4-41bb-b033-62d122739350/networking-console-plugin/0.log"
Jun 06 20:51:18.252976 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:18.252948    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-hd2x6_3b4a1f36-dfbc-4006-af93-218d90da10f3/download-server/0.log"
Jun 06 20:51:18.850905 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:18.850876    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t5svn_94831dda-b834-475e-b5f8-7c9a01ce25be/dns/0.log"
Jun 06 20:51:19.050775 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:19.050738    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t5svn_94831dda-b834-475e-b5f8-7c9a01ce25be/kube-rbac-proxy/0.log"
Jun 06 20:51:20.050710 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:20.050685    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wx7qf_7a3a545a-09f9-43df-a03d-452a58df3e9e/dns-node-resolver/0.log"
Jun 06 20:51:20.451276 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:20.451191    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-df5d466b8-ppv2k_bdc3bf76-99e9-4b60-b194-96307d04e926/registry/1.log"
Jun 06 20:51:21.051029 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:21.051000    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wlzv5_ee039af8-9795-4768-a9f3-e84e68fa3119/node-ca/0.log"
Jun 06 20:51:21.251224 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:21.251194    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f6949f47-6rxkq_073b123d-ea96-4527-aadb-769c8007858e/router/0.log"
Jun 06 20:51:21.449953 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:21.449867    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jmz78_1a29988c-1445-4801-9656-a8f6134dcb05/serve-healthcheck-canary/0.log"
Jun 06 20:51:22.089536 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:22.089508    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t5svn"
Jun 06 20:51:22.109713 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:22.109644    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-t5svn" podStartSLOduration=262.653186646 podStartE2EDuration="4m24.10959032s" totalImagesPullingTime="1.456403674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:51:11.095347318 +0000 UTC m=+287.512159236" watchObservedRunningTime="2026-06-06 20:51:22.10959032 +0000 UTC m=+298.526402239"
Jun 06 20:51:24.001068 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:24.001035    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 20:51:24.001562 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:24.001380    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 20:51:24.009059 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:24.009038    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jun 06 20:51:31.083934 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:51:31.083899    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-df5d466b8-ppv2k"
Jun 06 20:56:06.992359 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:06.992320    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5"]
Jun 06 20:56:06.992752 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:06.992634    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3129661f-60d1-4122-aa60-022b39069b66" containerName="registry"
Jun 06 20:56:06.992752 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:06.992647    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3129661f-60d1-4122-aa60-022b39069b66" containerName="registry"
Jun 06 20:56:06.992752 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:06.992704    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3129661f-60d1-4122-aa60-022b39069b66" containerName="registry"
Jun 06 20:56:06.995737 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:06.995721    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5"
Jun 06 20:56:06.998272 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:06.998248    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 06 20:56:06.999337 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:06.999317    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 06 20:56:06.999434 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:06.999375    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-226hw\""
Jun 06 20:56:07.004373 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:07.004352    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5"]
Jun 06 20:56:07.021643 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:07.021621    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d7f6b42-5373-4108-9d40-0d68bcc0349a-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5\" (UID: \"7d7f6b42-5373-4108-9d40-0d68bcc0349a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5"
Jun 06 20:56:07.021765 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:07.021662    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d7f6b42-5373-4108-9d40-0d68bcc0349a-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5\" (UID: \"7d7f6b42-5373-4108-9d40-0d68bcc0349a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5"
Jun 06 20:56:07.021765 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:07.021694    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5rz2\" (UniqueName: \"kubernetes.io/projected/7d7f6b42-5373-4108-9d40-0d68bcc0349a-kube-api-access-k5rz2\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5\" (UID: \"7d7f6b42-5373-4108-9d40-0d68bcc0349a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5"
Jun 06 20:56:07.122338 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:07.122289    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d7f6b42-5373-4108-9d40-0d68bcc0349a-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5\" (UID: \"7d7f6b42-5373-4108-9d40-0d68bcc0349a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5"
Jun 06 20:56:07.122515 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:07.122375    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d7f6b42-5373-4108-9d40-0d68bcc0349a-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5\" (UID: \"7d7f6b42-5373-4108-9d40-0d68bcc0349a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5"
Jun 06 20:56:07.122515 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:07.122443    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5rz2\" (UniqueName: \"kubernetes.io/projected/7d7f6b42-5373-4108-9d40-0d68bcc0349a-kube-api-access-k5rz2\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5\" (UID: \"7d7f6b42-5373-4108-9d40-0d68bcc0349a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5"
Jun 06 20:56:07.122756 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:07.122735    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d7f6b42-5373-4108-9d40-0d68bcc0349a-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5\" (UID: \"7d7f6b42-5373-4108-9d40-0d68bcc0349a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5"
Jun 06 20:56:07.122822 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:07.122756    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d7f6b42-5373-4108-9d40-0d68bcc0349a-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5\" (UID: \"7d7f6b42-5373-4108-9d40-0d68bcc0349a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5"
Jun 06 20:56:07.130995 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:07.130973    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5rz2\" (UniqueName: \"kubernetes.io/projected/7d7f6b42-5373-4108-9d40-0d68bcc0349a-kube-api-access-k5rz2\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5\" (UID: \"7d7f6b42-5373-4108-9d40-0d68bcc0349a\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5"
Jun 06 20:56:07.305053 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:07.305006    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5"
Jun 06 20:56:07.431484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:07.431450    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5"]
Jun 06 20:56:07.434774 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:56:07.434747    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d7f6b42_5373_4108_9d40_0d68bcc0349a.slice/crio-bde47f8face6977103e12fcadc9b95b9cc7e3c91fc9737091a6e0df74e9a0e90 WatchSource:0}: Error finding container bde47f8face6977103e12fcadc9b95b9cc7e3c91fc9737091a6e0df74e9a0e90: Status 404 returned error can't find the container with id bde47f8face6977103e12fcadc9b95b9cc7e3c91fc9737091a6e0df74e9a0e90
Jun 06 20:56:07.436713 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:07.436697    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 06 20:56:08.120544 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:08.120501    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5" event={"ID":"7d7f6b42-5373-4108-9d40-0d68bcc0349a","Type":"ContainerStarted","Data":"bde47f8face6977103e12fcadc9b95b9cc7e3c91fc9737091a6e0df74e9a0e90"}
Jun 06 20:56:14.144077 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:14.144037    2577 generic.go:356] "Generic (PLEG): container finished" podID="7d7f6b42-5373-4108-9d40-0d68bcc0349a" containerID="ae445d65d699664a8653de5912a76a06cae73c35357ec787a09c9b520dbd6732" exitCode=0
Jun 06 20:56:14.144531 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:14.144123    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5" event={"ID":"7d7f6b42-5373-4108-9d40-0d68bcc0349a","Type":"ContainerDied","Data":"ae445d65d699664a8653de5912a76a06cae73c35357ec787a09c9b520dbd6732"}
Jun 06 20:56:15.149233 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:15.149149    2577 generic.go:356] "Generic (PLEG): container finished" podID="7d7f6b42-5373-4108-9d40-0d68bcc0349a" containerID="667cea910a6242a27f0ce1ff436c325454b862751831f8dcd0dc6fc5ff165de8" exitCode=0
Jun 06 20:56:15.149233 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:15.149213    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5" event={"ID":"7d7f6b42-5373-4108-9d40-0d68bcc0349a","Type":"ContainerDied","Data":"667cea910a6242a27f0ce1ff436c325454b862751831f8dcd0dc6fc5ff165de8"}
Jun 06 20:56:21.174914 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:21.174876    2577 generic.go:356] "Generic (PLEG): container finished" podID="7d7f6b42-5373-4108-9d40-0d68bcc0349a" containerID="88edd87c7387a55c771adbcd64908c37c7af0580b1c37551260fd578565193f9" exitCode=0
Jun 06 20:56:21.175268 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:21.174964    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5" event={"ID":"7d7f6b42-5373-4108-9d40-0d68bcc0349a","Type":"ContainerDied","Data":"88edd87c7387a55c771adbcd64908c37c7af0580b1c37551260fd578565193f9"}
Jun 06 20:56:22.298045 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:22.298019    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5"
Jun 06 20:56:22.352039 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:22.352010    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d7f6b42-5373-4108-9d40-0d68bcc0349a-bundle\") pod \"7d7f6b42-5373-4108-9d40-0d68bcc0349a\" (UID: \"7d7f6b42-5373-4108-9d40-0d68bcc0349a\") "
Jun 06 20:56:22.352179 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:22.352059    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5rz2\" (UniqueName: \"kubernetes.io/projected/7d7f6b42-5373-4108-9d40-0d68bcc0349a-kube-api-access-k5rz2\") pod \"7d7f6b42-5373-4108-9d40-0d68bcc0349a\" (UID: \"7d7f6b42-5373-4108-9d40-0d68bcc0349a\") "
Jun 06 20:56:22.352179 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:22.352090    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d7f6b42-5373-4108-9d40-0d68bcc0349a-util\") pod \"7d7f6b42-5373-4108-9d40-0d68bcc0349a\" (UID: \"7d7f6b42-5373-4108-9d40-0d68bcc0349a\") "
Jun 06 20:56:22.352640 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:22.352614    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7f6b42-5373-4108-9d40-0d68bcc0349a-bundle" (OuterVolumeSpecName: "bundle") pod "7d7f6b42-5373-4108-9d40-0d68bcc0349a" (UID: "7d7f6b42-5373-4108-9d40-0d68bcc0349a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:56:22.354246 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:22.354222    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d7f6b42-5373-4108-9d40-0d68bcc0349a-kube-api-access-k5rz2" (OuterVolumeSpecName: "kube-api-access-k5rz2") pod "7d7f6b42-5373-4108-9d40-0d68bcc0349a" (UID: "7d7f6b42-5373-4108-9d40-0d68bcc0349a"). InnerVolumeSpecName "kube-api-access-k5rz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 20:56:22.357857 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:22.357823    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d7f6b42-5373-4108-9d40-0d68bcc0349a-util" (OuterVolumeSpecName: "util") pod "7d7f6b42-5373-4108-9d40-0d68bcc0349a" (UID: "7d7f6b42-5373-4108-9d40-0d68bcc0349a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:56:22.453262 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:22.453156    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5rz2\" (UniqueName: \"kubernetes.io/projected/7d7f6b42-5373-4108-9d40-0d68bcc0349a-kube-api-access-k5rz2\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:56:22.453262 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:22.453204    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d7f6b42-5373-4108-9d40-0d68bcc0349a-util\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:56:22.453262 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:22.453214    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d7f6b42-5373-4108-9d40-0d68bcc0349a-bundle\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:56:23.183211 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:23.183185    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5"
Jun 06 20:56:23.183211 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:23.183208    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dc5mt5" event={"ID":"7d7f6b42-5373-4108-9d40-0d68bcc0349a","Type":"ContainerDied","Data":"bde47f8face6977103e12fcadc9b95b9cc7e3c91fc9737091a6e0df74e9a0e90"}
Jun 06 20:56:23.183440 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:23.183250    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bde47f8face6977103e12fcadc9b95b9cc7e3c91fc9737091a6e0df74e9a0e90"
Jun 06 20:56:24.026216 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:24.026182    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 20:56:24.027221 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:24.027199    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 20:56:34.573692 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.573616    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m"]
Jun 06 20:56:34.575960 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.573893    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d7f6b42-5373-4108-9d40-0d68bcc0349a" containerName="pull"
Jun 06 20:56:34.575960 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.573904    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d7f6b42-5373-4108-9d40-0d68bcc0349a" containerName="pull"
Jun 06 20:56:34.575960 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.573918    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d7f6b42-5373-4108-9d40-0d68bcc0349a" containerName="util"
Jun 06 20:56:34.575960 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.573923    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d7f6b42-5373-4108-9d40-0d68bcc0349a" containerName="util"
Jun 06 20:56:34.575960 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.573936    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d7f6b42-5373-4108-9d40-0d68bcc0349a" containerName="extract"
Jun 06 20:56:34.575960 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.573942    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d7f6b42-5373-4108-9d40-0d68bcc0349a" containerName="extract"
Jun 06 20:56:34.575960 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.573983    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d7f6b42-5373-4108-9d40-0d68bcc0349a" containerName="extract"
Jun 06 20:56:34.576770 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.576754    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m"
Jun 06 20:56:34.579408 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.579381    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 06 20:56:34.579515 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.579440    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 06 20:56:34.580439 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.580422    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-226hw\""
Jun 06 20:56:34.585610 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.585589    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m"]
Jun 06 20:56:34.653966 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.653933    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82686c88-0ee2-4807-8185-690bbd3c186f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m\" (UID: \"82686c88-0ee2-4807-8185-690bbd3c186f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m"
Jun 06 20:56:34.654118 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.654002    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82686c88-0ee2-4807-8185-690bbd3c186f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m\" (UID: \"82686c88-0ee2-4807-8185-690bbd3c186f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m"
Jun 06 20:56:34.654118 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.654045    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6nx2\" (UniqueName: \"kubernetes.io/projected/82686c88-0ee2-4807-8185-690bbd3c186f-kube-api-access-r6nx2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m\" (UID: \"82686c88-0ee2-4807-8185-690bbd3c186f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m"
Jun 06 20:56:34.755380 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.755347    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82686c88-0ee2-4807-8185-690bbd3c186f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m\" (UID: \"82686c88-0ee2-4807-8185-690bbd3c186f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m"
Jun 06 20:56:34.755579 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.755426    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82686c88-0ee2-4807-8185-690bbd3c186f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m\" (UID: \"82686c88-0ee2-4807-8185-690bbd3c186f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m"
Jun 06 20:56:34.755579 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.755447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6nx2\" (UniqueName: \"kubernetes.io/projected/82686c88-0ee2-4807-8185-690bbd3c186f-kube-api-access-r6nx2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m\" (UID: \"82686c88-0ee2-4807-8185-690bbd3c186f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m"
Jun 06 20:56:34.755817 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.755795    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82686c88-0ee2-4807-8185-690bbd3c186f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m\" (UID: \"82686c88-0ee2-4807-8185-690bbd3c186f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m"
Jun 06 20:56:34.755882 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.755813    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82686c88-0ee2-4807-8185-690bbd3c186f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m\" (UID: \"82686c88-0ee2-4807-8185-690bbd3c186f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m"
Jun 06 20:56:34.766194 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.766162    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6nx2\" (UniqueName: \"kubernetes.io/projected/82686c88-0ee2-4807-8185-690bbd3c186f-kube-api-access-r6nx2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m\" (UID: \"82686c88-0ee2-4807-8185-690bbd3c186f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m"
Jun 06 20:56:34.886595 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:34.886508    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m"
Jun 06 20:56:35.015736 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:35.015709    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m"]
Jun 06 20:56:35.018205 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:56:35.018173    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82686c88_0ee2_4807_8185_690bbd3c186f.slice/crio-0c34d7ba7c9fa5d084bca66d49f67ff7f4562a09b1eb1680843d8bfcdca10d90 WatchSource:0}: Error finding container 0c34d7ba7c9fa5d084bca66d49f67ff7f4562a09b1eb1680843d8bfcdca10d90: Status 404 returned error can't find the container with id 0c34d7ba7c9fa5d084bca66d49f67ff7f4562a09b1eb1680843d8bfcdca10d90
Jun 06 20:56:35.231728 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:35.231645    2577 generic.go:356] "Generic (PLEG): container finished" podID="82686c88-0ee2-4807-8185-690bbd3c186f" containerID="58eeaa6c4d8c479aaf8a0882541d4942b62d054293702c5a835bed8b20a4693c" exitCode=0
Jun 06 20:56:35.231868 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:35.231725    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m" event={"ID":"82686c88-0ee2-4807-8185-690bbd3c186f","Type":"ContainerDied","Data":"58eeaa6c4d8c479aaf8a0882541d4942b62d054293702c5a835bed8b20a4693c"}
Jun 06 20:56:35.231868 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:35.231775    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m" event={"ID":"82686c88-0ee2-4807-8185-690bbd3c186f","Type":"ContainerStarted","Data":"0c34d7ba7c9fa5d084bca66d49f67ff7f4562a09b1eb1680843d8bfcdca10d90"}
Jun 06 20:56:38.246730 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:38.246698    2577 generic.go:356] "Generic (PLEG): container finished" podID="82686c88-0ee2-4807-8185-690bbd3c186f" containerID="92ba9c18b91817d0aa3d37882d73bbf5c1fb52f108f668edb94cb17b900cfc06" exitCode=0
Jun 06 20:56:38.247065 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:38.246752    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m" event={"ID":"82686c88-0ee2-4807-8185-690bbd3c186f","Type":"ContainerDied","Data":"92ba9c18b91817d0aa3d37882d73bbf5c1fb52f108f668edb94cb17b900cfc06"}
Jun 06 20:56:39.252246 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:39.252201    2577 generic.go:356] "Generic (PLEG): container finished" podID="82686c88-0ee2-4807-8185-690bbd3c186f" containerID="1253932b80f1eb2afee62db50e41f495dbc89f41b364eef54429c5492a7c9b20" exitCode=0
Jun 06 20:56:39.252692 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:39.252266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m" event={"ID":"82686c88-0ee2-4807-8185-690bbd3c186f","Type":"ContainerDied","Data":"1253932b80f1eb2afee62db50e41f495dbc89f41b364eef54429c5492a7c9b20"}
Jun 06 20:56:40.374693 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:40.374668    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m"
Jun 06 20:56:40.505445 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:40.505413    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6nx2\" (UniqueName: \"kubernetes.io/projected/82686c88-0ee2-4807-8185-690bbd3c186f-kube-api-access-r6nx2\") pod \"82686c88-0ee2-4807-8185-690bbd3c186f\" (UID: \"82686c88-0ee2-4807-8185-690bbd3c186f\") "
Jun 06 20:56:40.505626 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:40.505475    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82686c88-0ee2-4807-8185-690bbd3c186f-bundle\") pod \"82686c88-0ee2-4807-8185-690bbd3c186f\" (UID: \"82686c88-0ee2-4807-8185-690bbd3c186f\") "
Jun 06 20:56:40.505626 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:40.505494    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82686c88-0ee2-4807-8185-690bbd3c186f-util\") pod \"82686c88-0ee2-4807-8185-690bbd3c186f\" (UID: \"82686c88-0ee2-4807-8185-690bbd3c186f\") "
Jun 06 20:56:40.505847 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:40.505823    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82686c88-0ee2-4807-8185-690bbd3c186f-bundle" (OuterVolumeSpecName: "bundle") pod "82686c88-0ee2-4807-8185-690bbd3c186f" (UID: "82686c88-0ee2-4807-8185-690bbd3c186f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:56:40.507623 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:40.507570    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82686c88-0ee2-4807-8185-690bbd3c186f-kube-api-access-r6nx2" (OuterVolumeSpecName: "kube-api-access-r6nx2") pod "82686c88-0ee2-4807-8185-690bbd3c186f" (UID: "82686c88-0ee2-4807-8185-690bbd3c186f"). InnerVolumeSpecName "kube-api-access-r6nx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 20:56:40.511116 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:40.511085    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82686c88-0ee2-4807-8185-690bbd3c186f-util" (OuterVolumeSpecName: "util") pod "82686c88-0ee2-4807-8185-690bbd3c186f" (UID: "82686c88-0ee2-4807-8185-690bbd3c186f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:56:40.606001 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:40.605964    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82686c88-0ee2-4807-8185-690bbd3c186f-bundle\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:56:40.606001 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:40.605994    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82686c88-0ee2-4807-8185-690bbd3c186f-util\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:56:40.606001 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:40.606009    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6nx2\" (UniqueName: \"kubernetes.io/projected/82686c88-0ee2-4807-8185-690bbd3c186f-kube-api-access-r6nx2\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:56:41.261444 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:41.261418    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m"
Jun 06 20:56:41.261632 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:41.261416    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f9bh2m" event={"ID":"82686c88-0ee2-4807-8185-690bbd3c186f","Type":"ContainerDied","Data":"0c34d7ba7c9fa5d084bca66d49f67ff7f4562a09b1eb1680843d8bfcdca10d90"}
Jun 06 20:56:41.261632 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:41.261539    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c34d7ba7c9fa5d084bca66d49f67ff7f4562a09b1eb1680843d8bfcdca10d90"
Jun 06 20:56:47.801987 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:47.801947    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kl6w7"]
Jun 06 20:56:47.802613 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:47.802324    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82686c88-0ee2-4807-8185-690bbd3c186f" containerName="util"
Jun 06 20:56:47.802613 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:47.802341    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="82686c88-0ee2-4807-8185-690bbd3c186f" containerName="util"
Jun 06 20:56:47.802613 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:47.802358    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82686c88-0ee2-4807-8185-690bbd3c186f" containerName="pull"
Jun 06 20:56:47.802613 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:47.802366    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="82686c88-0ee2-4807-8185-690bbd3c186f" containerName="pull"
Jun 06 20:56:47.802613 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:47.802386    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82686c88-0ee2-4807-8185-690bbd3c186f" containerName="extract"
Jun 06 20:56:47.802613 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:47.802393    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="82686c88-0ee2-4807-8185-690bbd3c186f" containerName="extract"
Jun 06 20:56:47.802613 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:47.802471    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="82686c88-0ee2-4807-8185-690bbd3c186f" containerName="extract"
Jun 06 20:56:47.806999 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:47.806975    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kl6w7"
Jun 06 20:56:47.809360 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:47.809340    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 06 20:56:47.810387 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:47.810366    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-l4lwk\""
Jun 06 20:56:47.810491 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:47.810384    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 06 20:56:47.813193 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:47.813166    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kl6w7"]
Jun 06 20:56:47.968512 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:47.968470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f14fe964-45e0-422b-bf99-2b0a01d10262-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kl6w7\" (UID: \"f14fe964-45e0-422b-bf99-2b0a01d10262\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kl6w7"
Jun 06 20:56:47.968688 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:47.968556    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wxpx\" (UniqueName: \"kubernetes.io/projected/f14fe964-45e0-422b-bf99-2b0a01d10262-kube-api-access-5wxpx\") pod \"openshift-lws-operator-fd8ccff4c-kl6w7\" (UID: \"f14fe964-45e0-422b-bf99-2b0a01d10262\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kl6w7"
Jun 06 20:56:48.069607 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:48.069536    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wxpx\" (UniqueName: \"kubernetes.io/projected/f14fe964-45e0-422b-bf99-2b0a01d10262-kube-api-access-5wxpx\") pod \"openshift-lws-operator-fd8ccff4c-kl6w7\" (UID: \"f14fe964-45e0-422b-bf99-2b0a01d10262\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kl6w7"
Jun 06 20:56:48.069607 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:48.069582    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f14fe964-45e0-422b-bf99-2b0a01d10262-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kl6w7\" (UID: \"f14fe964-45e0-422b-bf99-2b0a01d10262\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kl6w7"
Jun 06 20:56:48.069921 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:48.069905    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f14fe964-45e0-422b-bf99-2b0a01d10262-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kl6w7\" (UID: \"f14fe964-45e0-422b-bf99-2b0a01d10262\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kl6w7"
Jun 06 20:56:48.077208 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:48.077181    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wxpx\" (UniqueName: \"kubernetes.io/projected/f14fe964-45e0-422b-bf99-2b0a01d10262-kube-api-access-5wxpx\") pod \"openshift-lws-operator-fd8ccff4c-kl6w7\" (UID: \"f14fe964-45e0-422b-bf99-2b0a01d10262\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kl6w7"
Jun 06 20:56:48.117009 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:48.116980    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kl6w7"
Jun 06 20:56:48.245193 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:48.245169    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kl6w7"]
Jun 06 20:56:48.247889 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:56:48.247863    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf14fe964_45e0_422b_bf99_2b0a01d10262.slice/crio-24e9f08bead596a8f5ecd3a23207b9969bb3abb43653de68fe73c8fd444b2ab5 WatchSource:0}: Error finding container 24e9f08bead596a8f5ecd3a23207b9969bb3abb43653de68fe73c8fd444b2ab5: Status 404 returned error can't find the container with id 24e9f08bead596a8f5ecd3a23207b9969bb3abb43653de68fe73c8fd444b2ab5
Jun 06 20:56:48.288317 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:48.288270    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kl6w7" event={"ID":"f14fe964-45e0-422b-bf99-2b0a01d10262","Type":"ContainerStarted","Data":"24e9f08bead596a8f5ecd3a23207b9969bb3abb43653de68fe73c8fd444b2ab5"}
Jun 06 20:56:50.297971 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:50.297934    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kl6w7" event={"ID":"f14fe964-45e0-422b-bf99-2b0a01d10262","Type":"ContainerStarted","Data":"e791b49342c7230ff16d3df7bc929a1db92c1d3baa7c4de8d230f03f355d6791"}
Jun 06 20:56:50.313903 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:50.313850    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kl6w7" podStartSLOduration=1.63891817 podStartE2EDuration="3.313835061s" totalImagesPullingTime="1.674916891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:56:50.31291347 +0000 UTC m=+626.729725388" watchObservedRunningTime="2026-06-06 20:56:50.313835061 +0000 UTC m=+626.730646977"
Jun 06 20:56:55.428932 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.428896    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc"]
Jun 06 20:56:55.433958 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.432098    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc"
Jun 06 20:56:55.435438 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.435407    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-226hw\""
Jun 06 20:56:55.435438 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.435431    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 06 20:56:55.435933 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.435918    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 06 20:56:55.439110 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.439065    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc"]
Jun 06 20:56:55.523758 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.523717    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7gz2\" (UniqueName: \"kubernetes.io/projected/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-kube-api-access-p7gz2\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc\" (UID: \"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc"
Jun 06 20:56:55.523758 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.523762    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc\" (UID: \"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc"
Jun 06 20:56:55.523976 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.523839    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc\" (UID: \"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc"
Jun 06 20:56:55.624212 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.624165    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc\" (UID: \"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc"
Jun 06 20:56:55.624373 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.624247    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7gz2\" (UniqueName: \"kubernetes.io/projected/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-kube-api-access-p7gz2\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc\" (UID: \"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc"
Jun 06 20:56:55.624373 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.624270    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc\" (UID: \"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc"
Jun 06 20:56:55.624638 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.624613    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc\" (UID: \"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc"
Jun 06 20:56:55.624716 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.624621    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc\" (UID: \"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc"
Jun 06 20:56:55.633121 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.633100    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7gz2\" (UniqueName: \"kubernetes.io/projected/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-kube-api-access-p7gz2\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc\" (UID: \"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc"
Jun 06 20:56:55.744837 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.744804    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc"
Jun 06 20:56:55.872850 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:55.872822    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc"]
Jun 06 20:56:55.875387 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:56:55.875356    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a8bc85_9def_4cdb_be9e_fdfa7cbfbd44.slice/crio-587a4eb5d9612317e32f927c7231a9310f9d2f2b34a396bc5a4d2f96ce7599fc WatchSource:0}: Error finding container 587a4eb5d9612317e32f927c7231a9310f9d2f2b34a396bc5a4d2f96ce7599fc: Status 404 returned error can't find the container with id 587a4eb5d9612317e32f927c7231a9310f9d2f2b34a396bc5a4d2f96ce7599fc
Jun 06 20:56:56.322462 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:56.322427    2577 generic.go:356] "Generic (PLEG): container finished" podID="28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44" containerID="61a4e3d583ed4613f0cde1e229bceb7da7bbb4e82b09951c86f19d3409dc10c0" exitCode=0
Jun 06 20:56:56.322631 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:56.322499    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc" event={"ID":"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44","Type":"ContainerDied","Data":"61a4e3d583ed4613f0cde1e229bceb7da7bbb4e82b09951c86f19d3409dc10c0"}
Jun 06 20:56:56.322631 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:56.322549    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc" event={"ID":"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44","Type":"ContainerStarted","Data":"587a4eb5d9612317e32f927c7231a9310f9d2f2b34a396bc5a4d2f96ce7599fc"}
Jun 06 20:56:57.328023 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:57.327986    2577 generic.go:356] "Generic (PLEG): container finished" podID="28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44" containerID="88c2d8269d694776c645276b9454f8e5d0bb565f04e6fcb0b49e5c8004a77d9a" exitCode=0
Jun 06 20:56:57.328481 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:57.328066    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc" event={"ID":"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44","Type":"ContainerDied","Data":"88c2d8269d694776c645276b9454f8e5d0bb565f04e6fcb0b49e5c8004a77d9a"}
Jun 06 20:56:58.333527 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:58.333488    2577 generic.go:356] "Generic (PLEG): container finished" podID="28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44" containerID="abd43a639a9d94b03495f17a0e10e2ba72b59dfbd21ac2d060b22dc59891feed" exitCode=0
Jun 06 20:56:58.333959 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:58.333566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc" event={"ID":"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44","Type":"ContainerDied","Data":"abd43a639a9d94b03495f17a0e10e2ba72b59dfbd21ac2d060b22dc59891feed"}
Jun 06 20:56:59.463343 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:59.463319    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc"
Jun 06 20:56:59.549539 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:59.549508    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-util\") pod \"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44\" (UID: \"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44\") "
Jun 06 20:56:59.549711 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:59.549566    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-bundle\") pod \"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44\" (UID: \"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44\") "
Jun 06 20:56:59.549711 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:59.549603    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7gz2\" (UniqueName: \"kubernetes.io/projected/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-kube-api-access-p7gz2\") pod \"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44\" (UID: \"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44\") "
Jun 06 20:56:59.550283 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:59.550253    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-bundle" (OuterVolumeSpecName: "bundle") pod "28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44" (UID: "28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:56:59.551750 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:59.551726    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-kube-api-access-p7gz2" (OuterVolumeSpecName: "kube-api-access-p7gz2") pod "28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44" (UID: "28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44"). InnerVolumeSpecName "kube-api-access-p7gz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 20:56:59.554924 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:59.554900    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-util" (OuterVolumeSpecName: "util") pod "28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44" (UID: "28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:56:59.650080 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:59.650000    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-bundle\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:56:59.650080 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:59.650028    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7gz2\" (UniqueName: \"kubernetes.io/projected/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-kube-api-access-p7gz2\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:56:59.650080 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:56:59.650038    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44-util\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:57:00.343367 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:00.343257    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc"
Jun 06 20:57:00.343367 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:00.343265    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdlzgxc" event={"ID":"28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44","Type":"ContainerDied","Data":"587a4eb5d9612317e32f927c7231a9310f9d2f2b34a396bc5a4d2f96ce7599fc"}
Jun 06 20:57:00.343367 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:00.343364    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="587a4eb5d9612317e32f927c7231a9310f9d2f2b34a396bc5a4d2f96ce7599fc"
Jun 06 20:57:08.107830 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.107792    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"]
Jun 06 20:57:08.108247 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.108063    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44" containerName="extract"
Jun 06 20:57:08.108247 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.108076    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44" containerName="extract"
Jun 06 20:57:08.108247 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.108090    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44" containerName="util"
Jun 06 20:57:08.108247 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.108096    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44" containerName="util"
Jun 06 20:57:08.108247 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.108105    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44" containerName="pull"
Jun 06 20:57:08.108247 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.108111    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44" containerName="pull"
Jun 06 20:57:08.108247 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.108152    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="28a8bc85-9def-4cdb-be9e-fdfa7cbfbd44" containerName="extract"
Jun 06 20:57:08.110834 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.110819    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.113388 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.113363    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 06 20:57:08.113509 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.113393    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 06 20:57:08.113509 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.113455    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 06 20:57:08.113734 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.113719    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 06 20:57:08.113876 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.113862    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-48mzl\""
Jun 06 20:57:08.125173 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.125146    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"]
Jun 06 20:57:08.207612 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.207578    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75181641-b0e7-468d-bb72-6a7d70cc51a3-tmp\") pod \"opendatahub-operator-controller-manager-d755ddb6c-v4stl\" (UID: \"75181641-b0e7-468d-bb72-6a7d70cc51a3\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.207773 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.207635    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75181641-b0e7-468d-bb72-6a7d70cc51a3-webhook-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-v4stl\" (UID: \"75181641-b0e7-468d-bb72-6a7d70cc51a3\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.207773 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.207690    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/75181641-b0e7-468d-bb72-6a7d70cc51a3-manifests\") pod \"opendatahub-operator-controller-manager-d755ddb6c-v4stl\" (UID: \"75181641-b0e7-468d-bb72-6a7d70cc51a3\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.207773 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.207725    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/75181641-b0e7-468d-bb72-6a7d70cc51a3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-v4stl\" (UID: \"75181641-b0e7-468d-bb72-6a7d70cc51a3\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.207773 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.207750    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56wds\" (UniqueName: \"kubernetes.io/projected/75181641-b0e7-468d-bb72-6a7d70cc51a3-kube-api-access-56wds\") pod \"opendatahub-operator-controller-manager-d755ddb6c-v4stl\" (UID: \"75181641-b0e7-468d-bb72-6a7d70cc51a3\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.308801 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.308769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/75181641-b0e7-468d-bb72-6a7d70cc51a3-manifests\") pod \"opendatahub-operator-controller-manager-d755ddb6c-v4stl\" (UID: \"75181641-b0e7-468d-bb72-6a7d70cc51a3\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.308972 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.308814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/75181641-b0e7-468d-bb72-6a7d70cc51a3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-v4stl\" (UID: \"75181641-b0e7-468d-bb72-6a7d70cc51a3\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.308972 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.308842    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56wds\" (UniqueName: \"kubernetes.io/projected/75181641-b0e7-468d-bb72-6a7d70cc51a3-kube-api-access-56wds\") pod \"opendatahub-operator-controller-manager-d755ddb6c-v4stl\" (UID: \"75181641-b0e7-468d-bb72-6a7d70cc51a3\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.308972 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.308873    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75181641-b0e7-468d-bb72-6a7d70cc51a3-tmp\") pod \"opendatahub-operator-controller-manager-d755ddb6c-v4stl\" (UID: \"75181641-b0e7-468d-bb72-6a7d70cc51a3\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.308972 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.308908    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75181641-b0e7-468d-bb72-6a7d70cc51a3-webhook-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-v4stl\" (UID: \"75181641-b0e7-468d-bb72-6a7d70cc51a3\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.309170 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.309156    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/75181641-b0e7-468d-bb72-6a7d70cc51a3-manifests\") pod \"opendatahub-operator-controller-manager-d755ddb6c-v4stl\" (UID: \"75181641-b0e7-468d-bb72-6a7d70cc51a3\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.311449 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.311410    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75181641-b0e7-468d-bb72-6a7d70cc51a3-tmp\") pod \"opendatahub-operator-controller-manager-d755ddb6c-v4stl\" (UID: \"75181641-b0e7-468d-bb72-6a7d70cc51a3\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.311578 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.311556    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75181641-b0e7-468d-bb72-6a7d70cc51a3-webhook-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-v4stl\" (UID: \"75181641-b0e7-468d-bb72-6a7d70cc51a3\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.311637 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.311584    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/75181641-b0e7-468d-bb72-6a7d70cc51a3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d755ddb6c-v4stl\" (UID: \"75181641-b0e7-468d-bb72-6a7d70cc51a3\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.316914 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.316895    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56wds\" (UniqueName: \"kubernetes.io/projected/75181641-b0e7-468d-bb72-6a7d70cc51a3-kube-api-access-56wds\") pod \"opendatahub-operator-controller-manager-d755ddb6c-v4stl\" (UID: \"75181641-b0e7-468d-bb72-6a7d70cc51a3\") " pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.420623 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.420538    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:08.552866 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:08.552830    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"]
Jun 06 20:57:08.556806 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:57:08.556778    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75181641_b0e7_468d_bb72_6a7d70cc51a3.slice/crio-3906983d1e237b0a4e72a30d28141ac34d632ded54d7f03cfa737b4a02ecb43d WatchSource:0}: Error finding container 3906983d1e237b0a4e72a30d28141ac34d632ded54d7f03cfa737b4a02ecb43d: Status 404 returned error can't find the container with id 3906983d1e237b0a4e72a30d28141ac34d632ded54d7f03cfa737b4a02ecb43d
Jun 06 20:57:09.382604 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:09.382502    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl" event={"ID":"75181641-b0e7-468d-bb72-6a7d70cc51a3","Type":"ContainerStarted","Data":"3906983d1e237b0a4e72a30d28141ac34d632ded54d7f03cfa737b4a02ecb43d"}
Jun 06 20:57:12.395293 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:12.395251    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl" event={"ID":"75181641-b0e7-468d-bb72-6a7d70cc51a3","Type":"ContainerStarted","Data":"acddea21808155dabc653eed54f9b7ce10d3574f50bc6ec7659ca290b9cf5c71"}
Jun 06 20:57:13.401050 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:13.401018    2577 generic.go:356] "Generic (PLEG): container finished" podID="75181641-b0e7-468d-bb72-6a7d70cc51a3" containerID="acddea21808155dabc653eed54f9b7ce10d3574f50bc6ec7659ca290b9cf5c71" exitCode=0
Jun 06 20:57:13.401415 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:13.401060    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl" event={"ID":"75181641-b0e7-468d-bb72-6a7d70cc51a3","Type":"ContainerDied","Data":"acddea21808155dabc653eed54f9b7ce10d3574f50bc6ec7659ca290b9cf5c71"}
Jun 06 20:57:14.407573 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:14.407534    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl" event={"ID":"75181641-b0e7-468d-bb72-6a7d70cc51a3","Type":"ContainerStarted","Data":"565c5201329f0d459daa1b64602272b64fe3770608bef7be56209ce610ca5668"}
Jun 06 20:57:14.408059 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:14.407631    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:14.429828 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:14.429779    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl" podStartSLOduration=2.315876254 podStartE2EDuration="6.429763131s" totalImagesPullingTime="3.140033322s" totalInitContainerRuntime="973.853555ms" isStatefulPod=false podCreationTimestamp="2026-06-06 20:57:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:57:14.428007402 +0000 UTC m=+650.844819321" watchObservedRunningTime="2026-06-06 20:57:14.429763131 +0000 UTC m=+650.846575048"
Jun 06 20:57:25.414722 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:25.414689    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d755ddb6c-v4stl"
Jun 06 20:57:27.944553 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:27.944518    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb"]
Jun 06 20:57:27.954702 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:27.954660    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb"
Jun 06 20:57:27.957048 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:27.957022    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 06 20:57:27.957184 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:27.957093    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-d8xbs\""
Jun 06 20:57:27.957244 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:27.957180    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb"]
Jun 06 20:57:27.957352 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:27.957334    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 06 20:57:28.061065 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.061036    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16b8132c-d9de-4ff3-ae16-1d7845972917-tls-certs\") pod \"kube-auth-proxy-ccf7fd987-jmlpb\" (UID: \"16b8132c-d9de-4ff3-ae16-1d7845972917\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb"
Jun 06 20:57:28.061224 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.061082    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16b8132c-d9de-4ff3-ae16-1d7845972917-tmp\") pod \"kube-auth-proxy-ccf7fd987-jmlpb\" (UID: \"16b8132c-d9de-4ff3-ae16-1d7845972917\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb"
Jun 06 20:57:28.061224 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.061126    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkncp\" (UniqueName: \"kubernetes.io/projected/16b8132c-d9de-4ff3-ae16-1d7845972917-kube-api-access-dkncp\") pod \"kube-auth-proxy-ccf7fd987-jmlpb\" (UID: \"16b8132c-d9de-4ff3-ae16-1d7845972917\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb"
Jun 06 20:57:28.093087 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.093058    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-qwrjs"]
Jun 06 20:57:28.096329 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.096290    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-qwrjs"
Jun 06 20:57:28.098966 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.098936    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jun 06 20:57:28.099157 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.099144    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xv4tq\""
Jun 06 20:57:28.106975 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.106949    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-qwrjs"]
Jun 06 20:57:28.162258 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.162225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16b8132c-d9de-4ff3-ae16-1d7845972917-tmp\") pod \"kube-auth-proxy-ccf7fd987-jmlpb\" (UID: \"16b8132c-d9de-4ff3-ae16-1d7845972917\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb"
Jun 06 20:57:28.162432 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.162329    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dktws\" (UniqueName: \"kubernetes.io/projected/c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a-kube-api-access-dktws\") pod \"odh-model-controller-6dc94f689f-qwrjs\" (UID: \"c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-qwrjs"
Jun 06 20:57:28.162547 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.162519    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkncp\" (UniqueName: \"kubernetes.io/projected/16b8132c-d9de-4ff3-ae16-1d7845972917-kube-api-access-dkncp\") pod \"kube-auth-proxy-ccf7fd987-jmlpb\" (UID: \"16b8132c-d9de-4ff3-ae16-1d7845972917\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb"
Jun 06 20:57:28.162589 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.162574    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a-cert\") pod \"odh-model-controller-6dc94f689f-qwrjs\" (UID: \"c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-qwrjs"
Jun 06 20:57:28.162750 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.162726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16b8132c-d9de-4ff3-ae16-1d7845972917-tls-certs\") pod \"kube-auth-proxy-ccf7fd987-jmlpb\" (UID: \"16b8132c-d9de-4ff3-ae16-1d7845972917\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb"
Jun 06 20:57:28.164493 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.164474    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16b8132c-d9de-4ff3-ae16-1d7845972917-tmp\") pod \"kube-auth-proxy-ccf7fd987-jmlpb\" (UID: \"16b8132c-d9de-4ff3-ae16-1d7845972917\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb"
Jun 06 20:57:28.165011 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.164988    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16b8132c-d9de-4ff3-ae16-1d7845972917-tls-certs\") pod \"kube-auth-proxy-ccf7fd987-jmlpb\" (UID: \"16b8132c-d9de-4ff3-ae16-1d7845972917\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb"
Jun 06 20:57:28.169800 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.169779    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkncp\" (UniqueName: \"kubernetes.io/projected/16b8132c-d9de-4ff3-ae16-1d7845972917-kube-api-access-dkncp\") pod \"kube-auth-proxy-ccf7fd987-jmlpb\" (UID: \"16b8132c-d9de-4ff3-ae16-1d7845972917\") " pod="openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb"
Jun 06 20:57:28.263657 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.263625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dktws\" (UniqueName: \"kubernetes.io/projected/c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a-kube-api-access-dktws\") pod \"odh-model-controller-6dc94f689f-qwrjs\" (UID: \"c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-qwrjs"
Jun 06 20:57:28.263824 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.263678    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a-cert\") pod \"odh-model-controller-6dc94f689f-qwrjs\" (UID: \"c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-qwrjs"
Jun 06 20:57:28.263882 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:57:28.263858    2577 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jun 06 20:57:28.263971 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:57:28.263960    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a-cert podName:c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a nodeName:}" failed. No retries permitted until 2026-06-06 20:57:28.763929408 +0000 UTC m=+665.180741306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a-cert") pod "odh-model-controller-6dc94f689f-qwrjs" (UID: "c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a") : secret "odh-model-controller-webhook-cert" not found
Jun 06 20:57:28.267485 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.267459    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb"
Jun 06 20:57:28.275582 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.275559    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dktws\" (UniqueName: \"kubernetes.io/projected/c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a-kube-api-access-dktws\") pod \"odh-model-controller-6dc94f689f-qwrjs\" (UID: \"c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-qwrjs"
Jun 06 20:57:28.421472 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.421442    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb"]
Jun 06 20:57:28.423860 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:57:28.423832    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b8132c_d9de_4ff3_ae16_1d7845972917.slice/crio-508893ccd2dce1c3493d23de8c1ee2aa6d8987a74420e95c9ac7a0620cbe546f WatchSource:0}: Error finding container 508893ccd2dce1c3493d23de8c1ee2aa6d8987a74420e95c9ac7a0620cbe546f: Status 404 returned error can't find the container with id 508893ccd2dce1c3493d23de8c1ee2aa6d8987a74420e95c9ac7a0620cbe546f
Jun 06 20:57:28.468516 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.468477    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb" event={"ID":"16b8132c-d9de-4ff3-ae16-1d7845972917","Type":"ContainerStarted","Data":"508893ccd2dce1c3493d23de8c1ee2aa6d8987a74420e95c9ac7a0620cbe546f"}
Jun 06 20:57:28.767258 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.767216    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a-cert\") pod \"odh-model-controller-6dc94f689f-qwrjs\" (UID: \"c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-qwrjs"
Jun 06 20:57:28.769652 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.769631    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a-cert\") pod \"odh-model-controller-6dc94f689f-qwrjs\" (UID: \"c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a\") " pod="opendatahub/odh-model-controller-6dc94f689f-qwrjs"
Jun 06 20:57:28.792580 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.792546    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-xfxmc"]
Jun 06 20:57:28.797451 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.797427    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-xfxmc"
Jun 06 20:57:28.799839 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.799818    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jun 06 20:57:28.806681 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.806656    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-xfxmc"]
Jun 06 20:57:28.867932 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.867895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db573428-5192-410a-811e-d11075f75d8b-tls-certs\") pod \"model-serving-api-5dd488fc48-xfxmc\" (UID: \"db573428-5192-410a-811e-d11075f75d8b\") " pod="opendatahub/model-serving-api-5dd488fc48-xfxmc"
Jun 06 20:57:28.868100 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.867945    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr8z5\" (UniqueName: \"kubernetes.io/projected/db573428-5192-410a-811e-d11075f75d8b-kube-api-access-vr8z5\") pod \"model-serving-api-5dd488fc48-xfxmc\" (UID: \"db573428-5192-410a-811e-d11075f75d8b\") " pod="opendatahub/model-serving-api-5dd488fc48-xfxmc"
Jun 06 20:57:28.969439 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.969400    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db573428-5192-410a-811e-d11075f75d8b-tls-certs\") pod \"model-serving-api-5dd488fc48-xfxmc\" (UID: \"db573428-5192-410a-811e-d11075f75d8b\") " pod="opendatahub/model-serving-api-5dd488fc48-xfxmc"
Jun 06 20:57:28.969887 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.969464    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr8z5\" (UniqueName: \"kubernetes.io/projected/db573428-5192-410a-811e-d11075f75d8b-kube-api-access-vr8z5\") pod \"model-serving-api-5dd488fc48-xfxmc\" (UID: \"db573428-5192-410a-811e-d11075f75d8b\") " pod="opendatahub/model-serving-api-5dd488fc48-xfxmc"
Jun 06 20:57:28.972135 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.972102    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db573428-5192-410a-811e-d11075f75d8b-tls-certs\") pod \"model-serving-api-5dd488fc48-xfxmc\" (UID: \"db573428-5192-410a-811e-d11075f75d8b\") " pod="opendatahub/model-serving-api-5dd488fc48-xfxmc"
Jun 06 20:57:28.978790 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:28.978760    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr8z5\" (UniqueName: \"kubernetes.io/projected/db573428-5192-410a-811e-d11075f75d8b-kube-api-access-vr8z5\") pod \"model-serving-api-5dd488fc48-xfxmc\" (UID: \"db573428-5192-410a-811e-d11075f75d8b\") " pod="opendatahub/model-serving-api-5dd488fc48-xfxmc"
Jun 06 20:57:29.006656 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.006433    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-qwrjs"
Jun 06 20:57:29.109772 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.108590    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-xfxmc"
Jun 06 20:57:29.172628 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.172518    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-qwrjs"]
Jun 06 20:57:29.179460 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:57:29.179426    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3aeb0c2_bf29_45dc_9267_ab05a9df5c2a.slice/crio-66e13c4fced22c1c87b1a3cda92a7a27c1af1261ae7e9d9965d3f6af0ececf10 WatchSource:0}: Error finding container 66e13c4fced22c1c87b1a3cda92a7a27c1af1261ae7e9d9965d3f6af0ececf10: Status 404 returned error can't find the container with id 66e13c4fced22c1c87b1a3cda92a7a27c1af1261ae7e9d9965d3f6af0ececf10
Jun 06 20:57:29.287666 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.287636    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-xfxmc"]
Jun 06 20:57:29.290679 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:57:29.290642    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb573428_5192_410a_811e_d11075f75d8b.slice/crio-1e5caf3d77dc35c7625306bce291ffd97d7e43150f715777b95afdb8273eb466 WatchSource:0}: Error finding container 1e5caf3d77dc35c7625306bce291ffd97d7e43150f715777b95afdb8273eb466: Status 404 returned error can't find the container with id 1e5caf3d77dc35c7625306bce291ffd97d7e43150f715777b95afdb8273eb466
Jun 06 20:57:29.476732 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.476680    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-xfxmc" event={"ID":"db573428-5192-410a-811e-d11075f75d8b","Type":"ContainerStarted","Data":"1e5caf3d77dc35c7625306bce291ffd97d7e43150f715777b95afdb8273eb466"}
Jun 06 20:57:29.478210 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.478177    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-qwrjs" event={"ID":"c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a","Type":"ContainerStarted","Data":"66e13c4fced22c1c87b1a3cda92a7a27c1af1261ae7e9d9965d3f6af0ececf10"}
Jun 06 20:57:29.807439 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.806881    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq"]
Jun 06 20:57:29.810923 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.810897    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq"
Jun 06 20:57:29.813652 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.813629    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 06 20:57:29.813948 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.813927    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 06 20:57:29.814656 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.814479    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-226hw\""
Jun 06 20:57:29.818606 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.818579    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq"]
Jun 06 20:57:29.878406 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.878192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8193464e-e720-415f-8955-1f360a7e5a33-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq\" (UID: \"8193464e-e720-415f-8955-1f360a7e5a33\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq"
Jun 06 20:57:29.878406 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.878266    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8193464e-e720-415f-8955-1f360a7e5a33-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq\" (UID: \"8193464e-e720-415f-8955-1f360a7e5a33\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq"
Jun 06 20:57:29.878406 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.878334    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8trc\" (UniqueName: \"kubernetes.io/projected/8193464e-e720-415f-8955-1f360a7e5a33-kube-api-access-q8trc\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq\" (UID: \"8193464e-e720-415f-8955-1f360a7e5a33\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq"
Jun 06 20:57:29.979662 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.979372    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8trc\" (UniqueName: \"kubernetes.io/projected/8193464e-e720-415f-8955-1f360a7e5a33-kube-api-access-q8trc\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq\" (UID: \"8193464e-e720-415f-8955-1f360a7e5a33\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq"
Jun 06 20:57:29.979662 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.979474    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8193464e-e720-415f-8955-1f360a7e5a33-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq\" (UID: \"8193464e-e720-415f-8955-1f360a7e5a33\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq"
Jun 06 20:57:29.979662 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.979527    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8193464e-e720-415f-8955-1f360a7e5a33-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq\" (UID: \"8193464e-e720-415f-8955-1f360a7e5a33\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq"
Jun 06 20:57:29.980255 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.979929    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8193464e-e720-415f-8955-1f360a7e5a33-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq\" (UID: \"8193464e-e720-415f-8955-1f360a7e5a33\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq"
Jun 06 20:57:29.980255 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.979970    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8193464e-e720-415f-8955-1f360a7e5a33-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq\" (UID: \"8193464e-e720-415f-8955-1f360a7e5a33\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq"
Jun 06 20:57:29.990508 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:29.990454    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8trc\" (UniqueName: \"kubernetes.io/projected/8193464e-e720-415f-8955-1f360a7e5a33-kube-api-access-q8trc\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq\" (UID: \"8193464e-e720-415f-8955-1f360a7e5a33\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq"
Jun 06 20:57:30.129952 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:30.129652    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq"
Jun 06 20:57:33.142999 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:33.142917    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq"]
Jun 06 20:57:33.145627 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:57:33.145594    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8193464e_e720_415f_8955_1f360a7e5a33.slice/crio-08065873951ad6de49b3697a4bd02a4292f98c2a1597a0583d56a9d7debf5721 WatchSource:0}: Error finding container 08065873951ad6de49b3697a4bd02a4292f98c2a1597a0583d56a9d7debf5721: Status 404 returned error can't find the container with id 08065873951ad6de49b3697a4bd02a4292f98c2a1597a0583d56a9d7debf5721
Jun 06 20:57:33.501641 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:33.501588    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb" event={"ID":"16b8132c-d9de-4ff3-ae16-1d7845972917","Type":"ContainerStarted","Data":"2dd11ad28ede7a2f0409549f81f56c2febbc4cc52305b10a8a77c932e32f97ff"}
Jun 06 20:57:33.503069 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:33.503045    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-xfxmc" event={"ID":"db573428-5192-410a-811e-d11075f75d8b","Type":"ContainerStarted","Data":"5b506a3f84117288196fc4702bcb2d98b8a3125458bf68ac374fc73fdd3fff37"}
Jun 06 20:57:33.503196 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:33.503136    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-xfxmc"
Jun 06 20:57:33.504556 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:33.504516    2577 generic.go:356] "Generic (PLEG): container finished" podID="8193464e-e720-415f-8955-1f360a7e5a33" containerID="05ae7dec61a7a152f5fbf29ddc1f1c429b76337dcd49b9d8e86362e8516f12b2" exitCode=0
Jun 06 20:57:33.504664 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:33.504620    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq" event={"ID":"8193464e-e720-415f-8955-1f360a7e5a33","Type":"ContainerDied","Data":"05ae7dec61a7a152f5fbf29ddc1f1c429b76337dcd49b9d8e86362e8516f12b2"}
Jun 06 20:57:33.504664 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:33.504652    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq" event={"ID":"8193464e-e720-415f-8955-1f360a7e5a33","Type":"ContainerStarted","Data":"08065873951ad6de49b3697a4bd02a4292f98c2a1597a0583d56a9d7debf5721"}
Jun 06 20:57:33.506252 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:33.506217    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-qwrjs" event={"ID":"c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a","Type":"ContainerStarted","Data":"5bbb9d5129d9b10b4c3b87fa4f8911278f41aea15c795d2f319f3d943fd3214e"}
Jun 06 20:57:33.506355 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:33.506344    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-qwrjs"
Jun 06 20:57:33.518724 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:33.518684    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-ccf7fd987-jmlpb" podStartSLOduration=1.9399926459999999 podStartE2EDuration="6.518671175s" totalImagesPullingTime="4.578678529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:57:33.516728536 +0000 UTC m=+669.933540453" watchObservedRunningTime="2026-06-06 20:57:33.518671175 +0000 UTC m=+669.935483092"
Jun 06 20:57:33.533618 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:33.533569    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-xfxmc" podStartSLOduration=1.8189513659999998 podStartE2EDuration="5.533554491s" totalImagesPullingTime="3.714603125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:57:33.531694562 +0000 UTC m=+669.948506481" watchObservedRunningTime="2026-06-06 20:57:33.533554491 +0000 UTC m=+669.950366409"
Jun 06 20:57:33.546973 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:33.546921    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-qwrjs" podStartSLOduration=1.722157782 podStartE2EDuration="5.546906647s" totalImagesPullingTime="3.824748865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:57:33.545762095 +0000 UTC m=+669.962574015" watchObservedRunningTime="2026-06-06 20:57:33.546906647 +0000 UTC m=+669.963718563"
Jun 06 20:57:34.513037 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:34.512988    2577 generic.go:356] "Generic (PLEG): container finished" podID="8193464e-e720-415f-8955-1f360a7e5a33" containerID="daa284375e968e312f6a247d2061aaec5afe1bd93597e533fd6831cf58a60891" exitCode=0
Jun 06 20:57:34.513468 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:34.513070    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq" event={"ID":"8193464e-e720-415f-8955-1f360a7e5a33","Type":"ContainerDied","Data":"daa284375e968e312f6a247d2061aaec5afe1bd93597e533fd6831cf58a60891"}
Jun 06 20:57:35.519007 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:35.518966    2577 generic.go:356] "Generic (PLEG): container finished" podID="8193464e-e720-415f-8955-1f360a7e5a33" containerID="75757039e16ab3c687a5fc00996eb2f95bfb8693f46d1d325d1f9551f2d0c3d6" exitCode=0
Jun 06 20:57:35.519423 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:35.519054    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq" event={"ID":"8193464e-e720-415f-8955-1f360a7e5a33","Type":"ContainerDied","Data":"75757039e16ab3c687a5fc00996eb2f95bfb8693f46d1d325d1f9551f2d0c3d6"}
Jun 06 20:57:36.648607 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:36.648584    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq"
Jun 06 20:57:36.741551 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:36.741514    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8trc\" (UniqueName: \"kubernetes.io/projected/8193464e-e720-415f-8955-1f360a7e5a33-kube-api-access-q8trc\") pod \"8193464e-e720-415f-8955-1f360a7e5a33\" (UID: \"8193464e-e720-415f-8955-1f360a7e5a33\") "
Jun 06 20:57:36.741714 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:36.741604    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8193464e-e720-415f-8955-1f360a7e5a33-bundle\") pod \"8193464e-e720-415f-8955-1f360a7e5a33\" (UID: \"8193464e-e720-415f-8955-1f360a7e5a33\") "
Jun 06 20:57:36.741714 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:36.741644    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8193464e-e720-415f-8955-1f360a7e5a33-util\") pod \"8193464e-e720-415f-8955-1f360a7e5a33\" (UID: \"8193464e-e720-415f-8955-1f360a7e5a33\") "
Jun 06 20:57:36.742433 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:36.742407    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8193464e-e720-415f-8955-1f360a7e5a33-bundle" (OuterVolumeSpecName: "bundle") pod "8193464e-e720-415f-8955-1f360a7e5a33" (UID: "8193464e-e720-415f-8955-1f360a7e5a33"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:57:36.743682 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:36.743651    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8193464e-e720-415f-8955-1f360a7e5a33-kube-api-access-q8trc" (OuterVolumeSpecName: "kube-api-access-q8trc") pod "8193464e-e720-415f-8955-1f360a7e5a33" (UID: "8193464e-e720-415f-8955-1f360a7e5a33"). InnerVolumeSpecName "kube-api-access-q8trc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 20:57:36.746734 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:36.746700    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8193464e-e720-415f-8955-1f360a7e5a33-util" (OuterVolumeSpecName: "util") pod "8193464e-e720-415f-8955-1f360a7e5a33" (UID: "8193464e-e720-415f-8955-1f360a7e5a33"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:57:36.843064 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:36.842982    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8193464e-e720-415f-8955-1f360a7e5a33-bundle\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:57:36.843064 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:36.843010    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8193464e-e720-415f-8955-1f360a7e5a33-util\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:57:36.843064 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:36.843020    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8trc\" (UniqueName: \"kubernetes.io/projected/8193464e-e720-415f-8955-1f360a7e5a33-kube-api-access-q8trc\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:57:37.278027 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.277997    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-csl7p"]
Jun 06 20:57:37.278324 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.278311    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8193464e-e720-415f-8955-1f360a7e5a33" containerName="extract"
Jun 06 20:57:37.278378 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.278326    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8193464e-e720-415f-8955-1f360a7e5a33" containerName="extract"
Jun 06 20:57:37.278378 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.278336    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8193464e-e720-415f-8955-1f360a7e5a33" containerName="util"
Jun 06 20:57:37.278378 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.278341    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8193464e-e720-415f-8955-1f360a7e5a33" containerName="util"
Jun 06 20:57:37.278378 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.278350    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8193464e-e720-415f-8955-1f360a7e5a33" containerName="pull"
Jun 06 20:57:37.278378 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.278356    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8193464e-e720-415f-8955-1f360a7e5a33" containerName="pull"
Jun 06 20:57:37.278519 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.278401    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8193464e-e720-415f-8955-1f360a7e5a33" containerName="extract"
Jun 06 20:57:37.280932 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.280914    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-csl7p"
Jun 06 20:57:37.283773 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.283749    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jun 06 20:57:37.283919 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.283900    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5mqqg\""
Jun 06 20:57:37.287595 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.287571    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-6qcpc"]
Jun 06 20:57:37.291099 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.291077    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qcpc"
Jun 06 20:57:37.293572 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.293549    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dwnts\""
Jun 06 20:57:37.293811 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.293785    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jun 06 20:57:37.294211 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.294190    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-csl7p"]
Jun 06 20:57:37.300692 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.300670    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-6qcpc"]
Jun 06 20:57:37.347278 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.347232    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d907397-7313-4f7e-8999-3e2215c622c6-cert\") pod \"kserve-controller-manager-69fc866d76-csl7p\" (UID: \"8d907397-7313-4f7e-8999-3e2215c622c6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-csl7p"
Jun 06 20:57:37.347278 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.347284    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c169929-a78e-44a7-9543-e1333fb74dd8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-6qcpc\" (UID: \"4c169929-a78e-44a7-9543-e1333fb74dd8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qcpc"
Jun 06 20:57:37.347548 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.347392    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzdch\" (UniqueName: \"kubernetes.io/projected/8d907397-7313-4f7e-8999-3e2215c622c6-kube-api-access-bzdch\") pod \"kserve-controller-manager-69fc866d76-csl7p\" (UID: \"8d907397-7313-4f7e-8999-3e2215c622c6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-csl7p"
Jun 06 20:57:37.347548 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.347425    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbd6h\" (UniqueName: \"kubernetes.io/projected/4c169929-a78e-44a7-9543-e1333fb74dd8-kube-api-access-qbd6h\") pod \"llmisvc-controller-manager-864bfd7bc9-6qcpc\" (UID: \"4c169929-a78e-44a7-9543-e1333fb74dd8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qcpc"
Jun 06 20:57:37.448750 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.448714    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d907397-7313-4f7e-8999-3e2215c622c6-cert\") pod \"kserve-controller-manager-69fc866d76-csl7p\" (UID: \"8d907397-7313-4f7e-8999-3e2215c622c6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-csl7p"
Jun 06 20:57:37.448750 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.448751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c169929-a78e-44a7-9543-e1333fb74dd8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-6qcpc\" (UID: \"4c169929-a78e-44a7-9543-e1333fb74dd8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qcpc"
Jun 06 20:57:37.448999 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.448818    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzdch\" (UniqueName: \"kubernetes.io/projected/8d907397-7313-4f7e-8999-3e2215c622c6-kube-api-access-bzdch\") pod \"kserve-controller-manager-69fc866d76-csl7p\" (UID: \"8d907397-7313-4f7e-8999-3e2215c622c6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-csl7p"
Jun 06 20:57:37.448999 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.448853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbd6h\" (UniqueName: \"kubernetes.io/projected/4c169929-a78e-44a7-9543-e1333fb74dd8-kube-api-access-qbd6h\") pod \"llmisvc-controller-manager-864bfd7bc9-6qcpc\" (UID: \"4c169929-a78e-44a7-9543-e1333fb74dd8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qcpc"
Jun 06 20:57:37.451231 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.451208    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4c169929-a78e-44a7-9543-e1333fb74dd8-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-6qcpc\" (UID: \"4c169929-a78e-44a7-9543-e1333fb74dd8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qcpc"
Jun 06 20:57:37.451338 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.451319    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8d907397-7313-4f7e-8999-3e2215c622c6-cert\") pod \"kserve-controller-manager-69fc866d76-csl7p\" (UID: \"8d907397-7313-4f7e-8999-3e2215c622c6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-csl7p"
Jun 06 20:57:37.461347 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.461327    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzdch\" (UniqueName: \"kubernetes.io/projected/8d907397-7313-4f7e-8999-3e2215c622c6-kube-api-access-bzdch\") pod \"kserve-controller-manager-69fc866d76-csl7p\" (UID: \"8d907397-7313-4f7e-8999-3e2215c622c6\") " pod="opendatahub/kserve-controller-manager-69fc866d76-csl7p"
Jun 06 20:57:37.466585 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.466568    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbd6h\" (UniqueName: \"kubernetes.io/projected/4c169929-a78e-44a7-9543-e1333fb74dd8-kube-api-access-qbd6h\") pod \"llmisvc-controller-manager-864bfd7bc9-6qcpc\" (UID: \"4c169929-a78e-44a7-9543-e1333fb74dd8\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qcpc"
Jun 06 20:57:37.529481 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.529380    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq" event={"ID":"8193464e-e720-415f-8955-1f360a7e5a33","Type":"ContainerDied","Data":"08065873951ad6de49b3697a4bd02a4292f98c2a1597a0583d56a9d7debf5721"}
Jun 06 20:57:37.529481 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.529438    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08065873951ad6de49b3697a4bd02a4292f98c2a1597a0583d56a9d7debf5721"
Jun 06 20:57:37.529481 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.529456    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab062ljqq"
Jun 06 20:57:37.593242 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.593210    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-csl7p"
Jun 06 20:57:37.604264 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.604233    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qcpc"
Jun 06 20:57:37.749663 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.749638    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-csl7p"]
Jun 06 20:57:37.751960 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:57:37.751930    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d907397_7313_4f7e_8999_3e2215c622c6.slice/crio-242699e36e1dae6616b3103ab53c293867ce71dfb5220bec33ad878f6c27528e WatchSource:0}: Error finding container 242699e36e1dae6616b3103ab53c293867ce71dfb5220bec33ad878f6c27528e: Status 404 returned error can't find the container with id 242699e36e1dae6616b3103ab53c293867ce71dfb5220bec33ad878f6c27528e
Jun 06 20:57:37.761660 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:37.761573    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-6qcpc"]
Jun 06 20:57:37.763923 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:57:37.763900    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4c169929_a78e_44a7_9543_e1333fb74dd8.slice/crio-e3b67b38291147029d3702ea06d53c06bb1660bb7007d9ea78bb5c27de612522 WatchSource:0}: Error finding container e3b67b38291147029d3702ea06d53c06bb1660bb7007d9ea78bb5c27de612522: Status 404 returned error can't find the container with id e3b67b38291147029d3702ea06d53c06bb1660bb7007d9ea78bb5c27de612522
Jun 06 20:57:38.541439 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:38.541399    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-csl7p" event={"ID":"8d907397-7313-4f7e-8999-3e2215c622c6","Type":"ContainerStarted","Data":"242699e36e1dae6616b3103ab53c293867ce71dfb5220bec33ad878f6c27528e"}
Jun 06 20:57:38.543029 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:38.542997    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qcpc" event={"ID":"4c169929-a78e-44a7-9543-e1333fb74dd8","Type":"ContainerStarted","Data":"e3b67b38291147029d3702ea06d53c06bb1660bb7007d9ea78bb5c27de612522"}
Jun 06 20:57:41.560322 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:41.560264    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-csl7p" event={"ID":"8d907397-7313-4f7e-8999-3e2215c622c6","Type":"ContainerStarted","Data":"7fcc365755871d0652d871f896e1fb383d5afe194a42613a44fb1c04127570d6"}
Jun 06 20:57:41.560754 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:41.560439    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-csl7p"
Jun 06 20:57:41.561736 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:41.561713    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qcpc" event={"ID":"4c169929-a78e-44a7-9543-e1333fb74dd8","Type":"ContainerStarted","Data":"d8c16460ad815493bc438c4f45def618846511a42d5154ab24bde23db52ef9c1"}
Jun 06 20:57:41.561849 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:41.561842    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qcpc"
Jun 06 20:57:41.578479 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:41.578428    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-csl7p" podStartSLOduration=1.617430786 podStartE2EDuration="4.5784117s" totalImagesPullingTime="2.960980914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:57:41.576916123 +0000 UTC m=+677.993728065" watchObservedRunningTime="2026-06-06 20:57:41.5784117 +0000 UTC m=+677.995223617"
Jun 06 20:57:41.595067 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:41.595019    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qcpc" podStartSLOduration=1.641957713 podStartE2EDuration="4.595004299s" totalImagesPullingTime="2.953046586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:57:41.593750006 +0000 UTC m=+678.010561926" watchObservedRunningTime="2026-06-06 20:57:41.595004299 +0000 UTC m=+678.011816216"
Jun 06 20:57:44.515812 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:44.515779    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-qwrjs"
Jun 06 20:57:44.518020 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:44.517997    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-xfxmc"
Jun 06 20:57:45.030177 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.030142    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn"]
Jun 06 20:57:45.037717 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.037685    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn"
Jun 06 20:57:45.040203 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.040180    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 06 20:57:45.041499 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.041470    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-226hw\""
Jun 06 20:57:45.041499 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.041502    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 06 20:57:45.044204 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.044182    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn"]
Jun 06 20:57:45.114506 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.114466    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/037807f6-fd9c-4dd9-af60-2424d4e551b6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn\" (UID: \"037807f6-fd9c-4dd9-af60-2424d4e551b6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn"
Jun 06 20:57:45.114768 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.114542    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/037807f6-fd9c-4dd9-af60-2424d4e551b6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn\" (UID: \"037807f6-fd9c-4dd9-af60-2424d4e551b6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn"
Jun 06 20:57:45.114768 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.114574    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jtr4\" (UniqueName: \"kubernetes.io/projected/037807f6-fd9c-4dd9-af60-2424d4e551b6-kube-api-access-8jtr4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn\" (UID: \"037807f6-fd9c-4dd9-af60-2424d4e551b6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn"
Jun 06 20:57:45.215006 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.214966    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/037807f6-fd9c-4dd9-af60-2424d4e551b6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn\" (UID: \"037807f6-fd9c-4dd9-af60-2424d4e551b6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn"
Jun 06 20:57:45.215171 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.215027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/037807f6-fd9c-4dd9-af60-2424d4e551b6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn\" (UID: \"037807f6-fd9c-4dd9-af60-2424d4e551b6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn"
Jun 06 20:57:45.215171 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.215046    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jtr4\" (UniqueName: \"kubernetes.io/projected/037807f6-fd9c-4dd9-af60-2424d4e551b6-kube-api-access-8jtr4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn\" (UID: \"037807f6-fd9c-4dd9-af60-2424d4e551b6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn"
Jun 06 20:57:45.215380 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.215362    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/037807f6-fd9c-4dd9-af60-2424d4e551b6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn\" (UID: \"037807f6-fd9c-4dd9-af60-2424d4e551b6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn"
Jun 06 20:57:45.215423 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.215395    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/037807f6-fd9c-4dd9-af60-2424d4e551b6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn\" (UID: \"037807f6-fd9c-4dd9-af60-2424d4e551b6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn"
Jun 06 20:57:45.229848 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.229818    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jtr4\" (UniqueName: \"kubernetes.io/projected/037807f6-fd9c-4dd9-af60-2424d4e551b6-kube-api-access-8jtr4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn\" (UID: \"037807f6-fd9c-4dd9-af60-2424d4e551b6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn"
Jun 06 20:57:45.348896 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.348801    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn"
Jun 06 20:57:45.499935 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.499906    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn"]
Jun 06 20:57:45.502737 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:57:45.502707    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod037807f6_fd9c_4dd9_af60_2424d4e551b6.slice/crio-b0aa29507021b8e2240e3691b83ec21ca7c393df78a1113fd6fb6bb339cfad1c WatchSource:0}: Error finding container b0aa29507021b8e2240e3691b83ec21ca7c393df78a1113fd6fb6bb339cfad1c: Status 404 returned error can't find the container with id b0aa29507021b8e2240e3691b83ec21ca7c393df78a1113fd6fb6bb339cfad1c
Jun 06 20:57:45.582096 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.582059    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn" event={"ID":"037807f6-fd9c-4dd9-af60-2424d4e551b6","Type":"ContainerStarted","Data":"78f355eacdc2025b9da8206210f7eddcfd09360a282cbbef78360be96cd572d2"}
Jun 06 20:57:45.582454 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:45.582121    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn" event={"ID":"037807f6-fd9c-4dd9-af60-2424d4e551b6","Type":"ContainerStarted","Data":"b0aa29507021b8e2240e3691b83ec21ca7c393df78a1113fd6fb6bb339cfad1c"}
Jun 06 20:57:46.508639 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:46.508607    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-q4678"]
Jun 06 20:57:46.511841 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:46.511821    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-q4678"
Jun 06 20:57:46.514667 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:46.514646    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-7hjzt\""
Jun 06 20:57:46.514791 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:46.514680    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
Jun 06 20:57:46.516052 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:46.516032    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
Jun 06 20:57:46.547715 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:46.547684    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-q4678"]
Jun 06 20:57:46.588264 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:46.588220    2577 generic.go:356] "Generic (PLEG): container finished" podID="037807f6-fd9c-4dd9-af60-2424d4e551b6" containerID="78f355eacdc2025b9da8206210f7eddcfd09360a282cbbef78360be96cd572d2" exitCode=0
Jun 06 20:57:46.588736 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:46.588327    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn" event={"ID":"037807f6-fd9c-4dd9-af60-2424d4e551b6","Type":"ContainerDied","Data":"78f355eacdc2025b9da8206210f7eddcfd09360a282cbbef78360be96cd572d2"}
Jun 06 20:57:46.626878 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:46.626848    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjkvm\" (UniqueName: \"kubernetes.io/projected/07574c8e-cadd-4141-a03e-c9910cf92783-kube-api-access-gjkvm\") pod \"servicemesh-operator3-57f65f65fb-q4678\" (UID: \"07574c8e-cadd-4141-a03e-c9910cf92783\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-q4678"
Jun 06 20:57:46.627043 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:46.626936    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/07574c8e-cadd-4141-a03e-c9910cf92783-operator-config\") pod \"servicemesh-operator3-57f65f65fb-q4678\" (UID: \"07574c8e-cadd-4141-a03e-c9910cf92783\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-q4678"
Jun 06 20:57:46.728029 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:46.727990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/07574c8e-cadd-4141-a03e-c9910cf92783-operator-config\") pod \"servicemesh-operator3-57f65f65fb-q4678\" (UID: \"07574c8e-cadd-4141-a03e-c9910cf92783\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-q4678"
Jun 06 20:57:46.728200 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:46.728056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjkvm\" (UniqueName: \"kubernetes.io/projected/07574c8e-cadd-4141-a03e-c9910cf92783-kube-api-access-gjkvm\") pod \"servicemesh-operator3-57f65f65fb-q4678\" (UID: \"07574c8e-cadd-4141-a03e-c9910cf92783\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-q4678"
Jun 06 20:57:46.730571 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:46.730553    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/07574c8e-cadd-4141-a03e-c9910cf92783-operator-config\") pod \"servicemesh-operator3-57f65f65fb-q4678\" (UID: \"07574c8e-cadd-4141-a03e-c9910cf92783\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-q4678"
Jun 06 20:57:46.737803 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:46.737778    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjkvm\" (UniqueName: \"kubernetes.io/projected/07574c8e-cadd-4141-a03e-c9910cf92783-kube-api-access-gjkvm\") pod \"servicemesh-operator3-57f65f65fb-q4678\" (UID: \"07574c8e-cadd-4141-a03e-c9910cf92783\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-q4678"
Jun 06 20:57:46.820801 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:46.820687    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-q4678"
Jun 06 20:57:46.957806 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:46.957774    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-q4678"]
Jun 06 20:57:46.960065 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:57:46.960031    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07574c8e_cadd_4141_a03e_c9910cf92783.slice/crio-c087ead0c542841350ab0a933f4c695e2a88279dc7877f2ca8b7047790b43965 WatchSource:0}: Error finding container c087ead0c542841350ab0a933f4c695e2a88279dc7877f2ca8b7047790b43965: Status 404 returned error can't find the container with id c087ead0c542841350ab0a933f4c695e2a88279dc7877f2ca8b7047790b43965
Jun 06 20:57:47.595114 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:47.595082    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-q4678" event={"ID":"07574c8e-cadd-4141-a03e-c9910cf92783","Type":"ContainerStarted","Data":"c087ead0c542841350ab0a933f4c695e2a88279dc7877f2ca8b7047790b43965"}
Jun 06 20:57:48.604144 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:48.604105    2577 generic.go:356] "Generic (PLEG): container finished" podID="037807f6-fd9c-4dd9-af60-2424d4e551b6" containerID="a03f8146a75c9b64a88951b3941f336099d449462ff19f0e13f1f6e8ec8c5258" exitCode=0
Jun 06 20:57:48.604625 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:48.604197    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn" event={"ID":"037807f6-fd9c-4dd9-af60-2424d4e551b6","Type":"ContainerDied","Data":"a03f8146a75c9b64a88951b3941f336099d449462ff19f0e13f1f6e8ec8c5258"}
Jun 06 20:57:49.612474 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:49.612442    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn" event={"ID":"037807f6-fd9c-4dd9-af60-2424d4e551b6","Type":"ContainerStarted","Data":"2dc899999f14e609b4c066d0b5cd7bbe89277b3dcf8f72279b0afc4aa4dea98f"}
Jun 06 20:57:49.630213 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:49.630099    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn" podStartSLOduration=3.497755039 podStartE2EDuration="4.630079996s" totalImagesPullingTime="1.132324957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:57:49.629842186 +0000 UTC m=+686.046654118" watchObservedRunningTime="2026-06-06 20:57:49.630079996 +0000 UTC m=+686.046891914"
Jun 06 20:57:50.619961 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:50.619903    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-q4678" event={"ID":"07574c8e-cadd-4141-a03e-c9910cf92783","Type":"ContainerStarted","Data":"7d32d2fd46e82783d74df9245751d5e10ded96d0842965b9f17494268505114b"}
Jun 06 20:57:50.620393 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:50.619975    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-q4678"
Jun 06 20:57:50.621988 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:50.621962    2577 generic.go:356] "Generic (PLEG): container finished" podID="037807f6-fd9c-4dd9-af60-2424d4e551b6" containerID="2dc899999f14e609b4c066d0b5cd7bbe89277b3dcf8f72279b0afc4aa4dea98f" exitCode=0
Jun 06 20:57:50.622336 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:50.622028    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn" event={"ID":"037807f6-fd9c-4dd9-af60-2424d4e551b6","Type":"ContainerDied","Data":"2dc899999f14e609b4c066d0b5cd7bbe89277b3dcf8f72279b0afc4aa4dea98f"}
Jun 06 20:57:50.640727 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:50.640676    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-q4678" podStartSLOduration=1.9217471609999999 podStartE2EDuration="4.640661623s" totalImagesPullingTime="2.718914462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:57:50.638167189 +0000 UTC m=+687.054979107" watchObservedRunningTime="2026-06-06 20:57:50.640661623 +0000 UTC m=+687.057473540"
Jun 06 20:57:51.751754 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:51.751730    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn"
Jun 06 20:57:51.874485 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:51.874453    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/037807f6-fd9c-4dd9-af60-2424d4e551b6-bundle\") pod \"037807f6-fd9c-4dd9-af60-2424d4e551b6\" (UID: \"037807f6-fd9c-4dd9-af60-2424d4e551b6\") "
Jun 06 20:57:51.874655 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:51.874516    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jtr4\" (UniqueName: \"kubernetes.io/projected/037807f6-fd9c-4dd9-af60-2424d4e551b6-kube-api-access-8jtr4\") pod \"037807f6-fd9c-4dd9-af60-2424d4e551b6\" (UID: \"037807f6-fd9c-4dd9-af60-2424d4e551b6\") "
Jun 06 20:57:51.874655 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:51.874548    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/037807f6-fd9c-4dd9-af60-2424d4e551b6-util\") pod \"037807f6-fd9c-4dd9-af60-2424d4e551b6\" (UID: \"037807f6-fd9c-4dd9-af60-2424d4e551b6\") "
Jun 06 20:57:51.875438 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:51.875405    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037807f6-fd9c-4dd9-af60-2424d4e551b6-bundle" (OuterVolumeSpecName: "bundle") pod "037807f6-fd9c-4dd9-af60-2424d4e551b6" (UID: "037807f6-fd9c-4dd9-af60-2424d4e551b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:57:51.876628 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:51.876607    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/037807f6-fd9c-4dd9-af60-2424d4e551b6-kube-api-access-8jtr4" (OuterVolumeSpecName: "kube-api-access-8jtr4") pod "037807f6-fd9c-4dd9-af60-2424d4e551b6" (UID: "037807f6-fd9c-4dd9-af60-2424d4e551b6"). InnerVolumeSpecName "kube-api-access-8jtr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 20:57:51.881247 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:51.881178    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037807f6-fd9c-4dd9-af60-2424d4e551b6-util" (OuterVolumeSpecName: "util") pod "037807f6-fd9c-4dd9-af60-2424d4e551b6" (UID: "037807f6-fd9c-4dd9-af60-2424d4e551b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:57:51.975969 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:51.975937    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/037807f6-fd9c-4dd9-af60-2424d4e551b6-util\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:57:51.975969 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:51.975966    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/037807f6-fd9c-4dd9-af60-2424d4e551b6-bundle\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:57:51.976123 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:51.975977    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jtr4\" (UniqueName: \"kubernetes.io/projected/037807f6-fd9c-4dd9-af60-2424d4e551b6-kube-api-access-8jtr4\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:57:52.632678 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:52.632645    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn"
Jun 06 20:57:52.632839 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:52.632648    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a6pgfn" event={"ID":"037807f6-fd9c-4dd9-af60-2424d4e551b6","Type":"ContainerDied","Data":"b0aa29507021b8e2240e3691b83ec21ca7c393df78a1113fd6fb6bb339cfad1c"}
Jun 06 20:57:52.632839 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:52.632766    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0aa29507021b8e2240e3691b83ec21ca7c393df78a1113fd6fb6bb339cfad1c"
Jun 06 20:57:56.269594 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.269551    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"]
Jun 06 20:57:56.270071 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.270021    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="037807f6-fd9c-4dd9-af60-2424d4e551b6" containerName="extract"
Jun 06 20:57:56.270071 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.270039    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="037807f6-fd9c-4dd9-af60-2424d4e551b6" containerName="extract"
Jun 06 20:57:56.270071 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.270065    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="037807f6-fd9c-4dd9-af60-2424d4e551b6" containerName="pull"
Jun 06 20:57:56.270071 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.270073    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="037807f6-fd9c-4dd9-af60-2424d4e551b6" containerName="pull"
Jun 06 20:57:56.270280 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.270084    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="037807f6-fd9c-4dd9-af60-2424d4e551b6" containerName="util"
Jun 06 20:57:56.270280 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.270093    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="037807f6-fd9c-4dd9-af60-2424d4e551b6" containerName="util"
Jun 06 20:57:56.270280 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.270183    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="037807f6-fd9c-4dd9-af60-2424d4e551b6" containerName="extract"
Jun 06 20:57:56.274231 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.274207    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.276981 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.276954    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jun 06 20:57:56.277113 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.277052    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jun 06 20:57:56.277210 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.277193    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hh8b9\""
Jun 06 20:57:56.277364 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.277346    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 06 20:57:56.277440 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.277356    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jun 06 20:57:56.293375 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.293348    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"]
Jun 06 20:57:56.414249 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.414213    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f89-5535-464d-90c3-ae74fc45039a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.414249 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.414250    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5c21f89-5535-464d-90c3-ae74fc45039a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.414485 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.414275    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5c21f89-5535-464d-90c3-ae74fc45039a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.414485 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.414310    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5c21f89-5535-464d-90c3-ae74fc45039a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.414485 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.414374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5c21f89-5535-464d-90c3-ae74fc45039a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.414485 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.414446    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd9n7\" (UniqueName: \"kubernetes.io/projected/b5c21f89-5535-464d-90c3-ae74fc45039a-kube-api-access-xd9n7\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.414485 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.414471    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5c21f89-5535-464d-90c3-ae74fc45039a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.515247 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.515212    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5c21f89-5535-464d-90c3-ae74fc45039a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.515438 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.515255    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5c21f89-5535-464d-90c3-ae74fc45039a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.515438 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.515278    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5c21f89-5535-464d-90c3-ae74fc45039a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.515438 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.515354    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd9n7\" (UniqueName: \"kubernetes.io/projected/b5c21f89-5535-464d-90c3-ae74fc45039a-kube-api-access-xd9n7\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.515438 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.515381    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5c21f89-5535-464d-90c3-ae74fc45039a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.515438 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.515410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f89-5535-464d-90c3-ae74fc45039a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.515438 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.515425    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5c21f89-5535-464d-90c3-ae74fc45039a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.515954 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.515927    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5c21f89-5535-464d-90c3-ae74fc45039a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.517758 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.517736    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5c21f89-5535-464d-90c3-ae74fc45039a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.517940 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.517916    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5c21f89-5535-464d-90c3-ae74fc45039a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.518333 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.518283    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f89-5535-464d-90c3-ae74fc45039a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.518436 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.518346    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5c21f89-5535-464d-90c3-ae74fc45039a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.523635 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.523575    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd9n7\" (UniqueName: \"kubernetes.io/projected/b5c21f89-5535-464d-90c3-ae74fc45039a-kube-api-access-xd9n7\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.523635 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.523576    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5c21f89-5535-464d-90c3-ae74fc45039a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-x6gds\" (UID: \"b5c21f89-5535-464d-90c3-ae74fc45039a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.583706 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.583669    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:56.730771 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:56.730745    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"]
Jun 06 20:57:56.733411 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:57:56.733377    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5c21f89_5535_464d_90c3_ae74fc45039a.slice/crio-4425c5d554f2c3a883067795202b19896a4f84945074dc3cb2746e44fb3fcd5d WatchSource:0}: Error finding container 4425c5d554f2c3a883067795202b19896a4f84945074dc3cb2746e44fb3fcd5d: Status 404 returned error can't find the container with id 4425c5d554f2c3a883067795202b19896a4f84945074dc3cb2746e44fb3fcd5d
Jun 06 20:57:57.665438 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:57.665380    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds" event={"ID":"b5c21f89-5535-464d-90c3-ae74fc45039a","Type":"ContainerStarted","Data":"4425c5d554f2c3a883067795202b19896a4f84945074dc3cb2746e44fb3fcd5d"}
Jun 06 20:57:59.053561 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:59.053519    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jun 06 20:57:59.053884 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:59.053587    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jun 06 20:57:59.677645 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:59.677607    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds" event={"ID":"b5c21f89-5535-464d-90c3-ae74fc45039a","Type":"ContainerStarted","Data":"cfb7045e3a5c5a35a58a640a17b1cc33c792299eaa107b0eba9304da36afa086"}
Jun 06 20:57:59.677856 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:59.677692    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:57:59.701462 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:57:59.701405    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds" podStartSLOduration=1.383880736 podStartE2EDuration="3.701391263s" totalImagesPullingTime="2.317510527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:57:59.699843614 +0000 UTC m=+696.116655533" watchObservedRunningTime="2026-06-06 20:57:59.701391263 +0000 UTC m=+696.118203179"
Jun 06 20:58:00.685490 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:00.685455    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x6gds"
Jun 06 20:58:01.629407 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:01.629370    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-q4678"
Jun 06 20:58:04.262232 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:04.262156    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-dcfc9684d-fqpvc"]
Jun 06 20:58:04.328645 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:04.328608    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-dcfc9684d-fqpvc"]
Jun 06 20:58:04.328815 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:04.328728    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-dcfc9684d-fqpvc"
Jun 06 20:58:04.331443 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:04.331417    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 06 20:58:04.331580 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:04.331421    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bdqcj\""
Jun 06 20:58:04.486062 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:04.486017    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbh77\" (UniqueName: \"kubernetes.io/projected/8ce2784a-bd23-4aee-a1fa-55bf65476d9a-kube-api-access-xbh77\") pod \"dashboard-redirect-dcfc9684d-fqpvc\" (UID: \"8ce2784a-bd23-4aee-a1fa-55bf65476d9a\") " pod="opendatahub/dashboard-redirect-dcfc9684d-fqpvc"
Jun 06 20:58:04.486062 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:04.486061    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8ce2784a-bd23-4aee-a1fa-55bf65476d9a-redirect-config\") pod \"dashboard-redirect-dcfc9684d-fqpvc\" (UID: \"8ce2784a-bd23-4aee-a1fa-55bf65476d9a\") " pod="opendatahub/dashboard-redirect-dcfc9684d-fqpvc"
Jun 06 20:58:04.587556 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:04.587478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbh77\" (UniqueName: \"kubernetes.io/projected/8ce2784a-bd23-4aee-a1fa-55bf65476d9a-kube-api-access-xbh77\") pod \"dashboard-redirect-dcfc9684d-fqpvc\" (UID: \"8ce2784a-bd23-4aee-a1fa-55bf65476d9a\") " pod="opendatahub/dashboard-redirect-dcfc9684d-fqpvc"
Jun 06 20:58:04.587556 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:04.587513    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8ce2784a-bd23-4aee-a1fa-55bf65476d9a-redirect-config\") pod \"dashboard-redirect-dcfc9684d-fqpvc\" (UID: \"8ce2784a-bd23-4aee-a1fa-55bf65476d9a\") " pod="opendatahub/dashboard-redirect-dcfc9684d-fqpvc"
Jun 06 20:58:04.588243 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:04.588223    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8ce2784a-bd23-4aee-a1fa-55bf65476d9a-redirect-config\") pod \"dashboard-redirect-dcfc9684d-fqpvc\" (UID: \"8ce2784a-bd23-4aee-a1fa-55bf65476d9a\") " pod="opendatahub/dashboard-redirect-dcfc9684d-fqpvc"
Jun 06 20:58:04.595744 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:04.595714    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbh77\" (UniqueName: \"kubernetes.io/projected/8ce2784a-bd23-4aee-a1fa-55bf65476d9a-kube-api-access-xbh77\") pod \"dashboard-redirect-dcfc9684d-fqpvc\" (UID: \"8ce2784a-bd23-4aee-a1fa-55bf65476d9a\") " pod="opendatahub/dashboard-redirect-dcfc9684d-fqpvc"
Jun 06 20:58:04.639663 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:04.639635    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-dcfc9684d-fqpvc"
Jun 06 20:58:04.793671 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:04.793647    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-dcfc9684d-fqpvc"]
Jun 06 20:58:04.796032 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:58:04.796007    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce2784a_bd23_4aee_a1fa_55bf65476d9a.slice/crio-57766c7f812e7cb83db893c54ff1a85dc94d9911f4e78b38e6a012400a04836d WatchSource:0}: Error finding container 57766c7f812e7cb83db893c54ff1a85dc94d9911f4e78b38e6a012400a04836d: Status 404 returned error can't find the container with id 57766c7f812e7cb83db893c54ff1a85dc94d9911f4e78b38e6a012400a04836d
Jun 06 20:58:05.715212 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:05.715177    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-dcfc9684d-fqpvc" event={"ID":"8ce2784a-bd23-4aee-a1fa-55bf65476d9a","Type":"ContainerStarted","Data":"57766c7f812e7cb83db893c54ff1a85dc94d9911f4e78b38e6a012400a04836d"}
Jun 06 20:58:07.727593 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:07.727554    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-dcfc9684d-fqpvc" event={"ID":"8ce2784a-bd23-4aee-a1fa-55bf65476d9a","Type":"ContainerStarted","Data":"f18762413ca6a742f29f459b847b4184cb00ef92ce6cf000efb2ba4842340736"}
Jun 06 20:58:07.746689 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:07.746637    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-dcfc9684d-fqpvc" podStartSLOduration=1.524908546 podStartE2EDuration="3.746621785s" totalImagesPullingTime="2.221713239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:58:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:58:07.744164902 +0000 UTC m=+704.160976820" watchObservedRunningTime="2026-06-06 20:58:07.746621785 +0000 UTC m=+704.163433701"
Jun 06 20:58:12.569547 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:12.569512    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-6qcpc"
Jun 06 20:58:12.572291 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:12.572268    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-csl7p"
Jun 06 20:58:44.230066 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.230034    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m"]
Jun 06 20:58:44.241101 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.241074    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m"]
Jun 06 20:58:44.241246 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.241170    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m"
Jun 06 20:58:44.244206 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.243976    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 06 20:58:44.244206 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.244001    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gcflb\""
Jun 06 20:58:44.244206 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.244126    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 06 20:58:44.334453 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.334416    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98595487-eaa4-4708-b655-30d234017907-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m\" (UID: \"98595487-eaa4-4708-b655-30d234017907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m"
Jun 06 20:58:44.334621 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.334493    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8js4n\" (UniqueName: \"kubernetes.io/projected/98595487-eaa4-4708-b655-30d234017907-kube-api-access-8js4n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m\" (UID: \"98595487-eaa4-4708-b655-30d234017907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m"
Jun 06 20:58:44.334621 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.334514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98595487-eaa4-4708-b655-30d234017907-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m\" (UID: \"98595487-eaa4-4708-b655-30d234017907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m"
Jun 06 20:58:44.435894 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.435844    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8js4n\" (UniqueName: \"kubernetes.io/projected/98595487-eaa4-4708-b655-30d234017907-kube-api-access-8js4n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m\" (UID: \"98595487-eaa4-4708-b655-30d234017907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m"
Jun 06 20:58:44.435894 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.435899    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98595487-eaa4-4708-b655-30d234017907-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m\" (UID: \"98595487-eaa4-4708-b655-30d234017907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m"
Jun 06 20:58:44.436101 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.435940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98595487-eaa4-4708-b655-30d234017907-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m\" (UID: \"98595487-eaa4-4708-b655-30d234017907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m"
Jun 06 20:58:44.436403 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.436383    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98595487-eaa4-4708-b655-30d234017907-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m\" (UID: \"98595487-eaa4-4708-b655-30d234017907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m"
Jun 06 20:58:44.436456 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.436390    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98595487-eaa4-4708-b655-30d234017907-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m\" (UID: \"98595487-eaa4-4708-b655-30d234017907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m"
Jun 06 20:58:44.444270 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.444251    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8js4n\" (UniqueName: \"kubernetes.io/projected/98595487-eaa4-4708-b655-30d234017907-kube-api-access-8js4n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m\" (UID: \"98595487-eaa4-4708-b655-30d234017907\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m"
Jun 06 20:58:44.550950 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.550909    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m"
Jun 06 20:58:44.683775 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.683751    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m"]
Jun 06 20:58:44.685664 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:58:44.685631    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98595487_eaa4_4708_b655_30d234017907.slice/crio-3abe06458edfd3a818855298cd767cf79b9838c22d73fc2caa027d2a70926125 WatchSource:0}: Error finding container 3abe06458edfd3a818855298cd767cf79b9838c22d73fc2caa027d2a70926125: Status 404 returned error can't find the container with id 3abe06458edfd3a818855298cd767cf79b9838c22d73fc2caa027d2a70926125
Jun 06 20:58:44.829981 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.829898    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg"]
Jun 06 20:58:44.833450 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.833434    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg"
Jun 06 20:58:44.844381 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.842126    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg"]
Jun 06 20:58:44.916032 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.915994    2577 generic.go:356] "Generic (PLEG): container finished" podID="98595487-eaa4-4708-b655-30d234017907" containerID="697d1c0a30944eb3ae041c85d3e58a226f45225ddefea1732cf38a310af7cf0c" exitCode=0
Jun 06 20:58:44.916210 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.916079    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m" event={"ID":"98595487-eaa4-4708-b655-30d234017907","Type":"ContainerDied","Data":"697d1c0a30944eb3ae041c85d3e58a226f45225ddefea1732cf38a310af7cf0c"}
Jun 06 20:58:44.916210 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.916144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m" event={"ID":"98595487-eaa4-4708-b655-30d234017907","Type":"ContainerStarted","Data":"3abe06458edfd3a818855298cd767cf79b9838c22d73fc2caa027d2a70926125"}
Jun 06 20:58:44.940073 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.940042    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x92l4\" (UniqueName: \"kubernetes.io/projected/07478a35-fde3-411e-9083-caace692aa14-kube-api-access-x92l4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg\" (UID: \"07478a35-fde3-411e-9083-caace692aa14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg"
Jun 06 20:58:44.940217 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.940081    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07478a35-fde3-411e-9083-caace692aa14-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg\" (UID: \"07478a35-fde3-411e-9083-caace692aa14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg"
Jun 06 20:58:44.940217 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:44.940181    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07478a35-fde3-411e-9083-caace692aa14-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg\" (UID: \"07478a35-fde3-411e-9083-caace692aa14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg"
Jun 06 20:58:45.040764 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.040730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07478a35-fde3-411e-9083-caace692aa14-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg\" (UID: \"07478a35-fde3-411e-9083-caace692aa14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg"
Jun 06 20:58:45.040931 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.040822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x92l4\" (UniqueName: \"kubernetes.io/projected/07478a35-fde3-411e-9083-caace692aa14-kube-api-access-x92l4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg\" (UID: \"07478a35-fde3-411e-9083-caace692aa14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg"
Jun 06 20:58:45.040931 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.040841    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07478a35-fde3-411e-9083-caace692aa14-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg\" (UID: \"07478a35-fde3-411e-9083-caace692aa14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg"
Jun 06 20:58:45.041208 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.041190    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07478a35-fde3-411e-9083-caace692aa14-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg\" (UID: \"07478a35-fde3-411e-9083-caace692aa14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg"
Jun 06 20:58:45.041260 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.041194    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07478a35-fde3-411e-9083-caace692aa14-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg\" (UID: \"07478a35-fde3-411e-9083-caace692aa14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg"
Jun 06 20:58:45.048721 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.048698    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x92l4\" (UniqueName: \"kubernetes.io/projected/07478a35-fde3-411e-9083-caace692aa14-kube-api-access-x92l4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg\" (UID: \"07478a35-fde3-411e-9083-caace692aa14\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg"
Jun 06 20:58:45.156687 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.156595    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg"
Jun 06 20:58:45.288935 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.288910    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg"]
Jun 06 20:58:45.290760 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:58:45.290733    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07478a35_fde3_411e_9083_caace692aa14.slice/crio-55e699595c8f4094706544afada2914fa671b5a7302755f916d8760e15270085 WatchSource:0}: Error finding container 55e699595c8f4094706544afada2914fa671b5a7302755f916d8760e15270085: Status 404 returned error can't find the container with id 55e699595c8f4094706544afada2914fa671b5a7302755f916d8760e15270085
Jun 06 20:58:45.433316 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.433229    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm"]
Jun 06 20:58:45.436696 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.436680    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm"
Jun 06 20:58:45.444360 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.444336    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm"]
Jun 06 20:58:45.545729 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.545691    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f67b9936-1393-40b2-afc4-60cf56381d70-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm\" (UID: \"f67b9936-1393-40b2-afc4-60cf56381d70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm"
Jun 06 20:58:45.545873 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.545742    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbrhj\" (UniqueName: \"kubernetes.io/projected/f67b9936-1393-40b2-afc4-60cf56381d70-kube-api-access-lbrhj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm\" (UID: \"f67b9936-1393-40b2-afc4-60cf56381d70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm"
Jun 06 20:58:45.545873 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.545831    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f67b9936-1393-40b2-afc4-60cf56381d70-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm\" (UID: \"f67b9936-1393-40b2-afc4-60cf56381d70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm"
Jun 06 20:58:45.646483 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.646449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f67b9936-1393-40b2-afc4-60cf56381d70-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm\" (UID: \"f67b9936-1393-40b2-afc4-60cf56381d70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm"
Jun 06 20:58:45.646667 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.646492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbrhj\" (UniqueName: \"kubernetes.io/projected/f67b9936-1393-40b2-afc4-60cf56381d70-kube-api-access-lbrhj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm\" (UID: \"f67b9936-1393-40b2-afc4-60cf56381d70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm"
Jun 06 20:58:45.646667 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.646534    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f67b9936-1393-40b2-afc4-60cf56381d70-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm\" (UID: \"f67b9936-1393-40b2-afc4-60cf56381d70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm"
Jun 06 20:58:45.646856 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.646834    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f67b9936-1393-40b2-afc4-60cf56381d70-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm\" (UID: \"f67b9936-1393-40b2-afc4-60cf56381d70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm"
Jun 06 20:58:45.646915 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.646891    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f67b9936-1393-40b2-afc4-60cf56381d70-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm\" (UID: \"f67b9936-1393-40b2-afc4-60cf56381d70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm"
Jun 06 20:58:45.654687 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.654660    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbrhj\" (UniqueName: \"kubernetes.io/projected/f67b9936-1393-40b2-afc4-60cf56381d70-kube-api-access-lbrhj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm\" (UID: \"f67b9936-1393-40b2-afc4-60cf56381d70\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm"
Jun 06 20:58:45.758240 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.758213    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm"
Jun 06 20:58:45.837213 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.837174    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p"]
Jun 06 20:58:45.841033 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.841005    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p"
Jun 06 20:58:45.851269 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.851246    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p"]
Jun 06 20:58:45.920738 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.920712    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm"]
Jun 06 20:58:45.922955 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:58:45.922924    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf67b9936_1393_40b2_afc4_60cf56381d70.slice/crio-784033a477bd2a5103b51e237c886cea8e85cf8b08b0677622fd582e49e0239a WatchSource:0}: Error finding container 784033a477bd2a5103b51e237c886cea8e85cf8b08b0677622fd582e49e0239a: Status 404 returned error can't find the container with id 784033a477bd2a5103b51e237c886cea8e85cf8b08b0677622fd582e49e0239a
Jun 06 20:58:45.923378 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.923351    2577 generic.go:356] "Generic (PLEG): container finished" podID="07478a35-fde3-411e-9083-caace692aa14" containerID="3b754f05068a7d4ecaa3be0bccac4b83c07ae750dbf16215202fcfa02342a6be" exitCode=0
Jun 06 20:58:45.923485 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.923422    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg" event={"ID":"07478a35-fde3-411e-9083-caace692aa14","Type":"ContainerDied","Data":"3b754f05068a7d4ecaa3be0bccac4b83c07ae750dbf16215202fcfa02342a6be"}
Jun 06 20:58:45.923485 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.923462    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg" event={"ID":"07478a35-fde3-411e-9083-caace692aa14","Type":"ContainerStarted","Data":"55e699595c8f4094706544afada2914fa671b5a7302755f916d8760e15270085"}
Jun 06 20:58:45.925562 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.925520    2577 generic.go:356] "Generic (PLEG): container finished" podID="98595487-eaa4-4708-b655-30d234017907" containerID="12e84833ae23cba6fe1409fafbcad27369a401b70b6e3b3ec59bae02badb17ff" exitCode=0
Jun 06 20:58:45.925633 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.925587    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m" event={"ID":"98595487-eaa4-4708-b655-30d234017907","Type":"ContainerDied","Data":"12e84833ae23cba6fe1409fafbcad27369a401b70b6e3b3ec59bae02badb17ff"}
Jun 06 20:58:45.948564 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.948541    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/297d384e-e391-4cad-b4ff-8424b48fc89b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p\" (UID: \"297d384e-e391-4cad-b4ff-8424b48fc89b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p"
Jun 06 20:58:45.948667 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.948627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8vck\" (UniqueName: \"kubernetes.io/projected/297d384e-e391-4cad-b4ff-8424b48fc89b-kube-api-access-f8vck\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p\" (UID: \"297d384e-e391-4cad-b4ff-8424b48fc89b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p"
Jun 06 20:58:45.948725 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:45.948706    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/297d384e-e391-4cad-b4ff-8424b48fc89b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p\" (UID: \"297d384e-e391-4cad-b4ff-8424b48fc89b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p"
Jun 06 20:58:46.049281 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.049243    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/297d384e-e391-4cad-b4ff-8424b48fc89b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p\" (UID: \"297d384e-e391-4cad-b4ff-8424b48fc89b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p"
Jun 06 20:58:46.049432 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.049423    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8vck\" (UniqueName: \"kubernetes.io/projected/297d384e-e391-4cad-b4ff-8424b48fc89b-kube-api-access-f8vck\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p\" (UID: \"297d384e-e391-4cad-b4ff-8424b48fc89b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p"
Jun 06 20:58:46.049602 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.049577    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/297d384e-e391-4cad-b4ff-8424b48fc89b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p\" (UID: \"297d384e-e391-4cad-b4ff-8424b48fc89b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p"
Jun 06 20:58:46.049839 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.049821    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/297d384e-e391-4cad-b4ff-8424b48fc89b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p\" (UID: \"297d384e-e391-4cad-b4ff-8424b48fc89b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p"
Jun 06 20:58:46.049882 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.049869    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/297d384e-e391-4cad-b4ff-8424b48fc89b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p\" (UID: \"297d384e-e391-4cad-b4ff-8424b48fc89b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p"
Jun 06 20:58:46.060283 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.060261    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8vck\" (UniqueName: \"kubernetes.io/projected/297d384e-e391-4cad-b4ff-8424b48fc89b-kube-api-access-f8vck\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p\" (UID: \"297d384e-e391-4cad-b4ff-8424b48fc89b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p"
Jun 06 20:58:46.151633 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.151599    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p"
Jun 06 20:58:46.282651 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.282629    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p"]
Jun 06 20:58:46.284342 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:58:46.284291    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297d384e_e391_4cad_b4ff_8424b48fc89b.slice/crio-c8f3a1517cfe9d1d70854abc858b159184a0fabf73e64005b7cfbf3b2344401f WatchSource:0}: Error finding container c8f3a1517cfe9d1d70854abc858b159184a0fabf73e64005b7cfbf3b2344401f: Status 404 returned error can't find the container with id c8f3a1517cfe9d1d70854abc858b159184a0fabf73e64005b7cfbf3b2344401f
Jun 06 20:58:46.937480 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.937382    2577 generic.go:356] "Generic (PLEG): container finished" podID="f67b9936-1393-40b2-afc4-60cf56381d70" containerID="bbf834dac7e25e1d42cf29eb6c20061265a34e44043d4ff5b559c49b87feffd5" exitCode=0
Jun 06 20:58:46.937480 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.937462    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm" event={"ID":"f67b9936-1393-40b2-afc4-60cf56381d70","Type":"ContainerDied","Data":"bbf834dac7e25e1d42cf29eb6c20061265a34e44043d4ff5b559c49b87feffd5"}
Jun 06 20:58:46.937941 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.937553    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm" event={"ID":"f67b9936-1393-40b2-afc4-60cf56381d70","Type":"ContainerStarted","Data":"784033a477bd2a5103b51e237c886cea8e85cf8b08b0677622fd582e49e0239a"}
Jun 06 20:58:46.939855 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.939783    2577 generic.go:356] "Generic (PLEG): container finished" podID="98595487-eaa4-4708-b655-30d234017907" containerID="f1a7c25d71413fdaac7f22aefb9d8df3031c8d804e0b76d047504beb3813c770" exitCode=0
Jun 06 20:58:46.939938 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.939896    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m" event={"ID":"98595487-eaa4-4708-b655-30d234017907","Type":"ContainerDied","Data":"f1a7c25d71413fdaac7f22aefb9d8df3031c8d804e0b76d047504beb3813c770"}
Jun 06 20:58:46.941309 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.941276    2577 generic.go:356] "Generic (PLEG): container finished" podID="297d384e-e391-4cad-b4ff-8424b48fc89b" containerID="dbd869bc4fafffb042dec4214de4992c89c0b6dff3fde16fc183039b8bb1fa23" exitCode=0
Jun 06 20:58:46.941377 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.941326    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p" event={"ID":"297d384e-e391-4cad-b4ff-8424b48fc89b","Type":"ContainerDied","Data":"dbd869bc4fafffb042dec4214de4992c89c0b6dff3fde16fc183039b8bb1fa23"}
Jun 06 20:58:46.941377 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.941366    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p" event={"ID":"297d384e-e391-4cad-b4ff-8424b48fc89b","Type":"ContainerStarted","Data":"c8f3a1517cfe9d1d70854abc858b159184a0fabf73e64005b7cfbf3b2344401f"}
Jun 06 20:58:46.943354 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.943333    2577 generic.go:356] "Generic (PLEG): container finished" podID="07478a35-fde3-411e-9083-caace692aa14" containerID="1368b9220f3c9bea4b3e62059427a94e455d3b5012950bc98eb2136f12c14037" exitCode=0
Jun 06 20:58:46.943446 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:46.943362    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg" event={"ID":"07478a35-fde3-411e-9083-caace692aa14","Type":"ContainerDied","Data":"1368b9220f3c9bea4b3e62059427a94e455d3b5012950bc98eb2136f12c14037"}
Jun 06 20:58:47.951016 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:47.950983    2577 generic.go:356] "Generic (PLEG): container finished" podID="f67b9936-1393-40b2-afc4-60cf56381d70" containerID="01a3b6ee83008ea1857dfd06be2235cf478668467aa18f2f9ec615729ae834f9" exitCode=0
Jun 06 20:58:47.951451 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:47.951066    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm" event={"ID":"f67b9936-1393-40b2-afc4-60cf56381d70","Type":"ContainerDied","Data":"01a3b6ee83008ea1857dfd06be2235cf478668467aa18f2f9ec615729ae834f9"}
Jun 06 20:58:47.953181 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:47.953161    2577 generic.go:356] "Generic (PLEG): container finished" podID="297d384e-e391-4cad-b4ff-8424b48fc89b" containerID="b297fb844672b2b2e1ed673e64e34c0a31a6824a97b3a5a7833736d555008196" exitCode=0
Jun 06 20:58:47.953277 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:47.953193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p" event={"ID":"297d384e-e391-4cad-b4ff-8424b48fc89b","Type":"ContainerDied","Data":"b297fb844672b2b2e1ed673e64e34c0a31a6824a97b3a5a7833736d555008196"}
Jun 06 20:58:47.955414 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:47.955391    2577 generic.go:356] "Generic (PLEG): container finished" podID="07478a35-fde3-411e-9083-caace692aa14" containerID="e2204bb6de7729f5ea2e4635bb4cdb8259b8159ad897924999fc100a17d57e33" exitCode=0
Jun 06 20:58:47.955525 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:47.955444    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg" event={"ID":"07478a35-fde3-411e-9083-caace692aa14","Type":"ContainerDied","Data":"e2204bb6de7729f5ea2e4635bb4cdb8259b8159ad897924999fc100a17d57e33"}
Jun 06 20:58:48.086521 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.086490    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m"
Jun 06 20:58:48.273457 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.273422    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8js4n\" (UniqueName: \"kubernetes.io/projected/98595487-eaa4-4708-b655-30d234017907-kube-api-access-8js4n\") pod \"98595487-eaa4-4708-b655-30d234017907\" (UID: \"98595487-eaa4-4708-b655-30d234017907\") "
Jun 06 20:58:48.273625 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.273486    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98595487-eaa4-4708-b655-30d234017907-util\") pod \"98595487-eaa4-4708-b655-30d234017907\" (UID: \"98595487-eaa4-4708-b655-30d234017907\") "
Jun 06 20:58:48.273625 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.273530    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98595487-eaa4-4708-b655-30d234017907-bundle\") pod \"98595487-eaa4-4708-b655-30d234017907\" (UID: \"98595487-eaa4-4708-b655-30d234017907\") "
Jun 06 20:58:48.274039 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.274004    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98595487-eaa4-4708-b655-30d234017907-bundle" (OuterVolumeSpecName: "bundle") pod "98595487-eaa4-4708-b655-30d234017907" (UID: "98595487-eaa4-4708-b655-30d234017907"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:58:48.275649 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.275626    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98595487-eaa4-4708-b655-30d234017907-kube-api-access-8js4n" (OuterVolumeSpecName: "kube-api-access-8js4n") pod "98595487-eaa4-4708-b655-30d234017907" (UID: "98595487-eaa4-4708-b655-30d234017907"). InnerVolumeSpecName "kube-api-access-8js4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 20:58:48.278892 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.278856    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98595487-eaa4-4708-b655-30d234017907-util" (OuterVolumeSpecName: "util") pod "98595487-eaa4-4708-b655-30d234017907" (UID: "98595487-eaa4-4708-b655-30d234017907"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:58:48.374762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.374725    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98595487-eaa4-4708-b655-30d234017907-util\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:58:48.374762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.374756    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98595487-eaa4-4708-b655-30d234017907-bundle\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:58:48.374762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.374765    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8js4n\" (UniqueName: \"kubernetes.io/projected/98595487-eaa4-4708-b655-30d234017907-kube-api-access-8js4n\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:58:48.962527 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.962496    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m"
Jun 06 20:58:48.962915 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.962499    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m" event={"ID":"98595487-eaa4-4708-b655-30d234017907","Type":"ContainerDied","Data":"3abe06458edfd3a818855298cd767cf79b9838c22d73fc2caa027d2a70926125"}
Jun 06 20:58:48.962915 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.962631    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3abe06458edfd3a818855298cd767cf79b9838c22d73fc2caa027d2a70926125"
Jun 06 20:58:48.964763 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.964738    2577 generic.go:356] "Generic (PLEG): container finished" podID="297d384e-e391-4cad-b4ff-8424b48fc89b" containerID="e187a690df8d99257ade8c15df31143dcf3ec5a1c087c59a0261f62a01a2c7ad" exitCode=0
Jun 06 20:58:48.964884 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.964819    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p" event={"ID":"297d384e-e391-4cad-b4ff-8424b48fc89b","Type":"ContainerDied","Data":"e187a690df8d99257ade8c15df31143dcf3ec5a1c087c59a0261f62a01a2c7ad"}
Jun 06 20:58:48.966985 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.966961    2577 generic.go:356] "Generic (PLEG): container finished" podID="f67b9936-1393-40b2-afc4-60cf56381d70" containerID="8f3eb1b547e6c99c303b4d67d2c5603375505a0e5db2500661a869743be47cf2" exitCode=0
Jun 06 20:58:48.967069 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:48.967040    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm" event={"ID":"f67b9936-1393-40b2-afc4-60cf56381d70","Type":"ContainerDied","Data":"8f3eb1b547e6c99c303b4d67d2c5603375505a0e5db2500661a869743be47cf2"}
Jun 06 20:58:49.100246 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:49.100223    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg"
Jun 06 20:58:49.281797 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:49.281720    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07478a35-fde3-411e-9083-caace692aa14-util\") pod \"07478a35-fde3-411e-9083-caace692aa14\" (UID: \"07478a35-fde3-411e-9083-caace692aa14\") "
Jun 06 20:58:49.281797 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:49.281758    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x92l4\" (UniqueName: \"kubernetes.io/projected/07478a35-fde3-411e-9083-caace692aa14-kube-api-access-x92l4\") pod \"07478a35-fde3-411e-9083-caace692aa14\" (UID: \"07478a35-fde3-411e-9083-caace692aa14\") "
Jun 06 20:58:49.281797 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:49.281776    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07478a35-fde3-411e-9083-caace692aa14-bundle\") pod \"07478a35-fde3-411e-9083-caace692aa14\" (UID: \"07478a35-fde3-411e-9083-caace692aa14\") "
Jun 06 20:58:49.282374 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:49.282348    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07478a35-fde3-411e-9083-caace692aa14-bundle" (OuterVolumeSpecName: "bundle") pod "07478a35-fde3-411e-9083-caace692aa14" (UID: "07478a35-fde3-411e-9083-caace692aa14"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:58:49.283848 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:49.283823    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07478a35-fde3-411e-9083-caace692aa14-kube-api-access-x92l4" (OuterVolumeSpecName: "kube-api-access-x92l4") pod "07478a35-fde3-411e-9083-caace692aa14" (UID: "07478a35-fde3-411e-9083-caace692aa14"). InnerVolumeSpecName "kube-api-access-x92l4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 20:58:49.287308 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:49.287267    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07478a35-fde3-411e-9083-caace692aa14-util" (OuterVolumeSpecName: "util") pod "07478a35-fde3-411e-9083-caace692aa14" (UID: "07478a35-fde3-411e-9083-caace692aa14"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:58:49.382309 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:49.382276    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x92l4\" (UniqueName: \"kubernetes.io/projected/07478a35-fde3-411e-9083-caace692aa14-kube-api-access-x92l4\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:58:49.382468 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:49.382321    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07478a35-fde3-411e-9083-caace692aa14-bundle\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:58:49.382468 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:49.382330    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07478a35-fde3-411e-9083-caace692aa14-util\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:58:49.974358 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:49.974292    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg" event={"ID":"07478a35-fde3-411e-9083-caace692aa14","Type":"ContainerDied","Data":"55e699595c8f4094706544afada2914fa671b5a7302755f916d8760e15270085"}
Jun 06 20:58:49.974811 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:49.974383    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55e699595c8f4094706544afada2914fa671b5a7302755f916d8760e15270085"
Jun 06 20:58:49.974811 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:49.974333    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg"
Jun 06 20:58:50.125893 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.125866    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm"
Jun 06 20:58:50.155378 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.155355    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p"
Jun 06 20:58:50.290823 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.290793    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbrhj\" (UniqueName: \"kubernetes.io/projected/f67b9936-1393-40b2-afc4-60cf56381d70-kube-api-access-lbrhj\") pod \"f67b9936-1393-40b2-afc4-60cf56381d70\" (UID: \"f67b9936-1393-40b2-afc4-60cf56381d70\") "
Jun 06 20:58:50.290980 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.290852    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f67b9936-1393-40b2-afc4-60cf56381d70-util\") pod \"f67b9936-1393-40b2-afc4-60cf56381d70\" (UID: \"f67b9936-1393-40b2-afc4-60cf56381d70\") "
Jun 06 20:58:50.290980 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.290871    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f67b9936-1393-40b2-afc4-60cf56381d70-bundle\") pod \"f67b9936-1393-40b2-afc4-60cf56381d70\" (UID: \"f67b9936-1393-40b2-afc4-60cf56381d70\") "
Jun 06 20:58:50.290980 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.290888    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/297d384e-e391-4cad-b4ff-8424b48fc89b-bundle\") pod \"297d384e-e391-4cad-b4ff-8424b48fc89b\" (UID: \"297d384e-e391-4cad-b4ff-8424b48fc89b\") "
Jun 06 20:58:50.290980 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.290910    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8vck\" (UniqueName: \"kubernetes.io/projected/297d384e-e391-4cad-b4ff-8424b48fc89b-kube-api-access-f8vck\") pod \"297d384e-e391-4cad-b4ff-8424b48fc89b\" (UID: \"297d384e-e391-4cad-b4ff-8424b48fc89b\") "
Jun 06 20:58:50.290980 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.290984    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/297d384e-e391-4cad-b4ff-8424b48fc89b-util\") pod \"297d384e-e391-4cad-b4ff-8424b48fc89b\" (UID: \"297d384e-e391-4cad-b4ff-8424b48fc89b\") "
Jun 06 20:58:50.291645 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.291502    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f67b9936-1393-40b2-afc4-60cf56381d70-bundle" (OuterVolumeSpecName: "bundle") pod "f67b9936-1393-40b2-afc4-60cf56381d70" (UID: "f67b9936-1393-40b2-afc4-60cf56381d70"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:58:50.291775 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.291631    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/297d384e-e391-4cad-b4ff-8424b48fc89b-bundle" (OuterVolumeSpecName: "bundle") pod "297d384e-e391-4cad-b4ff-8424b48fc89b" (UID: "297d384e-e391-4cad-b4ff-8424b48fc89b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:58:50.293185 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.293158    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/297d384e-e391-4cad-b4ff-8424b48fc89b-kube-api-access-f8vck" (OuterVolumeSpecName: "kube-api-access-f8vck") pod "297d384e-e391-4cad-b4ff-8424b48fc89b" (UID: "297d384e-e391-4cad-b4ff-8424b48fc89b"). InnerVolumeSpecName "kube-api-access-f8vck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 20:58:50.293441 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.293419    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f67b9936-1393-40b2-afc4-60cf56381d70-kube-api-access-lbrhj" (OuterVolumeSpecName: "kube-api-access-lbrhj") pod "f67b9936-1393-40b2-afc4-60cf56381d70" (UID: "f67b9936-1393-40b2-afc4-60cf56381d70"). InnerVolumeSpecName "kube-api-access-lbrhj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 20:58:50.296978 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.296942    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/297d384e-e391-4cad-b4ff-8424b48fc89b-util" (OuterVolumeSpecName: "util") pod "297d384e-e391-4cad-b4ff-8424b48fc89b" (UID: "297d384e-e391-4cad-b4ff-8424b48fc89b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:58:50.297226 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.297207    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f67b9936-1393-40b2-afc4-60cf56381d70-util" (OuterVolumeSpecName: "util") pod "f67b9936-1393-40b2-afc4-60cf56381d70" (UID: "f67b9936-1393-40b2-afc4-60cf56381d70"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:58:50.391811 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.391775    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f67b9936-1393-40b2-afc4-60cf56381d70-util\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:58:50.391811 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.391806    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f67b9936-1393-40b2-afc4-60cf56381d70-bundle\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:58:50.391811 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.391815    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/297d384e-e391-4cad-b4ff-8424b48fc89b-bundle\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:58:50.392023 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.391824    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8vck\" (UniqueName: \"kubernetes.io/projected/297d384e-e391-4cad-b4ff-8424b48fc89b-kube-api-access-f8vck\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:58:50.392023 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.391834    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/297d384e-e391-4cad-b4ff-8424b48fc89b-util\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:58:50.392023 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.391842    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbrhj\" (UniqueName: \"kubernetes.io/projected/f67b9936-1393-40b2-afc4-60cf56381d70-kube-api-access-lbrhj\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:58:50.981543 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.981499    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p"
Jun 06 20:58:50.981543 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.981535    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p" event={"ID":"297d384e-e391-4cad-b4ff-8424b48fc89b","Type":"ContainerDied","Data":"c8f3a1517cfe9d1d70854abc858b159184a0fabf73e64005b7cfbf3b2344401f"}
Jun 06 20:58:50.982010 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.981583    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8f3a1517cfe9d1d70854abc858b159184a0fabf73e64005b7cfbf3b2344401f"
Jun 06 20:58:50.983460 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.983437    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm" event={"ID":"f67b9936-1393-40b2-afc4-60cf56381d70","Type":"ContainerDied","Data":"784033a477bd2a5103b51e237c886cea8e85cf8b08b0677622fd582e49e0239a"}
Jun 06 20:58:50.983576 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.983471    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="784033a477bd2a5103b51e237c886cea8e85cf8b08b0677622fd582e49e0239a"
Jun 06 20:58:50.983576 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:58:50.983472    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm"
Jun 06 20:59:04.436366 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436326    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pbx9b"]
Jun 06 20:59:04.436741 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436692    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98595487-eaa4-4708-b655-30d234017907" containerName="util"
Jun 06 20:59:04.436741 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436707    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="98595487-eaa4-4708-b655-30d234017907" containerName="util"
Jun 06 20:59:04.436741 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436719    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98595487-eaa4-4708-b655-30d234017907" containerName="pull"
Jun 06 20:59:04.436741 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436725    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="98595487-eaa4-4708-b655-30d234017907" containerName="pull"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436746    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98595487-eaa4-4708-b655-30d234017907" containerName="extract"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436752    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="98595487-eaa4-4708-b655-30d234017907" containerName="extract"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436758    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="297d384e-e391-4cad-b4ff-8424b48fc89b" containerName="util"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436763    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="297d384e-e391-4cad-b4ff-8424b48fc89b" containerName="util"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436770    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07478a35-fde3-411e-9083-caace692aa14" containerName="pull"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436774    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="07478a35-fde3-411e-9083-caace692aa14" containerName="pull"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436782    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07478a35-fde3-411e-9083-caace692aa14" containerName="extract"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436787    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="07478a35-fde3-411e-9083-caace692aa14" containerName="extract"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436793    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="297d384e-e391-4cad-b4ff-8424b48fc89b" containerName="extract"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436798    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="297d384e-e391-4cad-b4ff-8424b48fc89b" containerName="extract"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436803    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f67b9936-1393-40b2-afc4-60cf56381d70" containerName="pull"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436808    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f67b9936-1393-40b2-afc4-60cf56381d70" containerName="pull"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436815    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f67b9936-1393-40b2-afc4-60cf56381d70" containerName="extract"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436821    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f67b9936-1393-40b2-afc4-60cf56381d70" containerName="extract"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436827    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07478a35-fde3-411e-9083-caace692aa14" containerName="util"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436831    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="07478a35-fde3-411e-9083-caace692aa14" containerName="util"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436837    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="297d384e-e391-4cad-b4ff-8424b48fc89b" containerName="pull"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436841    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="297d384e-e391-4cad-b4ff-8424b48fc89b" containerName="pull"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436850    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f67b9936-1393-40b2-afc4-60cf56381d70" containerName="util"
Jun 06 20:59:04.436870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436855    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f67b9936-1393-40b2-afc4-60cf56381d70" containerName="util"
Jun 06 20:59:04.437450 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436906    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="98595487-eaa4-4708-b655-30d234017907" containerName="extract"
Jun 06 20:59:04.437450 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436914    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="297d384e-e391-4cad-b4ff-8424b48fc89b" containerName="extract"
Jun 06 20:59:04.437450 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436921    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f67b9936-1393-40b2-afc4-60cf56381d70" containerName="extract"
Jun 06 20:59:04.437450 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.436927    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="07478a35-fde3-411e-9083-caace692aa14" containerName="extract"
Jun 06 20:59:04.440988 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.440972    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pbx9b"
Jun 06 20:59:04.443622 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.443599    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qbkjd\""
Jun 06 20:59:04.443819 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.443797    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jun 06 20:59:04.443875 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.443855    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 06 20:59:04.444674 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.444658    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 06 20:59:04.454386 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.454362    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pbx9b"]
Jun 06 20:59:04.508135 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.508098    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzdzp\" (UniqueName: \"kubernetes.io/projected/b151ec5a-972d-4f7f-9fa4-a871facc1a87-kube-api-access-nzdzp\") pod \"dns-operator-controller-manager-864dd78c4c-pbx9b\" (UID: \"b151ec5a-972d-4f7f-9fa4-a871facc1a87\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pbx9b"
Jun 06 20:59:04.608869 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.608821    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzdzp\" (UniqueName: \"kubernetes.io/projected/b151ec5a-972d-4f7f-9fa4-a871facc1a87-kube-api-access-nzdzp\") pod \"dns-operator-controller-manager-864dd78c4c-pbx9b\" (UID: \"b151ec5a-972d-4f7f-9fa4-a871facc1a87\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pbx9b"
Jun 06 20:59:04.621870 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.621840    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzdzp\" (UniqueName: \"kubernetes.io/projected/b151ec5a-972d-4f7f-9fa4-a871facc1a87-kube-api-access-nzdzp\") pod \"dns-operator-controller-manager-864dd78c4c-pbx9b\" (UID: \"b151ec5a-972d-4f7f-9fa4-a871facc1a87\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pbx9b"
Jun 06 20:59:04.750918 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.750886    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pbx9b"
Jun 06 20:59:04.894195 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:04.894171    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pbx9b"]
Jun 06 20:59:04.897107 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:59:04.897083    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb151ec5a_972d_4f7f_9fa4_a871facc1a87.slice/crio-1f5d12714ad60238de04d38a62bbcd60441a52d2281d157854137f68c48cd790 WatchSource:0}: Error finding container 1f5d12714ad60238de04d38a62bbcd60441a52d2281d157854137f68c48cd790: Status 404 returned error can't find the container with id 1f5d12714ad60238de04d38a62bbcd60441a52d2281d157854137f68c48cd790
Jun 06 20:59:05.057728 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:05.057638    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pbx9b" event={"ID":"b151ec5a-972d-4f7f-9fa4-a871facc1a87","Type":"ContainerStarted","Data":"1f5d12714ad60238de04d38a62bbcd60441a52d2281d157854137f68c48cd790"}
Jun 06 20:59:07.075173 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:07.075133    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pbx9b" event={"ID":"b151ec5a-972d-4f7f-9fa4-a871facc1a87","Type":"ContainerStarted","Data":"2f2a01df4e2118f1bdce501762c04ff7d4c0840751e1e62e9a7e2858a1cb549d"}
Jun 06 20:59:07.075626 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:07.075270    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pbx9b"
Jun 06 20:59:07.094747 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:07.094693    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pbx9b" podStartSLOduration=1.3512897050000001 podStartE2EDuration="3.094679578s" totalImagesPullingTime="1.743389873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:59:07.093337917 +0000 UTC m=+763.510149831" watchObservedRunningTime="2026-06-06 20:59:07.094679578 +0000 UTC m=+763.511491495"
Jun 06 20:59:12.790080 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:12.790040    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"]
Jun 06 20:59:12.793418 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:12.793399    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:12.796091 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:12.796066    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-px95t\""
Jun 06 20:59:12.804792 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:12.804767    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"]
Jun 06 20:59:12.881614 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:12.881579    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z27rw\" (UniqueName: \"kubernetes.io/projected/6fc79fee-7355-4787-8dec-7ea141cb2e06-kube-api-access-z27rw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dlmst\" (UID: \"6fc79fee-7355-4787-8dec-7ea141cb2e06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:12.881777 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:12.881663    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fc79fee-7355-4787-8dec-7ea141cb2e06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dlmst\" (UID: \"6fc79fee-7355-4787-8dec-7ea141cb2e06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:12.982904 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:12.982868    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z27rw\" (UniqueName: \"kubernetes.io/projected/6fc79fee-7355-4787-8dec-7ea141cb2e06-kube-api-access-z27rw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dlmst\" (UID: \"6fc79fee-7355-4787-8dec-7ea141cb2e06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:12.983058 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:12.982921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fc79fee-7355-4787-8dec-7ea141cb2e06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dlmst\" (UID: \"6fc79fee-7355-4787-8dec-7ea141cb2e06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:12.983347 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:12.983329    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fc79fee-7355-4787-8dec-7ea141cb2e06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dlmst\" (UID: \"6fc79fee-7355-4787-8dec-7ea141cb2e06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:12.994638 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:12.994618    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z27rw\" (UniqueName: \"kubernetes.io/projected/6fc79fee-7355-4787-8dec-7ea141cb2e06-kube-api-access-z27rw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dlmst\" (UID: \"6fc79fee-7355-4787-8dec-7ea141cb2e06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:13.104739 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:13.104653    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:13.241766 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:13.241735    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"]
Jun 06 20:59:13.243063 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:59:13.243035    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fc79fee_7355_4787_8dec_7ea141cb2e06.slice/crio-217efe9cc121d420b0066cebbf6de713fda183f2770a511b30c6eddf375c28ba WatchSource:0}: Error finding container 217efe9cc121d420b0066cebbf6de713fda183f2770a511b30c6eddf375c28ba: Status 404 returned error can't find the container with id 217efe9cc121d420b0066cebbf6de713fda183f2770a511b30c6eddf375c28ba
Jun 06 20:59:14.115100 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:14.115066    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst" event={"ID":"6fc79fee-7355-4787-8dec-7ea141cb2e06","Type":"ContainerStarted","Data":"217efe9cc121d420b0066cebbf6de713fda183f2770a511b30c6eddf375c28ba"}
Jun 06 20:59:18.084243 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:18.084199    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pbx9b"
Jun 06 20:59:18.141884 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:18.141847    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst" event={"ID":"6fc79fee-7355-4787-8dec-7ea141cb2e06","Type":"ContainerStarted","Data":"2cbb5765127a53de4f3ab97111a8c79e19dfbca51126be2b1cf58613b9e94fa2"}
Jun 06 20:59:18.142037 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:18.141915    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:18.161944 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:18.161890    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst" podStartSLOduration=1.895323376 podStartE2EDuration="6.161874367s" totalImagesPullingTime="4.266550991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:59:18.159086983 +0000 UTC m=+774.575898901" watchObservedRunningTime="2026-06-06 20:59:18.161874367 +0000 UTC m=+774.578686284"
Jun 06 20:59:29.149936 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:29.149904    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:30.065167 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.065126    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"]
Jun 06 20:59:30.070189 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.070164    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:30.081646 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.081619    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"]
Jun 06 20:59:30.234484 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.234453    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-896n8\" (UniqueName: \"kubernetes.io/projected/7d9e1043-97d3-420f-bd3d-a96c98fb27bf-kube-api-access-896n8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sdx2w\" (UID: \"7d9e1043-97d3-420f-bd3d-a96c98fb27bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:30.234894 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.234508    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d9e1043-97d3-420f-bd3d-a96c98fb27bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sdx2w\" (UID: \"7d9e1043-97d3-420f-bd3d-a96c98fb27bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:30.335210 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.335111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-896n8\" (UniqueName: \"kubernetes.io/projected/7d9e1043-97d3-420f-bd3d-a96c98fb27bf-kube-api-access-896n8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sdx2w\" (UID: \"7d9e1043-97d3-420f-bd3d-a96c98fb27bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:30.335210 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.335172    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d9e1043-97d3-420f-bd3d-a96c98fb27bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sdx2w\" (UID: \"7d9e1043-97d3-420f-bd3d-a96c98fb27bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:30.335535 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.335516    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d9e1043-97d3-420f-bd3d-a96c98fb27bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sdx2w\" (UID: \"7d9e1043-97d3-420f-bd3d-a96c98fb27bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:30.342770 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.342748    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-896n8\" (UniqueName: \"kubernetes.io/projected/7d9e1043-97d3-420f-bd3d-a96c98fb27bf-kube-api-access-896n8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sdx2w\" (UID: \"7d9e1043-97d3-420f-bd3d-a96c98fb27bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:30.380376 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.380350    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:30.536092 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.536058    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"]
Jun 06 20:59:30.539088 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:59:30.539054    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d9e1043_97d3_420f_bd3d_a96c98fb27bf.slice/crio-43ec211d4359ee00a10fbeaa4900e59411e37a18e8eb1edf2aca2d5a35f4d354 WatchSource:0}: Error finding container 43ec211d4359ee00a10fbeaa4900e59411e37a18e8eb1edf2aca2d5a35f4d354: Status 404 returned error can't find the container with id 43ec211d4359ee00a10fbeaa4900e59411e37a18e8eb1edf2aca2d5a35f4d354
Jun 06 20:59:30.833198 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.833161    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"]
Jun 06 20:59:30.839253 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.839177    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"]
Jun 06 20:59:30.851159 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.851111    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"]
Jun 06 20:59:30.851727 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.851426    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst" podUID="6fc79fee-7355-4787-8dec-7ea141cb2e06" containerName="manager" containerID="cri-o://2cbb5765127a53de4f3ab97111a8c79e19dfbca51126be2b1cf58613b9e94fa2" gracePeriod=2
Jun 06 20:59:30.854138 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.854046    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"]
Jun 06 20:59:30.854859 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.854639    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d9e1043-97d3-420f-bd3d-a96c98fb27bf" containerName="manager"
Jun 06 20:59:30.854859 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.854659    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d9e1043-97d3-420f-bd3d-a96c98fb27bf" containerName="manager"
Jun 06 20:59:30.854859 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.854752    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d9e1043-97d3-420f-bd3d-a96c98fb27bf" containerName="manager"
Jun 06 20:59:30.858727 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.858368    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"
Jun 06 20:59:30.860812 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.860759    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"]
Jun 06 20:59:30.863086 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:30.862985    2577 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"6fc79fee-7355-4787-8dec-7ea141cb2e06\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-dlmst\": pods \"kuadrant-operator-controller-manager-8684c9ff49-dlmst\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:30.865139 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:30.865108    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dlmst\" is forbidden: User \"system:node:ip-10-0-129-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-66.ec2.internal' and this object" podUID="6fc79fee-7355-4787-8dec-7ea141cb2e06" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:30.872940 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.872911    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"]
Jun 06 20:59:30.876727 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.876703    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"]
Jun 06 20:59:30.877228 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.877214    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fc79fee-7355-4787-8dec-7ea141cb2e06" containerName="manager"
Jun 06 20:59:30.877270 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.877232    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fc79fee-7355-4787-8dec-7ea141cb2e06" containerName="manager"
Jun 06 20:59:30.877374 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.877362    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fc79fee-7355-4787-8dec-7ea141cb2e06" containerName="manager"
Jun 06 20:59:30.888496 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.888472    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"
Jun 06 20:59:30.892630 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:30.892595    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dlmst\" is forbidden: User \"system:node:ip-10-0-129-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-66.ec2.internal' and this object" podUID="6fc79fee-7355-4787-8dec-7ea141cb2e06" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:30.896649 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.896621    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"]
Jun 06 20:59:30.940050 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.940015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77202e56-10f8-4826-a29f-ea549ff90271-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncnl8\" (UID: \"77202e56-10f8-4826-a29f-ea549ff90271\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"
Jun 06 20:59:30.940206 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:30.940077    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjmxn\" (UniqueName: \"kubernetes.io/projected/77202e56-10f8-4826-a29f-ea549ff90271-kube-api-access-bjmxn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncnl8\" (UID: \"77202e56-10f8-4826-a29f-ea549ff90271\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"
Jun 06 20:59:31.040903 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.040872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77202e56-10f8-4826-a29f-ea549ff90271-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncnl8\" (UID: \"77202e56-10f8-4826-a29f-ea549ff90271\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"
Jun 06 20:59:31.041064 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.040915    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp8bz\" (UniqueName: \"kubernetes.io/projected/2747ef1f-9702-4d62-952c-00216e8909cf-kube-api-access-tp8bz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5ch8f\" (UID: \"2747ef1f-9702-4d62-952c-00216e8909cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"
Jun 06 20:59:31.041064 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.040942    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjmxn\" (UniqueName: \"kubernetes.io/projected/77202e56-10f8-4826-a29f-ea549ff90271-kube-api-access-bjmxn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncnl8\" (UID: \"77202e56-10f8-4826-a29f-ea549ff90271\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"
Jun 06 20:59:31.041064 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.040966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2747ef1f-9702-4d62-952c-00216e8909cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5ch8f\" (UID: \"2747ef1f-9702-4d62-952c-00216e8909cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"
Jun 06 20:59:31.041356 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.041332    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77202e56-10f8-4826-a29f-ea549ff90271-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncnl8\" (UID: \"77202e56-10f8-4826-a29f-ea549ff90271\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"
Jun 06 20:59:31.053891 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.053855    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjmxn\" (UniqueName: \"kubernetes.io/projected/77202e56-10f8-4826-a29f-ea549ff90271-kube-api-access-bjmxn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ncnl8\" (UID: \"77202e56-10f8-4826-a29f-ea549ff90271\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"
Jun 06 20:59:31.087054 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.087024    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:31.089742 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:31.089687    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dlmst\" is forbidden: User \"system:node:ip-10-0-129-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-66.ec2.internal' and this object" podUID="6fc79fee-7355-4787-8dec-7ea141cb2e06" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:31.142191 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.142157    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp8bz\" (UniqueName: \"kubernetes.io/projected/2747ef1f-9702-4d62-952c-00216e8909cf-kube-api-access-tp8bz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5ch8f\" (UID: \"2747ef1f-9702-4d62-952c-00216e8909cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"
Jun 06 20:59:31.142362 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.142212    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2747ef1f-9702-4d62-952c-00216e8909cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5ch8f\" (UID: \"2747ef1f-9702-4d62-952c-00216e8909cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"
Jun 06 20:59:31.142580 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.142562    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2747ef1f-9702-4d62-952c-00216e8909cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5ch8f\" (UID: \"2747ef1f-9702-4d62-952c-00216e8909cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"
Jun 06 20:59:31.158347 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.158326    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp8bz\" (UniqueName: \"kubernetes.io/projected/2747ef1f-9702-4d62-952c-00216e8909cf-kube-api-access-tp8bz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5ch8f\" (UID: \"2747ef1f-9702-4d62-952c-00216e8909cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"
Jun 06 20:59:31.209944 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.209916    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"
Jun 06 20:59:31.211731 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:31.211711    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w" container="manager"
Jun 06 20:59:31.213052 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.213025    2577 generic.go:356] "Generic (PLEG): container finished" podID="6fc79fee-7355-4787-8dec-7ea141cb2e06" containerID="2cbb5765127a53de4f3ab97111a8c79e19dfbca51126be2b1cf58613b9e94fa2" exitCode=0
Jun 06 20:59:31.213135 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.213073    2577 scope.go:117] "RemoveContainer" containerID="2cbb5765127a53de4f3ab97111a8c79e19dfbca51126be2b1cf58613b9e94fa2"
Jun 06 20:59:31.213135 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.213081    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:31.214207 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:31.214168    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dlmst\" is forbidden: User \"system:node:ip-10-0-129-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-66.ec2.internal' and this object" podUID="6fc79fee-7355-4787-8dec-7ea141cb2e06" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:31.216372 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.216350    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"
Jun 06 20:59:31.216907 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:31.216875    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sdx2w\" is forbidden: User \"system:node:ip-10-0-129-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-66.ec2.internal' and this object" podUID="7d9e1043-97d3-420f-bd3d-a96c98fb27bf" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:31.220227 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:31.220197    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sdx2w\" is forbidden: User \"system:node:ip-10-0-129-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-66.ec2.internal' and this object" podUID="7d9e1043-97d3-420f-bd3d-a96c98fb27bf" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:31.222587 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:31.222562    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dlmst\" is forbidden: User \"system:node:ip-10-0-129-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-66.ec2.internal' and this object" podUID="6fc79fee-7355-4787-8dec-7ea141cb2e06" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:31.228428 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.228399    2577 scope.go:117] "RemoveContainer" containerID="2cbb5765127a53de4f3ab97111a8c79e19dfbca51126be2b1cf58613b9e94fa2"
Jun 06 20:59:31.228933 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:31.228910    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cbb5765127a53de4f3ab97111a8c79e19dfbca51126be2b1cf58613b9e94fa2\": container with ID starting with 2cbb5765127a53de4f3ab97111a8c79e19dfbca51126be2b1cf58613b9e94fa2 not found: ID does not exist" containerID="2cbb5765127a53de4f3ab97111a8c79e19dfbca51126be2b1cf58613b9e94fa2"
Jun 06 20:59:31.229024 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.228946    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cbb5765127a53de4f3ab97111a8c79e19dfbca51126be2b1cf58613b9e94fa2"} err="failed to get container status \"2cbb5765127a53de4f3ab97111a8c79e19dfbca51126be2b1cf58613b9e94fa2\": rpc error: code = NotFound desc = could not find container \"2cbb5765127a53de4f3ab97111a8c79e19dfbca51126be2b1cf58613b9e94fa2\": container with ID starting with 2cbb5765127a53de4f3ab97111a8c79e19dfbca51126be2b1cf58613b9e94fa2 not found: ID does not exist"
Jun 06 20:59:31.243055 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.243025    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z27rw\" (UniqueName: \"kubernetes.io/projected/6fc79fee-7355-4787-8dec-7ea141cb2e06-kube-api-access-z27rw\") pod \"6fc79fee-7355-4787-8dec-7ea141cb2e06\" (UID: \"6fc79fee-7355-4787-8dec-7ea141cb2e06\") "
Jun 06 20:59:31.243407 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.243126    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fc79fee-7355-4787-8dec-7ea141cb2e06-extensions-socket-volume\") pod \"6fc79fee-7355-4787-8dec-7ea141cb2e06\" (UID: \"6fc79fee-7355-4787-8dec-7ea141cb2e06\") "
Jun 06 20:59:31.243590 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.243568    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fc79fee-7355-4787-8dec-7ea141cb2e06-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6fc79fee-7355-4787-8dec-7ea141cb2e06" (UID: "6fc79fee-7355-4787-8dec-7ea141cb2e06"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:59:31.246131 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.246027    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fc79fee-7355-4787-8dec-7ea141cb2e06-kube-api-access-z27rw" (OuterVolumeSpecName: "kube-api-access-z27rw") pod "6fc79fee-7355-4787-8dec-7ea141cb2e06" (UID: "6fc79fee-7355-4787-8dec-7ea141cb2e06"). InnerVolumeSpecName "kube-api-access-z27rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 20:59:31.345005 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.344072    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z27rw\" (UniqueName: \"kubernetes.io/projected/6fc79fee-7355-4787-8dec-7ea141cb2e06-kube-api-access-z27rw\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:59:31.345005 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.344106    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6fc79fee-7355-4787-8dec-7ea141cb2e06-extensions-socket-volume\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:59:31.380153 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.380127    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"]
Jun 06 20:59:31.383092 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:59:31.383053    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77202e56_10f8_4826_a29f_ea549ff90271.slice/crio-a7f6cb5b126a3b550f2000d3a680148b0616164b2c1ad27c241a79faa4753385 WatchSource:0}: Error finding container a7f6cb5b126a3b550f2000d3a680148b0616164b2c1ad27c241a79faa4753385: Status 404 returned error can't find the container with id a7f6cb5b126a3b550f2000d3a680148b0616164b2c1ad27c241a79faa4753385
Jun 06 20:59:31.393045 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:31.393021    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"]
Jun 06 20:59:31.396755 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:59:31.396732    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2747ef1f_9702_4d62_952c_00216e8909cf.slice/crio-7cabc2aaa720815e5ba677cce53907a0be5cf5b0d359e8b8d57d7f78776de7da WatchSource:0}: Error finding container 7cabc2aaa720815e5ba677cce53907a0be5cf5b0d359e8b8d57d7f78776de7da: Status 404 returned error can't find the container with id 7cabc2aaa720815e5ba677cce53907a0be5cf5b0d359e8b8d57d7f78776de7da
Jun 06 20:59:31.523500 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:31.523464    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dlmst\" is forbidden: User \"system:node:ip-10-0-129-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-66.ec2.internal' and this object" podUID="6fc79fee-7355-4787-8dec-7ea141cb2e06" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dlmst"
Jun 06 20:59:31.525382 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:31.525351    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sdx2w\" is forbidden: User \"system:node:ip-10-0-129-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-66.ec2.internal' and this object" podUID="7d9e1043-97d3-420f-bd3d-a96c98fb27bf" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:32.059938 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.059903    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fc79fee-7355-4787-8dec-7ea141cb2e06" path="/var/lib/kubelet/pods/6fc79fee-7355-4787-8dec-7ea141cb2e06/volumes"
Jun 06 20:59:32.221945 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.221832    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f" event={"ID":"2747ef1f-9702-4d62-952c-00216e8909cf","Type":"ContainerStarted","Data":"eb67c77a2bf4527ffa2d378d1213f3bd99f2240e8848b921b1368b0f3563765d"}
Jun 06 20:59:32.222136 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.221951    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f" event={"ID":"2747ef1f-9702-4d62-952c-00216e8909cf","Type":"ContainerStarted","Data":"7cabc2aaa720815e5ba677cce53907a0be5cf5b0d359e8b8d57d7f78776de7da"}
Jun 06 20:59:32.222136 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.221986    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"
Jun 06 20:59:32.225406 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.225344    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w" podUID="7d9e1043-97d3-420f-bd3d-a96c98fb27bf" containerName="manager" containerID="cri-o://5fc4514434baee0ffca6af1804759f2bcb49e5b3d5742091dbe7db7077aec769" gracePeriod=2
Jun 06 20:59:32.227464 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.227425    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8" event={"ID":"77202e56-10f8-4826-a29f-ea549ff90271","Type":"ContainerStarted","Data":"eeb98a87f32bc0d7cf2b1dd33d97c26c0696e272b760af8bf1210e6f9ccacf73"}
Jun 06 20:59:32.227574 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.227484    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8" event={"ID":"77202e56-10f8-4826-a29f-ea549ff90271","Type":"ContainerStarted","Data":"a7f6cb5b126a3b550f2000d3a680148b0616164b2c1ad27c241a79faa4753385"}
Jun 06 20:59:32.227574 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.227515    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"
Jun 06 20:59:32.245093 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.245047    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f" podStartSLOduration=2.245030198 podStartE2EDuration="2.245030198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:59:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:59:32.242679957 +0000 UTC m=+788.659491887" watchObservedRunningTime="2026-06-06 20:59:32.245030198 +0000 UTC m=+788.661842115"
Jun 06 20:59:32.265945 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.265899    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8" podStartSLOduration=2.265884407 podStartE2EDuration="2.265884407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:59:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:59:32.263787528 +0000 UTC m=+788.680599471" watchObservedRunningTime="2026-06-06 20:59:32.265884407 +0000 UTC m=+788.682696323"
Jun 06 20:59:32.472053 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.472027    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:32.474226 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:32.474201    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sdx2w\" is forbidden: User \"system:node:ip-10-0-129-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-66.ec2.internal' and this object" podUID="7d9e1043-97d3-420f-bd3d-a96c98fb27bf" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:32.554592 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.554555    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d9e1043-97d3-420f-bd3d-a96c98fb27bf-extensions-socket-volume\") pod \"7d9e1043-97d3-420f-bd3d-a96c98fb27bf\" (UID: \"7d9e1043-97d3-420f-bd3d-a96c98fb27bf\") "
Jun 06 20:59:32.554774 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.554656    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-896n8\" (UniqueName: \"kubernetes.io/projected/7d9e1043-97d3-420f-bd3d-a96c98fb27bf-kube-api-access-896n8\") pod \"7d9e1043-97d3-420f-bd3d-a96c98fb27bf\" (UID: \"7d9e1043-97d3-420f-bd3d-a96c98fb27bf\") "
Jun 06 20:59:32.555003 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.554978    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d9e1043-97d3-420f-bd3d-a96c98fb27bf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7d9e1043-97d3-420f-bd3d-a96c98fb27bf" (UID: "7d9e1043-97d3-420f-bd3d-a96c98fb27bf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:59:32.556667 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.556647    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d9e1043-97d3-420f-bd3d-a96c98fb27bf-kube-api-access-896n8" (OuterVolumeSpecName: "kube-api-access-896n8") pod "7d9e1043-97d3-420f-bd3d-a96c98fb27bf" (UID: "7d9e1043-97d3-420f-bd3d-a96c98fb27bf"). InnerVolumeSpecName "kube-api-access-896n8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 20:59:32.655998 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.655914    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d9e1043-97d3-420f-bd3d-a96c98fb27bf-extensions-socket-volume\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:59:32.655998 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:32.655944    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-896n8\" (UniqueName: \"kubernetes.io/projected/7d9e1043-97d3-420f-bd3d-a96c98fb27bf-kube-api-access-896n8\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:59:33.234516 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:33.234480    2577 generic.go:356] "Generic (PLEG): container finished" podID="7d9e1043-97d3-420f-bd3d-a96c98fb27bf" containerID="5fc4514434baee0ffca6af1804759f2bcb49e5b3d5742091dbe7db7077aec769" exitCode=0
Jun 06 20:59:33.234704 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:33.234527    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:33.234704 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:33.234590    2577 scope.go:117] "RemoveContainer" containerID="5fc4514434baee0ffca6af1804759f2bcb49e5b3d5742091dbe7db7077aec769"
Jun 06 20:59:33.237082 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:33.237054    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sdx2w\" is forbidden: User \"system:node:ip-10-0-129-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-66.ec2.internal' and this object" podUID="7d9e1043-97d3-420f-bd3d-a96c98fb27bf" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:33.245860 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:33.245563    2577 scope.go:117] "RemoveContainer" containerID="5fc4514434baee0ffca6af1804759f2bcb49e5b3d5742091dbe7db7077aec769"
Jun 06 20:59:33.247175 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:33.247150    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fc4514434baee0ffca6af1804759f2bcb49e5b3d5742091dbe7db7077aec769\": container with ID starting with 5fc4514434baee0ffca6af1804759f2bcb49e5b3d5742091dbe7db7077aec769 not found: ID does not exist" containerID="5fc4514434baee0ffca6af1804759f2bcb49e5b3d5742091dbe7db7077aec769"
Jun 06 20:59:33.247270 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:33.247186    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fc4514434baee0ffca6af1804759f2bcb49e5b3d5742091dbe7db7077aec769"} err="failed to get container status \"5fc4514434baee0ffca6af1804759f2bcb49e5b3d5742091dbe7db7077aec769\": rpc error: code = NotFound desc = could not find container \"5fc4514434baee0ffca6af1804759f2bcb49e5b3d5742091dbe7db7077aec769\": container with ID starting with 5fc4514434baee0ffca6af1804759f2bcb49e5b3d5742091dbe7db7077aec769 not found: ID does not exist"
Jun 06 20:59:33.249558 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:33.249530    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sdx2w\" is forbidden: User \"system:node:ip-10-0-129-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-66.ec2.internal' and this object" podUID="7d9e1043-97d3-420f-bd3d-a96c98fb27bf" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:34.058450 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:34.058406    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sdx2w\" is forbidden: User \"system:node:ip-10-0-129-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-66.ec2.internal' and this object" podUID="7d9e1043-97d3-420f-bd3d-a96c98fb27bf" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sdx2w"
Jun 06 20:59:34.059731 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:34.059706    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d9e1043-97d3-420f-bd3d-a96c98fb27bf" path="/var/lib/kubelet/pods/7d9e1043-97d3-420f-bd3d-a96c98fb27bf/volumes"
Jun 06 20:59:43.237272 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.237235    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"
Jun 06 20:59:43.237652 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.237432    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"
Jun 06 20:59:43.310087 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.310055    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"]
Jun 06 20:59:43.310259 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.310236    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f" podUID="2747ef1f-9702-4d62-952c-00216e8909cf" containerName="manager" containerID="cri-o://eb67c77a2bf4527ffa2d378d1213f3bd99f2240e8848b921b1368b0f3563765d" gracePeriod=10
Jun 06 20:59:43.592211 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.592187    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"
Jun 06 20:59:43.655168 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.655131    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2747ef1f-9702-4d62-952c-00216e8909cf-extensions-socket-volume\") pod \"2747ef1f-9702-4d62-952c-00216e8909cf\" (UID: \"2747ef1f-9702-4d62-952c-00216e8909cf\") "
Jun 06 20:59:43.655350 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.655183    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp8bz\" (UniqueName: \"kubernetes.io/projected/2747ef1f-9702-4d62-952c-00216e8909cf-kube-api-access-tp8bz\") pod \"2747ef1f-9702-4d62-952c-00216e8909cf\" (UID: \"2747ef1f-9702-4d62-952c-00216e8909cf\") "
Jun 06 20:59:43.655513 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.655492    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2747ef1f-9702-4d62-952c-00216e8909cf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2747ef1f-9702-4d62-952c-00216e8909cf" (UID: "2747ef1f-9702-4d62-952c-00216e8909cf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:59:43.657229 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.657202    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2747ef1f-9702-4d62-952c-00216e8909cf-kube-api-access-tp8bz" (OuterVolumeSpecName: "kube-api-access-tp8bz") pod "2747ef1f-9702-4d62-952c-00216e8909cf" (UID: "2747ef1f-9702-4d62-952c-00216e8909cf"). InnerVolumeSpecName "kube-api-access-tp8bz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 20:59:43.755692 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.755655    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2747ef1f-9702-4d62-952c-00216e8909cf-extensions-socket-volume\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:59:43.755692 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.755687    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp8bz\" (UniqueName: \"kubernetes.io/projected/2747ef1f-9702-4d62-952c-00216e8909cf-kube-api-access-tp8bz\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:59:43.920832 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.920756    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"]
Jun 06 20:59:43.921142 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.921128    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2747ef1f-9702-4d62-952c-00216e8909cf" containerName="manager"
Jun 06 20:59:43.921183 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.921144    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2747ef1f-9702-4d62-952c-00216e8909cf" containerName="manager"
Jun 06 20:59:43.921217 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.921206    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2747ef1f-9702-4d62-952c-00216e8909cf" containerName="manager"
Jun 06 20:59:43.924812 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.924796    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"
Jun 06 20:59:43.940819 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.940789    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"]
Jun 06 20:59:43.956843 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.956813    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57d27c33-8a92-477b-8cb3-8a794cd6c6ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-scgtv\" (UID: \"57d27c33-8a92-477b-8cb3-8a794cd6c6ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"
Jun 06 20:59:43.956947 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:43.956874    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7n6j\" (UniqueName: \"kubernetes.io/projected/57d27c33-8a92-477b-8cb3-8a794cd6c6ab-kube-api-access-l7n6j\") pod \"kuadrant-operator-controller-manager-86878c769f-scgtv\" (UID: \"57d27c33-8a92-477b-8cb3-8a794cd6c6ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"
Jun 06 20:59:44.059130 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:44.059091    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7n6j\" (UniqueName: \"kubernetes.io/projected/57d27c33-8a92-477b-8cb3-8a794cd6c6ab-kube-api-access-l7n6j\") pod \"kuadrant-operator-controller-manager-86878c769f-scgtv\" (UID: \"57d27c33-8a92-477b-8cb3-8a794cd6c6ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"
Jun 06 20:59:44.059462 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:44.059441    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57d27c33-8a92-477b-8cb3-8a794cd6c6ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-scgtv\" (UID: \"57d27c33-8a92-477b-8cb3-8a794cd6c6ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"
Jun 06 20:59:44.060014 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:44.059989    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57d27c33-8a92-477b-8cb3-8a794cd6c6ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-scgtv\" (UID: \"57d27c33-8a92-477b-8cb3-8a794cd6c6ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"
Jun 06 20:59:44.079463 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:44.079441    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7n6j\" (UniqueName: \"kubernetes.io/projected/57d27c33-8a92-477b-8cb3-8a794cd6c6ab-kube-api-access-l7n6j\") pod \"kuadrant-operator-controller-manager-86878c769f-scgtv\" (UID: \"57d27c33-8a92-477b-8cb3-8a794cd6c6ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"
Jun 06 20:59:44.234384 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:44.234271    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"
Jun 06 20:59:44.300125 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:44.300094    2577 generic.go:356] "Generic (PLEG): container finished" podID="2747ef1f-9702-4d62-952c-00216e8909cf" containerID="eb67c77a2bf4527ffa2d378d1213f3bd99f2240e8848b921b1368b0f3563765d" exitCode=0
Jun 06 20:59:44.300560 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:44.300162    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f" event={"ID":"2747ef1f-9702-4d62-952c-00216e8909cf","Type":"ContainerDied","Data":"eb67c77a2bf4527ffa2d378d1213f3bd99f2240e8848b921b1368b0f3563765d"}
Jun 06 20:59:44.300560 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:44.300227    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"
Jun 06 20:59:44.300560 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:44.300237    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f" event={"ID":"2747ef1f-9702-4d62-952c-00216e8909cf","Type":"ContainerDied","Data":"7cabc2aaa720815e5ba677cce53907a0be5cf5b0d359e8b8d57d7f78776de7da"}
Jun 06 20:59:44.300560 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:44.300272    2577 scope.go:117] "RemoveContainer" containerID="eb67c77a2bf4527ffa2d378d1213f3bd99f2240e8848b921b1368b0f3563765d"
Jun 06 20:59:44.310348 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:44.310323    2577 scope.go:117] "RemoveContainer" containerID="eb67c77a2bf4527ffa2d378d1213f3bd99f2240e8848b921b1368b0f3563765d"
Jun 06 20:59:44.310690 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:44.310663    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb67c77a2bf4527ffa2d378d1213f3bd99f2240e8848b921b1368b0f3563765d\": container with ID starting with eb67c77a2bf4527ffa2d378d1213f3bd99f2240e8848b921b1368b0f3563765d not found: ID does not exist" containerID="eb67c77a2bf4527ffa2d378d1213f3bd99f2240e8848b921b1368b0f3563765d"
Jun 06 20:59:44.310762 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:44.310701    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb67c77a2bf4527ffa2d378d1213f3bd99f2240e8848b921b1368b0f3563765d"} err="failed to get container status \"eb67c77a2bf4527ffa2d378d1213f3bd99f2240e8848b921b1368b0f3563765d\": rpc error: code = NotFound desc = could not find container \"eb67c77a2bf4527ffa2d378d1213f3bd99f2240e8848b921b1368b0f3563765d\": container with ID starting with eb67c77a2bf4527ffa2d378d1213f3bd99f2240e8848b921b1368b0f3563765d not found: ID does not exist"
Jun 06 20:59:44.324282 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:44.324255    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"]
Jun 06 20:59:44.328028 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:44.328000    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5ch8f"]
Jun 06 20:59:44.375397 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:44.375368    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"]
Jun 06 20:59:44.377719 ip-10-0-129-66 kubenswrapper[2577]: W0606 20:59:44.377693    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d27c33_8a92_477b_8cb3_8a794cd6c6ab.slice/crio-9d0b154f6e2d47ca86ecdb4bf1b9b191f3cbc81f0f4d2a9060ba280f5771b206 WatchSource:0}: Error finding container 9d0b154f6e2d47ca86ecdb4bf1b9b191f3cbc81f0f4d2a9060ba280f5771b206: Status 404 returned error can't find the container with id 9d0b154f6e2d47ca86ecdb4bf1b9b191f3cbc81f0f4d2a9060ba280f5771b206
Jun 06 20:59:45.309100 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:45.309061    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv" event={"ID":"57d27c33-8a92-477b-8cb3-8a794cd6c6ab","Type":"ContainerStarted","Data":"868df56e09af5d1753d707837ade8d999906793b17916f30bb9f37abb51d8023"}
Jun 06 20:59:45.309580 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:45.309108    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv" event={"ID":"57d27c33-8a92-477b-8cb3-8a794cd6c6ab","Type":"ContainerStarted","Data":"9d0b154f6e2d47ca86ecdb4bf1b9b191f3cbc81f0f4d2a9060ba280f5771b206"}
Jun 06 20:59:45.309580 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:45.309150    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"
Jun 06 20:59:45.349044 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:45.348992    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv" podStartSLOduration=2.3489752 podStartE2EDuration="2.3489752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:59:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:59:45.346986777 +0000 UTC m=+801.763798693" watchObservedRunningTime="2026-06-06 20:59:45.3489752 +0000 UTC m=+801.765787116"
Jun 06 20:59:46.059689 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:46.059659    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2747ef1f-9702-4d62-952c-00216e8909cf" path="/var/lib/kubelet/pods/2747ef1f-9702-4d62-952c-00216e8909cf/volumes"
Jun 06 20:59:56.316258 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:56.316223    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"
Jun 06 20:59:56.365539 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:56.365505    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"]
Jun 06 20:59:56.365760 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:56.365717    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8" podUID="77202e56-10f8-4826-a29f-ea549ff90271" containerName="manager" containerID="cri-o://eeb98a87f32bc0d7cf2b1dd33d97c26c0696e272b760af8bf1210e6f9ccacf73" gracePeriod=10
Jun 06 20:59:56.610601 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:56.610573    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"
Jun 06 20:59:56.664261 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:56.664224    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77202e56-10f8-4826-a29f-ea549ff90271-extensions-socket-volume\") pod \"77202e56-10f8-4826-a29f-ea549ff90271\" (UID: \"77202e56-10f8-4826-a29f-ea549ff90271\") "
Jun 06 20:59:56.664457 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:56.664350    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjmxn\" (UniqueName: \"kubernetes.io/projected/77202e56-10f8-4826-a29f-ea549ff90271-kube-api-access-bjmxn\") pod \"77202e56-10f8-4826-a29f-ea549ff90271\" (UID: \"77202e56-10f8-4826-a29f-ea549ff90271\") "
Jun 06 20:59:56.664660 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:56.664637    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77202e56-10f8-4826-a29f-ea549ff90271-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "77202e56-10f8-4826-a29f-ea549ff90271" (UID: "77202e56-10f8-4826-a29f-ea549ff90271"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 20:59:56.666395 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:56.666369    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77202e56-10f8-4826-a29f-ea549ff90271-kube-api-access-bjmxn" (OuterVolumeSpecName: "kube-api-access-bjmxn") pod "77202e56-10f8-4826-a29f-ea549ff90271" (UID: "77202e56-10f8-4826-a29f-ea549ff90271"). InnerVolumeSpecName "kube-api-access-bjmxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 20:59:56.765615 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:56.765578    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77202e56-10f8-4826-a29f-ea549ff90271-extensions-socket-volume\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:59:56.765615 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:56.765613    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjmxn\" (UniqueName: \"kubernetes.io/projected/77202e56-10f8-4826-a29f-ea549ff90271-kube-api-access-bjmxn\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 20:59:57.377519 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:57.377485    2577 generic.go:356] "Generic (PLEG): container finished" podID="77202e56-10f8-4826-a29f-ea549ff90271" containerID="eeb98a87f32bc0d7cf2b1dd33d97c26c0696e272b760af8bf1210e6f9ccacf73" exitCode=0
Jun 06 20:59:57.377992 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:57.377533    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"
Jun 06 20:59:57.377992 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:57.377576    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8" event={"ID":"77202e56-10f8-4826-a29f-ea549ff90271","Type":"ContainerDied","Data":"eeb98a87f32bc0d7cf2b1dd33d97c26c0696e272b760af8bf1210e6f9ccacf73"}
Jun 06 20:59:57.377992 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:57.377639    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8" event={"ID":"77202e56-10f8-4826-a29f-ea549ff90271","Type":"ContainerDied","Data":"a7f6cb5b126a3b550f2000d3a680148b0616164b2c1ad27c241a79faa4753385"}
Jun 06 20:59:57.377992 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:57.377676    2577 scope.go:117] "RemoveContainer" containerID="eeb98a87f32bc0d7cf2b1dd33d97c26c0696e272b760af8bf1210e6f9ccacf73"
Jun 06 20:59:57.387372 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:57.387355    2577 scope.go:117] "RemoveContainer" containerID="eeb98a87f32bc0d7cf2b1dd33d97c26c0696e272b760af8bf1210e6f9ccacf73"
Jun 06 20:59:57.387621 ip-10-0-129-66 kubenswrapper[2577]: E0606 20:59:57.387601    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeb98a87f32bc0d7cf2b1dd33d97c26c0696e272b760af8bf1210e6f9ccacf73\": container with ID starting with eeb98a87f32bc0d7cf2b1dd33d97c26c0696e272b760af8bf1210e6f9ccacf73 not found: ID does not exist" containerID="eeb98a87f32bc0d7cf2b1dd33d97c26c0696e272b760af8bf1210e6f9ccacf73"
Jun 06 20:59:57.387672 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:57.387629    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeb98a87f32bc0d7cf2b1dd33d97c26c0696e272b760af8bf1210e6f9ccacf73"} err="failed to get container status \"eeb98a87f32bc0d7cf2b1dd33d97c26c0696e272b760af8bf1210e6f9ccacf73\": rpc error: code = NotFound desc = could not find container \"eeb98a87f32bc0d7cf2b1dd33d97c26c0696e272b760af8bf1210e6f9ccacf73\": container with ID starting with eeb98a87f32bc0d7cf2b1dd33d97c26c0696e272b760af8bf1210e6f9ccacf73 not found: ID does not exist"
Jun 06 20:59:57.403416 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:57.403388    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"]
Jun 06 20:59:57.407790 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:57.407764    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ncnl8"]
Jun 06 20:59:58.059573 ip-10-0-129-66 kubenswrapper[2577]: I0606 20:59:58.059539    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77202e56-10f8-4826-a29f-ea549ff90271" path="/var/lib/kubelet/pods/77202e56-10f8-4826-a29f-ea549ff90271/volumes"
Jun 06 21:00:16.060757 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.060727    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"]
Jun 06 21:00:16.061114 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.061045    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77202e56-10f8-4826-a29f-ea549ff90271" containerName="manager"
Jun 06 21:00:16.061114 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.061055    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="77202e56-10f8-4826-a29f-ea549ff90271" containerName="manager"
Jun 06 21:00:16.061114 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.061109    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="77202e56-10f8-4826-a29f-ea549ff90271" containerName="manager"
Jun 06 21:00:16.064035 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.064019    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"
Jun 06 21:00:16.066475 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.066446    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jun 06 21:00:16.066608 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.066512    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gcflb\""
Jun 06 21:00:16.070933 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.070911    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"]
Jun 06 21:00:16.135984 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.135924    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwchv\" (UniqueName: \"kubernetes.io/projected/b6c97418-f8f9-47e1-914c-2d68bf365ee0-kube-api-access-hwchv\") pod \"limitador-limitador-64c94fd64f-mx9vd\" (UID: \"b6c97418-f8f9-47e1-914c-2d68bf365ee0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"
Jun 06 21:00:16.136195 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.136161    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6c97418-f8f9-47e1-914c-2d68bf365ee0-config-file\") pod \"limitador-limitador-64c94fd64f-mx9vd\" (UID: \"b6c97418-f8f9-47e1-914c-2d68bf365ee0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"
Jun 06 21:00:16.156181 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.156151    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"]
Jun 06 21:00:16.237583 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.237551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwchv\" (UniqueName: \"kubernetes.io/projected/b6c97418-f8f9-47e1-914c-2d68bf365ee0-kube-api-access-hwchv\") pod \"limitador-limitador-64c94fd64f-mx9vd\" (UID: \"b6c97418-f8f9-47e1-914c-2d68bf365ee0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"
Jun 06 21:00:16.237794 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.237612    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6c97418-f8f9-47e1-914c-2d68bf365ee0-config-file\") pod \"limitador-limitador-64c94fd64f-mx9vd\" (UID: \"b6c97418-f8f9-47e1-914c-2d68bf365ee0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"
Jun 06 21:00:16.238244 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.238223    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6c97418-f8f9-47e1-914c-2d68bf365ee0-config-file\") pod \"limitador-limitador-64c94fd64f-mx9vd\" (UID: \"b6c97418-f8f9-47e1-914c-2d68bf365ee0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"
Jun 06 21:00:16.246201 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.246174    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwchv\" (UniqueName: \"kubernetes.io/projected/b6c97418-f8f9-47e1-914c-2d68bf365ee0-kube-api-access-hwchv\") pod \"limitador-limitador-64c94fd64f-mx9vd\" (UID: \"b6c97418-f8f9-47e1-914c-2d68bf365ee0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"
Jun 06 21:00:16.375485 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.375401    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"
Jun 06 21:00:16.515924 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:16.515891    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"]
Jun 06 21:00:16.517550 ip-10-0-129-66 kubenswrapper[2577]: W0606 21:00:16.517525    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c97418_f8f9_47e1_914c_2d68bf365ee0.slice/crio-74a4f1460e118e9c755ce7439a581f043406225788eade929223e14a07188eb3 WatchSource:0}: Error finding container 74a4f1460e118e9c755ce7439a581f043406225788eade929223e14a07188eb3: Status 404 returned error can't find the container with id 74a4f1460e118e9c755ce7439a581f043406225788eade929223e14a07188eb3
Jun 06 21:00:17.495883 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:17.495839    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd" event={"ID":"b6c97418-f8f9-47e1-914c-2d68bf365ee0","Type":"ContainerStarted","Data":"74a4f1460e118e9c755ce7439a581f043406225788eade929223e14a07188eb3"}
Jun 06 21:00:19.509360 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:19.509325    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd" event={"ID":"b6c97418-f8f9-47e1-914c-2d68bf365ee0","Type":"ContainerStarted","Data":"76d240d26a82c3daf3999ead911055b77d31b97c4d9b7674eb524747a1a0cbd7"}
Jun 06 21:00:19.509736 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:19.509409    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"
Jun 06 21:00:19.526855 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:19.526801    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd" podStartSLOduration=1.012334099 podStartE2EDuration="3.526787314s" totalImagesPullingTime="2.514453215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:00:19.524199707 +0000 UTC m=+835.941011649" watchObservedRunningTime="2026-06-06 21:00:19.526787314 +0000 UTC m=+835.943599268"
Jun 06 21:00:30.515364 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:30.515332    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"
Jun 06 21:00:32.782631 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:32.782587    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"]
Jun 06 21:00:32.783062 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:32.782811    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd" podUID="b6c97418-f8f9-47e1-914c-2d68bf365ee0" containerName="limitador" containerID="cri-o://76d240d26a82c3daf3999ead911055b77d31b97c4d9b7674eb524747a1a0cbd7" gracePeriod=30
Jun 06 21:00:33.336154 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:33.336124    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"
Jun 06 21:00:33.493532 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:33.493504    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwchv\" (UniqueName: \"kubernetes.io/projected/b6c97418-f8f9-47e1-914c-2d68bf365ee0-kube-api-access-hwchv\") pod \"b6c97418-f8f9-47e1-914c-2d68bf365ee0\" (UID: \"b6c97418-f8f9-47e1-914c-2d68bf365ee0\") "
Jun 06 21:00:33.493689 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:33.493558    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6c97418-f8f9-47e1-914c-2d68bf365ee0-config-file\") pod \"b6c97418-f8f9-47e1-914c-2d68bf365ee0\" (UID: \"b6c97418-f8f9-47e1-914c-2d68bf365ee0\") "
Jun 06 21:00:33.493964 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:33.493942    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6c97418-f8f9-47e1-914c-2d68bf365ee0-config-file" (OuterVolumeSpecName: "config-file") pod "b6c97418-f8f9-47e1-914c-2d68bf365ee0" (UID: "b6c97418-f8f9-47e1-914c-2d68bf365ee0"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 06 21:00:33.495569 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:33.495552    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6c97418-f8f9-47e1-914c-2d68bf365ee0-kube-api-access-hwchv" (OuterVolumeSpecName: "kube-api-access-hwchv") pod "b6c97418-f8f9-47e1-914c-2d68bf365ee0" (UID: "b6c97418-f8f9-47e1-914c-2d68bf365ee0"). InnerVolumeSpecName "kube-api-access-hwchv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 21:00:33.590905 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:33.590865    2577 generic.go:356] "Generic (PLEG): container finished" podID="b6c97418-f8f9-47e1-914c-2d68bf365ee0" containerID="76d240d26a82c3daf3999ead911055b77d31b97c4d9b7674eb524747a1a0cbd7" exitCode=0
Jun 06 21:00:33.591091 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:33.590912    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"
Jun 06 21:00:33.591091 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:33.590915    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd" event={"ID":"b6c97418-f8f9-47e1-914c-2d68bf365ee0","Type":"ContainerDied","Data":"76d240d26a82c3daf3999ead911055b77d31b97c4d9b7674eb524747a1a0cbd7"}
Jun 06 21:00:33.591091 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:33.590990    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mx9vd" event={"ID":"b6c97418-f8f9-47e1-914c-2d68bf365ee0","Type":"ContainerDied","Data":"74a4f1460e118e9c755ce7439a581f043406225788eade929223e14a07188eb3"}
Jun 06 21:00:33.591091 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:33.591006    2577 scope.go:117] "RemoveContainer" containerID="76d240d26a82c3daf3999ead911055b77d31b97c4d9b7674eb524747a1a0cbd7"
Jun 06 21:00:33.594270 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:33.594252    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwchv\" (UniqueName: \"kubernetes.io/projected/b6c97418-f8f9-47e1-914c-2d68bf365ee0-kube-api-access-hwchv\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 21:00:33.594384 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:33.594273    2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6c97418-f8f9-47e1-914c-2d68bf365ee0-config-file\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 21:00:33.602866 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:33.602845    2577 scope.go:117] "RemoveContainer" containerID="76d240d26a82c3daf3999ead911055b77d31b97c4d9b7674eb524747a1a0cbd7"
Jun 06 21:00:33.603154 ip-10-0-129-66 kubenswrapper[2577]: E0606 21:00:33.603133    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76d240d26a82c3daf3999ead911055b77d31b97c4d9b7674eb524747a1a0cbd7\": container with ID starting with 76d240d26a82c3daf3999ead911055b77d31b97c4d9b7674eb524747a1a0cbd7 not found: ID does not exist" containerID="76d240d26a82c3daf3999ead911055b77d31b97c4d9b7674eb524747a1a0cbd7"
Jun 06 21:00:33.603245 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:33.603161    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76d240d26a82c3daf3999ead911055b77d31b97c4d9b7674eb524747a1a0cbd7"} err="failed to get container status \"76d240d26a82c3daf3999ead911055b77d31b97c4d9b7674eb524747a1a0cbd7\": rpc error: code = NotFound desc = could not find container \"76d240d26a82c3daf3999ead911055b77d31b97c4d9b7674eb524747a1a0cbd7\": container with ID starting with 76d240d26a82c3daf3999ead911055b77d31b97c4d9b7674eb524747a1a0cbd7 not found: ID does not exist"
Jun 06 21:00:33.613978 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:33.613917    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"]
Jun 06 21:00:33.616903 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:33.616876    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mx9vd"]
Jun 06 21:00:34.059835 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:34.059792    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6c97418-f8f9-47e1-914c-2d68bf365ee0" path="/var/lib/kubelet/pods/b6c97418-f8f9-47e1-914c-2d68bf365ee0/volumes"
Jun 06 21:00:34.992013 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:34.991978    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-lgp4w"]
Jun 06 21:00:34.992531 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:34.992511    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6c97418-f8f9-47e1-914c-2d68bf365ee0" containerName="limitador"
Jun 06 21:00:34.992584 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:34.992536    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6c97418-f8f9-47e1-914c-2d68bf365ee0" containerName="limitador"
Jun 06 21:00:34.992671 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:34.992658    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6c97418-f8f9-47e1-914c-2d68bf365ee0" containerName="limitador"
Jun 06 21:00:34.997579 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:34.997553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-lgp4w"
Jun 06 21:00:35.000625 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:35.000602    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jun 06 21:00:35.001625 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:35.001570    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-lgp4w"]
Jun 06 21:00:35.106460 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:35.106425    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/445ae285-a5d2-413b-997d-99e07d5a021c-data\") pod \"postgres-69fb4594cf-lgp4w\" (UID: \"445ae285-a5d2-413b-997d-99e07d5a021c\") " pod="opendatahub/postgres-69fb4594cf-lgp4w"
Jun 06 21:00:35.106460 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:35.106467    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7q2p\" (UniqueName: \"kubernetes.io/projected/445ae285-a5d2-413b-997d-99e07d5a021c-kube-api-access-p7q2p\") pod \"postgres-69fb4594cf-lgp4w\" (UID: \"445ae285-a5d2-413b-997d-99e07d5a021c\") " pod="opendatahub/postgres-69fb4594cf-lgp4w"
Jun 06 21:00:35.206988 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:35.206936    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/445ae285-a5d2-413b-997d-99e07d5a021c-data\") pod \"postgres-69fb4594cf-lgp4w\" (UID: \"445ae285-a5d2-413b-997d-99e07d5a021c\") " pod="opendatahub/postgres-69fb4594cf-lgp4w"
Jun 06 21:00:35.206988 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:35.206995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7q2p\" (UniqueName: \"kubernetes.io/projected/445ae285-a5d2-413b-997d-99e07d5a021c-kube-api-access-p7q2p\") pod \"postgres-69fb4594cf-lgp4w\" (UID: \"445ae285-a5d2-413b-997d-99e07d5a021c\") " pod="opendatahub/postgres-69fb4594cf-lgp4w"
Jun 06 21:00:35.207398 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:35.207376    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/445ae285-a5d2-413b-997d-99e07d5a021c-data\") pod \"postgres-69fb4594cf-lgp4w\" (UID: \"445ae285-a5d2-413b-997d-99e07d5a021c\") " pod="opendatahub/postgres-69fb4594cf-lgp4w"
Jun 06 21:00:35.215529 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:35.215506    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7q2p\" (UniqueName: \"kubernetes.io/projected/445ae285-a5d2-413b-997d-99e07d5a021c-kube-api-access-p7q2p\") pod \"postgres-69fb4594cf-lgp4w\" (UID: \"445ae285-a5d2-413b-997d-99e07d5a021c\") " pod="opendatahub/postgres-69fb4594cf-lgp4w"
Jun 06 21:00:35.310635 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:35.310600    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-lgp4w"
Jun 06 21:00:35.442391 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:35.442353    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-lgp4w"]
Jun 06 21:00:35.443929 ip-10-0-129-66 kubenswrapper[2577]: W0606 21:00:35.443901    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445ae285_a5d2_413b_997d_99e07d5a021c.slice/crio-46313df5c6adb02ce46639fe5fe4229741801f3b228412d6e04cdc9161d29f94 WatchSource:0}: Error finding container 46313df5c6adb02ce46639fe5fe4229741801f3b228412d6e04cdc9161d29f94: Status 404 returned error can't find the container with id 46313df5c6adb02ce46639fe5fe4229741801f3b228412d6e04cdc9161d29f94
Jun 06 21:00:35.603718 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:35.603636    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-lgp4w" event={"ID":"445ae285-a5d2-413b-997d-99e07d5a021c","Type":"ContainerStarted","Data":"46313df5c6adb02ce46639fe5fe4229741801f3b228412d6e04cdc9161d29f94"}
Jun 06 21:00:39.630282 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:39.630240    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-lgp4w" event={"ID":"445ae285-a5d2-413b-997d-99e07d5a021c","Type":"ContainerStarted","Data":"74022a301d561102afb5bede696c1c9158d0afeb64d261d288aa04289ff312ec"}
Jun 06 21:00:39.630764 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:39.630356    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-lgp4w"
Jun 06 21:00:39.646747 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:39.646696    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-lgp4w" podStartSLOduration=2.528895813 podStartE2EDuration="5.646682022s" totalImagesPullingTime="3.117786209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:00:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:00:39.644150953 +0000 UTC m=+856.060962872" watchObservedRunningTime="2026-06-06 21:00:39.646682022 +0000 UTC m=+856.063493939"
Jun 06 21:00:45.671985 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:45.671954    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-lgp4w"
Jun 06 21:00:47.077611 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.077576    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr"]
Jun 06 21:00:47.084440 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.084418    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr"
Jun 06 21:00:47.087284 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.087250    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 06 21:00:47.087284 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.087283    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 06 21:00:47.088268 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.088247    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-226hw\""
Jun 06 21:00:47.093207 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.093181    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr"]
Jun 06 21:00:47.100804 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.100769    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a39ba67c-6acd-4c94-b30e-48783be1ba44-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr\" (UID: \"a39ba67c-6acd-4c94-b30e-48783be1ba44\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr"
Jun 06 21:00:47.100969 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.100872    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8c8v\" (UniqueName: \"kubernetes.io/projected/a39ba67c-6acd-4c94-b30e-48783be1ba44-kube-api-access-g8c8v\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr\" (UID: \"a39ba67c-6acd-4c94-b30e-48783be1ba44\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr"
Jun 06 21:00:47.100969 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.100958    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a39ba67c-6acd-4c94-b30e-48783be1ba44-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr\" (UID: \"a39ba67c-6acd-4c94-b30e-48783be1ba44\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr"
Jun 06 21:00:47.201606 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.201564    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8c8v\" (UniqueName: \"kubernetes.io/projected/a39ba67c-6acd-4c94-b30e-48783be1ba44-kube-api-access-g8c8v\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr\" (UID: \"a39ba67c-6acd-4c94-b30e-48783be1ba44\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr"
Jun 06 21:00:47.201794 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.201638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a39ba67c-6acd-4c94-b30e-48783be1ba44-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr\" (UID: \"a39ba67c-6acd-4c94-b30e-48783be1ba44\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr"
Jun 06 21:00:47.201794 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.201696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a39ba67c-6acd-4c94-b30e-48783be1ba44-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr\" (UID: \"a39ba67c-6acd-4c94-b30e-48783be1ba44\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr"
Jun 06 21:00:47.202039 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.202017    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a39ba67c-6acd-4c94-b30e-48783be1ba44-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr\" (UID: \"a39ba67c-6acd-4c94-b30e-48783be1ba44\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr"
Jun 06 21:00:47.202080 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.202068    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a39ba67c-6acd-4c94-b30e-48783be1ba44-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr\" (UID: \"a39ba67c-6acd-4c94-b30e-48783be1ba44\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr"
Jun 06 21:00:47.211582 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.211558    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8c8v\" (UniqueName: \"kubernetes.io/projected/a39ba67c-6acd-4c94-b30e-48783be1ba44-kube-api-access-g8c8v\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr\" (UID: \"a39ba67c-6acd-4c94-b30e-48783be1ba44\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr"
Jun 06 21:00:47.394962 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.394857    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr"
Jun 06 21:00:47.531826 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.531797    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr"]
Jun 06 21:00:47.533727 ip-10-0-129-66 kubenswrapper[2577]: W0606 21:00:47.533699    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda39ba67c_6acd_4c94_b30e_48783be1ba44.slice/crio-53ce45a9a8dbe71c8755e633bd5f20e3665a43dd14b441bcfd17f0ebc49367db WatchSource:0}: Error finding container 53ce45a9a8dbe71c8755e633bd5f20e3665a43dd14b441bcfd17f0ebc49367db: Status 404 returned error can't find the container with id 53ce45a9a8dbe71c8755e633bd5f20e3665a43dd14b441bcfd17f0ebc49367db
Jun 06 21:00:47.674720 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.674629    2577 generic.go:356] "Generic (PLEG): container finished" podID="a39ba67c-6acd-4c94-b30e-48783be1ba44" containerID="2363b149f43d2e31f29a13a410bf922aecb731e0bed48a7eae280c68007275d5" exitCode=0
Jun 06 21:00:47.674849 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.674718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr" event={"ID":"a39ba67c-6acd-4c94-b30e-48783be1ba44","Type":"ContainerDied","Data":"2363b149f43d2e31f29a13a410bf922aecb731e0bed48a7eae280c68007275d5"}
Jun 06 21:00:47.674849 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:47.674768    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr" event={"ID":"a39ba67c-6acd-4c94-b30e-48783be1ba44","Type":"ContainerStarted","Data":"53ce45a9a8dbe71c8755e633bd5f20e3665a43dd14b441bcfd17f0ebc49367db"}
Jun 06 21:00:48.681894 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:48.681857    2577 generic.go:356] "Generic (PLEG): container finished" podID="a39ba67c-6acd-4c94-b30e-48783be1ba44" containerID="06f95fe43cb1b38da5bc20d80adcaaef58596a5d75666315635d6aaf22a2ded3" exitCode=0
Jun 06 21:00:48.682261 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:48.681940    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr" event={"ID":"a39ba67c-6acd-4c94-b30e-48783be1ba44","Type":"ContainerDied","Data":"06f95fe43cb1b38da5bc20d80adcaaef58596a5d75666315635d6aaf22a2ded3"}
Jun 06 21:00:49.689415 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:49.689380    2577 generic.go:356] "Generic (PLEG): container finished" podID="a39ba67c-6acd-4c94-b30e-48783be1ba44" containerID="0148b52884aca0267a3b92b1e4cff07e6638c2e651e8067ab00715a9b35caf5a" exitCode=0
Jun 06 21:00:49.689802 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:49.689431    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr" event={"ID":"a39ba67c-6acd-4c94-b30e-48783be1ba44","Type":"ContainerDied","Data":"0148b52884aca0267a3b92b1e4cff07e6638c2e651e8067ab00715a9b35caf5a"}
Jun 06 21:00:50.886779 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:50.886743    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr"
Jun 06 21:00:50.934260 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:50.934224    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a39ba67c-6acd-4c94-b30e-48783be1ba44-bundle\") pod \"a39ba67c-6acd-4c94-b30e-48783be1ba44\" (UID: \"a39ba67c-6acd-4c94-b30e-48783be1ba44\") "
Jun 06 21:00:50.934458 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:50.934291    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a39ba67c-6acd-4c94-b30e-48783be1ba44-util\") pod \"a39ba67c-6acd-4c94-b30e-48783be1ba44\" (UID: \"a39ba67c-6acd-4c94-b30e-48783be1ba44\") "
Jun 06 21:00:50.934458 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:50.934359    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8c8v\" (UniqueName: \"kubernetes.io/projected/a39ba67c-6acd-4c94-b30e-48783be1ba44-kube-api-access-g8c8v\") pod \"a39ba67c-6acd-4c94-b30e-48783be1ba44\" (UID: \"a39ba67c-6acd-4c94-b30e-48783be1ba44\") "
Jun 06 21:00:50.934749 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:50.934723    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a39ba67c-6acd-4c94-b30e-48783be1ba44-bundle" (OuterVolumeSpecName: "bundle") pod "a39ba67c-6acd-4c94-b30e-48783be1ba44" (UID: "a39ba67c-6acd-4c94-b30e-48783be1ba44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 21:00:50.936569 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:50.936541    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a39ba67c-6acd-4c94-b30e-48783be1ba44-kube-api-access-g8c8v" (OuterVolumeSpecName: "kube-api-access-g8c8v") pod "a39ba67c-6acd-4c94-b30e-48783be1ba44" (UID: "a39ba67c-6acd-4c94-b30e-48783be1ba44"). InnerVolumeSpecName "kube-api-access-g8c8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 21:00:50.940120 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:50.940080    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a39ba67c-6acd-4c94-b30e-48783be1ba44-util" (OuterVolumeSpecName: "util") pod "a39ba67c-6acd-4c94-b30e-48783be1ba44" (UID: "a39ba67c-6acd-4c94-b30e-48783be1ba44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 21:00:51.035395 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:51.035359    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a39ba67c-6acd-4c94-b30e-48783be1ba44-bundle\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 21:00:51.035395 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:51.035389    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a39ba67c-6acd-4c94-b30e-48783be1ba44-util\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 21:00:51.035395 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:51.035398    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8c8v\" (UniqueName: \"kubernetes.io/projected/a39ba67c-6acd-4c94-b30e-48783be1ba44-kube-api-access-g8c8v\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 21:00:51.701677 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:51.701646    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr"
Jun 06 21:00:51.701677 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:51.701666    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748kh7kr" event={"ID":"a39ba67c-6acd-4c94-b30e-48783be1ba44","Type":"ContainerDied","Data":"53ce45a9a8dbe71c8755e633bd5f20e3665a43dd14b441bcfd17f0ebc49367db"}
Jun 06 21:00:51.701936 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:51.701717    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53ce45a9a8dbe71c8755e633bd5f20e3665a43dd14b441bcfd17f0ebc49367db"
Jun 06 21:00:54.379393 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.379354    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-mpsvv"]
Jun 06 21:00:54.379792 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.379695    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a39ba67c-6acd-4c94-b30e-48783be1ba44" containerName="pull"
Jun 06 21:00:54.379792 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.379706    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39ba67c-6acd-4c94-b30e-48783be1ba44" containerName="pull"
Jun 06 21:00:54.379792 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.379716    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a39ba67c-6acd-4c94-b30e-48783be1ba44" containerName="util"
Jun 06 21:00:54.379792 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.379721    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39ba67c-6acd-4c94-b30e-48783be1ba44" containerName="util"
Jun 06 21:00:54.379792 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.379729    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a39ba67c-6acd-4c94-b30e-48783be1ba44" containerName="extract"
Jun 06 21:00:54.379792 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.379735    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39ba67c-6acd-4c94-b30e-48783be1ba44" containerName="extract"
Jun 06 21:00:54.380005 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.379802    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a39ba67c-6acd-4c94-b30e-48783be1ba44" containerName="extract"
Jun 06 21:00:54.384392 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.384371    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-mpsvv"
Jun 06 21:00:54.387036 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.387007    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 06 21:00:54.388054 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.388034    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-48fhf\""
Jun 06 21:00:54.388149 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.388067    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 06 21:00:54.393748 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.393721    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-mpsvv"]
Jun 06 21:00:54.467589 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.467546    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw498\" (UniqueName: \"kubernetes.io/projected/6d55034a-0a7b-419a-b3d0-f03395582f40-kube-api-access-gw498\") pod \"keycloak-operator-d67dbbb48-mpsvv\" (UID: \"6d55034a-0a7b-419a-b3d0-f03395582f40\") " pod="keycloak-system/keycloak-operator-d67dbbb48-mpsvv"
Jun 06 21:00:54.568551 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.568506    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw498\" (UniqueName: \"kubernetes.io/projected/6d55034a-0a7b-419a-b3d0-f03395582f40-kube-api-access-gw498\") pod \"keycloak-operator-d67dbbb48-mpsvv\" (UID: \"6d55034a-0a7b-419a-b3d0-f03395582f40\") " pod="keycloak-system/keycloak-operator-d67dbbb48-mpsvv"
Jun 06 21:00:54.577577 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.577545    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw498\" (UniqueName: \"kubernetes.io/projected/6d55034a-0a7b-419a-b3d0-f03395582f40-kube-api-access-gw498\") pod \"keycloak-operator-d67dbbb48-mpsvv\" (UID: \"6d55034a-0a7b-419a-b3d0-f03395582f40\") " pod="keycloak-system/keycloak-operator-d67dbbb48-mpsvv"
Jun 06 21:00:54.695725 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.695637    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-mpsvv"
Jun 06 21:00:54.833444 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:54.833411    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-mpsvv"]
Jun 06 21:00:54.834403 ip-10-0-129-66 kubenswrapper[2577]: W0606 21:00:54.834374    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d55034a_0a7b_419a_b3d0_f03395582f40.slice/crio-e0b84470a9488d3ee05ce1dcd53b00a1d2ff200bdc55f21aa2eb5a3a615520c9 WatchSource:0}: Error finding container e0b84470a9488d3ee05ce1dcd53b00a1d2ff200bdc55f21aa2eb5a3a615520c9: Status 404 returned error can't find the container with id e0b84470a9488d3ee05ce1dcd53b00a1d2ff200bdc55f21aa2eb5a3a615520c9
Jun 06 21:00:55.731568 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:00:55.731523    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-mpsvv" event={"ID":"6d55034a-0a7b-419a-b3d0-f03395582f40","Type":"ContainerStarted","Data":"e0b84470a9488d3ee05ce1dcd53b00a1d2ff200bdc55f21aa2eb5a3a615520c9"}
Jun 06 21:01:00.764025 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:01:00.763982    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-mpsvv" event={"ID":"6d55034a-0a7b-419a-b3d0-f03395582f40","Type":"ContainerStarted","Data":"c808f1b68a49d46e80e6fed871a557698355dfc42dd58d4f39d5e82089bcc12d"}
Jun 06 21:01:00.781370 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:01:00.781290    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-mpsvv" podStartSLOduration=1.451127129 podStartE2EDuration="6.781274216s" totalImagesPullingTime="5.330147087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:01:00.778589376 +0000 UTC m=+877.195401294" watchObservedRunningTime="2026-06-06 21:01:00.781274216 +0000 UTC m=+877.198086132"
Jun 06 21:01:24.066794 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:01:24.066760    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 21:01:24.067245 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:01:24.066829    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 21:03:42.382969 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.382938    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"]
Jun 06 21:03:42.386450 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.386417    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.389966 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.389939    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 06 21:03:42.390107 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.389968    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jun 06 21:03:42.390107 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.389974    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 06 21:03:42.390107 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.390052    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2zx5s\""
Jun 06 21:03:42.393198 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.393169    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75c6c97e-315c-4286-80be-50fa2864b98a-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.393364 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.393212    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75c6c97e-315c-4286-80be-50fa2864b98a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.393364 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.393269    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2gsh\" (UniqueName: \"kubernetes.io/projected/75c6c97e-315c-4286-80be-50fa2864b98a-kube-api-access-s2gsh\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.393364 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.393353    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75c6c97e-315c-4286-80be-50fa2864b98a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.393540 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.393398    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75c6c97e-315c-4286-80be-50fa2864b98a-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.393540 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.393423    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/75c6c97e-315c-4286-80be-50fa2864b98a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.397578 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.397557    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"]
Jun 06 21:03:42.493933 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.493897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75c6c97e-315c-4286-80be-50fa2864b98a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.494110 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.493947    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75c6c97e-315c-4286-80be-50fa2864b98a-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.494110 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.493966    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/75c6c97e-315c-4286-80be-50fa2864b98a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.494110 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.493997    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75c6c97e-315c-4286-80be-50fa2864b98a-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.494110 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.494013    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75c6c97e-315c-4286-80be-50fa2864b98a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.494110 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.494040    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2gsh\" (UniqueName: \"kubernetes.io/projected/75c6c97e-315c-4286-80be-50fa2864b98a-kube-api-access-s2gsh\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.494457 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.494432    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75c6c97e-315c-4286-80be-50fa2864b98a-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.494532 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.494451    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/75c6c97e-315c-4286-80be-50fa2864b98a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.494532 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.494493    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75c6c97e-315c-4286-80be-50fa2864b98a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.496338 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.496292    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75c6c97e-315c-4286-80be-50fa2864b98a-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.496734 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.496714    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75c6c97e-315c-4286-80be-50fa2864b98a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.501760 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.501736    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2gsh\" (UniqueName: \"kubernetes.io/projected/75c6c97e-315c-4286-80be-50fa2864b98a-kube-api-access-s2gsh\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p\" (UID: \"75c6c97e-315c-4286-80be-50fa2864b98a\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.698685 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.698582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"
Jun 06 21:03:42.839403 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.839369    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p"]
Jun 06 21:03:42.841453 ip-10-0-129-66 kubenswrapper[2577]: W0606 21:03:42.841425    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c6c97e_315c_4286_80be_50fa2864b98a.slice/crio-6cb5fb24e53ef41dd43d51de6526c8c8d44e986d3d0b61fee169c5b0a515410f WatchSource:0}: Error finding container 6cb5fb24e53ef41dd43d51de6526c8c8d44e986d3d0b61fee169c5b0a515410f: Status 404 returned error can't find the container with id 6cb5fb24e53ef41dd43d51de6526c8c8d44e986d3d0b61fee169c5b0a515410f
Jun 06 21:03:42.843252 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:42.843233    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 06 21:03:43.650849 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:43.650808    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p" event={"ID":"75c6c97e-315c-4286-80be-50fa2864b98a","Type":"ContainerStarted","Data":"6cb5fb24e53ef41dd43d51de6526c8c8d44e986d3d0b61fee169c5b0a515410f"}
Jun 06 21:03:46.674195 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:03:46.674147    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-hl88p" event={"ID":"75c6c97e-315c-4286-80be-50fa2864b98a","Type":"ContainerStarted","Data":"e3ebd9e482db73d9bb34d007d50c6ed0332409584b73873b9352f71aff130786"}
Jun 06 21:06:24.104037 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:06:24.104008    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 21:06:24.105774 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:06:24.105749    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 21:11:24.142894 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:11:24.142864    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 21:11:24.146491 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:11:24.146473    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 21:15:00.137822 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:00.137736    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29679675-h6mb5"]
Jun 06 21:15:00.139837 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:00.139822    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29679675-h6mb5"
Jun 06 21:15:00.142280 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:00.142257    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-75spc\""
Jun 06 21:15:00.156147 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:00.156121    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29679675-h6mb5"]
Jun 06 21:15:00.275493 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:00.275451    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw4gj\" (UniqueName: \"kubernetes.io/projected/ab8eb344-050d-4bb1-bb95-c2b1050cfbc3-kube-api-access-lw4gj\") pod \"maas-api-key-cleanup-29679675-h6mb5\" (UID: \"ab8eb344-050d-4bb1-bb95-c2b1050cfbc3\") " pod="opendatahub/maas-api-key-cleanup-29679675-h6mb5"
Jun 06 21:15:00.376036 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:00.376002    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw4gj\" (UniqueName: \"kubernetes.io/projected/ab8eb344-050d-4bb1-bb95-c2b1050cfbc3-kube-api-access-lw4gj\") pod \"maas-api-key-cleanup-29679675-h6mb5\" (UID: \"ab8eb344-050d-4bb1-bb95-c2b1050cfbc3\") " pod="opendatahub/maas-api-key-cleanup-29679675-h6mb5"
Jun 06 21:15:00.392261 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:00.392175    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw4gj\" (UniqueName: \"kubernetes.io/projected/ab8eb344-050d-4bb1-bb95-c2b1050cfbc3-kube-api-access-lw4gj\") pod \"maas-api-key-cleanup-29679675-h6mb5\" (UID: \"ab8eb344-050d-4bb1-bb95-c2b1050cfbc3\") " pod="opendatahub/maas-api-key-cleanup-29679675-h6mb5"
Jun 06 21:15:00.450010 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:00.449977    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29679675-h6mb5"
Jun 06 21:15:00.584745 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:00.584718    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29679675-h6mb5"]
Jun 06 21:15:00.586537 ip-10-0-129-66 kubenswrapper[2577]: W0606 21:15:00.586499    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8eb344_050d_4bb1_bb95_c2b1050cfbc3.slice/crio-42ce238f786d1df75e07a30bdeec2275fbdb210d71d4f8e55c7840598475f2bb WatchSource:0}: Error finding container 42ce238f786d1df75e07a30bdeec2275fbdb210d71d4f8e55c7840598475f2bb: Status 404 returned error can't find the container with id 42ce238f786d1df75e07a30bdeec2275fbdb210d71d4f8e55c7840598475f2bb
Jun 06 21:15:00.588692 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:00.588670    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 06 21:15:01.354842 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:01.354811    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29679675-h6mb5" event={"ID":"ab8eb344-050d-4bb1-bb95-c2b1050cfbc3","Type":"ContainerStarted","Data":"42ce238f786d1df75e07a30bdeec2275fbdb210d71d4f8e55c7840598475f2bb"}
Jun 06 21:15:04.376819 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:04.376781    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29679675-h6mb5" event={"ID":"ab8eb344-050d-4bb1-bb95-c2b1050cfbc3","Type":"ContainerStarted","Data":"c36916368275a50b227028c1457f895182a853eae30d967bf260be72ffd6310a"}
Jun 06 21:15:04.394034 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:04.393976    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29679675-h6mb5" podStartSLOduration=1.503983456 podStartE2EDuration="4.393960048s" totalImagesPullingTime="2.889976592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:15:04.392184096 +0000 UTC m=+1720.808996014" watchObservedRunningTime="2026-06-06 21:15:04.393960048 +0000 UTC m=+1720.810772014"
Jun 06 21:15:05.383271 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:05.383235    2577 generic.go:356] "Generic (PLEG): container finished" podID="ab8eb344-050d-4bb1-bb95-c2b1050cfbc3" containerID="c36916368275a50b227028c1457f895182a853eae30d967bf260be72ffd6310a" exitCode=0
Jun 06 21:15:05.383667 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:05.383290    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29679675-h6mb5" event={"ID":"ab8eb344-050d-4bb1-bb95-c2b1050cfbc3","Type":"ContainerDied","Data":"c36916368275a50b227028c1457f895182a853eae30d967bf260be72ffd6310a"}
Jun 06 21:15:06.520471 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:06.520443    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29679675-h6mb5"
Jun 06 21:15:06.634223 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:06.634183    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lw4gj\" (UniqueName: \"kubernetes.io/projected/ab8eb344-050d-4bb1-bb95-c2b1050cfbc3-kube-api-access-lw4gj\") pod \"ab8eb344-050d-4bb1-bb95-c2b1050cfbc3\" (UID: \"ab8eb344-050d-4bb1-bb95-c2b1050cfbc3\") "
Jun 06 21:15:06.636432 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:06.636401    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab8eb344-050d-4bb1-bb95-c2b1050cfbc3-kube-api-access-lw4gj" (OuterVolumeSpecName: "kube-api-access-lw4gj") pod "ab8eb344-050d-4bb1-bb95-c2b1050cfbc3" (UID: "ab8eb344-050d-4bb1-bb95-c2b1050cfbc3"). InnerVolumeSpecName "kube-api-access-lw4gj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 21:15:06.735456 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:06.735423    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw4gj\" (UniqueName: \"kubernetes.io/projected/ab8eb344-050d-4bb1-bb95-c2b1050cfbc3-kube-api-access-lw4gj\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 21:15:07.395473 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:07.395441    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29679675-h6mb5"
Jun 06 21:15:07.395473 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:07.395458    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29679675-h6mb5" event={"ID":"ab8eb344-050d-4bb1-bb95-c2b1050cfbc3","Type":"ContainerDied","Data":"42ce238f786d1df75e07a30bdeec2275fbdb210d71d4f8e55c7840598475f2bb"}
Jun 06 21:15:07.395675 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:15:07.395505    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42ce238f786d1df75e07a30bdeec2275fbdb210d71d4f8e55c7840598475f2bb"
Jun 06 21:16:24.183842 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:16:24.183816    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 21:16:24.188020 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:16:24.188001    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 21:17:26.762806 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:26.762769    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"]
Jun 06 21:17:26.763377 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:26.762983    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv" podUID="57d27c33-8a92-477b-8cb3-8a794cd6c6ab" containerName="manager" containerID="cri-o://868df56e09af5d1753d707837ade8d999906793b17916f30bb9f37abb51d8023" gracePeriod=10
Jun 06 21:17:27.022362 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:27.022283    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"
Jun 06 21:17:27.104738 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:27.104696    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7n6j\" (UniqueName: \"kubernetes.io/projected/57d27c33-8a92-477b-8cb3-8a794cd6c6ab-kube-api-access-l7n6j\") pod \"57d27c33-8a92-477b-8cb3-8a794cd6c6ab\" (UID: \"57d27c33-8a92-477b-8cb3-8a794cd6c6ab\") "
Jun 06 21:17:27.104913 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:27.104796    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57d27c33-8a92-477b-8cb3-8a794cd6c6ab-extensions-socket-volume\") pod \"57d27c33-8a92-477b-8cb3-8a794cd6c6ab\" (UID: \"57d27c33-8a92-477b-8cb3-8a794cd6c6ab\") "
Jun 06 21:17:27.105186 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:27.105148    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d27c33-8a92-477b-8cb3-8a794cd6c6ab-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "57d27c33-8a92-477b-8cb3-8a794cd6c6ab" (UID: "57d27c33-8a92-477b-8cb3-8a794cd6c6ab"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 06 21:17:27.106877 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:27.106854    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57d27c33-8a92-477b-8cb3-8a794cd6c6ab-kube-api-access-l7n6j" (OuterVolumeSpecName: "kube-api-access-l7n6j") pod "57d27c33-8a92-477b-8cb3-8a794cd6c6ab" (UID: "57d27c33-8a92-477b-8cb3-8a794cd6c6ab"). InnerVolumeSpecName "kube-api-access-l7n6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 06 21:17:27.176498 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:27.176461    2577 generic.go:356] "Generic (PLEG): container finished" podID="57d27c33-8a92-477b-8cb3-8a794cd6c6ab" containerID="868df56e09af5d1753d707837ade8d999906793b17916f30bb9f37abb51d8023" exitCode=0
Jun 06 21:17:27.176669 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:27.176542    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"
Jun 06 21:17:27.176669 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:27.176539    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv" event={"ID":"57d27c33-8a92-477b-8cb3-8a794cd6c6ab","Type":"ContainerDied","Data":"868df56e09af5d1753d707837ade8d999906793b17916f30bb9f37abb51d8023"}
Jun 06 21:17:27.176802 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:27.176670    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv" event={"ID":"57d27c33-8a92-477b-8cb3-8a794cd6c6ab","Type":"ContainerDied","Data":"9d0b154f6e2d47ca86ecdb4bf1b9b191f3cbc81f0f4d2a9060ba280f5771b206"}
Jun 06 21:17:27.176802 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:27.176693    2577 scope.go:117] "RemoveContainer" containerID="868df56e09af5d1753d707837ade8d999906793b17916f30bb9f37abb51d8023"
Jun 06 21:17:27.186857 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:27.186838    2577 scope.go:117] "RemoveContainer" containerID="868df56e09af5d1753d707837ade8d999906793b17916f30bb9f37abb51d8023"
Jun 06 21:17:27.187151 ip-10-0-129-66 kubenswrapper[2577]: E0606 21:17:27.187131    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"868df56e09af5d1753d707837ade8d999906793b17916f30bb9f37abb51d8023\": container with ID starting with 868df56e09af5d1753d707837ade8d999906793b17916f30bb9f37abb51d8023 not found: ID does not exist" containerID="868df56e09af5d1753d707837ade8d999906793b17916f30bb9f37abb51d8023"
Jun 06 21:17:27.187194 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:27.187162    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"868df56e09af5d1753d707837ade8d999906793b17916f30bb9f37abb51d8023"} err="failed to get container status \"868df56e09af5d1753d707837ade8d999906793b17916f30bb9f37abb51d8023\": rpc error: code = NotFound desc = could not find container \"868df56e09af5d1753d707837ade8d999906793b17916f30bb9f37abb51d8023\": container with ID starting with 868df56e09af5d1753d707837ade8d999906793b17916f30bb9f37abb51d8023 not found: ID does not exist"
Jun 06 21:17:27.199215 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:27.199186    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"]
Jun 06 21:17:27.203033 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:27.203005    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-scgtv"]
Jun 06 21:17:27.205628 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:27.205607    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7n6j\" (UniqueName: \"kubernetes.io/projected/57d27c33-8a92-477b-8cb3-8a794cd6c6ab-kube-api-access-l7n6j\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 21:17:27.205691 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:27.205630    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/57d27c33-8a92-477b-8cb3-8a794cd6c6ab-extensions-socket-volume\") on node \"ip-10-0-129-66.ec2.internal\" DevicePath \"\""
Jun 06 21:17:28.060350 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:17:28.060318    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57d27c33-8a92-477b-8cb3-8a794cd6c6ab" path="/var/lib/kubelet/pods/57d27c33-8a92-477b-8cb3-8a794cd6c6ab/volumes"
Jun 06 21:18:32.861604 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:32.861562    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8x64"]
Jun 06 21:18:32.862057 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:32.861960    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab8eb344-050d-4bb1-bb95-c2b1050cfbc3" containerName="cleanup"
Jun 06 21:18:32.862057 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:32.861972    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8eb344-050d-4bb1-bb95-c2b1050cfbc3" containerName="cleanup"
Jun 06 21:18:32.862057 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:32.861993    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57d27c33-8a92-477b-8cb3-8a794cd6c6ab" containerName="manager"
Jun 06 21:18:32.862057 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:32.861999    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="57d27c33-8a92-477b-8cb3-8a794cd6c6ab" containerName="manager"
Jun 06 21:18:32.862057 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:32.862058    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab8eb344-050d-4bb1-bb95-c2b1050cfbc3" containerName="cleanup"
Jun 06 21:18:32.862231 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:32.862067    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="57d27c33-8a92-477b-8cb3-8a794cd6c6ab" containerName="manager"
Jun 06 21:18:32.866505 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:32.866488    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8x64"
Jun 06 21:18:32.869348 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:32.869330    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-px95t\""
Jun 06 21:18:32.876619 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:32.876595    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8x64"]
Jun 06 21:18:33.011434 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:33.011395    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d97caed7-38c7-4a60-aebc-c29253abaab0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q8x64\" (UID: \"d97caed7-38c7-4a60-aebc-c29253abaab0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8x64"
Jun 06 21:18:33.011434 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:33.011436    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7b24\" (UniqueName: \"kubernetes.io/projected/d97caed7-38c7-4a60-aebc-c29253abaab0-kube-api-access-l7b24\") pod \"kuadrant-operator-controller-manager-86878c769f-q8x64\" (UID: \"d97caed7-38c7-4a60-aebc-c29253abaab0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8x64"
Jun 06 21:18:33.112364 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:33.112227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d97caed7-38c7-4a60-aebc-c29253abaab0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q8x64\" (UID: \"d97caed7-38c7-4a60-aebc-c29253abaab0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8x64"
Jun 06 21:18:33.112364 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:33.112272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7b24\" (UniqueName: \"kubernetes.io/projected/d97caed7-38c7-4a60-aebc-c29253abaab0-kube-api-access-l7b24\") pod \"kuadrant-operator-controller-manager-86878c769f-q8x64\" (UID: \"d97caed7-38c7-4a60-aebc-c29253abaab0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8x64"
Jun 06 21:18:33.112668 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:33.112643    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d97caed7-38c7-4a60-aebc-c29253abaab0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q8x64\" (UID: \"d97caed7-38c7-4a60-aebc-c29253abaab0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8x64"
Jun 06 21:18:33.123306 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:33.123274    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7b24\" (UniqueName: \"kubernetes.io/projected/d97caed7-38c7-4a60-aebc-c29253abaab0-kube-api-access-l7b24\") pod \"kuadrant-operator-controller-manager-86878c769f-q8x64\" (UID: \"d97caed7-38c7-4a60-aebc-c29253abaab0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8x64"
Jun 06 21:18:33.177151 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:33.177119    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8x64"
Jun 06 21:18:33.323009 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:33.322984    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8x64"]
Jun 06 21:18:33.325969 ip-10-0-129-66 kubenswrapper[2577]: W0606 21:18:33.325939    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97caed7_38c7_4a60_aebc_c29253abaab0.slice/crio-be98dd2ce465fe09713543235069aca0fb43f8c1c9f57c4cd92d038644da0748 WatchSource:0}: Error finding container be98dd2ce465fe09713543235069aca0fb43f8c1c9f57c4cd92d038644da0748: Status 404 returned error can't find the container with id be98dd2ce465fe09713543235069aca0fb43f8c1c9f57c4cd92d038644da0748
Jun 06 21:18:33.553723 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:33.553687    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8x64" event={"ID":"d97caed7-38c7-4a60-aebc-c29253abaab0","Type":"ContainerStarted","Data":"65eb52e6c6a3af419c2a0668171c03bddcf30dfe688174136b4e39ded032c39e"}
Jun 06 21:18:33.553919 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:33.553747    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8x64" event={"ID":"d97caed7-38c7-4a60-aebc-c29253abaab0","Type":"ContainerStarted","Data":"be98dd2ce465fe09713543235069aca0fb43f8c1c9f57c4cd92d038644da0748"}
Jun 06 21:18:33.553919 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:33.553785    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8x64"
Jun 06 21:18:33.570484 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:33.570427    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8x64" podStartSLOduration=1.570407959 podStartE2EDuration="1.570407959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 21:18:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:18:33.570172469 +0000 UTC m=+1929.986984382" watchObservedRunningTime="2026-06-06 21:18:33.570407959 +0000 UTC m=+1929.987219879"
Jun 06 21:18:44.561793 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:18:44.561759    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q8x64"
Jun 06 21:21:24.220461 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:21:24.220431    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 21:21:24.224964 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:21:24.224941    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 21:26:24.257134 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:26:24.257102    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 21:26:24.264587 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:26:24.264554    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 21:28:47.968663 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:47.968620    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-dcfc9684d-fqpvc_8ce2784a-bd23-4aee-a1fa-55bf65476d9a/nginx/0.log"
Jun 06 21:28:48.208911 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:48.208887    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-csl7p_8d907397-7313-4f7e-8999-3e2215c622c6/manager/0.log"
Jun 06 21:28:48.326228 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:48.326190    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-6qcpc_4c169929-a78e-44a7-9543-e1333fb74dd8/manager/0.log"
Jun 06 21:28:48.543111 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:48.543084    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29679675-h6mb5_ab8eb344-050d-4bb1-bb95-c2b1050cfbc3/cleanup/0.log"
Jun 06 21:28:48.784162 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:48.784128    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-xfxmc_db573428-5192-410a-811e-d11075f75d8b/server/0.log"
Jun 06 21:28:48.898516 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:48.898487    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-qwrjs_c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a/manager/0.log"
Jun 06 21:28:49.248515 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:49.248489    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d755ddb6c-v4stl_75181641-b0e7-468d-bb72-6a7d70cc51a3/manager/0.log"
Jun 06 21:28:49.253967 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:49.253950    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d755ddb6c-v4stl_75181641-b0e7-468d-bb72-6a7d70cc51a3/copy-manifests/0.log"
Jun 06 21:28:49.363735 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:49.363707    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-lgp4w_445ae285-a5d2-413b-997d-99e07d5a021c/postgres/0.log"
Jun 06 21:28:50.141025 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:50.140990    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm_f67b9936-1393-40b2-afc4-60cf56381d70/util/0.log"
Jun 06 21:28:50.146691 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:50.146671    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm_f67b9936-1393-40b2-afc4-60cf56381d70/pull/0.log"
Jun 06 21:28:50.152105 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:50.152088    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm_f67b9936-1393-40b2-afc4-60cf56381d70/extract/0.log"
Jun 06 21:28:50.265061 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:50.265036    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg_07478a35-fde3-411e-9083-caace692aa14/pull/0.log"
Jun 06 21:28:50.270204 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:50.270187    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg_07478a35-fde3-411e-9083-caace692aa14/extract/0.log"
Jun 06 21:28:50.275221 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:50.275190    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg_07478a35-fde3-411e-9083-caace692aa14/util/0.log"
Jun 06 21:28:50.390200 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:50.390170    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p_297d384e-e391-4cad-b4ff-8424b48fc89b/util/0.log"
Jun 06 21:28:50.396674 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:50.396610    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p_297d384e-e391-4cad-b4ff-8424b48fc89b/pull/0.log"
Jun 06 21:28:50.403112 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:50.403092    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p_297d384e-e391-4cad-b4ff-8424b48fc89b/extract/0.log"
Jun 06 21:28:50.512861 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:50.512830    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m_98595487-eaa4-4708-b655-30d234017907/pull/0.log"
Jun 06 21:28:50.518294 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:50.518274    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m_98595487-eaa4-4708-b655-30d234017907/extract/0.log"
Jun 06 21:28:50.523716 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:50.523697    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m_98595487-eaa4-4708-b655-30d234017907/util/0.log"
Jun 06 21:28:50.875897 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:50.875864    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-pbx9b_b151ec5a-972d-4f7f-9fa4-a871facc1a87/manager/0.log"
Jun 06 21:28:51.234963 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:51.234883    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-q8x64_d97caed7-38c7-4a60-aebc-c29253abaab0/manager/0.log"
Jun 06 21:28:51.954947 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:51.954910    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-x6gds_b5c21f89-5535-464d-90c3-ae74fc45039a/discovery/0.log"
Jun 06 21:28:52.218497 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:52.218422    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccf7fd987-jmlpb_16b8132c-d9de-4ff3-ae16-1d7845972917/kube-auth-proxy/0.log"
Jun 06 21:28:52.718561 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:28:52.718534    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f6949f47-6rxkq_073b123d-ea96-4527-aadb-769c8007858e/router/0.log"
Jun 06 21:29:01.811672 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:01.811644    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gr6fv_b5f56b4d-6637-4296-9138-3b407b3c6737/global-pull-secret-syncer/0.log"
Jun 06 21:29:01.916161 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:01.916130    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rkrcj_dd6a7ac9-3f6d-403f-bb25-9ec8dc131337/konnectivity-agent/0.log"
Jun 06 21:29:01.957616 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:01.957583    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-66.ec2.internal_95af39ec743638abd6f8b98dcef4d6d0/haproxy/0.log"
Jun 06 21:29:05.229353 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:05.229324    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-q4678_07574c8e-cadd-4141-a03e-c9910cf92783/sail-operator/0.log"
Jun 06 21:29:06.041567 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:06.041535    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm_f67b9936-1393-40b2-afc4-60cf56381d70/extract/0.log"
Jun 06 21:29:06.061761 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:06.061726    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm_f67b9936-1393-40b2-afc4-60cf56381d70/util/0.log"
Jun 06 21:29:06.080075 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:06.080046    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wlvnm_f67b9936-1393-40b2-afc4-60cf56381d70/pull/0.log"
Jun 06 21:29:06.105794 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:06.105767    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg_07478a35-fde3-411e-9083-caace692aa14/extract/0.log"
Jun 06 21:29:06.133024 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:06.132994    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg_07478a35-fde3-411e-9083-caace692aa14/util/0.log"
Jun 06 21:29:06.164199 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:06.164173    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rmfdg_07478a35-fde3-411e-9083-caace692aa14/pull/0.log"
Jun 06 21:29:06.201465 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:06.201440    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p_297d384e-e391-4cad-b4ff-8424b48fc89b/extract/0.log"
Jun 06 21:29:06.220157 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:06.220127    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p_297d384e-e391-4cad-b4ff-8424b48fc89b/util/0.log"
Jun 06 21:29:06.250739 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:06.250714    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h547p_297d384e-e391-4cad-b4ff-8424b48fc89b/pull/0.log"
Jun 06 21:29:06.281621 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:06.281596    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m_98595487-eaa4-4708-b655-30d234017907/extract/0.log"
Jun 06 21:29:06.301456 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:06.301389    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m_98595487-eaa4-4708-b655-30d234017907/util/0.log"
Jun 06 21:29:06.329430 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:06.329406    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds56m_98595487-eaa4-4708-b655-30d234017907/pull/0.log"
Jun 06 21:29:06.624500 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:06.624415    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-pbx9b_b151ec5a-972d-4f7f-9fa4-a871facc1a87/manager/0.log"
Jun 06 21:29:06.755136 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:06.755104    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-q8x64_d97caed7-38c7-4a60-aebc-c29253abaab0/manager/0.log"
Jun 06 21:29:08.683653 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:08.683620    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-4xb76_39469d4f-a471-4585-aa7c-50da5c07e536/cluster-monitoring-operator/0.log"
Jun 06 21:29:08.888112 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:08.888083    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hdphs_79564215-9370-4efd-a981-a56967d41af5/node-exporter/0.log"
Jun 06 21:29:08.912069 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:08.912038    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hdphs_79564215-9370-4efd-a981-a56967d41af5/kube-rbac-proxy/0.log"
Jun 06 21:29:08.930750 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:08.930725    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hdphs_79564215-9370-4efd-a981-a56967d41af5/init-textfile/0.log"
Jun 06 21:29:09.289621 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:09.289587    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67b66fc94-hrd4k_ae7352c7-99e8-4ca6-a827-3350f3adacde/telemeter-client/0.log"
Jun 06 21:29:09.307535 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:09.307509    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67b66fc94-hrd4k_ae7352c7-99e8-4ca6-a827-3350f3adacde/reload/0.log"
Jun 06 21:29:09.327553 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:09.327528    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67b66fc94-hrd4k_ae7352c7-99e8-4ca6-a827-3350f3adacde/kube-rbac-proxy/0.log"
Jun 06 21:29:11.284453 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:11.284425    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-drjt8_69a6f7a6-2bc4-41bb-b033-62d122739350/networking-console-plugin/0.log"
Jun 06 21:29:12.602719 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:12.602685    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-hd2x6_3b4a1f36-dfbc-4006-af93-218d90da10f3/download-server/0.log"
Jun 06 21:29:14.208790 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.208754    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"]
Jun 06 21:29:14.212455 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.212434    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.215234 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.215213    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jnh9t\"/\"openshift-service-ca.crt\""
Jun 06 21:29:14.215234 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.215223    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jnh9t\"/\"kube-root-ca.crt\""
Jun 06 21:29:14.216346 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.216323    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jnh9t\"/\"default-dockercfg-6728j\""
Jun 06 21:29:14.223228 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.223204    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"]
Jun 06 21:29:14.260440 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.260409    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbrnb\" (UniqueName: \"kubernetes.io/projected/1c8c56e5-feb8-4a07-a045-b35209985ba2-kube-api-access-rbrnb\") pod \"perf-node-gather-daemonset-cxjs4\" (UID: \"1c8c56e5-feb8-4a07-a045-b35209985ba2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.260597 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.260468    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c8c56e5-feb8-4a07-a045-b35209985ba2-proc\") pod \"perf-node-gather-daemonset-cxjs4\" (UID: \"1c8c56e5-feb8-4a07-a045-b35209985ba2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.260597 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.260535    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c8c56e5-feb8-4a07-a045-b35209985ba2-podres\") pod \"perf-node-gather-daemonset-cxjs4\" (UID: \"1c8c56e5-feb8-4a07-a045-b35209985ba2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.260597 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.260580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c8c56e5-feb8-4a07-a045-b35209985ba2-lib-modules\") pod \"perf-node-gather-daemonset-cxjs4\" (UID: \"1c8c56e5-feb8-4a07-a045-b35209985ba2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.260706 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.260609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c8c56e5-feb8-4a07-a045-b35209985ba2-sys\") pod \"perf-node-gather-daemonset-cxjs4\" (UID: \"1c8c56e5-feb8-4a07-a045-b35209985ba2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.360995 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.360961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c8c56e5-feb8-4a07-a045-b35209985ba2-proc\") pod \"perf-node-gather-daemonset-cxjs4\" (UID: \"1c8c56e5-feb8-4a07-a045-b35209985ba2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.361160 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.361018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c8c56e5-feb8-4a07-a045-b35209985ba2-podres\") pod \"perf-node-gather-daemonset-cxjs4\" (UID: \"1c8c56e5-feb8-4a07-a045-b35209985ba2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.361160 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.361065    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c8c56e5-feb8-4a07-a045-b35209985ba2-lib-modules\") pod \"perf-node-gather-daemonset-cxjs4\" (UID: \"1c8c56e5-feb8-4a07-a045-b35209985ba2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.361160 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.361087    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c8c56e5-feb8-4a07-a045-b35209985ba2-proc\") pod \"perf-node-gather-daemonset-cxjs4\" (UID: \"1c8c56e5-feb8-4a07-a045-b35209985ba2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.361160 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.361112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c8c56e5-feb8-4a07-a045-b35209985ba2-sys\") pod \"perf-node-gather-daemonset-cxjs4\" (UID: \"1c8c56e5-feb8-4a07-a045-b35209985ba2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.361160 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.361156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbrnb\" (UniqueName: \"kubernetes.io/projected/1c8c56e5-feb8-4a07-a045-b35209985ba2-kube-api-access-rbrnb\") pod \"perf-node-gather-daemonset-cxjs4\" (UID: \"1c8c56e5-feb8-4a07-a045-b35209985ba2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.361418 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.361209    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c8c56e5-feb8-4a07-a045-b35209985ba2-lib-modules\") pod \"perf-node-gather-daemonset-cxjs4\" (UID: \"1c8c56e5-feb8-4a07-a045-b35209985ba2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.361418 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.361212    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c8c56e5-feb8-4a07-a045-b35209985ba2-podres\") pod \"perf-node-gather-daemonset-cxjs4\" (UID: \"1c8c56e5-feb8-4a07-a045-b35209985ba2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.361418 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.361249    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c8c56e5-feb8-4a07-a045-b35209985ba2-sys\") pod \"perf-node-gather-daemonset-cxjs4\" (UID: \"1c8c56e5-feb8-4a07-a045-b35209985ba2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.368784 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.368763    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbrnb\" (UniqueName: \"kubernetes.io/projected/1c8c56e5-feb8-4a07-a045-b35209985ba2-kube-api-access-rbrnb\") pod \"perf-node-gather-daemonset-cxjs4\" (UID: \"1c8c56e5-feb8-4a07-a045-b35209985ba2\") " pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.523500 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.523472    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:14.665111 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.665083    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"]
Jun 06 21:29:14.667011 ip-10-0-129-66 kubenswrapper[2577]: W0606 21:29:14.666978    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1c8c56e5_feb8_4a07_a045_b35209985ba2.slice/crio-e3ef7408d81858309e720db30bfbfe08890137f56a29f8475d2a044fa4d0af00 WatchSource:0}: Error finding container e3ef7408d81858309e720db30bfbfe08890137f56a29f8475d2a044fa4d0af00: Status 404 returned error can't find the container with id e3ef7408d81858309e720db30bfbfe08890137f56a29f8475d2a044fa4d0af00
Jun 06 21:29:14.690550 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.690522    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t5svn_94831dda-b834-475e-b5f8-7c9a01ce25be/dns/0.log"
Jun 06 21:29:14.718187 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.718160    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t5svn_94831dda-b834-475e-b5f8-7c9a01ce25be/kube-rbac-proxy/0.log"
Jun 06 21:29:14.823039 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:14.822959    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wx7qf_7a3a545a-09f9-43df-a03d-452a58df3e9e/dns-node-resolver/0.log"
Jun 06 21:29:15.142767 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:15.142679    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4" event={"ID":"1c8c56e5-feb8-4a07-a045-b35209985ba2","Type":"ContainerStarted","Data":"eea7d127bf0c09b7ffc528c1ee96d8871b173809b6971fa5da3220a038b91dce"}
Jun 06 21:29:15.142767 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:15.142731    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4" event={"ID":"1c8c56e5-feb8-4a07-a045-b35209985ba2","Type":"ContainerStarted","Data":"e3ef7408d81858309e720db30bfbfe08890137f56a29f8475d2a044fa4d0af00"}
Jun 06 21:29:15.142952 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:15.142772    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:15.160080 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:15.160022    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4" podStartSLOduration=1.160007408 podStartE2EDuration="1.160007408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 21:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:29:15.157756395 +0000 UTC m=+2571.574568324" watchObservedRunningTime="2026-06-06 21:29:15.160007408 +0000 UTC m=+2571.576819325"
Jun 06 21:29:15.323117 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:15.323087    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-df5d466b8-ppv2k_bdc3bf76-99e9-4b60-b194-96307d04e926/registry/0.log"
Jun 06 21:29:15.331997 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:15.331973    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-df5d466b8-ppv2k_bdc3bf76-99e9-4b60-b194-96307d04e926/registry/1.log"
Jun 06 21:29:15.396974 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:15.396898    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wlzv5_ee039af8-9795-4768-a9f3-e84e68fa3119/node-ca/0.log"
Jun 06 21:29:16.385537 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:16.385499    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-x6gds_b5c21f89-5535-464d-90c3-ae74fc45039a/discovery/0.log"
Jun 06 21:29:16.433152 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:16.433120    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccf7fd987-jmlpb_16b8132c-d9de-4ff3-ae16-1d7845972917/kube-auth-proxy/0.log"
Jun 06 21:29:16.586060 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:16.586032    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f6949f47-6rxkq_073b123d-ea96-4527-aadb-769c8007858e/router/0.log"
Jun 06 21:29:17.189078 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:17.189031    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jmz78_1a29988c-1445-4801-9656-a8f6134dcb05/serve-healthcheck-canary/0.log"
Jun 06 21:29:17.716680 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:17.716649    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9fhj4_54e8c74d-add3-475c-a43e-48e4c3e82b70/kube-rbac-proxy/0.log"
Jun 06 21:29:17.733487 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:17.733460    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9fhj4_54e8c74d-add3-475c-a43e-48e4c3e82b70/exporter/0.log"
Jun 06 21:29:17.749790 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:17.749767    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9fhj4_54e8c74d-add3-475c-a43e-48e4c3e82b70/extractor/0.log"
Jun 06 21:29:19.955996 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:19.955968    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-dcfc9684d-fqpvc_8ce2784a-bd23-4aee-a1fa-55bf65476d9a/nginx/0.log"
Jun 06 21:29:19.998962 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:19.998927    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-csl7p_8d907397-7313-4f7e-8999-3e2215c622c6/manager/0.log"
Jun 06 21:29:20.081444 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:20.081410    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-6qcpc_4c169929-a78e-44a7-9543-e1333fb74dd8/manager/0.log"
Jun 06 21:29:20.126401 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:20.126376    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29679675-h6mb5_ab8eb344-050d-4bb1-bb95-c2b1050cfbc3/cleanup/0.log"
Jun 06 21:29:20.210356 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:20.210249    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-xfxmc_db573428-5192-410a-811e-d11075f75d8b/server/0.log"
Jun 06 21:29:20.254261 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:20.254232    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-qwrjs_c3aeb0c2-bf29-45dc-9267-ab05a9df5c2a/manager/0.log"
Jun 06 21:29:20.419207 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:20.419177    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d755ddb6c-v4stl_75181641-b0e7-468d-bb72-6a7d70cc51a3/manager/0.log"
Jun 06 21:29:20.435462 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:20.435436    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d755ddb6c-v4stl_75181641-b0e7-468d-bb72-6a7d70cc51a3/copy-manifests/0.log"
Jun 06 21:29:20.456106 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:20.456074    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-lgp4w_445ae285-a5d2-413b-997d-99e07d5a021c/postgres/0.log"
Jun 06 21:29:21.158844 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:21.158818    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jnh9t/perf-node-gather-daemonset-cxjs4"
Jun 06 21:29:21.984860 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:21.984825    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-kl6w7_f14fe964-45e0-422b-bf99-2b0a01d10262/openshift-lws-operator/0.log"
Jun 06 21:29:26.815832 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:26.815789    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-x6gds_b5c21f89-5535-464d-90c3-ae74fc45039a/discovery/0.log"
Jun 06 21:29:26.841493 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:26.841467    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccf7fd987-jmlpb_16b8132c-d9de-4ff3-ae16-1d7845972917/kube-auth-proxy/0.log"
Jun 06 21:29:26.978818 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:26.978734    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f6949f47-6rxkq_073b123d-ea96-4527-aadb-769c8007858e/router/0.log"
Jun 06 21:29:28.119477 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:28.119444    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-x6gds_b5c21f89-5535-464d-90c3-ae74fc45039a/discovery/0.log"
Jun 06 21:29:28.144539 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:28.144509    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccf7fd987-jmlpb_16b8132c-d9de-4ff3-ae16-1d7845972917/kube-auth-proxy/0.log"
Jun 06 21:29:28.294457 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:28.294425    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f6949f47-6rxkq_073b123d-ea96-4527-aadb-769c8007858e/router/0.log"
Jun 06 21:29:29.005822 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:29.005798    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89fxb_909f3c74-4924-486d-b0ec-f256d44d4ae7/kube-multus-additional-cni-plugins/0.log"
Jun 06 21:29:29.023511 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:29.023475    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89fxb_909f3c74-4924-486d-b0ec-f256d44d4ae7/egress-router-binary-copy/0.log"
Jun 06 21:29:29.051813 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:29.051787    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89fxb_909f3c74-4924-486d-b0ec-f256d44d4ae7/cni-plugins/0.log"
Jun 06 21:29:29.070722 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:29.070696    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89fxb_909f3c74-4924-486d-b0ec-f256d44d4ae7/bond-cni-plugin/0.log"
Jun 06 21:29:29.093516 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:29.093487    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89fxb_909f3c74-4924-486d-b0ec-f256d44d4ae7/routeoverride-cni/0.log"
Jun 06 21:29:29.115994 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:29.115970    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89fxb_909f3c74-4924-486d-b0ec-f256d44d4ae7/whereabouts-cni-bincopy/0.log"
Jun 06 21:29:29.133209 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:29.133183    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89fxb_909f3c74-4924-486d-b0ec-f256d44d4ae7/whereabouts-cni/0.log"
Jun 06 21:29:29.497239 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:29.497213    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zqf2v_984f3c68-db04-4590-abfb-4a1e4fe904ba/kube-multus/0.log"
Jun 06 21:29:29.522632 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:29.522601    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4lgs6_896e1cee-2420-4fa5-b96b-40d4639695dc/network-metrics-daemon/0.log"
Jun 06 21:29:29.544674 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:29.544649    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4lgs6_896e1cee-2420-4fa5-b96b-40d4639695dc/kube-rbac-proxy/0.log"
Jun 06 21:29:29.915169 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:29.915077    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-x6gds_b5c21f89-5535-464d-90c3-ae74fc45039a/discovery/0.log"
Jun 06 21:29:29.940709 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:29.940677    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccf7fd987-jmlpb_16b8132c-d9de-4ff3-ae16-1d7845972917/kube-auth-proxy/0.log"
Jun 06 21:29:30.068219 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:30.068185    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f6949f47-6rxkq_073b123d-ea96-4527-aadb-769c8007858e/router/0.log"
Jun 06 21:29:30.890121 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:30.890087    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-controller/0.log"
Jun 06 21:29:30.902977 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:30.902945    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/1.log"
Jun 06 21:29:30.902977 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:30.902980    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovn-acl-logging/0.log"
Jun 06 21:29:30.921541 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:30.921516    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/kube-rbac-proxy-node/0.log"
Jun 06 21:29:30.938293 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:30.938269    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/kube-rbac-proxy-ovn-metrics/0.log"
Jun 06 21:29:30.951308 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:30.951283    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/northd/0.log"
Jun 06 21:29:30.969618 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:30.969592    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/nbdb/0.log"
Jun 06 21:29:30.985583 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:30.985561    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/sbdb/0.log"
Jun 06 21:29:31.028354 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:31.028326    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f47nm_3e84fe71-ac8f-4694-aacd-0bddfb8ebfd2/ovnkube-controller/0.log"
Jun 06 21:29:32.150259 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:32.150228    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-x6gds_b5c21f89-5535-464d-90c3-ae74fc45039a/discovery/0.log"
Jun 06 21:29:32.182068 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:32.182039    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccf7fd987-jmlpb_16b8132c-d9de-4ff3-ae16-1d7845972917/kube-auth-proxy/0.log"
Jun 06 21:29:32.311894 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:32.311864    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f6949f47-6rxkq_073b123d-ea96-4527-aadb-769c8007858e/router/0.log"
Jun 06 21:29:32.410142 ip-10-0-129-66 kubenswrapper[2577]: I0606 21:29:32.410066    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xdz66_2903038a-8636-4ffc-b799-46bea55ec8ba/network-check-target-container/0.log"