Jun 16 19:49:36.232993 ip-10-0-134-77 systemd[1]: Starting Kubernetes Kubelet... Jun 16 19:49:36.643370 ip-10-0-134-77 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 16 19:49:36.643370 ip-10-0-134-77 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 16 19:49:36.643370 ip-10-0-134-77 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 16 19:49:36.643370 ip-10-0-134-77 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 16 19:49:36.643370 ip-10-0-134-77 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 16 19:49:36.644600 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.644492 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 16 19:49:36.648268 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648250 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:49:36.648268 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648268 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648272 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648276 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648279 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648282 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648285 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648288 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648291 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648293 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648296 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648299 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648302 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648305 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648308 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648310 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648313 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648315 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648318 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648321 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:49:36.648338 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648325 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648329 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648332 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648335 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648345 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648349 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648352 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648355 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648358 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648361 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648363 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648366 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648369 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648372 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648374 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648377 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648380 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648382 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648385 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648388 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:49:36.648818 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648390 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648393 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648395 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648398 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648401 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648403 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648405 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648408 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648410 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648412 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648414 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648417 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648419 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648421 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648425 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648427 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648430 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648432 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648435 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648437 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:49:36.649286 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648440 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648442 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648444 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648447 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648449 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648452 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648454 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648457 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648459 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648461 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648464 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648467 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648470 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648473 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648475 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648478 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648480 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648482 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648485 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648488 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:49:36.649791 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648490 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648492 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648495 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648498 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648500 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648504 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648508 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648511 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648514 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648517 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648519 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648522 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648524 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648526 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648529 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648531 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648534 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648536 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.648539 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:49:36.650303 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649240 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649246 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649249 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649252 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649255 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649258 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649260 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649263 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649266 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649268 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649271 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649274 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649276 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649279 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649281 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649283 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649286 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649288 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649291 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649295 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:49:36.650781 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649298 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649301 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649303 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649306 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649308 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649310 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649313 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649316 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649318 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649322 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649325 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649328 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649332 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649334 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649339 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649342 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649345 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649348 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649351 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:49:36.651352 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649354 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649356 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649359 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649362 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649365 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649368 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649370 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649373 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649375 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649378 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649380 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649383 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649386 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649389 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649391 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649394 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649396 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649399 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649401 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649404 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:49:36.651848 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649406 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649408 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649411 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649413 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649416 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649419 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649421 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649424 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649426 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649429 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649440 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649444 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649447 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649450 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649454 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649457 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649460 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649462 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649465 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:49:36.652341 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649467 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649469 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649472 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649474 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649477 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649481 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649483 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649486 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649489 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649491 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649494 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649496 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649498 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649501 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649503 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649506 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649508 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649510 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649513 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649515 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:49:36.652851 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649518 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649902 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649907 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649909 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649912 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649915 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649918 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649921 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649923 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649925 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649928 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649931 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649933 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649936 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649938 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649941 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649943 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649946 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649949 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:49:36.653351 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649953 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649957 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649959 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649963 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649965 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649968 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649971 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649974 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649976 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649979 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649981 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649984 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649987 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649990 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649992 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649995 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649997 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.649999 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650002 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650005 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:49:36.653827 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650007 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650010 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650012 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650014 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650017 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650019 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650021 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650024 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650026 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650029 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650033 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650036 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650039 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650041 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650044 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650046 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650050 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650053 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650057 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:49:36.654305 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650059 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650062 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650065 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650067 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650070 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650072 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650075 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650077 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650080 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650083 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650085 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650088 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650090 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650094 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650097 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650099 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650101 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650103 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650106 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650109 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:49:36.654820 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650111 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650113 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650116 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650119 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650121 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650124 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650126 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650128 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650131 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650134 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650136 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650138 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650141 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650143 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650146 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650148 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650151 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650153 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650155 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650158 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:49:36.655332 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650162 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650165 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650246 2557 flags.go:64] FLAG: --address="0.0.0.0" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650257 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650263 2557 flags.go:64] FLAG: --anonymous-auth="true" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650267 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650272 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650276 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650280 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650284 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650287 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650290 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650293 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650297 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650300 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650303 2557 flags.go:64] FLAG: --cgroup-root="" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650306 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650309 2557 flags.go:64] FLAG: --client-ca-file="" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650311 2557 flags.go:64] FLAG: --cloud-provider="external" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650314 2557 flags.go:64] FLAG: --cluster-dns="[]" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650319 2557 flags.go:64] FLAG: --cluster-domain="" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650322 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650344 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650349 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 16 19:49:36.655828 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650352 2557 flags.go:64] FLAG: --container-log-max-files="5" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650356 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650360 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650363 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650366 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650369 2557 flags.go:64] FLAG: --contention-profiling="false" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650372 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650374 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650379 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650382 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650386 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650389 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650392 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650394 2557 flags.go:64] FLAG: --enable-load-reader="false" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650397 2557 flags.go:64] FLAG: --enable-server="true" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650401 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650405 2557 flags.go:64] FLAG: --event-burst="100" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650408 2557 flags.go:64] FLAG: --event-qps="50" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650410 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650414 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650417 2557 flags.go:64] FLAG: --eviction-hard="" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650420 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650423 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650426 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650429 2557 flags.go:64] FLAG: --eviction-soft="" Jun 16 19:49:36.656441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650431 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650434 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650438 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650441 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650443 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650446 2557 flags.go:64] FLAG: --fail-swap-on="true" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650449 2557 flags.go:64] FLAG: --feature-gates="" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650452 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650455 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650458 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650461 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650463 2557 flags.go:64] FLAG: --healthz-port="10248" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650466 2557 flags.go:64] FLAG: --help="false" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650469 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-134-77.ec2.internal" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650472 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650476 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650479 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650483 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650486 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650488 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650491 2557 flags.go:64] FLAG: --image-service-endpoint="" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650494 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650496 2557 flags.go:64] FLAG: --kube-api-burst="100" Jun 16 19:49:36.657052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650499 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650502 2557 flags.go:64] FLAG: --kube-api-qps="50" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650505 2557 flags.go:64] FLAG: --kube-reserved="" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650508 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650511 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650514 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650517 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650520 2557 flags.go:64] FLAG: --lock-file="" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650522 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650525 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650528 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650534 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650536 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650539 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650542 2557 flags.go:64] FLAG: --logging-format="text" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650544 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650547 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650550 2557 flags.go:64] FLAG: --manifest-url="" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650553 2557 flags.go:64] FLAG: --manifest-url-header="" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650557 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650560 2557 flags.go:64] FLAG: --max-open-files="1000000" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650579 2557 flags.go:64] FLAG: --max-pods="110" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650581 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650584 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650589 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jun 16 19:49:36.657691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650591 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650594 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650597 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650600 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650607 2557 flags.go:64] FLAG: --node-status-max-images="50" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650611 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650613 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650616 2557 flags.go:64] FLAG: --pod-cidr="" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650620 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650626 2557 flags.go:64] FLAG: --pod-manifest-path="" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650628 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650632 2557 flags.go:64] FLAG: --pods-per-core="0" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650635 2557 flags.go:64] FLAG: --port="10250" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650638 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650641 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d66ba3cd28c999c3" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650644 2557 flags.go:64] FLAG: --qos-reserved="" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650647 2557 flags.go:64] FLAG: --read-only-port="10255" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650649 2557 flags.go:64] FLAG: --register-node="true" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650652 2557 flags.go:64] FLAG: --register-with-taints="" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650656 2557 flags.go:64] FLAG: --registry-burst="10" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650658 2557 flags.go:64] FLAG: --registry-qps="5" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650661 2557 flags.go:64] FLAG: --reserved-cpus="" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650664 2557 flags.go:64] FLAG: --reserved-memory="" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650667 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650670 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 16 19:49:36.658308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650673 2557 flags.go:64] FLAG: --rotate-certificates="false" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650675 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650678 2557 flags.go:64] FLAG: --runonce="false" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650681 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650684 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650686 2557 flags.go:64] FLAG: --seccomp-default="false" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650690 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650693 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650696 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650699 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650702 2557 flags.go:64] FLAG: --storage-driver-password="root" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650705 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650708 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650710 2557 flags.go:64] FLAG: --storage-driver-user="root" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650713 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650716 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650719 2557 flags.go:64] FLAG: --system-cgroups="" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650722 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650727 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650730 2557 flags.go:64] FLAG: --tls-cert-file="" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650733 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650737 2557 flags.go:64] FLAG: --tls-min-version="" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650739 2557 flags.go:64] FLAG: --tls-private-key-file="" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650742 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650745 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 16 19:49:36.658912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650747 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650750 2557 flags.go:64] FLAG: --v="2" Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650754 2557 flags.go:64] FLAG: --version="false" Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650757 2557 flags.go:64] FLAG: --vmodule="" Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650761 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.650764 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650877 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650880 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650883 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650886 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650888 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650891 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650893 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650897 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650900 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650902 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650904 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650908 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650910 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650912 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650915 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:49:36.659514 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650918 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650922 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650925 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650928 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650932 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650935 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650938 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650940 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650943 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650945 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650948 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650950 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650952 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650955 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650957 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650960 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650962 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650965 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650967 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650970 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:49:36.660061 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650972 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650975 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650977 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650980 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650983 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650986 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650988 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650990 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650993 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650996 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.650998 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651000 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651003 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651005 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651007 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651010 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651014 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651016 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651019 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651021 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:49:36.660537 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651024 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651026 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651029 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651031 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651033 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651037 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651040 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651043 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651046 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651049 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651052 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651055 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651057 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651059 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651062 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651064 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651068 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651071 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651073 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:49:36.661063 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651076 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651078 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651082 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651085 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651088 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651090 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651093 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651095 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651097 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651101 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651104 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651106 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651109 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651111 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651114 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651116 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651119 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651121 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651124 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:49:36.661532 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651126 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:49:36.662098 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651129 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:49:36.662098 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651131 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:49:36.662098 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651133 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:49:36.662098 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651136 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:49:36.662098 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.651138 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:49:36.662098 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.651778 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 16 19:49:36.662098 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.658557 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 16 19:49:36.662098 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.658589 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 16 19:49:36.662098 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.659400 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 16 19:49:36.662098 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.659410 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 16 19:49:36.662098 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659467 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:49:36.662098 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659471 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:49:36.662098 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659474 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:49:36.662098 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659477 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:49:36.662098 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659480 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659483 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659486 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659489 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659491 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659493 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659496 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659498 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659501 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659504 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659506 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659509 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659511 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659513 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659516 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659518 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659521 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659523 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659526 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659529 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:49:36.662462 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659531 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659534 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659536 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659538 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659541 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659544 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659547 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659549 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659552 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659556 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659560 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659579 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659583 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659586 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659589 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659592 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659594 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659598 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659602 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:49:36.662978 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659605 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659608 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659610 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659613 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659616 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659618 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659620 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659623 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659625 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659628 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659630 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659632 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659635 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659638 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659640 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659642 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659645 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659647 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659665 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:49:36.663443 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659669 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659673 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659677 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659680 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659682 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659685 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659688 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659690 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659693 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659695 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659697 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659700 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659702 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659705 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659707 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659710 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659713 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659715 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659718 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659720 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:49:36.663902 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659723 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:49:36.664390 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659725 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:49:36.664390 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659727 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:49:36.664390 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659730 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:49:36.664390 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659732 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:49:36.664390 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659735 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:49:36.664390 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659737 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:49:36.664390 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659740 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:49:36.664390 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659743 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:49:36.664390 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659745 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:49:36.664390 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659747 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:49:36.664390 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659750 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:49:36.664390 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659752 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:49:36.664390 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659756 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:49:36.664390 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659758 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:49:36.664390 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659760 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:49:36.664390 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659763 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:49:36.664801 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.659767 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 16 19:49:36.664801 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659895 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:49:36.664801 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659901 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:49:36.664801 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659905 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:49:36.664801 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659908 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:49:36.664801 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659911 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:49:36.664801 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659914 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:49:36.664801 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659916 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:49:36.664801 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659919 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:49:36.664801 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659921 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:49:36.664801 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659924 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:49:36.664801 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659926 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:49:36.664801 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659929 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:49:36.664801 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659931 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659934 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659936 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659939 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659942 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659945 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659948 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659950 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659952 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659954 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659957 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659959 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659961 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659964 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659966 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659969 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659972 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659974 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659977 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659979 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:49:36.665151 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659982 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659984 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659986 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659989 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659991 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659993 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659996 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.659998 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660001 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660003 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660006 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660008 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660011 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660013 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660015 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660018 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660020 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660022 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660025 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660027 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:49:36.665719 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660030 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660032 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660034 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660037 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660039 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660041 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660044 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660046 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660049 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660051 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660054 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660056 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660058 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660061 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660063 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660066 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660068 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660071 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660073 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660076 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:49:36.666201 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660078 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660081 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660083 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660086 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660090 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660093 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660095 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660097 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660100 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660102 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660104 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660106 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660109 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660112 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660114 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660118 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660121 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660124 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660126 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660129 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:49:36.666698 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660132 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:49:36.667190 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660134 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:49:36.667190 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660137 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:49:36.667190 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660140 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:49:36.667190 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660142 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:49:36.667190 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660144 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:49:36.667190 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:36.660147 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:49:36.667190 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.660151 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 16 19:49:36.667190 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.660248 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jun 16 19:49:36.667190 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.665500 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 16 19:49:36.667190 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.667093 2557 server.go:1019] "Starting client certificate rotation" Jun 16 19:49:36.667446 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.667187 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 16 19:49:36.667446 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.667218 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 16 19:49:36.672215 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.672195 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 16 19:49:36.673365 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.673345 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 16 19:49:36.686179 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.686164 2557 log.go:25] "Validated CRI v1 runtime API" Jun 16 19:49:36.689807 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.689793 2557 log.go:25] "Validated CRI v1 image API" Jun 16 19:49:36.690639 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.690625 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 16 19:49:36.696431 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.696412 2557 fs.go:135] Filesystem UUIDs: map[01eec40b-0ead-497e-b1a4-239119fb4f3d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8f2bc148-7ac2-4168-b9a8-1728c30fa548:/dev/nvme0n1p3] Jun 16 19:49:36.696481 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.696430 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 16 19:49:36.701762 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.701660 2557 manager.go:216] Machine: {Timestamp:2026-06-16 19:49:36.701140817 +0000 UTC m=+0.353971431 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097801 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ef89856135b04eb3d1ccb73c1c3a1 SystemUUID:ec2ef898-5613-5b04-eb3d-1ccb73c1c3a1 BootID:f2b4a66c-f865-4027-9456-dbaec99e347a Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:27:7b:aa:1f:eb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:27:7b:aa:1f:eb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:73:13:3c:58:8b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 16 19:49:36.701762 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.701759 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 16 19:49:36.701861 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.701836 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 16 19:49:36.705350 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.705322 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 16 19:49:36.705502 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.705355 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-77.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 16 19:49:36.706283 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.706272 2557 topology_manager.go:138] "Creating topology manager with none policy" Jun 16 19:49:36.706317 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.706285 2557 container_manager_linux.go:309] "Creating device plugin manager" Jun 16 19:49:36.706317 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.706293 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 16 19:49:36.706989 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.706979 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 16 19:49:36.708903 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.708892 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 16 19:49:36.713345 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.713333 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 16 19:49:36.713472 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.713462 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 16 19:49:36.713860 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.713850 2557 kubelet.go:486] "Attempting to sync node with API server" Jun 16 19:49:36.713914 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.713863 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 16 19:49:36.713914 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.713874 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 16 19:49:36.713914 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.713882 2557 kubelet.go:398] "Adding apiserver pod source" Jun 16 19:49:36.713914 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.713891 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 16 19:49:36.714241 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.714230 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 16 19:49:36.718022 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.717995 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 16 19:49:36.718312 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.718290 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 16 19:49:36.721714 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.721691 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 16 19:49:36.723698 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.723674 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 16 19:49:36.723755 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.723727 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 16 19:49:36.724611 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.724600 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 16 19:49:36.724658 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.724617 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 16 19:49:36.724658 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.724623 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 16 19:49:36.724658 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.724629 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 16 19:49:36.724658 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.724638 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 16 19:49:36.724658 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.724644 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 16 19:49:36.724658 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.724652 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 16 19:49:36.724658 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.724657 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 16 19:49:36.724914 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.724664 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 16 19:49:36.724914 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.724669 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 16 19:49:36.724914 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.724677 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 16 19:49:36.724914 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.724682 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 16 19:49:36.724914 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.724707 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 16 19:49:36.724914 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.724712 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 16 19:49:36.728410 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.728396 2557 server.go:1268] "Started kubelet" Jun 16 19:49:36.728739 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.728712 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 16 19:49:36.729100 ip-10-0-134-77 systemd[1]: Started Kubernetes Kubelet. Jun 16 19:49:36.729710 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.729081 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 16 19:49:36.729710 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.729176 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 16 19:49:36.729710 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.729252 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-77.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 16 19:49:36.730059 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.730021 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 16 19:49:36.730105 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.730023 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 16 19:49:36.731326 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.731307 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 16 19:49:36.731597 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.731581 2557 server.go:310] "Adding debug handlers to kubelet server" Jun 16 19:49:36.734912 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.733811 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d7be3043 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.728371267 +0000 UTC m=+0.381201860,LastTimestamp:2026-06-16 19:49:36.728371267 +0000 UTC m=+0.381201860,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.736171 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.736148 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 16 19:49:36.738070 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.738055 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 16 19:49:36.738144 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.738074 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 16 19:49:36.738229 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.738212 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-77.ec2.internal\" not found" Jun 16 19:49:36.738832 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.738811 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 16 19:49:36.738832 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.738835 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 16 19:49:36.738975 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.738815 2557 factory.go:55] Registering systemd factory Jun 16 19:49:36.738975 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.738876 2557 factory.go:223] Registration of the systemd container factory successfully Jun 16 19:49:36.738975 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.738814 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 16 19:49:36.739087 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.739050 2557 factory.go:153] Registering CRI-O factory Jun 16 19:49:36.739087 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.739060 2557 factory.go:223] Registration of the crio container factory successfully Jun 16 19:49:36.739173 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.739109 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 16 19:49:36.739173 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.739139 2557 factory.go:103] Registering Raw factory Jun 16 19:49:36.739173 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.739154 2557 manager.go:1196] Started watching for new ooms in manager Jun 16 19:49:36.739629 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.739612 2557 manager.go:349] Starting recovery of all containers Jun 16 19:49:36.739998 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.739836 2557 reconstruct.go:97] "Volume reconstruction finished" Jun 16 19:49:36.740088 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.740070 2557 reconciler.go:29] "Reconciler: start to sync state" Jun 16 19:49:36.740830 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.740808 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 16 19:49:36.741218 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.741189 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 16 19:49:36.751536 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.751372 2557 manager.go:354] Recovery completed Jun 16 19:49:36.755592 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.755558 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:36.757594 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.757560 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:36.757685 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.757605 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:36.757685 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.757615 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:36.758177 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.758164 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 16 19:49:36.758177 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.758176 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 16 19:49:36.758264 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.758192 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 16 19:49:36.758264 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.758223 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:36.758849 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.758833 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:36.758937 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.758857 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:36.758937 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.758867 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:36.760318 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.760305 2557 policy_none.go:49] "None policy: Start" Jun 16 19:49:36.760379 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.760321 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 16 19:49:36.760379 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.760331 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 16 19:49:36.762289 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.762278 2557 policy_none.go:47] "Start" Jun 16 19:49:36.768541 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.768474 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c12ff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757592831 +0000 UTC m=+0.410423428,LastTimestamp:2026-06-16 19:49:36.757592831 +0000 UTC m=+0.410423428,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.771960 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.771903 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c56ad default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757610157 +0000 UTC m=+0.410440751,LastTimestamp:2026-06-16 19:49:36.757610157 +0000 UTC m=+0.410440751,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.780852 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.780793 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c7a71 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757619313 +0000 UTC m=+0.410449907,LastTimestamp:2026-06-16 19:49:36.757619313 +0000 UTC m=+0.410449907,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.784144 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.784066 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c12ff\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c12ff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757592831 +0000 UTC m=+0.410423428,LastTimestamp:2026-06-16 19:49:36.758846102 +0000 UTC m=+0.411676696,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.790983 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.790901 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c56ad\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c56ad default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757610157 +0000 UTC m=+0.410440751,LastTimestamp:2026-06-16 19:49:36.758861785 +0000 UTC m=+0.411692378,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.793929 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.793873 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c7a71\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c7a71 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757619313 +0000 UTC m=+0.410449907,LastTimestamp:2026-06-16 19:49:36.758870876 +0000 UTC m=+0.411701469,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.800330 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.800317 2557 manager.go:337] "Starting Device Plugin manager" Jun 16 19:49:36.823133 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.800351 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 16 19:49:36.823133 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.800364 2557 server.go:87] "Starting device plugin registration server" Jun 16 19:49:36.823133 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.800653 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 16 19:49:36.823133 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.800663 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 16 19:49:36.823133 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.800763 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 16 19:49:36.823133 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.800834 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 16 19:49:36.823133 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.800845 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 16 19:49:36.823133 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.801445 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 16 19:49:36.823133 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.801490 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-77.ec2.internal\" not found" Jun 16 19:49:36.823133 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.804840 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792dc2a133b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.802550587 +0000 UTC m=+0.455381168,LastTimestamp:2026-06-16 19:49:36.802550587 +0000 UTC m=+0.455381168,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.823133 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.813008 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 16 19:49:36.823133 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.814303 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 16 19:49:36.823133 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.814339 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 16 19:49:36.823133 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.814359 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jun 16 19:49:36.823133 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.814389 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 16 19:49:36.823133 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.819022 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ns57g" Jun 16 19:49:36.832735 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.832715 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 16 19:49:36.901213 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.901149 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:36.902211 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.902188 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:36.902307 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.902227 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:36.902307 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.902243 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:36.902307 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.902267 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:36.911861 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.911795 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c12ff\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c12ff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757592831 +0000 UTC m=+0.410423428,LastTimestamp:2026-06-16 19:49:36.902209865 +0000 UTC m=+0.555040464,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.914578 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.914540 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal"] Jun 16 19:49:36.914661 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.914635 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:36.916072 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.916048 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:36.916157 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.916082 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:36.916157 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.916097 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:36.918259 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.918246 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:36.918368 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.918354 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 16 19:49:36.918427 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.918386 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:36.918898 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.918883 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:36.918976 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.918915 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:36.918976 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.918930 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:36.918976 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.918930 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:36.918976 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.918952 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:36.918976 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.918969 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:36.919447 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.919425 2557 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:36.919813 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.919735 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c56ad\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c56ad default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757610157 +0000 UTC m=+0.410440751,LastTimestamp:2026-06-16 19:49:36.902234836 +0000 UTC m=+0.555065433,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.921045 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.921027 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" Jun 16 19:49:36.921117 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.921061 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:36.921713 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.921698 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:36.921784 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.921736 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:36.921784 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.921746 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:36.922184 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.922095 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c7a71\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c7a71 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757619313 +0000 UTC m=+0.410449907,LastTimestamp:2026-06-16 19:49:36.902247677 +0000 UTC m=+0.555078271,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.933441 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.933377 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c12ff\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c12ff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757592831 +0000 UTC m=+0.410423428,LastTimestamp:2026-06-16 19:49:36.916066575 +0000 UTC m=+0.568897175,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.938812 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.938752 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c56ad\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c56ad default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757610157 +0000 UTC m=+0.410440751,LastTimestamp:2026-06-16 19:49:36.916089748 +0000 UTC m=+0.568920341,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.941498 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.941478 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc6da1b13bca282ef865b3244f5b60b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal\" (UID: \"cc6da1b13bca282ef865b3244f5b60b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 16 19:49:36.941628 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.941504 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc6da1b13bca282ef865b3244f5b60b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal\" (UID: \"cc6da1b13bca282ef865b3244f5b60b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 16 19:49:36.941628 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:36.941522 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9d047301ade34e187f662d0538c7f23-config\") pod \"kube-apiserver-proxy-ip-10-0-134-77.ec2.internal\" (UID: \"b9d047301ade34e187f662d0538c7f23\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" Jun 16 19:49:36.944982 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.944964 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms" Jun 16 19:49:36.945157 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.945098 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c7a71\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c7a71 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757619313 +0000 UTC m=+0.410449907,LastTimestamp:2026-06-16 19:49:36.916101611 +0000 UTC m=+0.568932204,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.950273 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.950255 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-77.ec2.internal\" not found" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:36.950905 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.950850 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c12ff\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c12ff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757592831 +0000 UTC m=+0.410423428,LastTimestamp:2026-06-16 19:49:36.918897112 +0000 UTC m=+0.571727706,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.954912 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.954895 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-77.ec2.internal\" not found" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:36.959861 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.959809 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c56ad\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c56ad default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757610157 +0000 UTC m=+0.410440751,LastTimestamp:2026-06-16 19:49:36.918921777 +0000 UTC m=+0.571752372,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.971247 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.971191 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c7a71\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c7a71 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757619313 +0000 UTC m=+0.410449907,LastTimestamp:2026-06-16 19:49:36.918935888 +0000 UTC m=+0.571766488,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.989717 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.989655 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c12ff\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c12ff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757592831 +0000 UTC m=+0.410423428,LastTimestamp:2026-06-16 19:49:36.918941375 +0000 UTC m=+0.571771969,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:36.999603 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:36.999536 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c56ad\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c56ad default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757610157 +0000 UTC m=+0.410440751,LastTimestamp:2026-06-16 19:49:36.918957803 +0000 UTC m=+0.571788398,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:37.009748 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:37.009697 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c7a71\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c7a71 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757619313 +0000 UTC m=+0.410449907,LastTimestamp:2026-06-16 19:49:36.918975015 +0000 UTC m=+0.571805613,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:37.019192 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:37.019135 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c12ff\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c12ff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757592831 +0000 UTC m=+0.410423428,LastTimestamp:2026-06-16 19:49:36.92171202 +0000 UTC m=+0.574542613,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:37.032248 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:37.032188 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c56ad\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c56ad default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757610157 +0000 UTC m=+0.410440751,LastTimestamp:2026-06-16 19:49:36.921741305 +0000 UTC m=+0.574571898,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:37.041676 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.041653 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc6da1b13bca282ef865b3244f5b60b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal\" (UID: \"cc6da1b13bca282ef865b3244f5b60b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 16 19:49:37.041765 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.041679 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc6da1b13bca282ef865b3244f5b60b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal\" (UID: \"cc6da1b13bca282ef865b3244f5b60b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 16 19:49:37.041765 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.041694 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9d047301ade34e187f662d0538c7f23-config\") pod \"kube-apiserver-proxy-ip-10-0-134-77.ec2.internal\" (UID: \"b9d047301ade34e187f662d0538c7f23\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" Jun 16 19:49:37.041765 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.041739 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9d047301ade34e187f662d0538c7f23-config\") pod \"kube-apiserver-proxy-ip-10-0-134-77.ec2.internal\" (UID: \"b9d047301ade34e187f662d0538c7f23\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" Jun 16 19:49:37.041765 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.041751 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cc6da1b13bca282ef865b3244f5b60b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal\" (UID: \"cc6da1b13bca282ef865b3244f5b60b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 16 19:49:37.041888 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.041780 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc6da1b13bca282ef865b3244f5b60b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal\" (UID: \"cc6da1b13bca282ef865b3244f5b60b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 16 19:49:37.041939 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:37.041871 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c7a71\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c7a71 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757619313 +0000 UTC m=+0.410449907,LastTimestamp:2026-06-16 19:49:36.921749713 +0000 UTC m=+0.574580308,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:37.119963 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.119932 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:37.120996 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.120979 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:37.121073 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.121011 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:37.121073 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.121024 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:37.121073 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.121050 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:37.134968 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:37.134899 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c12ff\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c12ff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757592831 +0000 UTC m=+0.410423428,LastTimestamp:2026-06-16 19:49:37.120995798 +0000 UTC m=+0.773826395,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:37.146541 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:37.146517 2557 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:37.148027 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:37.146880 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-77.ec2.internal.18b9a792d97c56ad\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-77.ec2.internal.18b9a792d97c56ad default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-77.ec2.internal,UID:ip-10-0-134-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-77.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:36.757610157 +0000 UTC m=+0.410440751,LastTimestamp:2026-06-16 19:49:37.121018353 +0000 UTC m=+0.773848947,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:37.253811 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.253747 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 16 19:49:37.260059 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.260037 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" Jun 16 19:49:37.354115 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:37.354086 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="800ms" Jun 16 19:49:37.547296 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.547224 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:37.548485 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.548466 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:37.548608 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.548501 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:37.548608 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.548512 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:37.548608 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.548538 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:37.563189 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:37.563161 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 16 19:49:37.569460 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:37.569440 2557 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:37.732478 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.732452 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-77.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 16 19:49:37.884620 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.884556 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:37.885544 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.885526 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:37.885619 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.885559 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:37.885619 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.885591 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:37.903672 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:37.903646 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d047301ade34e187f662d0538c7f23.slice/crio-0c923ee8661069c1f5e24f1aaea479c092a22b2ed4e6025528ce302b8e3c0ae4 WatchSource:0}: Error finding container 0c923ee8661069c1f5e24f1aaea479c092a22b2ed4e6025528ce302b8e3c0ae4: Status 404 returned error can't find the container with id 0c923ee8661069c1f5e24f1aaea479c092a22b2ed4e6025528ce302b8e3c0ae4 Jun 16 19:49:37.903847 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:37.903826 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc6da1b13bca282ef865b3244f5b60b1.slice/crio-0fb07423d6dff6cdf7eef846831d321ae843c26e1410a9dcdde2928905b475a0 WatchSource:0}: Error finding container 0fb07423d6dff6cdf7eef846831d321ae843c26e1410a9dcdde2928905b475a0: Status 404 returned error can't find the container with id 0fb07423d6dff6cdf7eef846831d321ae843c26e1410a9dcdde2928905b475a0 Jun 16 19:49:37.910024 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:37.910004 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 16 19:49:37.919973 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:37.919903 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal.18b9a7931e2fbd74 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal,UID:cc6da1b13bca282ef865b3244f5b60b1,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f37f2309807dd6fa95f93965bbd2f7bc61a1279f57f9c60a6c55e4269e765fa4\",Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:37.9102181 +0000 UTC m=+1.563048680,LastTimestamp:2026-06-16 19:49:37.9102181 +0000 UTC m=+1.563048680,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:37.929260 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:37.929198 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-134-77.ec2.internal.18b9a7931e30948f kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-134-77.ec2.internal,UID:b9d047301ade34e187f662d0538c7f23,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:68c43f6705263ac9281e11c8a7628b5a094439fd5433a540504fa88630506200\",Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:37.910273167 +0000 UTC m=+1.563103749,LastTimestamp:2026-06-16 19:49:37.910273167 +0000 UTC m=+1.563103749,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:37.982662 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:37.982637 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 16 19:49:38.140333 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:38.140260 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 16 19:49:38.165720 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:38.165694 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="1.6s" Jun 16 19:49:38.370294 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:38.370263 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:38.371167 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:38.371150 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:38.371237 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:38.371184 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:38.371237 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:38.371194 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:38.371237 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:38.371220 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:38.379973 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:38.379943 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 16 19:49:38.385615 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:38.383139 2557 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:38.731951 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:38.731919 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-77.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 16 19:49:38.819755 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:38.819670 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" event={"ID":"cc6da1b13bca282ef865b3244f5b60b1","Type":"ContainerStarted","Data":"0fb07423d6dff6cdf7eef846831d321ae843c26e1410a9dcdde2928905b475a0"} Jun 16 19:49:38.820946 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:38.820924 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" event={"ID":"b9d047301ade34e187f662d0538c7f23","Type":"ContainerStarted","Data":"0c923ee8661069c1f5e24f1aaea479c092a22b2ed4e6025528ce302b8e3c0ae4"} Jun 16 19:49:39.738689 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:39.738658 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-77.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 16 19:49:39.777470 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:39.777429 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="3.2s" Jun 16 19:49:39.983666 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:39.983615 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:39.984780 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:39.984756 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:39.984889 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:39.984797 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:39.984889 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:39.984812 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:39.984889 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:39.984850 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:40.003504 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:40.003448 2557 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:40.141698 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:40.141659 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 16 19:49:40.177725 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:40.177690 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 16 19:49:40.282372 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:40.282287 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:40.283336 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:40.283314 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:40.283467 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:40.283346 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:40.283467 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:40.283363 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:40.367757 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:40.367656 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal.18b9a793b010db6b openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal,UID:cc6da1b13bca282ef865b3244f5b60b1,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f37f2309807dd6fa95f93965bbd2f7bc61a1279f57f9c60a6c55e4269e765fa4\" in 2.447s (2.447s including waiting). Image size: 292840757 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:40.357667691 +0000 UTC m=+4.010498294,LastTimestamp:2026-06-16 19:49:40.357667691 +0000 UTC m=+4.010498294,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:40.410547 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:40.410439 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-134-77.ec2.internal.18b9a793b29a7f06 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-134-77.ec2.internal,UID:b9d047301ade34e187f662d0538c7f23,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:68c43f6705263ac9281e11c8a7628b5a094439fd5433a540504fa88630506200\" in 2.489s (2.489s including waiting). Image size: 331817635 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:40.400242438 +0000 UTC m=+4.053073019,LastTimestamp:2026-06-16 19:49:40.400242438 +0000 UTC m=+4.053073019,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:40.480872 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:40.480796 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-134-77.ec2.internal.18b9a793b6d523bb kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-134-77.ec2.internal,UID:b9d047301ade34e187f662d0538c7f23,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Created,Message:Created container: haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:40.471194555 +0000 UTC m=+4.124025154,LastTimestamp:2026-06-16 19:49:40.471194555 +0000 UTC m=+4.124025154,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:40.491035 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:40.490945 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-134-77.ec2.internal.18b9a793b74ad96e kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-134-77.ec2.internal,UID:b9d047301ade34e187f662d0538c7f23,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Started,Message:Started container haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:40.478908782 +0000 UTC m=+4.131739387,LastTimestamp:2026-06-16 19:49:40.478908782 +0000 UTC m=+4.131739387,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:40.491165 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:40.491148 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 16 19:49:40.672016 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:40.671815 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal.18b9a793c23c8a3f openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal,UID:cc6da1b13bca282ef865b3244f5b60b1,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:40.662520383 +0000 UTC m=+4.315350964,LastTimestamp:2026-06-16 19:49:40.662520383 +0000 UTC m=+4.315350964,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:40.682093 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:40.682002 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal.18b9a793c2c088ba openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal,UID:cc6da1b13bca282ef865b3244f5b60b1,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:40.671170746 +0000 UTC m=+4.324001349,LastTimestamp:2026-06-16 19:49:40.671170746 +0000 UTC m=+4.324001349,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:40.700085 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:40.700060 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 16 19:49:40.738740 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:40.738715 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-77.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 16 19:49:40.826203 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:40.826164 2557 generic.go:356] "Generic (PLEG): container finished" podID="cc6da1b13bca282ef865b3244f5b60b1" containerID="8e39dc8053e866f679cbde12b1ec903fc92f58b1460bb189042a9e84821f0536" exitCode=0 Jun 16 19:49:40.826378 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:40.826227 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" event={"ID":"cc6da1b13bca282ef865b3244f5b60b1","Type":"ContainerDied","Data":"8e39dc8053e866f679cbde12b1ec903fc92f58b1460bb189042a9e84821f0536"} Jun 16 19:49:40.826378 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:40.826247 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:40.827089 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:40.827065 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:40.827186 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:40.827095 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:40.827186 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:40.827109 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:40.827285 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:40.827269 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-77.ec2.internal\" not found" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:40.827731 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:40.827667 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" event={"ID":"b9d047301ade34e187f662d0538c7f23","Type":"ContainerStarted","Data":"ca962b6e2cd66ea928239a96ac7b63450c5a43f4db048d759df1b6e7fc1afd93"} Jun 16 19:49:40.827731 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:40.827716 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:40.828931 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:40.828905 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:40.828996 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:40.828933 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:40.828996 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:40.828946 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:40.829093 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:40.829081 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-77.ec2.internal\" not found" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:40.838471 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:40.838375 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal.18b9a793cc2cec18 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal,UID:cc6da1b13bca282ef865b3244f5b60b1,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f37f2309807dd6fa95f93965bbd2f7bc61a1279f57f9c60a6c55e4269e765fa4\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:40.829269016 +0000 UTC m=+4.482099596,LastTimestamp:2026-06-16 19:49:40.829269016 +0000 UTC m=+4.482099596,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:40.917166 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:40.917087 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal.18b9a793d0e7d24f openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal,UID:cc6da1b13bca282ef865b3244f5b60b1,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:40.908626511 +0000 UTC m=+4.561457116,LastTimestamp:2026-06-16 19:49:40.908626511 +0000 UTC m=+4.561457116,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:40.925777 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:40.925696 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal.18b9a793d16b81ae openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal,UID:cc6da1b13bca282ef865b3244f5b60b1,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:40.917256622 +0000 UTC m=+4.570087226,LastTimestamp:2026-06-16 19:49:40.917256622 +0000 UTC m=+4.570087226,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:41.738635 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:41.738605 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-77.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 16 19:49:41.830182 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:41.830157 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/0.log" Jun 16 19:49:41.830525 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:41.830507 2557 generic.go:356] "Generic (PLEG): container finished" podID="cc6da1b13bca282ef865b3244f5b60b1" containerID="8d010f151515b9d019e645fd458660be957fb86b938506809950078afbec85ef" exitCode=1 Jun 16 19:49:41.830609 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:41.830597 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:41.830609 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:41.830593 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" event={"ID":"cc6da1b13bca282ef865b3244f5b60b1","Type":"ContainerDied","Data":"8d010f151515b9d019e645fd458660be957fb86b938506809950078afbec85ef"} Jun 16 19:49:41.830674 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:41.830600 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:41.831461 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:41.831442 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:41.831587 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:41.831477 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:41.831587 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:41.831489 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:41.831587 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:41.831442 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:41.831587 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:41.831537 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:41.831587 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:41.831551 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:41.831826 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:41.831690 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-77.ec2.internal\" not found" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:41.831826 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:41.831747 2557 scope.go:117] "RemoveContainer" containerID="8d010f151515b9d019e645fd458660be957fb86b938506809950078afbec85ef" Jun 16 19:49:41.831826 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:41.831750 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-77.ec2.internal\" not found" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:41.844877 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:41.844803 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal.18b9a793cc2cec18\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal.18b9a793cc2cec18 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal,UID:cc6da1b13bca282ef865b3244f5b60b1,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Pulled,Message:Container image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f37f2309807dd6fa95f93965bbd2f7bc61a1279f57f9c60a6c55e4269e765fa4\" already present on machine,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:40.829269016 +0000 UTC m=+4.482099596,LastTimestamp:2026-06-16 19:49:41.834684929 +0000 UTC m=+5.487515511,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:41.919776 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:41.919694 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal.18b9a793d0e7d24f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal.18b9a793d0e7d24f openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal,UID:cc6da1b13bca282ef865b3244f5b60b1,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Created,Message:Created container: kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:40.908626511 +0000 UTC m=+4.561457116,LastTimestamp:2026-06-16 19:49:41.910451201 +0000 UTC m=+5.563281805,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:41.928719 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:41.928643 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal.18b9a793d16b81ae\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal.18b9a793d16b81ae openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal,UID:cc6da1b13bca282ef865b3244f5b60b1,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:Started,Message:Started container kube-rbac-proxy-crio,Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:40.917256622 +0000 UTC m=+4.570087226,LastTimestamp:2026-06-16 19:49:41.918887423 +0000 UTC m=+5.571718030,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:42.740760 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:42.740730 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-77.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 16 19:49:42.833629 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:42.833606 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 19:49:42.834062 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:42.834044 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/0.log" Jun 16 19:49:42.834414 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:42.834395 2557 generic.go:356] "Generic (PLEG): container finished" podID="cc6da1b13bca282ef865b3244f5b60b1" containerID="a14edc114b67c144ec976897ee1c2d808941d3f404d7d98523bd8c423675198c" exitCode=1 Jun 16 19:49:42.834457 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:42.834427 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" event={"ID":"cc6da1b13bca282ef865b3244f5b60b1","Type":"ContainerDied","Data":"a14edc114b67c144ec976897ee1c2d808941d3f404d7d98523bd8c423675198c"} Jun 16 19:49:42.834487 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:42.834463 2557 scope.go:117] "RemoveContainer" containerID="8d010f151515b9d019e645fd458660be957fb86b938506809950078afbec85ef" Jun 16 19:49:42.834487 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:42.834465 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:42.835214 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:42.835198 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:42.835303 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:42.835227 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:42.835303 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:42.835240 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:42.835834 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:42.835537 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-77.ec2.internal\" not found" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:42.835834 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:42.835620 2557 scope.go:117] "RemoveContainer" containerID="a14edc114b67c144ec976897ee1c2d808941d3f404d7d98523bd8c423675198c" Jun 16 19:49:42.835938 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:42.835847 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_openshift-machine-config-operator(cc6da1b13bca282ef865b3244f5b60b1)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" podUID="cc6da1b13bca282ef865b3244f5b60b1" Jun 16 19:49:42.845336 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:42.845272 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal.18b9a79443c61998 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal,UID:cc6da1b13bca282ef865b3244f5b60b1,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_openshift-machine-config-operator(cc6da1b13bca282ef865b3244f5b60b1),Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:42.835796376 +0000 UTC m=+6.488626980,LastTimestamp:2026-06-16 19:49:42.835796376 +0000 UTC m=+6.488626980,Count:1,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:42.987744 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:42.987717 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="6.4s" Jun 16 19:49:43.204542 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:43.204513 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:43.205597 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:43.205555 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:43.205728 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:43.205613 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:43.205728 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:43.205631 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:43.205728 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:43.205666 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:43.223895 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:43.223864 2557 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:43.738980 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:43.738952 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-77.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 16 19:49:43.836745 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:43.836718 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 19:49:43.837139 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:43.837126 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:43.837857 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:43.837843 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:43.837903 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:43.837870 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:43.837903 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:43.837879 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:43.838101 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:43.838089 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-77.ec2.internal\" not found" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:43.838159 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:43.838132 2557 scope.go:117] "RemoveContainer" containerID="a14edc114b67c144ec976897ee1c2d808941d3f404d7d98523bd8c423675198c" Jun 16 19:49:43.838250 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:43.838232 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_openshift-machine-config-operator(cc6da1b13bca282ef865b3244f5b60b1)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" podUID="cc6da1b13bca282ef865b3244f5b60b1" Jun 16 19:49:43.848553 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:43.848477 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal.18b9a79443c61998\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal.18b9a79443c61998 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal,UID:cc6da1b13bca282ef865b3244f5b60b1,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{kube-rbac-proxy-crio},},Reason:BackOff,Message:Back-off restarting failed container kube-rbac-proxy-crio in pod kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_openshift-machine-config-operator(cc6da1b13bca282ef865b3244f5b60b1),Source:EventSource{Component:kubelet,Host:ip-10-0-134-77.ec2.internal,},FirstTimestamp:2026-06-16 19:49:42.835796376 +0000 UTC m=+6.488626980,LastTimestamp:2026-06-16 19:49:43.838201768 +0000 UTC m=+7.491032362,Count:2,Type:Warning,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-77.ec2.internal,}" Jun 16 19:49:43.905114 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:43.905096 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ns57g" Jun 16 19:49:44.167633 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:44.167607 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 16 19:49:44.569959 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:44.569934 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 16 19:49:44.666041 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:44.666009 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 16 19:49:44.666210 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:44.666187 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 16 19:49:44.666249 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:44.666204 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 16 19:49:44.721163 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:44.721140 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:44.722010 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:44.721989 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:44.722109 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:44.722028 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:44.722109 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:44.722042 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:44.730450 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:44.730425 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 16 19:49:44.738283 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:44.738267 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:44.755809 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:44.755792 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:44.814084 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:44.814063 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:44.909673 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:44.909550 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-15 19:44:43 +0000 UTC" deadline="2028-01-27 16:46:22.230899892 +0000 UTC" Jun 16 19:49:44.909673 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:44.909618 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14156h56m37.321286037s" Jun 16 19:49:45.092637 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:45.092612 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:45.092637 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:45.092636 2557 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:45.132145 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:45.132122 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:45.149355 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:45.149329 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:45.211319 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:45.211267 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:45.486791 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:45.486714 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:45.486791 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:45.486737 2557 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:45.748313 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:45.748258 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:45.765396 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:45.765376 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:45.826748 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:45.826730 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:46.063059 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:46.063031 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 16 19:49:46.090096 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:46.090069 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:46.090096 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:46.090093 2557 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:46.718955 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:46.718915 2557 apiserver.go:52] "Watching apiserver" Jun 16 19:49:46.722080 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:46.722064 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 16 19:49:46.722177 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:46.722161 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=[] Jun 16 19:49:46.739973 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:46.739956 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 16 19:49:46.801669 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:46.801640 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-77.ec2.internal\" not found" Jun 16 19:49:48.090634 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:48.090607 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:48.109238 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:48.109217 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:48.171099 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:48.171079 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:48.434767 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:48.434702 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:48.434767 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:48.434732 2557 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-134-77.ec2.internal" not found Jun 16 19:49:49.395213 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:49.395183 2557 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-77.ec2.internal\" not found" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:49.624276 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.624239 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:49.630252 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.630234 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:49.630323 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.630264 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:49.630323 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.630275 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:49.630323 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.630300 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:49.639501 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.639484 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-77.ec2.internal" Jun 16 19:49:49.663032 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.662962 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-sq5nb"] Jun 16 19:49:49.665264 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.665247 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-56dsz"] Jun 16 19:49:49.665373 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.665360 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sq5nb" Jun 16 19:49:49.667494 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.667475 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:49:49.667582 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:49.667532 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:49:49.667936 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.667917 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 16 19:49:49.668000 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.667971 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hztzm\"" Jun 16 19:49:49.668048 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.668034 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 16 19:49:49.681596 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.681581 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-zkxmt"] Jun 16 19:49:49.683714 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.683701 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zkxmt" Jun 16 19:49:49.686219 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.686201 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 16 19:49:49.686376 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.686363 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 16 19:49:49.686468 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.686421 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 16 19:49:49.686733 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.686715 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xcpzm\"" Jun 16 19:49:49.738657 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.738623 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" Jun 16 19:49:49.744655 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.744641 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 16 19:49:49.756600 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.756558 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal"] Jun 16 19:49:49.756693 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.756644 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 16 19:49:49.756733 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.756700 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" Jun 16 19:49:49.756900 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.756888 2557 scope.go:117] "RemoveContainer" containerID="a14edc114b67c144ec976897ee1c2d808941d3f404d7d98523bd8c423675198c" Jun 16 19:49:49.757011 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:49.756994 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_openshift-machine-config-operator(cc6da1b13bca282ef865b3244f5b60b1)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" podUID="cc6da1b13bca282ef865b3244f5b60b1" Jun 16 19:49:49.761397 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.761383 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-2hdpp"] Jun 16 19:49:49.763724 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.763706 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2hdpp" Jun 16 19:49:49.764655 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.764638 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-5hj7c"] Jun 16 19:49:49.766281 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.766265 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 16 19:49:49.766658 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.766642 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 16 19:49:49.766874 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.766861 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:49.767283 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.767268 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cdrc8\"" Jun 16 19:49:49.767365 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.767313 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 16 19:49:49.768758 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.768743 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 16 19:49:49.768893 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.768874 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal"] Jun 16 19:49:49.769158 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.769122 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4cmkz\"" Jun 16 19:49:49.769158 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.769127 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 16 19:49:49.769681 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.769668 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 16 19:49:49.793161 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.793137 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w78g7" Jun 16 19:49:49.802599 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.802578 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w78g7" Jun 16 19:49:49.805630 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.805613 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c183ed90-881e-4a72-bb89-056cc0f54cd3-agent-certs\") pod \"konnectivity-agent-sq5nb\" (UID: \"c183ed90-881e-4a72-bb89-056cc0f54cd3\") " pod="kube-system/konnectivity-agent-sq5nb" Jun 16 19:49:49.805685 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.805640 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh8zw\" (UniqueName: \"kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw\") pod \"network-check-target-56dsz\" (UID: \"3ee7881a-a800-4f6f-9be1-02d6e5892e46\") " pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:49:49.805685 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.805655 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fbbf7145-3244-4200-8748-797f2c7ac75a-serviceca\") pod \"node-ca-zkxmt\" (UID: \"fbbf7145-3244-4200-8748-797f2c7ac75a\") " pod="openshift-image-registry/node-ca-zkxmt" Jun 16 19:49:49.805685 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.805671 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79dms\" (UniqueName: \"kubernetes.io/projected/fbbf7145-3244-4200-8748-797f2c7ac75a-kube-api-access-79dms\") pod \"node-ca-zkxmt\" (UID: \"fbbf7145-3244-4200-8748-797f2c7ac75a\") " pod="openshift-image-registry/node-ca-zkxmt" Jun 16 19:49:49.805807 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.805691 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c183ed90-881e-4a72-bb89-056cc0f54cd3-konnectivity-ca\") pod \"konnectivity-agent-sq5nb\" (UID: \"c183ed90-881e-4a72-bb89-056cc0f54cd3\") " pod="kube-system/konnectivity-agent-sq5nb" Jun 16 19:49:49.805807 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.805710 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbbf7145-3244-4200-8748-797f2c7ac75a-host\") pod \"node-ca-zkxmt\" (UID: \"fbbf7145-3244-4200-8748-797f2c7ac75a\") " pod="openshift-image-registry/node-ca-zkxmt" Jun 16 19:49:49.830107 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.830070 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-77.ec2.internal" podStartSLOduration=0.830059485 podStartE2EDuration="830.059485ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:49.829794492 +0000 UTC m=+13.482625097" watchObservedRunningTime="2026-06-16 19:49:49.830059485 +0000 UTC m=+13.482890081" Jun 16 19:49:49.863387 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.863367 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-w8hwv"] Jun 16 19:49:49.865730 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.865717 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:49.868883 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.868864 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 16 19:49:49.869090 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.869075 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 16 19:49:49.869145 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.869106 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 16 19:49:49.869935 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.869921 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 16 19:49:49.870020 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.869921 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 16 19:49:49.870252 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.870238 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fgtds\"" Jun 16 19:49:49.871236 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.871220 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-w5b7l"] Jun 16 19:49:49.873701 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.873686 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w5b7l" Jun 16 19:49:49.877534 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.877516 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 16 19:49:49.879699 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.879680 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bp92p\"" Jun 16 19:49:49.904234 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.904213 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-7bn4d"] Jun 16 19:49:49.906079 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906063 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-run\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:49.906141 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906087 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-sys\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:49.906141 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906102 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-var-lib-kubelet\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:49.906141 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906121 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-host\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:49.906245 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906144 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76583c21-b8f4-4e80-830b-0b94f503b8c7-tmp\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:49.906245 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906171 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-lib-modules\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:49.906245 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906192 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-tuned\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:49.906245 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906213 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbbf7145-3244-4200-8748-797f2c7ac75a-host\") pod \"node-ca-zkxmt\" (UID: \"fbbf7145-3244-4200-8748-797f2c7ac75a\") " pod="openshift-image-registry/node-ca-zkxmt" Jun 16 19:49:49.906245 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906232 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf160577-a0e9-40fa-8392-f06851ff4e56-tmp-dir\") pod \"node-resolver-2hdpp\" (UID: \"cf160577-a0e9-40fa-8392-f06851ff4e56\") " pod="openshift-dns/node-resolver-2hdpp" Jun 16 19:49:49.906442 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906255 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdtn9\" (UniqueName: \"kubernetes.io/projected/cf160577-a0e9-40fa-8392-f06851ff4e56-kube-api-access-xdtn9\") pod \"node-resolver-2hdpp\" (UID: \"cf160577-a0e9-40fa-8392-f06851ff4e56\") " pod="openshift-dns/node-resolver-2hdpp" Jun 16 19:49:49.906442 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906274 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbbf7145-3244-4200-8748-797f2c7ac75a-host\") pod \"node-ca-zkxmt\" (UID: \"fbbf7145-3244-4200-8748-797f2c7ac75a\") " pod="openshift-image-registry/node-ca-zkxmt" Jun 16 19:49:49.906442 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906277 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-sysconfig\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:49.906442 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906306 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-kubernetes\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:49.906442 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906321 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-sysctl-d\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:49.906442 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906336 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwh45\" (UniqueName: \"kubernetes.io/projected/76583c21-b8f4-4e80-830b-0b94f503b8c7-kube-api-access-vwh45\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:49.906442 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906371 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c183ed90-881e-4a72-bb89-056cc0f54cd3-agent-certs\") pod \"konnectivity-agent-sq5nb\" (UID: \"c183ed90-881e-4a72-bb89-056cc0f54cd3\") " pod="kube-system/konnectivity-agent-sq5nb" Jun 16 19:49:49.906442 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906397 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8zw\" (UniqueName: \"kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw\") pod \"network-check-target-56dsz\" (UID: \"3ee7881a-a800-4f6f-9be1-02d6e5892e46\") " pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:49:49.906442 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906412 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fbbf7145-3244-4200-8748-797f2c7ac75a-serviceca\") pod \"node-ca-zkxmt\" (UID: \"fbbf7145-3244-4200-8748-797f2c7ac75a\") " pod="openshift-image-registry/node-ca-zkxmt" Jun 16 19:49:49.906442 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906430 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79dms\" (UniqueName: \"kubernetes.io/projected/fbbf7145-3244-4200-8748-797f2c7ac75a-kube-api-access-79dms\") pod \"node-ca-zkxmt\" (UID: \"fbbf7145-3244-4200-8748-797f2c7ac75a\") " pod="openshift-image-registry/node-ca-zkxmt" Jun 16 19:49:49.906834 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906446 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf160577-a0e9-40fa-8392-f06851ff4e56-hosts-file\") pod \"node-resolver-2hdpp\" (UID: \"cf160577-a0e9-40fa-8392-f06851ff4e56\") " pod="openshift-dns/node-resolver-2hdpp" Jun 16 19:49:49.906834 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906471 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-modprobe-d\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:49.906834 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906495 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-sysctl-conf\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:49.906834 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906529 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c183ed90-881e-4a72-bb89-056cc0f54cd3-konnectivity-ca\") pod \"konnectivity-agent-sq5nb\" (UID: \"c183ed90-881e-4a72-bb89-056cc0f54cd3\") " pod="kube-system/konnectivity-agent-sq5nb" Jun 16 19:49:49.906834 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906598 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-systemd\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:49.906834 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906724 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:49:49.906834 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.906755 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 16 19:49:49.906834 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:49.906782 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:49:49.907079 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.907062 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fbbf7145-3244-4200-8748-797f2c7ac75a-serviceca\") pod \"node-ca-zkxmt\" (UID: \"fbbf7145-3244-4200-8748-797f2c7ac75a\") " pod="openshift-image-registry/node-ca-zkxmt" Jun 16 19:49:49.907671 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.907644 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c183ed90-881e-4a72-bb89-056cc0f54cd3-konnectivity-ca\") pod \"konnectivity-agent-sq5nb\" (UID: \"c183ed90-881e-4a72-bb89-056cc0f54cd3\") " pod="kube-system/konnectivity-agent-sq5nb" Jun 16 19:49:49.910288 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.910269 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c183ed90-881e-4a72-bb89-056cc0f54cd3-agent-certs\") pod \"konnectivity-agent-sq5nb\" (UID: \"c183ed90-881e-4a72-bb89-056cc0f54cd3\") " pod="kube-system/konnectivity-agent-sq5nb" Jun 16 19:49:49.921411 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:49.921167 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:49:49.921411 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:49.921197 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:49:49.921411 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:49.921221 2557 projected.go:196] Error preparing data for projected volume kube-api-access-nh8zw for pod openshift-network-diagnostics/network-check-target-56dsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:49.921411 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:49.921300 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw podName:3ee7881a-a800-4f6f-9be1-02d6e5892e46 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:50.421281205 +0000 UTC m=+14.074111810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nh8zw" (UniqueName: "kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw") pod "network-check-target-56dsz" (UID: "3ee7881a-a800-4f6f-9be1-02d6e5892e46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:49.924503 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.924484 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79dms\" (UniqueName: \"kubernetes.io/projected/fbbf7145-3244-4200-8748-797f2c7ac75a-kube-api-access-79dms\") pod \"node-ca-zkxmt\" (UID: \"fbbf7145-3244-4200-8748-797f2c7ac75a\") " pod="openshift-image-registry/node-ca-zkxmt" Jun 16 19:49:49.973071 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.973041 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sq5nb" Jun 16 19:49:49.983371 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.983344 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk"] Jun 16 19:49:49.986074 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.986059 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-46ksf"] Jun 16 19:49:49.986167 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.986151 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:49.988375 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.988360 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-46ksf" Jun 16 19:49:49.989509 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.989492 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 16 19:49:49.989597 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.989586 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 16 19:49:49.989642 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.989589 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k2h9l\"" Jun 16 19:49:49.990203 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.990186 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 16 19:49:49.990753 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.990741 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zkxmt" Jun 16 19:49:49.992667 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.992648 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 16 19:49:49.993407 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.993392 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 16 19:49:49.997202 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.997170 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 16 19:49:49.997283 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:49.997267 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zsdgn\"" Jun 16 19:49:49.998844 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:49.998824 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbbf7145_3244_4200_8748_797f2c7ac75a.slice/crio-7a6c5e31c99fcf7567fb05e6c7603a53f25357b20331e072511f25d194096e2f WatchSource:0}: Error finding container 7a6c5e31c99fcf7567fb05e6c7603a53f25357b20331e072511f25d194096e2f: Status 404 returned error can't find the container with id 7a6c5e31c99fcf7567fb05e6c7603a53f25357b20331e072511f25d194096e2f Jun 16 19:49:50.007700 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.007680 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-run\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.007778 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.007706 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-host\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.007778 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.007725 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-cni-binary-copy\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.007778 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.007741 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-run-k8s-cni-cncf-io\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.007871 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.007782 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-var-lib-cni-bin\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.007871 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.007794 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-run\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.007871 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.007805 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-host\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.007871 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.007799 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-var-lib-cni-multus\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.007871 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.007849 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56k6q\" (UniqueName: \"kubernetes.io/projected/245829e4-8785-4cab-900c-c1adadd5cc63-kube-api-access-56k6q\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.007871 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.007870 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.008037 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.007887 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.008037 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.007904 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs\") pod \"network-metrics-daemon-7bn4d\" (UID: \"07dffcab-50c2-4c45-8e2e-64656af42fa2\") " pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:49:50.008037 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.007929 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-cnibin\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.008037 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.007943 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-os-release\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.008037 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.007970 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdtn9\" (UniqueName: \"kubernetes.io/projected/cf160577-a0e9-40fa-8392-f06851ff4e56-kube-api-access-xdtn9\") pod \"node-resolver-2hdpp\" (UID: \"cf160577-a0e9-40fa-8392-f06851ff4e56\") " pod="openshift-dns/node-resolver-2hdpp" Jun 16 19:49:50.008037 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.007990 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.008037 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008006 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-run-multus-certs\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.008037 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008024 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-etc-kubernetes\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.008297 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008058 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-systemd\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.008297 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008130 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76583c21-b8f4-4e80-830b-0b94f503b8c7-tmp\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.008297 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008171 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-systemd\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.008297 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008206 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-system-cni-dir\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.008486 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008309 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-sysctl-conf\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.008486 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008343 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-os-release\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.008486 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008369 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-run-netns\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.008486 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008396 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-sys\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.008486 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008421 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-system-cni-dir\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.008486 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008443 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/245829e4-8785-4cab-900c-c1adadd5cc63-cni-binary-copy\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.008486 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008454 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-sysctl-conf\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.008486 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008467 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-var-lib-kubelet\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008491 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-sys\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008494 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-hostroot\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008519 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-multus-conf-dir\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008543 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-lib-modules\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008581 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-tuned\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008598 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-multus-socket-dir-parent\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008613 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/245829e4-8785-4cab-900c-c1adadd5cc63-multus-daemon-config\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008631 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-cnibin\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008655 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf160577-a0e9-40fa-8392-f06851ff4e56-tmp-dir\") pod \"node-resolver-2hdpp\" (UID: \"cf160577-a0e9-40fa-8392-f06851ff4e56\") " pod="openshift-dns/node-resolver-2hdpp" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008679 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-sysconfig\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008691 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-lib-modules\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008701 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-kubernetes\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008735 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-sysctl-d\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008747 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-kubernetes\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008769 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7vdl\" (UniqueName: \"kubernetes.io/projected/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-kube-api-access-p7vdl\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008798 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzvs7\" (UniqueName: \"kubernetes.io/projected/07dffcab-50c2-4c45-8e2e-64656af42fa2-kube-api-access-hzvs7\") pod \"network-metrics-daemon-7bn4d\" (UID: \"07dffcab-50c2-4c45-8e2e-64656af42fa2\") " pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:49:50.008837 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008825 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-var-lib-kubelet\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.009471 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008848 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwh45\" (UniqueName: \"kubernetes.io/projected/76583c21-b8f4-4e80-830b-0b94f503b8c7-kube-api-access-vwh45\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.009471 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008961 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-sysconfig\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.009471 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.008962 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf160577-a0e9-40fa-8392-f06851ff4e56-tmp-dir\") pod \"node-resolver-2hdpp\" (UID: \"cf160577-a0e9-40fa-8392-f06851ff4e56\") " pod="openshift-dns/node-resolver-2hdpp" Jun 16 19:49:50.009471 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.009045 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-var-lib-kubelet\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.009471 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.009047 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-sysctl-d\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.009471 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.009069 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf160577-a0e9-40fa-8392-f06851ff4e56-hosts-file\") pod \"node-resolver-2hdpp\" (UID: \"cf160577-a0e9-40fa-8392-f06851ff4e56\") " pod="openshift-dns/node-resolver-2hdpp" Jun 16 19:49:50.009471 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.009105 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cf160577-a0e9-40fa-8392-f06851ff4e56-hosts-file\") pod \"node-resolver-2hdpp\" (UID: \"cf160577-a0e9-40fa-8392-f06851ff4e56\") " pod="openshift-dns/node-resolver-2hdpp" Jun 16 19:49:50.009471 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.009111 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-modprobe-d\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.009471 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.009140 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-multus-cni-dir\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.009471 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.009226 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-modprobe-d\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.010653 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.010635 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76583c21-b8f4-4e80-830b-0b94f503b8c7-tmp\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.010783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.010766 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76583c21-b8f4-4e80-830b-0b94f503b8c7-etc-tuned\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.023673 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.023650 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdtn9\" (UniqueName: \"kubernetes.io/projected/cf160577-a0e9-40fa-8392-f06851ff4e56-kube-api-access-xdtn9\") pod \"node-resolver-2hdpp\" (UID: \"cf160577-a0e9-40fa-8392-f06851ff4e56\") " pod="openshift-dns/node-resolver-2hdpp" Jun 16 19:49:50.024141 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.024125 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwh45\" (UniqueName: \"kubernetes.io/projected/76583c21-b8f4-4e80-830b-0b94f503b8c7-kube-api-access-vwh45\") pod \"tuned-5hj7c\" (UID: \"76583c21-b8f4-4e80-830b-0b94f503b8c7\") " pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.026897 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.026878 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-g82pv"] Jun 16 19:49:50.030587 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.030557 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:50.030641 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:50.030627 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:49:50.072368 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.072346 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2hdpp" Jun 16 19:49:50.075466 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.075446 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-q8dt4"] Jun 16 19:49:50.077986 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.077954 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" Jun 16 19:49:50.078516 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.078500 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.082071 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.081973 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 16 19:49:50.082163 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.081974 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 16 19:49:50.082163 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.082102 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 16 19:49:50.082163 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.082115 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 16 19:49:50.082163 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.082138 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 16 19:49:50.082356 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.082187 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d2hcr\"" Jun 16 19:49:50.082356 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.082116 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 16 19:49:50.082544 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:50.082525 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf160577_a0e9_40fa_8392_f06851ff4e56.slice/crio-10d353407e75c43d9421866aa5764b77851da6a7cfe9bf36f77ec83a0fbfdd7c WatchSource:0}: Error finding container 10d353407e75c43d9421866aa5764b77851da6a7cfe9bf36f77ec83a0fbfdd7c: Status 404 returned error can't find the container with id 10d353407e75c43d9421866aa5764b77851da6a7cfe9bf36f77ec83a0fbfdd7c Jun 16 19:49:50.086925 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:50.086904 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76583c21_b8f4_4e80_830b_0b94f503b8c7.slice/crio-fce59caf2063f65a95ebab1f54dd294f645ab1d428fee888834df163e4a9af5b WatchSource:0}: Error finding container fce59caf2063f65a95ebab1f54dd294f645ab1d428fee888834df163e4a9af5b: Status 404 returned error can't find the container with id fce59caf2063f65a95ebab1f54dd294f645ab1d428fee888834df163e4a9af5b Jun 16 19:49:50.109980 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.109957 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56k6q\" (UniqueName: \"kubernetes.io/projected/245829e4-8785-4cab-900c-c1adadd5cc63-kube-api-access-56k6q\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.110075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.109991 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbct6\" (UniqueName: \"kubernetes.io/projected/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-kube-api-access-sbct6\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.110075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110016 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b922c97-fed5-44e6-b134-192a137564e7-dbus\") pod \"global-pull-secret-syncer-g82pv\" (UID: \"3b922c97-fed5-44e6-b134-192a137564e7\") " pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:50.110075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110055 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-cni-binary-copy\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.110209 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110079 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-var-lib-cni-bin\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.110209 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110102 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-var-lib-cni-multus\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.110209 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110125 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.110209 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110149 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs\") pod \"network-metrics-daemon-7bn4d\" (UID: \"07dffcab-50c2-4c45-8e2e-64656af42fa2\") " pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:49:50.110209 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110188 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-var-lib-cni-bin\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.110436 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:50.110224 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:50.110436 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110228 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-var-lib-cni-multus\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.110436 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110261 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-etc-kubernetes\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.110436 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:50.110282 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs podName:07dffcab-50c2-4c45-8e2e-64656af42fa2 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:50.610259939 +0000 UTC m=+14.263090542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs") pod "network-metrics-daemon-7bn4d" (UID: "07dffcab-50c2-4c45-8e2e-64656af42fa2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:50.110436 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110301 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-var-lib-kubelet\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.110436 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110307 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-etc-kubernetes\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.110436 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110324 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-system-cni-dir\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.110436 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110364 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-system-cni-dir\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.110436 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110370 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-os-release\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.110436 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110363 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-var-lib-kubelet\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.110436 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110402 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pk2g\" (UniqueName: \"kubernetes.io/projected/9b02e210-6c96-478d-a4b8-f9d09d5946d8-kube-api-access-2pk2g\") pod \"iptables-alerter-46ksf\" (UID: \"9b02e210-6c96-478d-a4b8-f9d09d5946d8\") " pod="openshift-network-operator/iptables-alerter-46ksf" Jun 16 19:49:50.110436 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110427 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-os-release\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.110436 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110431 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-system-cni-dir\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110456 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/245829e4-8785-4cab-900c-c1adadd5cc63-cni-binary-copy\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110480 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-device-dir\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110532 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110559 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-socket-dir\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110599 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-cnibin\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110609 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-system-cni-dir\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110623 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-multus-cni-dir\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110654 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-cnibin\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110687 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-multus-cni-dir\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110694 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-cnibin\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110739 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-cnibin\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110742 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-cni-binary-copy\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110744 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b02e210-6c96-478d-a4b8-f9d09d5946d8-host-slash\") pod \"iptables-alerter-46ksf\" (UID: \"9b02e210-6c96-478d-a4b8-f9d09d5946d8\") " pod="openshift-network-operator/iptables-alerter-46ksf" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110791 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-registration-dir\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110822 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-run-k8s-cni-cncf-io\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110850 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.111075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110879 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110906 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-run-multus-certs\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110913 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-run-k8s-cni-cncf-io\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110932 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-etc-selinux\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110957 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-hostroot\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110983 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-multus-conf-dir\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111016 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-run-netns\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111018 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111026 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/245829e4-8785-4cab-900c-c1adadd5cc63-cni-binary-copy\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111039 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-hostroot\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111043 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9b02e210-6c96-478d-a4b8-f9d09d5946d8-iptables-alerter-script\") pod \"iptables-alerter-46ksf\" (UID: \"9b02e210-6c96-478d-a4b8-f9d09d5946d8\") " pod="openshift-network-operator/iptables-alerter-46ksf" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111058 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-run-netns\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111069 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b922c97-fed5-44e6-b134-192a137564e7-kubelet-config\") pod \"global-pull-secret-syncer-g82pv\" (UID: \"3b922c97-fed5-44e6-b134-192a137564e7\") " pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111043 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-multus-conf-dir\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.110982 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-host-run-multus-certs\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111094 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/245829e4-8785-4cab-900c-c1adadd5cc63-multus-daemon-config\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111113 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-sys-fs\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.111709 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111137 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret\") pod \"global-pull-secret-syncer-g82pv\" (UID: \"3b922c97-fed5-44e6-b134-192a137564e7\") " pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:50.112268 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111156 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-multus-socket-dir-parent\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.112268 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111173 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7vdl\" (UniqueName: \"kubernetes.io/projected/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-kube-api-access-p7vdl\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.112268 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111192 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzvs7\" (UniqueName: \"kubernetes.io/projected/07dffcab-50c2-4c45-8e2e-64656af42fa2-kube-api-access-hzvs7\") pod \"network-metrics-daemon-7bn4d\" (UID: \"07dffcab-50c2-4c45-8e2e-64656af42fa2\") " pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:49:50.112268 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111216 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-os-release\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.112268 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111229 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-multus-socket-dir-parent\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.112268 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111282 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/245829e4-8785-4cab-900c-c1adadd5cc63-os-release\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.112268 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111349 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.112268 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111429 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.112268 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.111510 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/245829e4-8785-4cab-900c-c1adadd5cc63-multus-daemon-config\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.121011 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.120987 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56k6q\" (UniqueName: \"kubernetes.io/projected/245829e4-8785-4cab-900c-c1adadd5cc63-kube-api-access-56k6q\") pod \"multus-w5b7l\" (UID: \"245829e4-8785-4cab-900c-c1adadd5cc63\") " pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.121913 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.121890 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7vdl\" (UniqueName: \"kubernetes.io/projected/57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1-kube-api-access-p7vdl\") pod \"multus-additional-cni-plugins-w8hwv\" (UID: \"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1\") " pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.122197 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.122179 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzvs7\" (UniqueName: \"kubernetes.io/projected/07dffcab-50c2-4c45-8e2e-64656af42fa2-kube-api-access-hzvs7\") pod \"network-metrics-daemon-7bn4d\" (UID: \"07dffcab-50c2-4c45-8e2e-64656af42fa2\") " pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:49:50.173036 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.172980 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w8hwv" Jun 16 19:49:50.181038 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.181020 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w5b7l" Jun 16 19:49:50.182378 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:50.182356 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57cf6e8c_cfe6_4a4a_9980_0138e4b03ec1.slice/crio-e73e9e6ad82524d7a7947c15a1c0c3f091beec4b486f29a1f781b0cefe306926 WatchSource:0}: Error finding container e73e9e6ad82524d7a7947c15a1c0c3f091beec4b486f29a1f781b0cefe306926: Status 404 returned error can't find the container with id e73e9e6ad82524d7a7947c15a1c0c3f091beec4b486f29a1f781b0cefe306926 Jun 16 19:49:50.188667 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:50.188644 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245829e4_8785_4cab_900c_c1adadd5cc63.slice/crio-07f9680283d53099e71cffa1f3f82051496553eb71ce316b3d5cf6ed920fe4b2 WatchSource:0}: Error finding container 07f9680283d53099e71cffa1f3f82051496553eb71ce316b3d5cf6ed920fe4b2: Status 404 returned error can't find the container with id 07f9680283d53099e71cffa1f3f82051496553eb71ce316b3d5cf6ed920fe4b2 Jun 16 19:49:50.211553 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.211524 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9b02e210-6c96-478d-a4b8-f9d09d5946d8-iptables-alerter-script\") pod \"iptables-alerter-46ksf\" (UID: \"9b02e210-6c96-478d-a4b8-f9d09d5946d8\") " pod="openshift-network-operator/iptables-alerter-46ksf" Jun 16 19:49:50.211553 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.211552 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b922c97-fed5-44e6-b134-192a137564e7-kubelet-config\") pod \"global-pull-secret-syncer-g82pv\" (UID: \"3b922c97-fed5-44e6-b134-192a137564e7\") " pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:50.211712 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.211587 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-sys-fs\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.211712 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.211604 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret\") pod \"global-pull-secret-syncer-g82pv\" (UID: \"3b922c97-fed5-44e6-b134-192a137564e7\") " pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:50.211712 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.211662 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b922c97-fed5-44e6-b134-192a137564e7-kubelet-config\") pod \"global-pull-secret-syncer-g82pv\" (UID: \"3b922c97-fed5-44e6-b134-192a137564e7\") " pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:50.211712 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.211666 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-sys-fs\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.211712 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:50.211671 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:50.211938 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.211686 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-log-socket\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.211938 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:50.211748 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret podName:3b922c97-fed5-44e6-b134-192a137564e7 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:50.711725858 +0000 UTC m=+14.364556451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret") pod "global-pull-secret-syncer-g82pv" (UID: "3b922c97-fed5-44e6-b134-192a137564e7") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:50.211938 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.211779 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c70e4a62-c85d-4f3d-9509-25c257bdb0af-ovnkube-config\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.211938 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.211810 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-kubelet\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.211938 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.211835 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-run-ovn-kubernetes\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.211938 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.211872 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbct6\" (UniqueName: \"kubernetes.io/projected/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-kube-api-access-sbct6\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.211938 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.211896 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b922c97-fed5-44e6-b134-192a137564e7-dbus\") pod \"global-pull-secret-syncer-g82pv\" (UID: \"3b922c97-fed5-44e6-b134-192a137564e7\") " pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:50.211938 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.211920 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-run-systemd\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.212251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.211947 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-run-netns\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.212251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.211977 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-run-ovn\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.212251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212003 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-node-log\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.212251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212001 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9b02e210-6c96-478d-a4b8-f9d09d5946d8-iptables-alerter-script\") pod \"iptables-alerter-46ksf\" (UID: \"9b02e210-6c96-478d-a4b8-f9d09d5946d8\") " pod="openshift-network-operator/iptables-alerter-46ksf" Jun 16 19:49:50.212251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212032 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-slash\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.212251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212054 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-systemd-units\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.212251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212056 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b922c97-fed5-44e6-b134-192a137564e7-dbus\") pod \"global-pull-secret-syncer-g82pv\" (UID: \"3b922c97-fed5-44e6-b134-192a137564e7\") " pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:50.212251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212069 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-cni-netd\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.212251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212095 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pk2g\" (UniqueName: \"kubernetes.io/projected/9b02e210-6c96-478d-a4b8-f9d09d5946d8-kube-api-access-2pk2g\") pod \"iptables-alerter-46ksf\" (UID: \"9b02e210-6c96-478d-a4b8-f9d09d5946d8\") " pod="openshift-network-operator/iptables-alerter-46ksf" Jun 16 19:49:50.212251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212110 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-cni-bin\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.212251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212131 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc8tj\" (UniqueName: \"kubernetes.io/projected/c70e4a62-c85d-4f3d-9509-25c257bdb0af-kube-api-access-lc8tj\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.212251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212150 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-device-dir\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.212251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212164 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c70e4a62-c85d-4f3d-9509-25c257bdb0af-ovn-node-metrics-cert\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.212251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212178 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c70e4a62-c85d-4f3d-9509-25c257bdb0af-ovnkube-script-lib\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.212251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212200 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.212251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212219 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-socket-dir\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.212841 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212234 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-run-openvswitch\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.212841 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212261 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b02e210-6c96-478d-a4b8-f9d09d5946d8-host-slash\") pod \"iptables-alerter-46ksf\" (UID: \"9b02e210-6c96-478d-a4b8-f9d09d5946d8\") " pod="openshift-network-operator/iptables-alerter-46ksf" Jun 16 19:49:50.212841 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212263 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-device-dir\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.212841 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212271 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.212841 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212293 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-registration-dir\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.212841 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212310 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b02e210-6c96-478d-a4b8-f9d09d5946d8-host-slash\") pod \"iptables-alerter-46ksf\" (UID: \"9b02e210-6c96-478d-a4b8-f9d09d5946d8\") " pod="openshift-network-operator/iptables-alerter-46ksf" Jun 16 19:49:50.212841 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212313 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-etc-openvswitch\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.212841 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212343 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-var-lib-openvswitch\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.212841 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212367 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c70e4a62-c85d-4f3d-9509-25c257bdb0af-env-overrides\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.212841 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212386 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-etc-selinux\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.212841 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212403 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.212841 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212438 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-registration-dir\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.212841 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212450 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-socket-dir\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.212841 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.212512 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-etc-selinux\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.231615 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.231598 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pk2g\" (UniqueName: \"kubernetes.io/projected/9b02e210-6c96-478d-a4b8-f9d09d5946d8-kube-api-access-2pk2g\") pod \"iptables-alerter-46ksf\" (UID: \"9b02e210-6c96-478d-a4b8-f9d09d5946d8\") " pod="openshift-network-operator/iptables-alerter-46ksf" Jun 16 19:49:50.231774 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.231756 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbct6\" (UniqueName: \"kubernetes.io/projected/125e2a0d-fbdc-45ad-b1ee-634b34d13bc5-kube-api-access-sbct6\") pod \"aws-ebs-csi-driver-node-496bk\" (UID: \"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.294705 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.294680 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" Jun 16 19:49:50.303608 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.303590 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-46ksf" Jun 16 19:49:50.304000 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:50.303977 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125e2a0d_fbdc_45ad_b1ee_634b34d13bc5.slice/crio-8f992496701a6700773eb90711a943ece6067b72d7bd5a7c5e543b9d31295fdb WatchSource:0}: Error finding container 8f992496701a6700773eb90711a943ece6067b72d7bd5a7c5e543b9d31295fdb: Status 404 returned error can't find the container with id 8f992496701a6700773eb90711a943ece6067b72d7bd5a7c5e543b9d31295fdb Jun 16 19:49:50.312291 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:50.312272 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b02e210_6c96_478d_a4b8_f9d09d5946d8.slice/crio-34ecfd038958fe340067ac912199189a87816e4cb79948618d1eaea808202201 WatchSource:0}: Error finding container 34ecfd038958fe340067ac912199189a87816e4cb79948618d1eaea808202201: Status 404 returned error can't find the container with id 34ecfd038958fe340067ac912199189a87816e4cb79948618d1eaea808202201 Jun 16 19:49:50.312880 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.312861 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-log-socket\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.312955 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.312887 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c70e4a62-c85d-4f3d-9509-25c257bdb0af-ovnkube-config\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.312955 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.312902 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-kubelet\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313023 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.312953 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-log-socket\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313023 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.312962 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-run-ovn-kubernetes\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313023 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313004 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-run-ovn-kubernetes\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313023 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313005 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-run-systemd\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313163 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313042 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-run-systemd\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313163 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313043 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-run-netns\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313163 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313060 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-kubelet\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313163 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313071 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-run-ovn\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313163 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313092 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-node-log\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313163 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313133 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-run-netns\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313163 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313138 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-run-ovn\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313395 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313163 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-slash\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313395 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313171 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-node-log\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313395 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313188 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-systemd-units\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313395 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313206 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-cni-netd\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313395 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313207 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-slash\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313395 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313216 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-systemd-units\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313395 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313251 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-cni-netd\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313395 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313265 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-cni-bin\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313395 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313299 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc8tj\" (UniqueName: \"kubernetes.io/projected/c70e4a62-c85d-4f3d-9509-25c257bdb0af-kube-api-access-lc8tj\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313395 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313320 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-cni-bin\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313395 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313327 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c70e4a62-c85d-4f3d-9509-25c257bdb0af-ovn-node-metrics-cert\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313395 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313369 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c70e4a62-c85d-4f3d-9509-25c257bdb0af-ovnkube-script-lib\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313395 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313390 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-run-openvswitch\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313934 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313414 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-etc-openvswitch\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313934 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313457 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-run-openvswitch\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313934 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313460 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-etc-openvswitch\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313934 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313481 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-var-lib-openvswitch\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313934 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313502 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c70e4a62-c85d-4f3d-9509-25c257bdb0af-env-overrides\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313934 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313521 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313934 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313539 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-var-lib-openvswitch\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.313934 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.313609 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c70e4a62-c85d-4f3d-9509-25c257bdb0af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.314702 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.314684 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c70e4a62-c85d-4f3d-9509-25c257bdb0af-ovnkube-config\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.314777 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.314736 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c70e4a62-c85d-4f3d-9509-25c257bdb0af-ovnkube-script-lib\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.315267 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.315187 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c70e4a62-c85d-4f3d-9509-25c257bdb0af-env-overrides\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.315667 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.315646 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c70e4a62-c85d-4f3d-9509-25c257bdb0af-ovn-node-metrics-cert\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.322688 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.322665 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc8tj\" (UniqueName: \"kubernetes.io/projected/c70e4a62-c85d-4f3d-9509-25c257bdb0af-kube-api-access-lc8tj\") pod \"ovnkube-node-q8dt4\" (UID: \"c70e4a62-c85d-4f3d-9509-25c257bdb0af\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.387624 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.387593 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:49:50.398616 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:49:50.398592 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70e4a62_c85d_4f3d_9509_25c257bdb0af.slice/crio-6e0334b20e1afff8b3131637ea7f65d54589ce525c53e0f2e93307ce4aeef36f WatchSource:0}: Error finding container 6e0334b20e1afff8b3131637ea7f65d54589ce525c53e0f2e93307ce4aeef36f: Status 404 returned error can't find the container with id 6e0334b20e1afff8b3131637ea7f65d54589ce525c53e0f2e93307ce4aeef36f Jun 16 19:49:50.516273 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.516188 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8zw\" (UniqueName: \"kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw\") pod \"network-check-target-56dsz\" (UID: \"3ee7881a-a800-4f6f-9be1-02d6e5892e46\") " pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:49:50.516403 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:50.516336 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:49:50.516403 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:50.516359 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:49:50.516403 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:50.516372 2557 projected.go:196] Error preparing data for projected volume kube-api-access-nh8zw for pod openshift-network-diagnostics/network-check-target-56dsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:50.516601 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:50.516435 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw podName:3ee7881a-a800-4f6f-9be1-02d6e5892e46 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:51.51641812 +0000 UTC m=+15.169248720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh8zw" (UniqueName: "kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw") pod "network-check-target-56dsz" (UID: "3ee7881a-a800-4f6f-9be1-02d6e5892e46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:50.617207 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.617170 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs\") pod \"network-metrics-daemon-7bn4d\" (UID: \"07dffcab-50c2-4c45-8e2e-64656af42fa2\") " pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:49:50.617418 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:50.617400 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:50.617490 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:50.617467 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs podName:07dffcab-50c2-4c45-8e2e-64656af42fa2 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:51.617449543 +0000 UTC m=+15.270280137 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs") pod "network-metrics-daemon-7bn4d" (UID: "07dffcab-50c2-4c45-8e2e-64656af42fa2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:50.717820 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.717741 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret\") pod \"global-pull-secret-syncer-g82pv\" (UID: \"3b922c97-fed5-44e6-b134-192a137564e7\") " pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:50.718057 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:50.717887 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:50.718057 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:50.717949 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret podName:3b922c97-fed5-44e6-b134-192a137564e7 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:51.717931843 +0000 UTC m=+15.370762428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret") pod "global-pull-secret-syncer-g82pv" (UID: "3b922c97-fed5-44e6-b134-192a137564e7") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:50.807262 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.807171 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-15 19:44:49 +0000 UTC" deadline="2027-12-20 23:30:09.381237616 +0000 UTC" Jun 16 19:49:50.807262 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.807240 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13251h40m18.574002378s" Jun 16 19:49:50.868446 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.868392 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" event={"ID":"c70e4a62-c85d-4f3d-9509-25c257bdb0af","Type":"ContainerStarted","Data":"6e0334b20e1afff8b3131637ea7f65d54589ce525c53e0f2e93307ce4aeef36f"} Jun 16 19:49:50.879813 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.879706 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-46ksf" event={"ID":"9b02e210-6c96-478d-a4b8-f9d09d5946d8","Type":"ContainerStarted","Data":"34ecfd038958fe340067ac912199189a87816e4cb79948618d1eaea808202201"} Jun 16 19:49:50.888198 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.888164 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" event={"ID":"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5","Type":"ContainerStarted","Data":"8f992496701a6700773eb90711a943ece6067b72d7bd5a7c5e543b9d31295fdb"} Jun 16 19:49:50.898376 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.898346 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w5b7l" event={"ID":"245829e4-8785-4cab-900c-c1adadd5cc63","Type":"ContainerStarted","Data":"07f9680283d53099e71cffa1f3f82051496553eb71ce316b3d5cf6ed920fe4b2"} Jun 16 19:49:50.908892 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.908866 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8hwv" event={"ID":"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1","Type":"ContainerStarted","Data":"e73e9e6ad82524d7a7947c15a1c0c3f091beec4b486f29a1f781b0cefe306926"} Jun 16 19:49:50.912630 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.912584 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" event={"ID":"76583c21-b8f4-4e80-830b-0b94f503b8c7","Type":"ContainerStarted","Data":"fce59caf2063f65a95ebab1f54dd294f645ab1d428fee888834df163e4a9af5b"} Jun 16 19:49:50.914918 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.914892 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2hdpp" event={"ID":"cf160577-a0e9-40fa-8392-f06851ff4e56","Type":"ContainerStarted","Data":"10d353407e75c43d9421866aa5764b77851da6a7cfe9bf36f77ec83a0fbfdd7c"} Jun 16 19:49:50.920476 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.920446 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zkxmt" event={"ID":"fbbf7145-3244-4200-8748-797f2c7ac75a","Type":"ContainerStarted","Data":"7a6c5e31c99fcf7567fb05e6c7603a53f25357b20331e072511f25d194096e2f"} Jun 16 19:49:50.930274 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:50.930247 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sq5nb" event={"ID":"c183ed90-881e-4a72-bb89-056cc0f54cd3","Type":"ContainerStarted","Data":"7e098941dd77aa02bb929af1ded3e1dc12d469d8aa1cd083c3c01386a45efb64"} Jun 16 19:49:51.525164 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:51.524457 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8zw\" (UniqueName: \"kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw\") pod \"network-check-target-56dsz\" (UID: \"3ee7881a-a800-4f6f-9be1-02d6e5892e46\") " pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:49:51.525164 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:51.524705 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:49:51.525164 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:51.524731 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:49:51.525164 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:51.524745 2557 projected.go:196] Error preparing data for projected volume kube-api-access-nh8zw for pod openshift-network-diagnostics/network-check-target-56dsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:51.525164 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:51.524812 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw podName:3ee7881a-a800-4f6f-9be1-02d6e5892e46 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:53.524794076 +0000 UTC m=+17.177624662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh8zw" (UniqueName: "kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw") pod "network-check-target-56dsz" (UID: "3ee7881a-a800-4f6f-9be1-02d6e5892e46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:51.625551 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:51.624905 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs\") pod \"network-metrics-daemon-7bn4d\" (UID: \"07dffcab-50c2-4c45-8e2e-64656af42fa2\") " pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:49:51.625551 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:51.625047 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:51.625551 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:51.625149 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs podName:07dffcab-50c2-4c45-8e2e-64656af42fa2 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:53.625093809 +0000 UTC m=+17.277924404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs") pod "network-metrics-daemon-7bn4d" (UID: "07dffcab-50c2-4c45-8e2e-64656af42fa2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:51.725739 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:51.725691 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret\") pod \"global-pull-secret-syncer-g82pv\" (UID: \"3b922c97-fed5-44e6-b134-192a137564e7\") " pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:51.725900 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:51.725831 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:51.725900 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:51.725893 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret podName:3b922c97-fed5-44e6-b134-192a137564e7 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:53.72587544 +0000 UTC m=+17.378706033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret") pod "global-pull-secret-syncer-g82pv" (UID: "3b922c97-fed5-44e6-b134-192a137564e7") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:51.808138 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:51.808073 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-15 19:44:49 +0000 UTC" deadline="2027-11-15 10:30:07.800628811 +0000 UTC" Jun 16 19:49:51.808138 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:51.808109 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12398h40m15.992524521s" Jun 16 19:49:51.815979 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:51.814950 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:51.815979 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:51.815071 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:49:51.815979 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:51.815532 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:49:51.815979 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:51.815763 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:49:51.815979 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:51.815846 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:49:51.815979 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:51.815920 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:49:53.542193 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:53.542157 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8zw\" (UniqueName: \"kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw\") pod \"network-check-target-56dsz\" (UID: \"3ee7881a-a800-4f6f-9be1-02d6e5892e46\") " pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:49:53.542609 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:53.542340 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:49:53.542609 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:53.542365 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:49:53.542609 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:53.542376 2557 projected.go:196] Error preparing data for projected volume kube-api-access-nh8zw for pod openshift-network-diagnostics/network-check-target-56dsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:53.542609 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:53.542433 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw podName:3ee7881a-a800-4f6f-9be1-02d6e5892e46 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:57.542414767 +0000 UTC m=+21.195245357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh8zw" (UniqueName: "kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw") pod "network-check-target-56dsz" (UID: "3ee7881a-a800-4f6f-9be1-02d6e5892e46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:53.643321 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:53.643283 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs\") pod \"network-metrics-daemon-7bn4d\" (UID: \"07dffcab-50c2-4c45-8e2e-64656af42fa2\") " pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:49:53.643471 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:53.643394 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:53.643471 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:53.643446 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs podName:07dffcab-50c2-4c45-8e2e-64656af42fa2 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:57.643428443 +0000 UTC m=+21.296259024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs") pod "network-metrics-daemon-7bn4d" (UID: "07dffcab-50c2-4c45-8e2e-64656af42fa2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:53.743707 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:53.743670 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret\") pod \"global-pull-secret-syncer-g82pv\" (UID: \"3b922c97-fed5-44e6-b134-192a137564e7\") " pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:53.743891 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:53.743835 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:53.743949 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:53.743893 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret podName:3b922c97-fed5-44e6-b134-192a137564e7 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:57.743875425 +0000 UTC m=+21.396706009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret") pod "global-pull-secret-syncer-g82pv" (UID: "3b922c97-fed5-44e6-b134-192a137564e7") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:53.816125 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:53.815295 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:49:53.816125 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:53.815416 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:49:53.816125 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:53.815809 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:49:53.816125 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:53.815920 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:49:53.816125 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:53.815967 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:53.816125 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:53.816044 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:49:54.089871 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:54.089784 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 16 19:49:54.141933 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:54.141306 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 16 19:49:55.815261 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:55.815224 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:49:55.815718 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:55.815386 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:49:55.815851 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:55.815822 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:55.815947 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:55.815927 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:49:55.816005 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:55.815987 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:49:55.816068 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:55.816052 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:49:57.574298 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:57.574252 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8zw\" (UniqueName: \"kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw\") pod \"network-check-target-56dsz\" (UID: \"3ee7881a-a800-4f6f-9be1-02d6e5892e46\") " pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:49:57.574723 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:57.574418 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:49:57.574723 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:57.574436 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:49:57.574723 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:57.574445 2557 projected.go:196] Error preparing data for projected volume kube-api-access-nh8zw for pod openshift-network-diagnostics/network-check-target-56dsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:57.574723 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:57.574489 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw podName:3ee7881a-a800-4f6f-9be1-02d6e5892e46 nodeName:}" failed. No retries permitted until 2026-06-16 19:50:05.574476893 +0000 UTC m=+29.227307474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh8zw" (UniqueName: "kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw") pod "network-check-target-56dsz" (UID: "3ee7881a-a800-4f6f-9be1-02d6e5892e46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:57.675085 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:57.675046 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs\") pod \"network-metrics-daemon-7bn4d\" (UID: \"07dffcab-50c2-4c45-8e2e-64656af42fa2\") " pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:49:57.675268 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:57.675195 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:57.675268 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:57.675256 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs podName:07dffcab-50c2-4c45-8e2e-64656af42fa2 nodeName:}" failed. No retries permitted until 2026-06-16 19:50:05.675238573 +0000 UTC m=+29.328069162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs") pod "network-metrics-daemon-7bn4d" (UID: "07dffcab-50c2-4c45-8e2e-64656af42fa2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:57.775432 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:57.775392 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret\") pod \"global-pull-secret-syncer-g82pv\" (UID: \"3b922c97-fed5-44e6-b134-192a137564e7\") " pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:57.775639 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:57.775583 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:57.775712 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:57.775656 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret podName:3b922c97-fed5-44e6-b134-192a137564e7 nodeName:}" failed. No retries permitted until 2026-06-16 19:50:05.775635548 +0000 UTC m=+29.428466135 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret") pod "global-pull-secret-syncer-g82pv" (UID: "3b922c97-fed5-44e6-b134-192a137564e7") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:57.815349 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:57.814690 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:49:57.815349 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:57.814834 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:49:57.815349 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:57.815140 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:57.815349 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:57.815227 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:49:57.815349 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:57.815257 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:49:57.815349 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:57.815321 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:49:59.815076 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:59.815035 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:49:59.815076 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:59.815057 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:49:59.815669 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:59.815188 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:49:59.815669 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:59.815580 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:49:59.815669 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:49:59.815639 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:49:59.815781 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:49:59.815714 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:50:01.814771 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:01.814737 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:01.814771 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:01.814772 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:01.815262 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:01.814740 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:01.815262 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:01.814856 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:50:01.815262 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:01.814920 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:50:01.815262 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:01.814993 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:50:03.814895 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:03.814864 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:03.815434 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:03.814865 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:03.815434 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:03.815026 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:50:03.815434 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:03.814865 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:03.815434 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:03.815076 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:50:03.815434 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:03.815144 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:50:04.632982 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.632944 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9dhlv"] Jun 16 19:50:04.709861 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.709819 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.714101 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.712784 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 16 19:50:04.714101 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.713037 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 16 19:50:04.714101 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.713213 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 16 19:50:04.714101 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.713463 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 16 19:50:04.714101 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.713714 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 16 19:50:04.714101 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.713758 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xndj5\"" Jun 16 19:50:04.714101 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.713950 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 16 19:50:04.815286 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.815260 2557 scope.go:117] "RemoveContainer" containerID="a14edc114b67c144ec976897ee1c2d808941d3f404d7d98523bd8c423675198c" Jun 16 19:50:04.832318 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.832293 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5d94e20-efe5-4e15-b1e1-23ce4c887636-node-exporter-wtmp\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.832452 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.832324 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5d94e20-efe5-4e15-b1e1-23ce4c887636-node-exporter-accelerators-collector-config\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.832452 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.832359 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5d94e20-efe5-4e15-b1e1-23ce4c887636-node-exporter-tls\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.832452 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.832407 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5d94e20-efe5-4e15-b1e1-23ce4c887636-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.832452 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.832447 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5d94e20-efe5-4e15-b1e1-23ce4c887636-root\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.832647 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.832484 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz9bt\" (UniqueName: \"kubernetes.io/projected/e5d94e20-efe5-4e15-b1e1-23ce4c887636-kube-api-access-wz9bt\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.832647 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.832514 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5d94e20-efe5-4e15-b1e1-23ce4c887636-node-exporter-textfile\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.832647 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.832536 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5d94e20-efe5-4e15-b1e1-23ce4c887636-metrics-client-ca\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.832647 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.832609 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5d94e20-efe5-4e15-b1e1-23ce4c887636-sys\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.933256 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.933174 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5d94e20-efe5-4e15-b1e1-23ce4c887636-node-exporter-wtmp\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.933256 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.933207 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5d94e20-efe5-4e15-b1e1-23ce4c887636-node-exporter-accelerators-collector-config\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.933256 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.933246 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5d94e20-efe5-4e15-b1e1-23ce4c887636-node-exporter-tls\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.933530 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.933270 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5d94e20-efe5-4e15-b1e1-23ce4c887636-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.933530 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.933292 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5d94e20-efe5-4e15-b1e1-23ce4c887636-root\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.933530 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.933320 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz9bt\" (UniqueName: \"kubernetes.io/projected/e5d94e20-efe5-4e15-b1e1-23ce4c887636-kube-api-access-wz9bt\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.933530 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.933351 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5d94e20-efe5-4e15-b1e1-23ce4c887636-node-exporter-textfile\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.933530 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.933377 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5d94e20-efe5-4e15-b1e1-23ce4c887636-metrics-client-ca\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.933530 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.933378 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5d94e20-efe5-4e15-b1e1-23ce4c887636-node-exporter-wtmp\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.933530 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.933417 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5d94e20-efe5-4e15-b1e1-23ce4c887636-sys\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.933530 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.933411 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5d94e20-efe5-4e15-b1e1-23ce4c887636-root\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.934266 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.933758 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5d94e20-efe5-4e15-b1e1-23ce4c887636-node-exporter-textfile\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.934266 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.933828 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5d94e20-efe5-4e15-b1e1-23ce4c887636-sys\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.934266 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.933909 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5d94e20-efe5-4e15-b1e1-23ce4c887636-node-exporter-accelerators-collector-config\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.934266 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.933966 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5d94e20-efe5-4e15-b1e1-23ce4c887636-metrics-client-ca\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.936888 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.936865 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5d94e20-efe5-4e15-b1e1-23ce4c887636-node-exporter-tls\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.936990 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.936914 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5d94e20-efe5-4e15-b1e1-23ce4c887636-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:04.942945 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:04.942924 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz9bt\" (UniqueName: \"kubernetes.io/projected/e5d94e20-efe5-4e15-b1e1-23ce4c887636-kube-api-access-wz9bt\") pod \"node-exporter-9dhlv\" (UID: \"e5d94e20-efe5-4e15-b1e1-23ce4c887636\") " pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:05.023373 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:05.023342 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9dhlv" Jun 16 19:50:05.639244 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:05.639216 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8zw\" (UniqueName: \"kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw\") pod \"network-check-target-56dsz\" (UID: \"3ee7881a-a800-4f6f-9be1-02d6e5892e46\") " pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:05.639418 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:05.639401 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:50:05.639480 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:05.639428 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:50:05.639480 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:05.639444 2557 projected.go:196] Error preparing data for projected volume kube-api-access-nh8zw for pod openshift-network-diagnostics/network-check-target-56dsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:50:05.639594 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:05.639510 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw podName:3ee7881a-a800-4f6f-9be1-02d6e5892e46 nodeName:}" failed. No retries permitted until 2026-06-16 19:50:21.639490168 +0000 UTC m=+45.292320751 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh8zw" (UniqueName: "kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw") pod "network-check-target-56dsz" (UID: "3ee7881a-a800-4f6f-9be1-02d6e5892e46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:50:05.740131 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:05.740095 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs\") pod \"network-metrics-daemon-7bn4d\" (UID: \"07dffcab-50c2-4c45-8e2e-64656af42fa2\") " pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:05.740332 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:05.740249 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:50:05.740332 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:05.740310 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs podName:07dffcab-50c2-4c45-8e2e-64656af42fa2 nodeName:}" failed. No retries permitted until 2026-06-16 19:50:21.740295283 +0000 UTC m=+45.393125864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs") pod "network-metrics-daemon-7bn4d" (UID: "07dffcab-50c2-4c45-8e2e-64656af42fa2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:50:05.815319 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:05.815290 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:05.815935 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:05.815411 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:05.815935 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:05.815424 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:05.815935 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:05.815421 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:50:05.815935 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:05.815507 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:50:05.815935 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:05.815611 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:50:05.841395 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:05.841363 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret\") pod \"global-pull-secret-syncer-g82pv\" (UID: \"3b922c97-fed5-44e6-b134-192a137564e7\") " pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:05.841584 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:05.841523 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:50:05.841655 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:05.841597 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret podName:3b922c97-fed5-44e6-b134-192a137564e7 nodeName:}" failed. No retries permitted until 2026-06-16 19:50:21.841578826 +0000 UTC m=+45.494409410 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret") pod "global-pull-secret-syncer-g82pv" (UID: "3b922c97-fed5-44e6-b134-192a137564e7") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:50:07.814852 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:07.814811 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:07.815326 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:07.814856 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:07.815326 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:07.814856 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:07.815326 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:07.814939 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:50:07.815326 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:07.815055 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:50:07.815326 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:07.815133 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:50:08.897800 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:50:08.897667 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d94e20_efe5_4e15_b1e1_23ce4c887636.slice/crio-d3a3d92ce75c70ca4d013700283ea893db4cf5b2343b83c9b3bd0b5f1735bd14 WatchSource:0}: Error finding container d3a3d92ce75c70ca4d013700283ea893db4cf5b2343b83c9b3bd0b5f1735bd14: Status 404 returned error can't find the container with id d3a3d92ce75c70ca4d013700283ea893db4cf5b2343b83c9b3bd0b5f1735bd14 Jun 16 19:50:08.976398 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:08.976202 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9dhlv" event={"ID":"e5d94e20-efe5-4e15-b1e1-23ce4c887636","Type":"ContainerStarted","Data":"d3a3d92ce75c70ca4d013700283ea893db4cf5b2343b83c9b3bd0b5f1735bd14"} Jun 16 19:50:09.814958 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.814773 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:09.815139 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:09.815030 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:50:09.815139 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.814793 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:09.815139 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:09.815110 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:50:09.815139 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.814773 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:09.815283 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:09.815194 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:50:09.983444 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.983402 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" event={"ID":"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5","Type":"ContainerStarted","Data":"379396e4a053544c0e0736ca001d86a448c4c4c8069f264efbd917b3f72fdc8d"} Jun 16 19:50:09.985121 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.985085 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w5b7l" event={"ID":"245829e4-8785-4cab-900c-c1adadd5cc63","Type":"ContainerStarted","Data":"6de5a24068e66cbeba29ab8d4d922f3f9f3c86bc9d3cdf91e955fa96ede1c971"} Jun 16 19:50:09.987412 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.987393 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 19:50:09.987882 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.987855 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" event={"ID":"cc6da1b13bca282ef865b3244f5b60b1","Type":"ContainerStarted","Data":"574a017a383c16a7f34425eee04bc96d4d1b789d45a9bbb01b0d3d3cedc651e1"} Jun 16 19:50:09.989559 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.989537 2557 generic.go:356] "Generic (PLEG): container finished" podID="57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1" containerID="259ec4be306ef84892ea9ba415c7fa8a8f69a1fa482e31aecc9af0c9091b8002" exitCode=0 Jun 16 19:50:09.989671 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.989638 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8hwv" event={"ID":"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1","Type":"ContainerDied","Data":"259ec4be306ef84892ea9ba415c7fa8a8f69a1fa482e31aecc9af0c9091b8002"} Jun 16 19:50:09.991694 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.991671 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" event={"ID":"76583c21-b8f4-4e80-830b-0b94f503b8c7","Type":"ContainerStarted","Data":"a22ae26e3a2b2f750cbbfb74af67308f6d4ecf98c33aa647e8d0343220572151"} Jun 16 19:50:09.993260 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.993227 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2hdpp" event={"ID":"cf160577-a0e9-40fa-8392-f06851ff4e56","Type":"ContainerStarted","Data":"9ca643d0bfc1fc331e4506dc2db1e84c621d97054ecba0f582f1fb0b23586459"} Jun 16 19:50:09.994740 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.994720 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zkxmt" event={"ID":"fbbf7145-3244-4200-8748-797f2c7ac75a","Type":"ContainerStarted","Data":"f23931431d4777130d3f40edddc7d9c7865d1cf3c1382f0bfd0a7a5dde2981bf"} Jun 16 19:50:09.996271 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.996248 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sq5nb" event={"ID":"c183ed90-881e-4a72-bb89-056cc0f54cd3","Type":"ContainerStarted","Data":"7a98ee3b91920532ed7a3830bb7bfc896c6102e8c42a0ee09c5b9bb8abf1f3e7"} Jun 16 19:50:09.999218 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.999198 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 19:50:09.999597 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.999550 2557 generic.go:356] "Generic (PLEG): container finished" podID="c70e4a62-c85d-4f3d-9509-25c257bdb0af" containerID="3f2142696741afe1f5385904dc9e8edde0360e5dc1f480ed9076433d917572de" exitCode=1 Jun 16 19:50:09.999671 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.999598 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" event={"ID":"c70e4a62-c85d-4f3d-9509-25c257bdb0af","Type":"ContainerStarted","Data":"5043badc2d15f16363936eda7858ae80488f866d542607dbf76587f6167b37fd"} Jun 16 19:50:09.999726 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.999672 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" event={"ID":"c70e4a62-c85d-4f3d-9509-25c257bdb0af","Type":"ContainerStarted","Data":"4ad0fafd10ad8af310c8ce87da5979f30d70adf15bc3c5d0e6b23f94d77c5d84"} Jun 16 19:50:09.999791 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.999723 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" event={"ID":"c70e4a62-c85d-4f3d-9509-25c257bdb0af","Type":"ContainerStarted","Data":"3bdf3dfeb26a991c72c179158fba156f9072962ecda439bffc04595679c23ee6"} Jun 16 19:50:09.999791 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.999770 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" event={"ID":"c70e4a62-c85d-4f3d-9509-25c257bdb0af","Type":"ContainerStarted","Data":"f0ae57420f0f5e97d982214cdcfa979aeae8a3070cea5e851bf1ef84d71d0d89"} Jun 16 19:50:09.999894 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.999818 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" event={"ID":"c70e4a62-c85d-4f3d-9509-25c257bdb0af","Type":"ContainerDied","Data":"3f2142696741afe1f5385904dc9e8edde0360e5dc1f480ed9076433d917572de"} Jun 16 19:50:09.999894 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:09.999867 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" event={"ID":"c70e4a62-c85d-4f3d-9509-25c257bdb0af","Type":"ContainerStarted","Data":"93b2320fcf91011d9b24039d8f05b9e7c5a684372a236b27a2d427e926264238"} Jun 16 19:50:10.005512 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:10.005470 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-w5b7l" podStartSLOduration=2.288296606 podStartE2EDuration="21.005453272s" totalImagesPullingTime="18.717156666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:10.004792286 +0000 UTC m=+33.657622892" watchObservedRunningTime="2026-06-16 19:50:10.005453272 +0000 UTC m=+33.658283878" Jun 16 19:50:10.045035 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:10.044987 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal" podStartSLOduration=21.044972408 podStartE2EDuration="21.044972408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:10.044584235 +0000 UTC m=+33.697414837" watchObservedRunningTime="2026-06-16 19:50:10.044972408 +0000 UTC m=+33.697803010" Jun 16 19:50:10.063670 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:10.063611 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5hj7c" podStartSLOduration=2.254102119 podStartE2EDuration="21.06359666s" totalImagesPullingTime="18.809494541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:10.062635598 +0000 UTC m=+33.715466201" watchObservedRunningTime="2026-06-16 19:50:10.06359666 +0000 UTC m=+33.716427262" Jun 16 19:50:10.082807 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:10.082734 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sq5nb" podStartSLOduration=10.613133816 podStartE2EDuration="21.082721648s" totalImagesPullingTime="10.469587832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:10.082314074 +0000 UTC m=+33.735144690" watchObservedRunningTime="2026-06-16 19:50:10.082721648 +0000 UTC m=+33.735552251" Jun 16 19:50:10.101049 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:10.100991 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zkxmt" podStartSLOduration=2.209339469 podStartE2EDuration="21.100974375s" totalImagesPullingTime="18.891634906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:10.10046684 +0000 UTC m=+33.753297443" watchObservedRunningTime="2026-06-16 19:50:10.100974375 +0000 UTC m=+33.753804979" Jun 16 19:50:10.119927 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:10.119887 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2hdpp" podStartSLOduration=2.311484713 podStartE2EDuration="21.119874488s" totalImagesPullingTime="18.808389775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:10.119685756 +0000 UTC m=+33.772516363" watchObservedRunningTime="2026-06-16 19:50:10.119874488 +0000 UTC m=+33.772705091" Jun 16 19:50:10.878138 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:10.878112 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 16 19:50:11.003355 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:11.003327 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-46ksf" event={"ID":"9b02e210-6c96-478d-a4b8-f9d09d5946d8","Type":"ContainerStarted","Data":"02a2170b61d644ab352e7c3704d8cfb2a139fcf8d7799385c160f5ebb3da5d22"} Jun 16 19:50:11.005386 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:11.005362 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" event={"ID":"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5","Type":"ContainerStarted","Data":"6ab18b5b71298c39a62299d5d8770e41e236ad3a5f34b2b6aec369d9e937a107"} Jun 16 19:50:11.006679 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:11.006657 2557 generic.go:356] "Generic (PLEG): container finished" podID="e5d94e20-efe5-4e15-b1e1-23ce4c887636" containerID="7a198d3e4667bd437e22aeab0437daad8843a9d00fa1c41e641f330ad5dbaecc" exitCode=0 Jun 16 19:50:11.006796 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:11.006774 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9dhlv" event={"ID":"e5d94e20-efe5-4e15-b1e1-23ce4c887636","Type":"ContainerDied","Data":"7a198d3e4667bd437e22aeab0437daad8843a9d00fa1c41e641f330ad5dbaecc"} Jun 16 19:50:11.021714 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:11.021671 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-46ksf" podStartSLOduration=3.502114124 podStartE2EDuration="22.021654594s" totalImagesPullingTime="18.51954047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:11.02147928 +0000 UTC m=+34.674309883" watchObservedRunningTime="2026-06-16 19:50:11.021654594 +0000 UTC m=+34.674485200" Jun 16 19:50:11.814692 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:11.814665 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:11.814864 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:11.814761 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:11.814864 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:11.814763 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:50:11.814864 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:11.814807 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:11.815027 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:11.814891 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:50:11.815027 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:11.814987 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:50:11.818765 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:11.818697 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-16T19:50:10.878133909Z","UUID":"8541ca34-b907-4d36-8623-78904bdcfd46","Handler":null,"Name":"","Endpoint":""} Jun 16 19:50:11.820067 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:11.820053 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 16 19:50:11.820163 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:11.820092 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 16 19:50:12.012664 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:12.012606 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 19:50:12.013244 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:12.013085 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" event={"ID":"c70e4a62-c85d-4f3d-9509-25c257bdb0af","Type":"ContainerStarted","Data":"b39f9fcbde4bf605c6ed2374ed89490e297120ba1f07f7ade2c85dbd8f0539a8"} Jun 16 19:50:12.016541 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:12.016515 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9dhlv" event={"ID":"e5d94e20-efe5-4e15-b1e1-23ce4c887636","Type":"ContainerStarted","Data":"790a3c66fea3b4bf26245cad1b3f3fa70da5919461fedf065a34a501227a5f65"} Jun 16 19:50:12.017120 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:12.016695 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9dhlv" event={"ID":"e5d94e20-efe5-4e15-b1e1-23ce4c887636","Type":"ContainerStarted","Data":"ddf8a8ba3cfde8340b2ce6573a19791a926a439a8d36f7dbe670f37ddee03023"} Jun 16 19:50:12.041542 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:12.041498 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9dhlv" podStartSLOduration=6.095850327 podStartE2EDuration="8.041484747s" totalImagesPullingTime="1.794032735s" totalInitContainerRuntime="151.601685ms" isStatefulPod=true podCreationTimestamp="2026-06-16 19:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:12.041100783 +0000 UTC m=+35.693931385" watchObservedRunningTime="2026-06-16 19:50:12.041484747 +0000 UTC m=+35.694315350" Jun 16 19:50:12.544240 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:12.544210 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sq5nb" Jun 16 19:50:13.021856 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:13.021820 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" event={"ID":"125e2a0d-fbdc-45ad-b1ee-634b34d13bc5","Type":"ContainerStarted","Data":"415f900fd094e16f222c6f6ae3e16ef599eff5e6a6546a7fc9c7cbb06cd12c51"} Jun 16 19:50:13.040654 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:13.040607 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-496bk" podStartSLOduration=2.78307064 podStartE2EDuration="24.040592623s" totalImagesPullingTime="21.257521983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:13.040546127 +0000 UTC m=+36.693376731" watchObservedRunningTime="2026-06-16 19:50:13.040592623 +0000 UTC m=+36.693423208" Jun 16 19:50:13.814991 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:13.814957 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:13.815158 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:13.814957 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:13.815158 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:13.815084 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:50:13.815158 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:13.814957 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:13.815315 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:13.815199 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:50:13.815315 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:13.815135 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:50:14.974154 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:14.973949 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sq5nb" Jun 16 19:50:14.974644 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:14.974448 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sq5nb" Jun 16 19:50:15.031587 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:15.031536 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 19:50:15.032027 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:15.031996 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" event={"ID":"c70e4a62-c85d-4f3d-9509-25c257bdb0af","Type":"ContainerStarted","Data":"96292be34b576a7c0fb10e8578e4cf8f7c4c4178f9896fe87e740dad78f6a6ed"} Jun 16 19:50:15.032279 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:15.032257 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:50:15.032457 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:15.032438 2557 scope.go:117] "RemoveContainer" containerID="3f2142696741afe1f5385904dc9e8edde0360e5dc1f480ed9076433d917572de" Jun 16 19:50:15.032893 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:15.032843 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sq5nb" Jun 16 19:50:15.049721 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:15.049703 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:50:15.815002 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:15.814972 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:15.815251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:15.815006 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:15.815251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:15.815006 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:15.815251 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:15.815083 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:50:15.815251 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:15.815193 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:50:15.815461 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:15.815251 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:50:16.215016 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:16.214823 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:50:16.363526 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:16.363493 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g82pv"] Jun 16 19:50:16.363727 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:16.363619 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:16.363727 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:16.363710 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:50:16.366883 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:16.366854 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-56dsz"] Jun 16 19:50:16.367000 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:16.366956 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:16.367111 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:16.367067 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:50:16.367551 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:16.367530 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7bn4d"] Jun 16 19:50:16.367658 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:16.367624 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:16.367718 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:16.367702 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:50:17.038390 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:17.038361 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8hwv" event={"ID":"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1","Type":"ContainerStarted","Data":"d2b51c4df82b91b9c68117dea170ccc8dc0a81399c0caacdb502f000f2a29df1"} Jun 16 19:50:17.041823 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:17.041804 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 19:50:17.042216 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:17.042187 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" event={"ID":"c70e4a62-c85d-4f3d-9509-25c257bdb0af","Type":"ContainerStarted","Data":"0fcf9a223887589417df4f46a984b2889b9280b0078b5f960a229555876ac9ee"} Jun 16 19:50:17.042462 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:17.042446 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:50:17.057348 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:17.057308 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:50:17.084308 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:17.084229 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" podStartSLOduration=8.536425947 podStartE2EDuration="27.084211911s" totalImagesPullingTime="18.547785964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:17.083835318 +0000 UTC m=+40.736665955" watchObservedRunningTime="2026-06-16 19:50:17.084211911 +0000 UTC m=+40.737042515" Jun 16 19:50:17.814870 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:17.814838 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:17.815499 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:17.814937 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:17.815499 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:17.814948 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:50:17.815499 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:17.814960 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:17.815499 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:17.815010 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:50:17.815499 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:17.815070 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:50:18.047440 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:18.047415 2557 generic.go:356] "Generic (PLEG): container finished" podID="57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1" containerID="d2b51c4df82b91b9c68117dea170ccc8dc0a81399c0caacdb502f000f2a29df1" exitCode=0 Jun 16 19:50:18.047549 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:18.047500 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8hwv" event={"ID":"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1","Type":"ContainerDied","Data":"d2b51c4df82b91b9c68117dea170ccc8dc0a81399c0caacdb502f000f2a29df1"} Jun 16 19:50:19.067469 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:19.067425 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" podUID="c70e4a62-c85d-4f3d-9509-25c257bdb0af" containerName="ovnkube-controller" probeResult="failure" output="" Jun 16 19:50:19.815616 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:19.815429 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:19.815787 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:19.815434 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:19.815787 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:19.815692 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:50:19.815881 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:19.815803 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:50:19.815881 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:19.815486 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:19.815942 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:19.815909 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:50:20.053789 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:20.053756 2557 generic.go:356] "Generic (PLEG): container finished" podID="57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1" containerID="fb73ae5aaaf33b547d8dc56c2468696800e6def30d6c212f7d05fc91c04eb5ca" exitCode=0 Jun 16 19:50:20.053948 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:20.053833 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8hwv" event={"ID":"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1","Type":"ContainerDied","Data":"fb73ae5aaaf33b547d8dc56c2468696800e6def30d6c212f7d05fc91c04eb5ca"} Jun 16 19:50:21.059037 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:21.059006 2557 generic.go:356] "Generic (PLEG): container finished" podID="57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1" containerID="eb17ca193f2a211926c416810968a412e3fdcbf90ab56c01a7bc95a2619ef1ee" exitCode=0 Jun 16 19:50:21.059376 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:21.059049 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8hwv" event={"ID":"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1","Type":"ContainerDied","Data":"eb17ca193f2a211926c416810968a412e3fdcbf90ab56c01a7bc95a2619ef1ee"} Jun 16 19:50:21.660098 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:21.660065 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8zw\" (UniqueName: \"kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw\") pod \"network-check-target-56dsz\" (UID: \"3ee7881a-a800-4f6f-9be1-02d6e5892e46\") " pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:21.660227 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:21.660200 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:50:21.660227 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:21.660218 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:50:21.660227 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:21.660226 2557 projected.go:196] Error preparing data for projected volume kube-api-access-nh8zw for pod openshift-network-diagnostics/network-check-target-56dsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:50:21.660392 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:21.660278 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw podName:3ee7881a-a800-4f6f-9be1-02d6e5892e46 nodeName:}" failed. No retries permitted until 2026-06-16 19:50:53.660261431 +0000 UTC m=+77.313092021 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nh8zw" (UniqueName: "kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw") pod "network-check-target-56dsz" (UID: "3ee7881a-a800-4f6f-9be1-02d6e5892e46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:50:21.761430 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:21.761390 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs\") pod \"network-metrics-daemon-7bn4d\" (UID: \"07dffcab-50c2-4c45-8e2e-64656af42fa2\") " pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:21.761609 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:21.761554 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:50:21.761664 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:21.761653 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs podName:07dffcab-50c2-4c45-8e2e-64656af42fa2 nodeName:}" failed. No retries permitted until 2026-06-16 19:50:53.761636077 +0000 UTC m=+77.414466664 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs") pod "network-metrics-daemon-7bn4d" (UID: "07dffcab-50c2-4c45-8e2e-64656af42fa2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:50:21.815484 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:21.815458 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:21.815675 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:21.815459 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:21.815675 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:21.815599 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7bn4d" podUID="07dffcab-50c2-4c45-8e2e-64656af42fa2" Jun 16 19:50:21.815777 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:21.815683 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56dsz" podUID="3ee7881a-a800-4f6f-9be1-02d6e5892e46" Jun 16 19:50:21.815777 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:21.815459 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:21.815853 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:21.815787 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g82pv" podUID="3b922c97-fed5-44e6-b134-192a137564e7" Jun 16 19:50:21.862805 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:21.862772 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret\") pod \"global-pull-secret-syncer-g82pv\" (UID: \"3b922c97-fed5-44e6-b134-192a137564e7\") " pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:21.862970 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:21.862945 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:50:21.863036 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:50:21.863027 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret podName:3b922c97-fed5-44e6-b134-192a137564e7 nodeName:}" failed. No retries permitted until 2026-06-16 19:50:53.862979795 +0000 UTC m=+77.515810376 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret") pod "global-pull-secret-syncer-g82pv" (UID: "3b922c97-fed5-44e6-b134-192a137564e7") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:50:22.169081 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.169049 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-77.ec2.internal" event="NodeReady" Jun 16 19:50:22.169526 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.169185 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 16 19:50:22.236358 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.236326 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7qpv6"] Jun 16 19:50:22.258634 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.258609 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xprhm"] Jun 16 19:50:22.258769 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.258736 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7qpv6" Jun 16 19:50:22.261956 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.261726 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 16 19:50:22.262112 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.262007 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dg7s6\"" Jun 16 19:50:22.262112 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.262018 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 16 19:50:22.262475 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.262456 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 16 19:50:22.265865 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.265845 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmdz8\" (UniqueName: \"kubernetes.io/projected/c812a43c-91e5-47bd-a649-2e27a20db227-kube-api-access-rmdz8\") pod \"ingress-canary-7qpv6\" (UID: \"c812a43c-91e5-47bd-a649-2e27a20db227\") " pod="openshift-ingress-canary/ingress-canary-7qpv6" Jun 16 19:50:22.265975 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.265887 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c812a43c-91e5-47bd-a649-2e27a20db227-cert\") pod \"ingress-canary-7qpv6\" (UID: \"c812a43c-91e5-47bd-a649-2e27a20db227\") " pod="openshift-ingress-canary/ingress-canary-7qpv6" Jun 16 19:50:22.273862 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.273830 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7qpv6"] Jun 16 19:50:22.273987 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.273866 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xprhm"] Jun 16 19:50:22.273987 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.273968 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.278806 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.278780 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 16 19:50:22.278910 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.278824 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 16 19:50:22.279360 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.279335 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 16 19:50:22.279457 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.279394 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-27kct\"" Jun 16 19:50:22.280230 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.280200 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 16 19:50:22.337334 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.337295 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d7qqp"] Jun 16 19:50:22.361209 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.361185 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d7qqp"] Jun 16 19:50:22.361402 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.361287 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d7qqp" Jun 16 19:50:22.364354 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.364333 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 16 19:50:22.364445 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.364333 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 16 19:50:22.364445 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.364333 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j9jnd\"" Jun 16 19:50:22.367206 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.366757 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c812a43c-91e5-47bd-a649-2e27a20db227-cert\") pod \"ingress-canary-7qpv6\" (UID: \"c812a43c-91e5-47bd-a649-2e27a20db227\") " pod="openshift-ingress-canary/ingress-canary-7qpv6" Jun 16 19:50:22.367206 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.366799 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07faee47-5575-472d-a8a0-809677d270f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xprhm\" (UID: \"07faee47-5575-472d-a8a0-809677d270f1\") " pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.367206 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.366825 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/00be44e7-5d9a-48be-aa2e-3354d49154c0-config-volume\") pod \"dns-default-d7qqp\" (UID: \"00be44e7-5d9a-48be-aa2e-3354d49154c0\") " pod="openshift-dns/dns-default-d7qqp" Jun 16 19:50:22.367206 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.366849 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00be44e7-5d9a-48be-aa2e-3354d49154c0-metrics-tls\") pod \"dns-default-d7qqp\" (UID: \"00be44e7-5d9a-48be-aa2e-3354d49154c0\") " pod="openshift-dns/dns-default-d7qqp" Jun 16 19:50:22.367206 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.366901 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07faee47-5575-472d-a8a0-809677d270f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xprhm\" (UID: \"07faee47-5575-472d-a8a0-809677d270f1\") " pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.367206 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.366918 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00be44e7-5d9a-48be-aa2e-3354d49154c0-tmp-dir\") pod \"dns-default-d7qqp\" (UID: \"00be44e7-5d9a-48be-aa2e-3354d49154c0\") " pod="openshift-dns/dns-default-d7qqp" Jun 16 19:50:22.367206 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.366966 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khvzf\" (UniqueName: \"kubernetes.io/projected/07faee47-5575-472d-a8a0-809677d270f1-kube-api-access-khvzf\") pod \"insights-runtime-extractor-xprhm\" (UID: \"07faee47-5575-472d-a8a0-809677d270f1\") " pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.367206 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.366991 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmdz8\" (UniqueName: \"kubernetes.io/projected/c812a43c-91e5-47bd-a649-2e27a20db227-kube-api-access-rmdz8\") pod \"ingress-canary-7qpv6\" (UID: \"c812a43c-91e5-47bd-a649-2e27a20db227\") " pod="openshift-ingress-canary/ingress-canary-7qpv6" Jun 16 19:50:22.367206 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.367010 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07faee47-5575-472d-a8a0-809677d270f1-data-volume\") pod \"insights-runtime-extractor-xprhm\" (UID: \"07faee47-5575-472d-a8a0-809677d270f1\") " pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.367206 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.367042 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqf7b\" (UniqueName: \"kubernetes.io/projected/00be44e7-5d9a-48be-aa2e-3354d49154c0-kube-api-access-dqf7b\") pod \"dns-default-d7qqp\" (UID: \"00be44e7-5d9a-48be-aa2e-3354d49154c0\") " pod="openshift-dns/dns-default-d7qqp" Jun 16 19:50:22.367206 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.367059 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07faee47-5575-472d-a8a0-809677d270f1-crio-socket\") pod \"insights-runtime-extractor-xprhm\" (UID: \"07faee47-5575-472d-a8a0-809677d270f1\") " pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.372288 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.372267 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c812a43c-91e5-47bd-a649-2e27a20db227-cert\") pod \"ingress-canary-7qpv6\" (UID: \"c812a43c-91e5-47bd-a649-2e27a20db227\") " pod="openshift-ingress-canary/ingress-canary-7qpv6" Jun 16 19:50:22.381655 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.381481 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmdz8\" (UniqueName: \"kubernetes.io/projected/c812a43c-91e5-47bd-a649-2e27a20db227-kube-api-access-rmdz8\") pod \"ingress-canary-7qpv6\" (UID: \"c812a43c-91e5-47bd-a649-2e27a20db227\") " pod="openshift-ingress-canary/ingress-canary-7qpv6" Jun 16 19:50:22.467697 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.467616 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khvzf\" (UniqueName: \"kubernetes.io/projected/07faee47-5575-472d-a8a0-809677d270f1-kube-api-access-khvzf\") pod \"insights-runtime-extractor-xprhm\" (UID: \"07faee47-5575-472d-a8a0-809677d270f1\") " pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.467697 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.467652 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07faee47-5575-472d-a8a0-809677d270f1-data-volume\") pod \"insights-runtime-extractor-xprhm\" (UID: \"07faee47-5575-472d-a8a0-809677d270f1\") " pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.467915 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.467775 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqf7b\" (UniqueName: \"kubernetes.io/projected/00be44e7-5d9a-48be-aa2e-3354d49154c0-kube-api-access-dqf7b\") pod \"dns-default-d7qqp\" (UID: \"00be44e7-5d9a-48be-aa2e-3354d49154c0\") " pod="openshift-dns/dns-default-d7qqp" Jun 16 19:50:22.467915 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.467813 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07faee47-5575-472d-a8a0-809677d270f1-crio-socket\") pod \"insights-runtime-extractor-xprhm\" (UID: \"07faee47-5575-472d-a8a0-809677d270f1\") " pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.467915 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.467845 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07faee47-5575-472d-a8a0-809677d270f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xprhm\" (UID: \"07faee47-5575-472d-a8a0-809677d270f1\") " pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.467915 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.467869 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/00be44e7-5d9a-48be-aa2e-3354d49154c0-config-volume\") pod \"dns-default-d7qqp\" (UID: \"00be44e7-5d9a-48be-aa2e-3354d49154c0\") " pod="openshift-dns/dns-default-d7qqp" Jun 16 19:50:22.467915 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.467898 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00be44e7-5d9a-48be-aa2e-3354d49154c0-metrics-tls\") pod \"dns-default-d7qqp\" (UID: \"00be44e7-5d9a-48be-aa2e-3354d49154c0\") " pod="openshift-dns/dns-default-d7qqp" Jun 16 19:50:22.468175 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.467947 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07faee47-5575-472d-a8a0-809677d270f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xprhm\" (UID: \"07faee47-5575-472d-a8a0-809677d270f1\") " pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.468175 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.467971 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00be44e7-5d9a-48be-aa2e-3354d49154c0-tmp-dir\") pod \"dns-default-d7qqp\" (UID: \"00be44e7-5d9a-48be-aa2e-3354d49154c0\") " pod="openshift-dns/dns-default-d7qqp" Jun 16 19:50:22.468175 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.467976 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07faee47-5575-472d-a8a0-809677d270f1-data-volume\") pod \"insights-runtime-extractor-xprhm\" (UID: \"07faee47-5575-472d-a8a0-809677d270f1\") " pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.468175 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.468031 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07faee47-5575-472d-a8a0-809677d270f1-crio-socket\") pod \"insights-runtime-extractor-xprhm\" (UID: \"07faee47-5575-472d-a8a0-809677d270f1\") " pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.468377 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.468353 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00be44e7-5d9a-48be-aa2e-3354d49154c0-tmp-dir\") pod \"dns-default-d7qqp\" (UID: \"00be44e7-5d9a-48be-aa2e-3354d49154c0\") " pod="openshift-dns/dns-default-d7qqp" Jun 16 19:50:22.468621 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.468597 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07faee47-5575-472d-a8a0-809677d270f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xprhm\" (UID: \"07faee47-5575-472d-a8a0-809677d270f1\") " pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.468708 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.468600 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/00be44e7-5d9a-48be-aa2e-3354d49154c0-config-volume\") pod \"dns-default-d7qqp\" (UID: \"00be44e7-5d9a-48be-aa2e-3354d49154c0\") " pod="openshift-dns/dns-default-d7qqp" Jun 16 19:50:22.470541 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.470516 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07faee47-5575-472d-a8a0-809677d270f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xprhm\" (UID: \"07faee47-5575-472d-a8a0-809677d270f1\") " pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.470769 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.470744 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00be44e7-5d9a-48be-aa2e-3354d49154c0-metrics-tls\") pod \"dns-default-d7qqp\" (UID: \"00be44e7-5d9a-48be-aa2e-3354d49154c0\") " pod="openshift-dns/dns-default-d7qqp" Jun 16 19:50:22.479516 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.479493 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khvzf\" (UniqueName: \"kubernetes.io/projected/07faee47-5575-472d-a8a0-809677d270f1-kube-api-access-khvzf\") pod \"insights-runtime-extractor-xprhm\" (UID: \"07faee47-5575-472d-a8a0-809677d270f1\") " pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.480256 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.480235 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqf7b\" (UniqueName: \"kubernetes.io/projected/00be44e7-5d9a-48be-aa2e-3354d49154c0-kube-api-access-dqf7b\") pod \"dns-default-d7qqp\" (UID: \"00be44e7-5d9a-48be-aa2e-3354d49154c0\") " pod="openshift-dns/dns-default-d7qqp" Jun 16 19:50:22.570285 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.570256 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7qpv6" Jun 16 19:50:22.585495 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.585461 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xprhm" Jun 16 19:50:22.671535 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.671502 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d7qqp" Jun 16 19:50:22.793274 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.793242 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7qpv6"] Jun 16 19:50:22.797547 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.797518 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xprhm"] Jun 16 19:50:22.856444 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:22.856402 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d7qqp"] Jun 16 19:50:22.860015 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:50:22.859988 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00be44e7_5d9a_48be_aa2e_3354d49154c0.slice/crio-de6ba359b9b2f31b87b9cf58f5ad6235ef47ef4001b8b56135a8669f20926782 WatchSource:0}: Error finding container de6ba359b9b2f31b87b9cf58f5ad6235ef47ef4001b8b56135a8669f20926782: Status 404 returned error can't find the container with id de6ba359b9b2f31b87b9cf58f5ad6235ef47ef4001b8b56135a8669f20926782 Jun 16 19:50:23.065775 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:23.065737 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7qpv6" event={"ID":"c812a43c-91e5-47bd-a649-2e27a20db227","Type":"ContainerStarted","Data":"8129c84c2bcc5f29bb026eaa4263427d3d3d0c40550ce6c2b793558aa9380285"} Jun 16 19:50:23.066902 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:23.066874 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xprhm" event={"ID":"07faee47-5575-472d-a8a0-809677d270f1","Type":"ContainerStarted","Data":"027d9df76714223765fb2b7eaa211f5b9861440b424ad69c0c70cd6bd4f625c6"} Jun 16 19:50:23.067985 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:23.067965 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d7qqp" event={"ID":"00be44e7-5d9a-48be-aa2e-3354d49154c0","Type":"ContainerStarted","Data":"de6ba359b9b2f31b87b9cf58f5ad6235ef47ef4001b8b56135a8669f20926782"} Jun 16 19:50:23.814944 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:23.814710 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:23.815442 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:23.815351 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:23.816075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:23.815797 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:23.819887 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:23.819697 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 16 19:50:23.823138 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:23.821907 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 16 19:50:23.823138 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:23.822301 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ct5dx\"" Jun 16 19:50:23.823138 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:23.822511 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 16 19:50:23.823138 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:23.822715 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xrkc\"" Jun 16 19:50:23.823138 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:23.822916 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 16 19:50:28.181005 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.180971 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79ffd84f84-g22b6"] Jun 16 19:50:28.203180 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.203109 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79ffd84f84-g22b6"] Jun 16 19:50:28.203340 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.203233 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.207588 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.207541 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 16 19:50:28.208153 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.208134 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 16 19:50:28.208777 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.208759 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 16 19:50:28.208877 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.208820 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 16 19:50:28.209790 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.209762 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4rflm\"" Jun 16 19:50:28.209790 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.209783 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 16 19:50:28.209943 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.209795 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 16 19:50:28.213208 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.213061 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 16 19:50:28.217041 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.217013 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-trusted-ca-bundle\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.217136 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.217076 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-service-ca\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.217212 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.217188 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-oauth-serving-cert\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.217264 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.217231 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-oauth-config\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.217319 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.217266 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-serving-cert\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.217369 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.217357 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-config\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.217418 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.217401 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg2jg\" (UniqueName: \"kubernetes.io/projected/58fa33e9-f8e5-4712-8b39-453ea4f54941-kube-api-access-gg2jg\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.222344 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.222315 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 16 19:50:28.318279 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.318232 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-oauth-serving-cert\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.318279 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.318279 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-oauth-config\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.318586 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.318539 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-serving-cert\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.318633 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.318619 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-config\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.318678 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.318650 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg2jg\" (UniqueName: \"kubernetes.io/projected/58fa33e9-f8e5-4712-8b39-453ea4f54941-kube-api-access-gg2jg\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.318728 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.318686 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-trusted-ca-bundle\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.318728 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.318715 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-service-ca\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.319107 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.319056 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-oauth-serving-cert\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.319384 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.319357 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-config\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.319674 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.319616 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-service-ca\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.320134 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.320108 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-trusted-ca-bundle\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.322252 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.322232 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-oauth-config\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.322414 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.322397 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-serving-cert\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.329700 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.329678 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg2jg\" (UniqueName: \"kubernetes.io/projected/58fa33e9-f8e5-4712-8b39-453ea4f54941-kube-api-access-gg2jg\") pod \"console-79ffd84f84-g22b6\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:28.514908 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:28.514876 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:29.741676 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:29.741635 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79ffd84f84-g22b6"] Jun 16 19:50:29.745212 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:50:29.745155 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58fa33e9_f8e5_4712_8b39_453ea4f54941.slice/crio-c8afc01f0767780e751027bf1baeedc802844bb863eba943bb9bb6722ff62898 WatchSource:0}: Error finding container c8afc01f0767780e751027bf1baeedc802844bb863eba943bb9bb6722ff62898: Status 404 returned error can't find the container with id c8afc01f0767780e751027bf1baeedc802844bb863eba943bb9bb6722ff62898 Jun 16 19:50:30.089970 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:30.089933 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d7qqp" event={"ID":"00be44e7-5d9a-48be-aa2e-3354d49154c0","Type":"ContainerStarted","Data":"0ffbebbf6ee01e0b4b136cb5b217f12873d821114269d1407c758789e043359c"} Jun 16 19:50:30.090140 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:30.089997 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d7qqp" event={"ID":"00be44e7-5d9a-48be-aa2e-3354d49154c0","Type":"ContainerStarted","Data":"f5afdd482819b67eca3c4594d13d04ca6768f6a63b7ceae9f4b69698e32a864c"} Jun 16 19:50:30.090140 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:30.090063 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d7qqp" Jun 16 19:50:30.091087 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:30.091068 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79ffd84f84-g22b6" event={"ID":"58fa33e9-f8e5-4712-8b39-453ea4f54941","Type":"ContainerStarted","Data":"c8afc01f0767780e751027bf1baeedc802844bb863eba943bb9bb6722ff62898"} Jun 16 19:50:30.093547 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:30.093527 2557 generic.go:356] "Generic (PLEG): container finished" podID="57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1" containerID="fdd550cb998fcd6420db69a6bb0f5d2b78e73b7880381f7e0ed2ccc7263c0a44" exitCode=0 Jun 16 19:50:30.093642 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:30.093607 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8hwv" event={"ID":"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1","Type":"ContainerDied","Data":"fdd550cb998fcd6420db69a6bb0f5d2b78e73b7880381f7e0ed2ccc7263c0a44"} Jun 16 19:50:30.095299 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:30.095275 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7qpv6" event={"ID":"c812a43c-91e5-47bd-a649-2e27a20db227","Type":"ContainerStarted","Data":"dd3c34c84792f05e453b6c3df0e93370c274bac98bf781e6f3b6fce4fdbb7027"} Jun 16 19:50:30.096692 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:30.096673 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xprhm" event={"ID":"07faee47-5575-472d-a8a0-809677d270f1","Type":"ContainerStarted","Data":"bf9bf2d2d4a4b8c874229064d88179bbc94948bbd09d698c45d20c51240cc0e5"} Jun 16 19:50:30.114251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:30.113955 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d7qqp" podStartSLOduration=1.4453640110000001 podStartE2EDuration="8.113939016s" totalImagesPullingTime="6.668575005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:30.113491911 +0000 UTC m=+53.766322515" watchObservedRunningTime="2026-06-16 19:50:30.113939016 +0000 UTC m=+53.766769614" Jun 16 19:50:30.161450 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:30.161397 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7qpv6" podStartSLOduration=1.4422579629999999 podStartE2EDuration="8.161377492s" totalImagesPullingTime="6.719119529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:30.160663491 +0000 UTC m=+53.813494116" watchObservedRunningTime="2026-06-16 19:50:30.161377492 +0000 UTC m=+53.814208096" Jun 16 19:50:31.104161 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:31.104120 2557 generic.go:356] "Generic (PLEG): container finished" podID="57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1" containerID="13613928f2d27ca90fe052ed8a3b364d43f9a500e1c7da32cf5c41af1f80f524" exitCode=0 Jun 16 19:50:31.104510 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:31.104424 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8hwv" event={"ID":"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1","Type":"ContainerDied","Data":"13613928f2d27ca90fe052ed8a3b364d43f9a500e1c7da32cf5c41af1f80f524"} Jun 16 19:50:31.107035 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:31.107010 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xprhm" event={"ID":"07faee47-5575-472d-a8a0-809677d270f1","Type":"ContainerStarted","Data":"c647bfb420674b31252f9b3e33b7701509c7f9cff559d1b9665705658b64d181"} Jun 16 19:50:32.115761 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:32.115712 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w8hwv" event={"ID":"57cf6e8c-cfe6-4a4a-9980-0138e4b03ec1","Type":"ContainerStarted","Data":"5db3d2e65b6759dbe44d39992c19bc826d5db399f5c55eccfbc2527727986339"} Jun 16 19:50:32.146926 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:32.146877 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w8hwv" podStartSLOduration=7.326032655 podStartE2EDuration="43.146857396s" totalImagesPullingTime="35.820824741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:32.145124279 +0000 UTC m=+55.797954882" watchObservedRunningTime="2026-06-16 19:50:32.146857396 +0000 UTC m=+55.799688005" Jun 16 19:50:34.124064 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:34.124026 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xprhm" event={"ID":"07faee47-5575-472d-a8a0-809677d270f1","Type":"ContainerStarted","Data":"4d24b31c36a75e7f23dcf60a140f6d1fa25bb01e28216c8d258927fc19972b63"} Jun 16 19:50:34.125452 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:34.125429 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79ffd84f84-g22b6" event={"ID":"58fa33e9-f8e5-4712-8b39-453ea4f54941","Type":"ContainerStarted","Data":"92cf85e29d198a0a2c6df21625745d9fd75c74821af2ba663de2c9969d785aa5"} Jun 16 19:50:34.149193 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:34.149152 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xprhm" podStartSLOduration=1.989748234 podStartE2EDuration="12.149140017s" totalImagesPullingTime="10.159391783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:50:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:34.148191211 +0000 UTC m=+57.801021813" watchObservedRunningTime="2026-06-16 19:50:34.149140017 +0000 UTC m=+57.801970622" Jun 16 19:50:38.515729 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:38.515682 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:38.516214 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:38.515796 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:38.520612 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:38.520589 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:38.540786 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:38.540744 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79ffd84f84-g22b6" podStartSLOduration=7.137233107 podStartE2EDuration="10.540729518s" totalImagesPullingTime="3.403496411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:34.171979427 +0000 UTC m=+57.824810031" watchObservedRunningTime="2026-06-16 19:50:38.540729518 +0000 UTC m=+62.193560099" Jun 16 19:50:39.144060 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:39.144035 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:50:40.109541 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:40.109505 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d7qqp" Jun 16 19:50:49.060071 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:49.059959 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q8dt4" Jun 16 19:50:53.710973 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:53.710920 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8zw\" (UniqueName: \"kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw\") pod \"network-check-target-56dsz\" (UID: \"3ee7881a-a800-4f6f-9be1-02d6e5892e46\") " pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:53.713694 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:53.713676 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 16 19:50:53.724389 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:53.724372 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 16 19:50:53.735072 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:53.735043 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh8zw\" (UniqueName: \"kubernetes.io/projected/3ee7881a-a800-4f6f-9be1-02d6e5892e46-kube-api-access-nh8zw\") pod \"network-check-target-56dsz\" (UID: \"3ee7881a-a800-4f6f-9be1-02d6e5892e46\") " pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:53.812310 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:53.812264 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs\") pod \"network-metrics-daemon-7bn4d\" (UID: \"07dffcab-50c2-4c45-8e2e-64656af42fa2\") " pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:53.815021 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:53.815006 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 16 19:50:53.825502 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:53.825481 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07dffcab-50c2-4c45-8e2e-64656af42fa2-metrics-certs\") pod \"network-metrics-daemon-7bn4d\" (UID: \"07dffcab-50c2-4c45-8e2e-64656af42fa2\") " pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:53.847060 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:53.847042 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xrkc\"" Jun 16 19:50:53.854251 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:53.854234 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ct5dx\"" Jun 16 19:50:53.855271 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:53.855257 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:50:53.862865 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:53.862843 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7bn4d" Jun 16 19:50:53.912988 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:53.912902 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret\") pod \"global-pull-secret-syncer-g82pv\" (UID: \"3b922c97-fed5-44e6-b134-192a137564e7\") " pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:53.916620 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:53.916252 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 16 19:50:53.925521 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:53.925491 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b922c97-fed5-44e6-b134-192a137564e7-original-pull-secret\") pod \"global-pull-secret-syncer-g82pv\" (UID: \"3b922c97-fed5-44e6-b134-192a137564e7\") " pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:53.993886 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:53.993810 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-56dsz"] Jun 16 19:50:53.998107 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:50:53.998077 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ee7881a_a800_4f6f_9be1_02d6e5892e46.slice/crio-73d05a62f90202b59dedc490325a2a41871e82b9b96246091a38de07fb6d20b8 WatchSource:0}: Error finding container 73d05a62f90202b59dedc490325a2a41871e82b9b96246091a38de07fb6d20b8: Status 404 returned error can't find the container with id 73d05a62f90202b59dedc490325a2a41871e82b9b96246091a38de07fb6d20b8 Jun 16 19:50:54.014346 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:54.014320 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7bn4d"] Jun 16 19:50:54.017143 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:50:54.017119 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07dffcab_50c2_4c45_8e2e_64656af42fa2.slice/crio-87b1b05258dd9c392432b5585d5d406f2a2722a00df29cafcfd1a1e47b6a687f WatchSource:0}: Error finding container 87b1b05258dd9c392432b5585d5d406f2a2722a00df29cafcfd1a1e47b6a687f: Status 404 returned error can't find the container with id 87b1b05258dd9c392432b5585d5d406f2a2722a00df29cafcfd1a1e47b6a687f Jun 16 19:50:54.146178 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:54.146144 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g82pv" Jun 16 19:50:54.185552 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:54.185505 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7bn4d" event={"ID":"07dffcab-50c2-4c45-8e2e-64656af42fa2","Type":"ContainerStarted","Data":"87b1b05258dd9c392432b5585d5d406f2a2722a00df29cafcfd1a1e47b6a687f"} Jun 16 19:50:54.186489 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:54.186469 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-56dsz" event={"ID":"3ee7881a-a800-4f6f-9be1-02d6e5892e46","Type":"ContainerStarted","Data":"73d05a62f90202b59dedc490325a2a41871e82b9b96246091a38de07fb6d20b8"} Jun 16 19:50:54.267991 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:54.267921 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g82pv"] Jun 16 19:50:54.270464 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:50:54.270425 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b922c97_fed5_44e6_b134_192a137564e7.slice/crio-37fbe63e5411d4d522deb0cc70ecb55499ca1e58923bf844661fdee5bbd62eae WatchSource:0}: Error finding container 37fbe63e5411d4d522deb0cc70ecb55499ca1e58923bf844661fdee5bbd62eae: Status 404 returned error can't find the container with id 37fbe63e5411d4d522deb0cc70ecb55499ca1e58923bf844661fdee5bbd62eae Jun 16 19:50:55.194101 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:55.194022 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g82pv" event={"ID":"3b922c97-fed5-44e6-b134-192a137564e7","Type":"ContainerStarted","Data":"37fbe63e5411d4d522deb0cc70ecb55499ca1e58923bf844661fdee5bbd62eae"} Jun 16 19:50:55.195960 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:55.195936 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7bn4d" event={"ID":"07dffcab-50c2-4c45-8e2e-64656af42fa2","Type":"ContainerStarted","Data":"7bc7e104e82fc7016d02cf7ef9e7fc57e1312554c05cad61e03291a16290f64a"} Jun 16 19:50:55.196096 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:55.195987 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7bn4d" event={"ID":"07dffcab-50c2-4c45-8e2e-64656af42fa2","Type":"ContainerStarted","Data":"a917cc20a9d0afbb3d239d5bc36963bcabc59911bc77fe545bbd5992e26b7eaf"} Jun 16 19:50:55.218165 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:50:55.218118 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7bn4d" podStartSLOduration=65.301451297 podStartE2EDuration="1m6.218100156s" totalImagesPullingTime="916.648859ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:55.21785608 +0000 UTC m=+78.870686665" watchObservedRunningTime="2026-06-16 19:50:55.218100156 +0000 UTC m=+78.870930767" Jun 16 19:51:00.216737 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:00.216690 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g82pv" event={"ID":"3b922c97-fed5-44e6-b134-192a137564e7","Type":"ContainerStarted","Data":"98921f6e2c9ecea3a80f5e23b687394be26ff7dfb9cc5dd4c207c31645667196"} Jun 16 19:51:00.218039 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:00.218002 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-56dsz" event={"ID":"3ee7881a-a800-4f6f-9be1-02d6e5892e46","Type":"ContainerStarted","Data":"17dfa5ac4308e01169515e8d23a537f292a4105f105b2f40aecb2f5fc5cd7d26"} Jun 16 19:51:00.218206 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:00.218124 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:51:00.237673 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:00.237632 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g82pv" podStartSLOduration=64.878888619 podStartE2EDuration="1m10.237619183s" totalImagesPullingTime="5.358730564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:51:00.237310741 +0000 UTC m=+83.890141344" watchObservedRunningTime="2026-06-16 19:51:00.237619183 +0000 UTC m=+83.890449786" Jun 16 19:51:00.259268 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:00.259220 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-56dsz" podStartSLOduration=65.619395458 podStartE2EDuration="1m11.259203808s" totalImagesPullingTime="5.63980835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:51:00.258287295 +0000 UTC m=+83.911117900" watchObservedRunningTime="2026-06-16 19:51:00.259203808 +0000 UTC m=+83.912034413" Jun 16 19:51:26.822089 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.822057 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 16 19:51:26.825486 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.825470 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:26.828561 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.828343 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 16 19:51:26.828561 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.828409 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 16 19:51:26.828561 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.828411 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 16 19:51:26.828561 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.828427 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 16 19:51:26.828561 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.828468 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 16 19:51:26.828561 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.828349 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6shch\"" Jun 16 19:51:26.828561 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.828411 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 16 19:51:26.828561 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.828586 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 16 19:51:26.829021 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.828746 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 16 19:51:26.834543 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.834508 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 16 19:51:26.835393 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.835370 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 16 19:51:26.934865 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.934837 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:26.934865 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.934870 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:26.935082 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.934893 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:26.935082 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.934945 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:26.935082 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.934963 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:26.935082 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.934994 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-config-volume\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:26.935082 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.935016 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:26.935082 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.935034 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-config-out\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:26.935364 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.935094 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2k86\" (UniqueName: \"kubernetes.io/projected/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-kube-api-access-w2k86\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:26.935364 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.935145 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:26.935364 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.935174 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-web-config\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:26.935364 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.935221 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:26.935364 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:26.935250 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.036577 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.036528 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.036747 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.036598 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.036802 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.036754 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.036802 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.036781 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.036900 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.036813 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.036900 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.036860 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.036900 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.036891 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.037059 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.036919 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-config-volume\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.037059 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.036946 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.037202 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.037174 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.038199 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.038173 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.038313 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.038232 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-config-out\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.038313 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.038270 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2k86\" (UniqueName: \"kubernetes.io/projected/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-kube-api-access-w2k86\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.038425 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.038315 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.038425 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.038343 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-web-config\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.039282 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.039253 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.039608 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.039560 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.039814 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.039794 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.039866 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.039794 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.040066 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.040039 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.040331 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.040153 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.040541 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.040518 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-config-volume\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.041545 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.041518 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-web-config\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.041685 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.041670 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.041812 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.041792 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-config-out\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.053176 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.053138 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2k86\" (UniqueName: \"kubernetes.io/projected/9276f312-ae06-4c06-a5ab-3d6d1cab48ed-kube-api-access-w2k86\") pod \"alertmanager-main-0\" (UID: \"9276f312-ae06-4c06-a5ab-3d6d1cab48ed\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.137306 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.137228 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:27.279785 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.279758 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 16 19:51:27.281964 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:51:27.281936 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9276f312_ae06_4c06_a5ab_3d6d1cab48ed.slice/crio-ce31c87d68e5788526fe2cdc7160ac48fa05495f39fdf837659e1d09b28ef3e6 WatchSource:0}: Error finding container ce31c87d68e5788526fe2cdc7160ac48fa05495f39fdf837659e1d09b28ef3e6: Status 404 returned error can't find the container with id ce31c87d68e5788526fe2cdc7160ac48fa05495f39fdf837659e1d09b28ef3e6 Jun 16 19:51:27.301636 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:27.301611 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9276f312-ae06-4c06-a5ab-3d6d1cab48ed","Type":"ContainerStarted","Data":"ce31c87d68e5788526fe2cdc7160ac48fa05495f39fdf837659e1d09b28ef3e6"} Jun 16 19:51:29.193756 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.193721 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-78ccfd488b-2jb4d"] Jun 16 19:51:29.215501 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.215477 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78ccfd488b-2jb4d"] Jun 16 19:51:29.215660 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.215633 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.218274 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.218249 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 16 19:51:29.218433 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.218408 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 16 19:51:29.218433 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.218422 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 16 19:51:29.218433 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.218408 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-66fzv\"" Jun 16 19:51:29.218665 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.218493 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 16 19:51:29.219103 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.219081 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 16 19:51:29.223785 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.223768 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 16 19:51:29.309667 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.309629 2557 generic.go:356] "Generic (PLEG): container finished" podID="9276f312-ae06-4c06-a5ab-3d6d1cab48ed" containerID="3f4e5e9400f10bc4e43245507aa659bc5aafa375dd51eeae9911f7c4117806b2" exitCode=0 Jun 16 19:51:29.309860 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.309695 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9276f312-ae06-4c06-a5ab-3d6d1cab48ed","Type":"ContainerDied","Data":"3f4e5e9400f10bc4e43245507aa659bc5aafa375dd51eeae9911f7c4117806b2"} Jun 16 19:51:29.354347 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.354313 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28f96171-0eb5-419e-a6ff-359fcb6d15c0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.354347 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.354357 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28f96171-0eb5-419e-a6ff-359fcb6d15c0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.354532 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.354389 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28f96171-0eb5-419e-a6ff-359fcb6d15c0-metrics-client-ca\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.354532 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.354432 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/28f96171-0eb5-419e-a6ff-359fcb6d15c0-federate-client-tls\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.354532 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.354455 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zg5j\" (UniqueName: \"kubernetes.io/projected/28f96171-0eb5-419e-a6ff-359fcb6d15c0-kube-api-access-9zg5j\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.354532 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.354512 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28f96171-0eb5-419e-a6ff-359fcb6d15c0-serving-certs-ca-bundle\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.354532 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.354531 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/28f96171-0eb5-419e-a6ff-359fcb6d15c0-secret-telemeter-client\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.354712 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.354555 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/28f96171-0eb5-419e-a6ff-359fcb6d15c0-telemeter-client-tls\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.455355 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.455272 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28f96171-0eb5-419e-a6ff-359fcb6d15c0-serving-certs-ca-bundle\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.455355 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.455314 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/28f96171-0eb5-419e-a6ff-359fcb6d15c0-secret-telemeter-client\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.455959 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.455622 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/28f96171-0eb5-419e-a6ff-359fcb6d15c0-telemeter-client-tls\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.455959 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.455662 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28f96171-0eb5-419e-a6ff-359fcb6d15c0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.455959 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.455721 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28f96171-0eb5-419e-a6ff-359fcb6d15c0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.455959 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.455797 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28f96171-0eb5-419e-a6ff-359fcb6d15c0-metrics-client-ca\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.455959 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.455829 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/28f96171-0eb5-419e-a6ff-359fcb6d15c0-federate-client-tls\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.455959 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.455855 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zg5j\" (UniqueName: \"kubernetes.io/projected/28f96171-0eb5-419e-a6ff-359fcb6d15c0-kube-api-access-9zg5j\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.456340 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.456108 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28f96171-0eb5-419e-a6ff-359fcb6d15c0-serving-certs-ca-bundle\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.456505 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.456478 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28f96171-0eb5-419e-a6ff-359fcb6d15c0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.456886 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.456864 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/28f96171-0eb5-419e-a6ff-359fcb6d15c0-metrics-client-ca\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.458200 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.458180 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/28f96171-0eb5-419e-a6ff-359fcb6d15c0-secret-telemeter-client\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.458530 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.458506 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/28f96171-0eb5-419e-a6ff-359fcb6d15c0-telemeter-client-tls\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.458819 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.458801 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/28f96171-0eb5-419e-a6ff-359fcb6d15c0-federate-client-tls\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.458819 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.458809 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/28f96171-0eb5-419e-a6ff-359fcb6d15c0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.466328 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.466302 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zg5j\" (UniqueName: \"kubernetes.io/projected/28f96171-0eb5-419e-a6ff-359fcb6d15c0-kube-api-access-9zg5j\") pod \"telemeter-client-78ccfd488b-2jb4d\" (UID: \"28f96171-0eb5-419e-a6ff-359fcb6d15c0\") " pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.524951 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.524924 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" Jun 16 19:51:29.689097 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:29.689062 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78ccfd488b-2jb4d"] Jun 16 19:51:29.691759 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:51:29.691733 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f96171_0eb5_419e_a6ff_359fcb6d15c0.slice/crio-90fac073f30f8cd1fc2a40e2f47fca0670ac0c10f200b35b1fc65d1facbe0fe0 WatchSource:0}: Error finding container 90fac073f30f8cd1fc2a40e2f47fca0670ac0c10f200b35b1fc65d1facbe0fe0: Status 404 returned error can't find the container with id 90fac073f30f8cd1fc2a40e2f47fca0670ac0c10f200b35b1fc65d1facbe0fe0 Jun 16 19:51:30.315484 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:30.315447 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" event={"ID":"28f96171-0eb5-419e-a6ff-359fcb6d15c0","Type":"ContainerStarted","Data":"90fac073f30f8cd1fc2a40e2f47fca0670ac0c10f200b35b1fc65d1facbe0fe0"} Jun 16 19:51:31.224817 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:31.224784 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-56dsz" Jun 16 19:51:31.320835 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:31.320807 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9276f312-ae06-4c06-a5ab-3d6d1cab48ed","Type":"ContainerStarted","Data":"d1a4cf3daf114adac4de44b38a31f41cbfac58f68cd4fc1e5578f574bb42e0f1"} Jun 16 19:51:31.321102 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:31.320871 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9276f312-ae06-4c06-a5ab-3d6d1cab48ed","Type":"ContainerStarted","Data":"2726e97ca297480c1b254fd479a718873eb27fc0481be839850fa8fa2dbdb3d6"} Jun 16 19:51:31.321102 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:31.320896 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9276f312-ae06-4c06-a5ab-3d6d1cab48ed","Type":"ContainerStarted","Data":"3c933bbe71da562e9d90535c79c302b74ba2c2f9696b51038a0fb4d0e5c7c3ae"} Jun 16 19:51:32.327634 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:32.327606 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" event={"ID":"28f96171-0eb5-419e-a6ff-359fcb6d15c0","Type":"ContainerStarted","Data":"a8bca8665a961b051714a414f87f3e60f74a39ecd50fbc42b484fe21cd38eba4"} Jun 16 19:51:32.331404 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:32.331382 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9276f312-ae06-4c06-a5ab-3d6d1cab48ed","Type":"ContainerStarted","Data":"d46ba0445a32717096fb8a63e98212b44bcf54ba4a76d55b6713532f29465d3e"} Jun 16 19:51:32.331523 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:32.331450 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9276f312-ae06-4c06-a5ab-3d6d1cab48ed","Type":"ContainerStarted","Data":"e24dce2681a62dfb2a74311b8362bc73343a3627da17cebc671543a41e4795c7"} Jun 16 19:51:33.336491 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:33.336460 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" event={"ID":"28f96171-0eb5-419e-a6ff-359fcb6d15c0","Type":"ContainerStarted","Data":"68a32e49b941d63f3a6ca6ded0d4e62285156040d3a93a692e1c2d9fedd15d47"} Jun 16 19:51:33.336952 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:33.336512 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" event={"ID":"28f96171-0eb5-419e-a6ff-359fcb6d15c0","Type":"ContainerStarted","Data":"91a67926e3fae57b5c10dac71fbcf56ce99a34e53053e7495413fc754bb917bc"} Jun 16 19:51:33.339590 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:33.339553 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9276f312-ae06-4c06-a5ab-3d6d1cab48ed","Type":"ContainerStarted","Data":"bc337e421ccaa72a6b2406bb02ce6829361d0e6034cac6a44aa48a53a0425af2"} Jun 16 19:51:33.369465 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:33.369393 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-78ccfd488b-2jb4d" podStartSLOduration=1.830356868 podStartE2EDuration="4.36938087s" totalImagesPullingTime="2.539024002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:51:33.367877429 +0000 UTC m=+117.020708033" watchObservedRunningTime="2026-06-16 19:51:33.36938087 +0000 UTC m=+117.022211473" Jun 16 19:51:33.413884 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:33.413841 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.189992249 podStartE2EDuration="7.413825264s" totalImagesPullingTime="3.211440605s" totalInitContainerRuntime="12.39241ms" isStatefulPod=false podCreationTimestamp="2026-06-16 19:51:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:51:33.404319183 +0000 UTC m=+117.057149798" watchObservedRunningTime="2026-06-16 19:51:33.413825264 +0000 UTC m=+117.066655866" Jun 16 19:51:34.270937 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.270904 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8666995fdf-qshfh"] Jun 16 19:51:34.272990 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.272970 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.285298 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.285266 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8666995fdf-qshfh"] Jun 16 19:51:34.396354 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.396320 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-serving-cert\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.396354 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.396350 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-oauth-serving-cert\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.396736 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.396396 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-oauth-config\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.396736 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.396428 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-trusted-ca-bundle\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.396736 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.396484 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-config\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.396736 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.396513 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-service-ca\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.396736 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.396531 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jcw2\" (UniqueName: \"kubernetes.io/projected/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-kube-api-access-8jcw2\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.497707 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.497661 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-serving-cert\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.497707 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.497716 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-oauth-serving-cert\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.497922 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.497763 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-oauth-config\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.497922 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.497807 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-trusted-ca-bundle\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.498028 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.497947 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-config\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.498081 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.498059 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-service-ca\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.498134 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.498092 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jcw2\" (UniqueName: \"kubernetes.io/projected/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-kube-api-access-8jcw2\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.499074 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.498799 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-oauth-serving-cert\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.499074 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.498818 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-trusted-ca-bundle\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.499257 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.499094 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-config\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.499405 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.499385 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-service-ca\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.500416 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.500395 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-serving-cert\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.500502 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.500444 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-oauth-config\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.509590 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.509554 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jcw2\" (UniqueName: \"kubernetes.io/projected/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-kube-api-access-8jcw2\") pod \"console-8666995fdf-qshfh\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.582488 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.582466 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:34.717052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:34.717010 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8666995fdf-qshfh"] Jun 16 19:51:34.720464 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:51:34.720439 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff6c3747_0f75_40f9_b1df_9ba0968ec0fa.slice/crio-a1af51c31f5df8d200e0b18a0a7645ccfaa65e0fca1633fc38b3681523809868 WatchSource:0}: Error finding container a1af51c31f5df8d200e0b18a0a7645ccfaa65e0fca1633fc38b3681523809868: Status 404 returned error can't find the container with id a1af51c31f5df8d200e0b18a0a7645ccfaa65e0fca1633fc38b3681523809868 Jun 16 19:51:35.347512 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:35.347479 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8666995fdf-qshfh" event={"ID":"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa","Type":"ContainerStarted","Data":"468678ad1d5be2abd1af6e36d0651d283676c4b1672ee35a59364a58eb5da4c3"} Jun 16 19:51:35.347697 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:35.347534 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8666995fdf-qshfh" event={"ID":"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa","Type":"ContainerStarted","Data":"a1af51c31f5df8d200e0b18a0a7645ccfaa65e0fca1633fc38b3681523809868"} Jun 16 19:51:35.371378 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:35.371337 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8666995fdf-qshfh" podStartSLOduration=1.371323589 podStartE2EDuration="1.371323589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:51:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:51:35.36927564 +0000 UTC m=+119.022106241" watchObservedRunningTime="2026-06-16 19:51:35.371323589 +0000 UTC m=+119.024154191" Jun 16 19:51:44.583504 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:44.583467 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:44.583946 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:44.583531 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:44.588085 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:44.588063 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:45.384309 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:45.384282 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:51:45.449391 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:51:45.449359 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79ffd84f84-g22b6"] Jun 16 19:52:10.472179 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.472140 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79ffd84f84-g22b6" podUID="58fa33e9-f8e5-4712-8b39-453ea4f54941" containerName="console" containerID="cri-o://92cf85e29d198a0a2c6df21625745d9fd75c74821af2ba663de2c9969d785aa5" gracePeriod=15 Jun 16 19:52:10.701218 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.701194 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:52:10.748142 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.748060 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-config\") pod \"58fa33e9-f8e5-4712-8b39-453ea4f54941\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " Jun 16 19:52:10.748142 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.748111 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-oauth-serving-cert\") pod \"58fa33e9-f8e5-4712-8b39-453ea4f54941\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " Jun 16 19:52:10.748342 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.748142 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-serving-cert\") pod \"58fa33e9-f8e5-4712-8b39-453ea4f54941\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " Jun 16 19:52:10.748342 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.748176 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-trusted-ca-bundle\") pod \"58fa33e9-f8e5-4712-8b39-453ea4f54941\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " Jun 16 19:52:10.748342 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.748197 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-service-ca\") pod \"58fa33e9-f8e5-4712-8b39-453ea4f54941\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " Jun 16 19:52:10.748342 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.748245 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-oauth-config\") pod \"58fa33e9-f8e5-4712-8b39-453ea4f54941\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " Jun 16 19:52:10.748342 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.748277 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg2jg\" (UniqueName: \"kubernetes.io/projected/58fa33e9-f8e5-4712-8b39-453ea4f54941-kube-api-access-gg2jg\") pod \"58fa33e9-f8e5-4712-8b39-453ea4f54941\" (UID: \"58fa33e9-f8e5-4712-8b39-453ea4f54941\") " Jun 16 19:52:10.748589 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.748488 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-config" (OuterVolumeSpecName: "console-config") pod "58fa33e9-f8e5-4712-8b39-453ea4f54941" (UID: "58fa33e9-f8e5-4712-8b39-453ea4f54941"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:52:10.748723 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.748636 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "58fa33e9-f8e5-4712-8b39-453ea4f54941" (UID: "58fa33e9-f8e5-4712-8b39-453ea4f54941"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:52:10.748839 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.748753 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "58fa33e9-f8e5-4712-8b39-453ea4f54941" (UID: "58fa33e9-f8e5-4712-8b39-453ea4f54941"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:52:10.748839 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.748786 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-service-ca" (OuterVolumeSpecName: "service-ca") pod "58fa33e9-f8e5-4712-8b39-453ea4f54941" (UID: "58fa33e9-f8e5-4712-8b39-453ea4f54941"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:52:10.750674 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.750647 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "58fa33e9-f8e5-4712-8b39-453ea4f54941" (UID: "58fa33e9-f8e5-4712-8b39-453ea4f54941"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:52:10.750764 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.750678 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58fa33e9-f8e5-4712-8b39-453ea4f54941-kube-api-access-gg2jg" (OuterVolumeSpecName: "kube-api-access-gg2jg") pod "58fa33e9-f8e5-4712-8b39-453ea4f54941" (UID: "58fa33e9-f8e5-4712-8b39-453ea4f54941"). InnerVolumeSpecName "kube-api-access-gg2jg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:52:10.750764 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.750721 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "58fa33e9-f8e5-4712-8b39-453ea4f54941" (UID: "58fa33e9-f8e5-4712-8b39-453ea4f54941"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:52:10.849258 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.849227 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gg2jg\" (UniqueName: \"kubernetes.io/projected/58fa33e9-f8e5-4712-8b39-453ea4f54941-kube-api-access-gg2jg\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:52:10.849258 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.849256 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-config\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:52:10.849428 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.849266 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-oauth-serving-cert\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:52:10.849428 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.849275 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-serving-cert\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:52:10.849428 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.849284 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-trusted-ca-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:52:10.849428 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.849293 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58fa33e9-f8e5-4712-8b39-453ea4f54941-service-ca\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:52:10.849428 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:10.849300 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58fa33e9-f8e5-4712-8b39-453ea4f54941-console-oauth-config\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:52:11.468213 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:11.468176 2557 generic.go:356] "Generic (PLEG): container finished" podID="58fa33e9-f8e5-4712-8b39-453ea4f54941" containerID="92cf85e29d198a0a2c6df21625745d9fd75c74821af2ba663de2c9969d785aa5" exitCode=0 Jun 16 19:52:11.468414 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:11.468229 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79ffd84f84-g22b6" event={"ID":"58fa33e9-f8e5-4712-8b39-453ea4f54941","Type":"ContainerDied","Data":"92cf85e29d198a0a2c6df21625745d9fd75c74821af2ba663de2c9969d785aa5"} Jun 16 19:52:11.468414 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:11.468274 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79ffd84f84-g22b6" event={"ID":"58fa33e9-f8e5-4712-8b39-453ea4f54941","Type":"ContainerDied","Data":"c8afc01f0767780e751027bf1baeedc802844bb863eba943bb9bb6722ff62898"} Jun 16 19:52:11.468414 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:11.468293 2557 scope.go:117] "RemoveContainer" containerID="92cf85e29d198a0a2c6df21625745d9fd75c74821af2ba663de2c9969d785aa5" Jun 16 19:52:11.468414 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:11.468230 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79ffd84f84-g22b6" Jun 16 19:52:11.476393 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:11.476323 2557 scope.go:117] "RemoveContainer" containerID="92cf85e29d198a0a2c6df21625745d9fd75c74821af2ba663de2c9969d785aa5" Jun 16 19:52:11.476646 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:52:11.476617 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92cf85e29d198a0a2c6df21625745d9fd75c74821af2ba663de2c9969d785aa5\": container with ID starting with 92cf85e29d198a0a2c6df21625745d9fd75c74821af2ba663de2c9969d785aa5 not found: ID does not exist" containerID="92cf85e29d198a0a2c6df21625745d9fd75c74821af2ba663de2c9969d785aa5" Jun 16 19:52:11.476691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:11.476654 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92cf85e29d198a0a2c6df21625745d9fd75c74821af2ba663de2c9969d785aa5"} err="failed to get container status \"92cf85e29d198a0a2c6df21625745d9fd75c74821af2ba663de2c9969d785aa5\": rpc error: code = NotFound desc = could not find container \"92cf85e29d198a0a2c6df21625745d9fd75c74821af2ba663de2c9969d785aa5\": container with ID starting with 92cf85e29d198a0a2c6df21625745d9fd75c74821af2ba663de2c9969d785aa5 not found: ID does not exist" Jun 16 19:52:11.489596 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:11.489556 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79ffd84f84-g22b6"] Jun 16 19:52:11.496887 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:11.496868 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79ffd84f84-g22b6"] Jun 16 19:52:12.818787 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:12.818751 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58fa33e9-f8e5-4712-8b39-453ea4f54941" path="/var/lib/kubelet/pods/58fa33e9-f8e5-4712-8b39-453ea4f54941/volumes" Jun 16 19:52:43.114498 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.114463 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d6b455f4d-hwtgh"] Jun 16 19:52:43.114984 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.114807 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58fa33e9-f8e5-4712-8b39-453ea4f54941" containerName="console" Jun 16 19:52:43.114984 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.114822 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="58fa33e9-f8e5-4712-8b39-453ea4f54941" containerName="console" Jun 16 19:52:43.114984 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.114894 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="58fa33e9-f8e5-4712-8b39-453ea4f54941" containerName="console" Jun 16 19:52:43.117348 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.117331 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.127993 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.127972 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6b455f4d-hwtgh"] Jun 16 19:52:43.167908 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.167885 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd369848-5878-4eb5-98c5-f785287e0896-console-serving-cert\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.168044 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.167913 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-service-ca\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.168044 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.167938 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd369848-5878-4eb5-98c5-f785287e0896-console-oauth-config\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.168044 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.167958 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-console-config\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.168044 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.168036 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-oauth-serving-cert\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.168185 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.168091 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-trusted-ca-bundle\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.168185 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.168112 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bczv\" (UniqueName: \"kubernetes.io/projected/bd369848-5878-4eb5-98c5-f785287e0896-kube-api-access-9bczv\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.268532 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.268491 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd369848-5878-4eb5-98c5-f785287e0896-console-serving-cert\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.268532 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.268528 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-service-ca\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.268740 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.268552 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd369848-5878-4eb5-98c5-f785287e0896-console-oauth-config\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.268740 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.268591 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-console-config\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.268835 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.268726 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-oauth-serving-cert\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.268835 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.268819 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-trusted-ca-bundle\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.268936 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.268847 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bczv\" (UniqueName: \"kubernetes.io/projected/bd369848-5878-4eb5-98c5-f785287e0896-kube-api-access-9bczv\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.269363 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.269338 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-service-ca\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.269461 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.269393 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-oauth-serving-cert\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.269595 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.269555 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-console-config\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.269894 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.269873 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-trusted-ca-bundle\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.271187 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.271165 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd369848-5878-4eb5-98c5-f785287e0896-console-oauth-config\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.271280 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.271263 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd369848-5878-4eb5-98c5-f785287e0896-console-serving-cert\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.279490 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.279472 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bczv\" (UniqueName: \"kubernetes.io/projected/bd369848-5878-4eb5-98c5-f785287e0896-kube-api-access-9bczv\") pod \"console-6d6b455f4d-hwtgh\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.425548 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.425473 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:43.555104 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.554943 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6b455f4d-hwtgh"] Jun 16 19:52:43.557726 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:52:43.557701 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd369848_5878_4eb5_98c5_f785287e0896.slice/crio-90e53d996a06f7b3efb91036238cf41899e5b5d140aab365fa6bacb6639c93c7 WatchSource:0}: Error finding container 90e53d996a06f7b3efb91036238cf41899e5b5d140aab365fa6bacb6639c93c7: Status 404 returned error can't find the container with id 90e53d996a06f7b3efb91036238cf41899e5b5d140aab365fa6bacb6639c93c7 Jun 16 19:52:43.575761 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:43.575739 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6b455f4d-hwtgh" event={"ID":"bd369848-5878-4eb5-98c5-f785287e0896","Type":"ContainerStarted","Data":"90e53d996a06f7b3efb91036238cf41899e5b5d140aab365fa6bacb6639c93c7"} Jun 16 19:52:44.581415 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:44.581369 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6b455f4d-hwtgh" event={"ID":"bd369848-5878-4eb5-98c5-f785287e0896","Type":"ContainerStarted","Data":"c7f29ce05bc3d41ee972dabe5cef4dfd82b78f7f8138b3d00796790584ef6ed5"} Jun 16 19:52:44.604188 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:44.604130 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d6b455f4d-hwtgh" podStartSLOduration=1.604112011 podStartE2EDuration="1.604112011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:52:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:52:44.603817581 +0000 UTC m=+188.256648178" watchObservedRunningTime="2026-06-16 19:52:44.604112011 +0000 UTC m=+188.256942614" Jun 16 19:52:53.426636 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:53.426600 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:53.427074 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:53.426672 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:53.431740 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:53.431716 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:53.615262 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:53.615237 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:52:53.681820 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:52:53.681738 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8666995fdf-qshfh"] Jun 16 19:53:17.864646 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:17.864614 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj"] Jun 16 19:53:17.867649 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:17.867633 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" Jun 16 19:53:17.870218 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:17.870197 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 16 19:53:17.870364 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:17.870270 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6krmm\"" Jun 16 19:53:17.871318 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:17.871303 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 16 19:53:17.879262 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:17.879227 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj"] Jun 16 19:53:18.022137 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:18.022099 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/451bdb39-8bbb-4a02-a391-0c1f164d6887-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj\" (UID: \"451bdb39-8bbb-4a02-a391-0c1f164d6887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" Jun 16 19:53:18.022315 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:18.022153 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fxbj\" (UniqueName: \"kubernetes.io/projected/451bdb39-8bbb-4a02-a391-0c1f164d6887-kube-api-access-6fxbj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj\" (UID: \"451bdb39-8bbb-4a02-a391-0c1f164d6887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" Jun 16 19:53:18.022315 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:18.022193 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/451bdb39-8bbb-4a02-a391-0c1f164d6887-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj\" (UID: \"451bdb39-8bbb-4a02-a391-0c1f164d6887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" Jun 16 19:53:18.123552 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:18.123460 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fxbj\" (UniqueName: \"kubernetes.io/projected/451bdb39-8bbb-4a02-a391-0c1f164d6887-kube-api-access-6fxbj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj\" (UID: \"451bdb39-8bbb-4a02-a391-0c1f164d6887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" Jun 16 19:53:18.123552 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:18.123502 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/451bdb39-8bbb-4a02-a391-0c1f164d6887-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj\" (UID: \"451bdb39-8bbb-4a02-a391-0c1f164d6887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" Jun 16 19:53:18.123552 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:18.123553 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/451bdb39-8bbb-4a02-a391-0c1f164d6887-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj\" (UID: \"451bdb39-8bbb-4a02-a391-0c1f164d6887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" Jun 16 19:53:18.123925 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:18.123908 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/451bdb39-8bbb-4a02-a391-0c1f164d6887-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj\" (UID: \"451bdb39-8bbb-4a02-a391-0c1f164d6887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" Jun 16 19:53:18.123988 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:18.123939 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/451bdb39-8bbb-4a02-a391-0c1f164d6887-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj\" (UID: \"451bdb39-8bbb-4a02-a391-0c1f164d6887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" Jun 16 19:53:18.134517 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:18.134496 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fxbj\" (UniqueName: \"kubernetes.io/projected/451bdb39-8bbb-4a02-a391-0c1f164d6887-kube-api-access-6fxbj\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj\" (UID: \"451bdb39-8bbb-4a02-a391-0c1f164d6887\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" Jun 16 19:53:18.176588 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:18.176546 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" Jun 16 19:53:18.304331 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:18.304302 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj"] Jun 16 19:53:18.307326 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:53:18.307296 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod451bdb39_8bbb_4a02_a391_0c1f164d6887.slice/crio-d3e4cf322bda7c7701a484526b9e45d412ac80aa51d7b40dfbc8ea1b6c84d3cd WatchSource:0}: Error finding container d3e4cf322bda7c7701a484526b9e45d412ac80aa51d7b40dfbc8ea1b6c84d3cd: Status 404 returned error can't find the container with id d3e4cf322bda7c7701a484526b9e45d412ac80aa51d7b40dfbc8ea1b6c84d3cd Jun 16 19:53:18.698305 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:18.698260 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" event={"ID":"451bdb39-8bbb-4a02-a391-0c1f164d6887","Type":"ContainerStarted","Data":"d3e4cf322bda7c7701a484526b9e45d412ac80aa51d7b40dfbc8ea1b6c84d3cd"} Jun 16 19:53:18.705643 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:18.705610 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8666995fdf-qshfh" podUID="ff6c3747-0f75-40f9-b1df-9ba0968ec0fa" containerName="console" containerID="cri-o://468678ad1d5be2abd1af6e36d0651d283676c4b1672ee35a59364a58eb5da4c3" gracePeriod=15 Jun 16 19:53:18.944177 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:18.944152 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:53:19.130728 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.130694 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-serving-cert\") pod \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " Jun 16 19:53:19.130920 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.130739 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-config\") pod \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " Jun 16 19:53:19.130920 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.130789 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-trusted-ca-bundle\") pod \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " Jun 16 19:53:19.130920 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.130825 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-oauth-config\") pod \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " Jun 16 19:53:19.130920 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.130847 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-service-ca\") pod \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " Jun 16 19:53:19.131140 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.130942 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jcw2\" (UniqueName: \"kubernetes.io/projected/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-kube-api-access-8jcw2\") pod \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " Jun 16 19:53:19.131140 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.130970 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-oauth-serving-cert\") pod \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\" (UID: \"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa\") " Jun 16 19:53:19.131304 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.131259 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-config" (OuterVolumeSpecName: "console-config") pod "ff6c3747-0f75-40f9-b1df-9ba0968ec0fa" (UID: "ff6c3747-0f75-40f9-b1df-9ba0968ec0fa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:53:19.131304 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.131274 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ff6c3747-0f75-40f9-b1df-9ba0968ec0fa" (UID: "ff6c3747-0f75-40f9-b1df-9ba0968ec0fa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:53:19.131707 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.131365 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-service-ca" (OuterVolumeSpecName: "service-ca") pod "ff6c3747-0f75-40f9-b1df-9ba0968ec0fa" (UID: "ff6c3747-0f75-40f9-b1df-9ba0968ec0fa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:53:19.131707 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.131456 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ff6c3747-0f75-40f9-b1df-9ba0968ec0fa" (UID: "ff6c3747-0f75-40f9-b1df-9ba0968ec0fa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:53:19.133246 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.133217 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ff6c3747-0f75-40f9-b1df-9ba0968ec0fa" (UID: "ff6c3747-0f75-40f9-b1df-9ba0968ec0fa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:53:19.133434 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.133413 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ff6c3747-0f75-40f9-b1df-9ba0968ec0fa" (UID: "ff6c3747-0f75-40f9-b1df-9ba0968ec0fa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:53:19.133560 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.133533 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-kube-api-access-8jcw2" (OuterVolumeSpecName: "kube-api-access-8jcw2") pod "ff6c3747-0f75-40f9-b1df-9ba0968ec0fa" (UID: "ff6c3747-0f75-40f9-b1df-9ba0968ec0fa"). InnerVolumeSpecName "kube-api-access-8jcw2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:53:19.231987 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.231954 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-trusted-ca-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:53:19.231987 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.231986 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-oauth-config\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:53:19.232155 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.231999 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-service-ca\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:53:19.232155 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.232007 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jcw2\" (UniqueName: \"kubernetes.io/projected/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-kube-api-access-8jcw2\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:53:19.232155 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.232022 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-oauth-serving-cert\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:53:19.232155 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.232036 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-serving-cert\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:53:19.232155 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.232048 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa-console-config\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:53:19.706644 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.706605 2557 generic.go:356] "Generic (PLEG): container finished" podID="ff6c3747-0f75-40f9-b1df-9ba0968ec0fa" containerID="468678ad1d5be2abd1af6e36d0651d283676c4b1672ee35a59364a58eb5da4c3" exitCode=0 Jun 16 19:53:19.706801 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.706662 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8666995fdf-qshfh" Jun 16 19:53:19.706801 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.706682 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8666995fdf-qshfh" event={"ID":"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa","Type":"ContainerDied","Data":"468678ad1d5be2abd1af6e36d0651d283676c4b1672ee35a59364a58eb5da4c3"} Jun 16 19:53:19.706801 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.706734 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8666995fdf-qshfh" event={"ID":"ff6c3747-0f75-40f9-b1df-9ba0968ec0fa","Type":"ContainerDied","Data":"a1af51c31f5df8d200e0b18a0a7645ccfaa65e0fca1633fc38b3681523809868"} Jun 16 19:53:19.706801 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.706760 2557 scope.go:117] "RemoveContainer" containerID="468678ad1d5be2abd1af6e36d0651d283676c4b1672ee35a59364a58eb5da4c3" Jun 16 19:53:19.716299 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.716279 2557 scope.go:117] "RemoveContainer" containerID="468678ad1d5be2abd1af6e36d0651d283676c4b1672ee35a59364a58eb5da4c3" Jun 16 19:53:19.716634 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:53:19.716604 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"468678ad1d5be2abd1af6e36d0651d283676c4b1672ee35a59364a58eb5da4c3\": container with ID starting with 468678ad1d5be2abd1af6e36d0651d283676c4b1672ee35a59364a58eb5da4c3 not found: ID does not exist" containerID="468678ad1d5be2abd1af6e36d0651d283676c4b1672ee35a59364a58eb5da4c3" Jun 16 19:53:19.716802 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.716642 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"468678ad1d5be2abd1af6e36d0651d283676c4b1672ee35a59364a58eb5da4c3"} err="failed to get container status \"468678ad1d5be2abd1af6e36d0651d283676c4b1672ee35a59364a58eb5da4c3\": rpc error: code = NotFound desc = could not find container \"468678ad1d5be2abd1af6e36d0651d283676c4b1672ee35a59364a58eb5da4c3\": container with ID starting with 468678ad1d5be2abd1af6e36d0651d283676c4b1672ee35a59364a58eb5da4c3 not found: ID does not exist" Jun 16 19:53:19.738495 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.738462 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8666995fdf-qshfh"] Jun 16 19:53:19.746452 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:19.746429 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8666995fdf-qshfh"] Jun 16 19:53:20.821079 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:20.821042 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff6c3747-0f75-40f9-b1df-9ba0968ec0fa" path="/var/lib/kubelet/pods/ff6c3747-0f75-40f9-b1df-9ba0968ec0fa/volumes" Jun 16 19:53:27.736357 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:27.736276 2557 generic.go:356] "Generic (PLEG): container finished" podID="451bdb39-8bbb-4a02-a391-0c1f164d6887" containerID="f8bd63a382c2c1b342221bbad70525ee76e033876d9026b3899ce898923c2337" exitCode=0 Jun 16 19:53:27.736357 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:27.736326 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" event={"ID":"451bdb39-8bbb-4a02-a391-0c1f164d6887","Type":"ContainerDied","Data":"f8bd63a382c2c1b342221bbad70525ee76e033876d9026b3899ce898923c2337"} Jun 16 19:53:31.752188 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:31.752153 2557 generic.go:356] "Generic (PLEG): container finished" podID="451bdb39-8bbb-4a02-a391-0c1f164d6887" containerID="acc996f24243aa88ffa0ac90db33d280a325624773c5a97de80fc978aaa022bf" exitCode=0 Jun 16 19:53:31.752553 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:31.752221 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" event={"ID":"451bdb39-8bbb-4a02-a391-0c1f164d6887","Type":"ContainerDied","Data":"acc996f24243aa88ffa0ac90db33d280a325624773c5a97de80fc978aaa022bf"} Jun 16 19:53:38.785960 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:38.785878 2557 generic.go:356] "Generic (PLEG): container finished" podID="451bdb39-8bbb-4a02-a391-0c1f164d6887" containerID="4ac761ea9f662cacb78df868f66d5cbd24fc8ef4a3bffdfcb793c508be163c99" exitCode=0 Jun 16 19:53:38.785960 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:38.785925 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" event={"ID":"451bdb39-8bbb-4a02-a391-0c1f164d6887","Type":"ContainerDied","Data":"4ac761ea9f662cacb78df868f66d5cbd24fc8ef4a3bffdfcb793c508be163c99"} Jun 16 19:53:39.963074 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:39.963050 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" Jun 16 19:53:39.992864 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:39.992828 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/451bdb39-8bbb-4a02-a391-0c1f164d6887-bundle\") pod \"451bdb39-8bbb-4a02-a391-0c1f164d6887\" (UID: \"451bdb39-8bbb-4a02-a391-0c1f164d6887\") " Jun 16 19:53:39.992983 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:39.992918 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/451bdb39-8bbb-4a02-a391-0c1f164d6887-util\") pod \"451bdb39-8bbb-4a02-a391-0c1f164d6887\" (UID: \"451bdb39-8bbb-4a02-a391-0c1f164d6887\") " Jun 16 19:53:39.992983 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:39.992945 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fxbj\" (UniqueName: \"kubernetes.io/projected/451bdb39-8bbb-4a02-a391-0c1f164d6887-kube-api-access-6fxbj\") pod \"451bdb39-8bbb-4a02-a391-0c1f164d6887\" (UID: \"451bdb39-8bbb-4a02-a391-0c1f164d6887\") " Jun 16 19:53:39.993634 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:39.993604 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/451bdb39-8bbb-4a02-a391-0c1f164d6887-bundle" (OuterVolumeSpecName: "bundle") pod "451bdb39-8bbb-4a02-a391-0c1f164d6887" (UID: "451bdb39-8bbb-4a02-a391-0c1f164d6887"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:53:39.995352 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:39.995322 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/451bdb39-8bbb-4a02-a391-0c1f164d6887-kube-api-access-6fxbj" (OuterVolumeSpecName: "kube-api-access-6fxbj") pod "451bdb39-8bbb-4a02-a391-0c1f164d6887" (UID: "451bdb39-8bbb-4a02-a391-0c1f164d6887"). InnerVolumeSpecName "kube-api-access-6fxbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:53:39.999277 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:39.999250 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/451bdb39-8bbb-4a02-a391-0c1f164d6887-util" (OuterVolumeSpecName: "util") pod "451bdb39-8bbb-4a02-a391-0c1f164d6887" (UID: "451bdb39-8bbb-4a02-a391-0c1f164d6887"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:53:40.093421 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:40.093396 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/451bdb39-8bbb-4a02-a391-0c1f164d6887-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:53:40.093421 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:40.093419 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fxbj\" (UniqueName: \"kubernetes.io/projected/451bdb39-8bbb-4a02-a391-0c1f164d6887-kube-api-access-6fxbj\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:53:40.093587 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:40.093429 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/451bdb39-8bbb-4a02-a391-0c1f164d6887-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:53:40.794612 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:40.794579 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" Jun 16 19:53:40.794782 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:40.794580 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dbs8tj" event={"ID":"451bdb39-8bbb-4a02-a391-0c1f164d6887","Type":"ContainerDied","Data":"d3e4cf322bda7c7701a484526b9e45d412ac80aa51d7b40dfbc8ea1b6c84d3cd"} Jun 16 19:53:40.794782 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:40.794700 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3e4cf322bda7c7701a484526b9e45d412ac80aa51d7b40dfbc8ea1b6c84d3cd" Jun 16 19:53:45.969334 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:45.969256 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-q4zpz"] Jun 16 19:53:45.969672 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:45.969548 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="451bdb39-8bbb-4a02-a391-0c1f164d6887" containerName="util" Jun 16 19:53:45.969672 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:45.969581 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="451bdb39-8bbb-4a02-a391-0c1f164d6887" containerName="util" Jun 16 19:53:45.969672 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:45.969598 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="451bdb39-8bbb-4a02-a391-0c1f164d6887" containerName="pull" Jun 16 19:53:45.969672 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:45.969603 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="451bdb39-8bbb-4a02-a391-0c1f164d6887" containerName="pull" Jun 16 19:53:45.969672 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:45.969612 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff6c3747-0f75-40f9-b1df-9ba0968ec0fa" containerName="console" Jun 16 19:53:45.969672 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:45.969617 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff6c3747-0f75-40f9-b1df-9ba0968ec0fa" containerName="console" Jun 16 19:53:45.969672 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:45.969624 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="451bdb39-8bbb-4a02-a391-0c1f164d6887" containerName="extract" Jun 16 19:53:45.969672 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:45.969629 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="451bdb39-8bbb-4a02-a391-0c1f164d6887" containerName="extract" Jun 16 19:53:45.969672 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:45.969671 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff6c3747-0f75-40f9-b1df-9ba0968ec0fa" containerName="console" Jun 16 19:53:45.969938 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:45.969679 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="451bdb39-8bbb-4a02-a391-0c1f164d6887" containerName="extract" Jun 16 19:53:45.971293 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:45.971279 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-q4zpz" Jun 16 19:53:45.973951 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:45.973925 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 16 19:53:45.974075 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:45.974048 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xrz6d\"" Jun 16 19:53:45.974144 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:45.974087 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 16 19:53:45.989931 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:45.989913 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-q4zpz"] Jun 16 19:53:46.037901 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:46.037876 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv8sn\" (UniqueName: \"kubernetes.io/projected/50020055-78c5-48d7-9f7f-80c77afc2eeb-kube-api-access-kv8sn\") pod \"cert-manager-operator-controller-manager-57757f7cfc-q4zpz\" (UID: \"50020055-78c5-48d7-9f7f-80c77afc2eeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-q4zpz" Jun 16 19:53:46.038035 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:46.037943 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50020055-78c5-48d7-9f7f-80c77afc2eeb-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-q4zpz\" (UID: \"50020055-78c5-48d7-9f7f-80c77afc2eeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-q4zpz" Jun 16 19:53:46.138602 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:46.138556 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv8sn\" (UniqueName: \"kubernetes.io/projected/50020055-78c5-48d7-9f7f-80c77afc2eeb-kube-api-access-kv8sn\") pod \"cert-manager-operator-controller-manager-57757f7cfc-q4zpz\" (UID: \"50020055-78c5-48d7-9f7f-80c77afc2eeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-q4zpz" Jun 16 19:53:46.138743 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:46.138629 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50020055-78c5-48d7-9f7f-80c77afc2eeb-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-q4zpz\" (UID: \"50020055-78c5-48d7-9f7f-80c77afc2eeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-q4zpz" Jun 16 19:53:46.138921 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:46.138906 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50020055-78c5-48d7-9f7f-80c77afc2eeb-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-q4zpz\" (UID: \"50020055-78c5-48d7-9f7f-80c77afc2eeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-q4zpz" Jun 16 19:53:46.149187 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:46.149165 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv8sn\" (UniqueName: \"kubernetes.io/projected/50020055-78c5-48d7-9f7f-80c77afc2eeb-kube-api-access-kv8sn\") pod \"cert-manager-operator-controller-manager-57757f7cfc-q4zpz\" (UID: \"50020055-78c5-48d7-9f7f-80c77afc2eeb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-q4zpz" Jun 16 19:53:46.280382 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:46.280295 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-q4zpz" Jun 16 19:53:46.415454 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:46.415430 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-q4zpz"] Jun 16 19:53:46.417231 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:53:46.417206 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50020055_78c5_48d7_9f7f_80c77afc2eeb.slice/crio-c7e8b95af737b4452f81ffa87b7325825f77a07fe3d1a935c24a7b7a27b7be40 WatchSource:0}: Error finding container c7e8b95af737b4452f81ffa87b7325825f77a07fe3d1a935c24a7b7a27b7be40: Status 404 returned error can't find the container with id c7e8b95af737b4452f81ffa87b7325825f77a07fe3d1a935c24a7b7a27b7be40 Jun 16 19:53:46.818652 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:46.818622 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-q4zpz" event={"ID":"50020055-78c5-48d7-9f7f-80c77afc2eeb","Type":"ContainerStarted","Data":"c7e8b95af737b4452f81ffa87b7325825f77a07fe3d1a935c24a7b7a27b7be40"} Jun 16 19:53:48.828002 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:48.827965 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-q4zpz" event={"ID":"50020055-78c5-48d7-9f7f-80c77afc2eeb","Type":"ContainerStarted","Data":"732d3ac1b8873ef3742652b1c16a13de7bffa50e760a0de298460b922fdcdab0"} Jun 16 19:53:48.863272 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:48.860480 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-q4zpz" podStartSLOduration=2.309572371 podStartE2EDuration="3.860459757s" totalImagesPullingTime="1.550887386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:53:48.857865236 +0000 UTC m=+252.510695842" watchObservedRunningTime="2026-06-16 19:53:48.860459757 +0000 UTC m=+252.513290360" Jun 16 19:53:50.348838 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.348804 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4"] Jun 16 19:53:50.352061 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.352044 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" Jun 16 19:53:50.355532 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.355511 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 16 19:53:50.356550 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.356537 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 16 19:53:50.356623 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.356538 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6krmm\"" Jun 16 19:53:50.372635 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.372598 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4"] Jun 16 19:53:50.470388 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.470352 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xctb8\" (UniqueName: \"kubernetes.io/projected/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-kube-api-access-xctb8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4\" (UID: \"20d7dbb0-6cec-4d46-8448-09357d5e0bcf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" Jun 16 19:53:50.470388 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.470391 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4\" (UID: \"20d7dbb0-6cec-4d46-8448-09357d5e0bcf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" Jun 16 19:53:50.470688 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.470448 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4\" (UID: \"20d7dbb0-6cec-4d46-8448-09357d5e0bcf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" Jun 16 19:53:50.571303 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.571270 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xctb8\" (UniqueName: \"kubernetes.io/projected/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-kube-api-access-xctb8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4\" (UID: \"20d7dbb0-6cec-4d46-8448-09357d5e0bcf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" Jun 16 19:53:50.571425 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.571308 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4\" (UID: \"20d7dbb0-6cec-4d46-8448-09357d5e0bcf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" Jun 16 19:53:50.571425 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.571360 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4\" (UID: \"20d7dbb0-6cec-4d46-8448-09357d5e0bcf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" Jun 16 19:53:50.571764 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.571746 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4\" (UID: \"20d7dbb0-6cec-4d46-8448-09357d5e0bcf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" Jun 16 19:53:50.571801 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.571780 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4\" (UID: \"20d7dbb0-6cec-4d46-8448-09357d5e0bcf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" Jun 16 19:53:50.581670 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.581633 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xctb8\" (UniqueName: \"kubernetes.io/projected/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-kube-api-access-xctb8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4\" (UID: \"20d7dbb0-6cec-4d46-8448-09357d5e0bcf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" Jun 16 19:53:50.660478 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.660422 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" Jun 16 19:53:50.810982 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.810867 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4"] Jun 16 19:53:50.813323 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:53:50.813300 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d7dbb0_6cec_4d46_8448_09357d5e0bcf.slice/crio-7b4bbe9939814804033cb859926bc4428b147df40ce39a1ab5a9ca19e064dd1a WatchSource:0}: Error finding container 7b4bbe9939814804033cb859926bc4428b147df40ce39a1ab5a9ca19e064dd1a: Status 404 returned error can't find the container with id 7b4bbe9939814804033cb859926bc4428b147df40ce39a1ab5a9ca19e064dd1a Jun 16 19:53:50.835649 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:50.835625 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" event={"ID":"20d7dbb0-6cec-4d46-8448-09357d5e0bcf","Type":"ContainerStarted","Data":"7b4bbe9939814804033cb859926bc4428b147df40ce39a1ab5a9ca19e064dd1a"} Jun 16 19:53:51.840891 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:51.840803 2557 generic.go:356] "Generic (PLEG): container finished" podID="20d7dbb0-6cec-4d46-8448-09357d5e0bcf" containerID="9bcc86fa37715fddd0b93ca20e3476efa99f9dce500e29bc2da0589199969959" exitCode=0 Jun 16 19:53:51.841229 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:51.840890 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" event={"ID":"20d7dbb0-6cec-4d46-8448-09357d5e0bcf","Type":"ContainerDied","Data":"9bcc86fa37715fddd0b93ca20e3476efa99f9dce500e29bc2da0589199969959"} Jun 16 19:53:53.434578 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:53.434532 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-xlbt2"] Jun 16 19:53:53.437557 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:53.437538 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xlbt2" Jun 16 19:53:53.440441 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:53.440422 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 16 19:53:53.440527 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:53.440481 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wknmv\"" Jun 16 19:53:53.441528 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:53.441513 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 16 19:53:53.448293 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:53.448272 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-xlbt2"] Jun 16 19:53:53.493581 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:53.493536 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58f7a5d6-c78d-479a-91ec-264706a24576-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-xlbt2\" (UID: \"58f7a5d6-c78d-479a-91ec-264706a24576\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xlbt2" Jun 16 19:53:53.493702 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:53.493582 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqvhc\" (UniqueName: \"kubernetes.io/projected/58f7a5d6-c78d-479a-91ec-264706a24576-kube-api-access-rqvhc\") pod \"cert-manager-webhook-7dc76cbb94-xlbt2\" (UID: \"58f7a5d6-c78d-479a-91ec-264706a24576\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xlbt2" Jun 16 19:53:53.594846 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:53.594815 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58f7a5d6-c78d-479a-91ec-264706a24576-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-xlbt2\" (UID: \"58f7a5d6-c78d-479a-91ec-264706a24576\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xlbt2" Jun 16 19:53:53.595006 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:53.594853 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqvhc\" (UniqueName: \"kubernetes.io/projected/58f7a5d6-c78d-479a-91ec-264706a24576-kube-api-access-rqvhc\") pod \"cert-manager-webhook-7dc76cbb94-xlbt2\" (UID: \"58f7a5d6-c78d-479a-91ec-264706a24576\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xlbt2" Jun 16 19:53:53.605970 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:53.605940 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqvhc\" (UniqueName: \"kubernetes.io/projected/58f7a5d6-c78d-479a-91ec-264706a24576-kube-api-access-rqvhc\") pod \"cert-manager-webhook-7dc76cbb94-xlbt2\" (UID: \"58f7a5d6-c78d-479a-91ec-264706a24576\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xlbt2" Jun 16 19:53:53.606087 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:53.606000 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58f7a5d6-c78d-479a-91ec-264706a24576-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-xlbt2\" (UID: \"58f7a5d6-c78d-479a-91ec-264706a24576\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xlbt2" Jun 16 19:53:53.757772 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:53.757686 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xlbt2" Jun 16 19:53:53.904769 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:53.904737 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-xlbt2"] Jun 16 19:53:54.175899 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:54.175869 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-fwkhc"] Jun 16 19:53:54.184320 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:54.184295 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fwkhc" Jun 16 19:53:54.187233 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:54.187211 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mskgz\"" Jun 16 19:53:54.192083 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:54.192036 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-fwkhc"] Jun 16 19:53:54.301719 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:54.301686 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32cf828a-029d-4a7e-8385-3e0d489d9106-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-fwkhc\" (UID: \"32cf828a-029d-4a7e-8385-3e0d489d9106\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fwkhc" Jun 16 19:53:54.301899 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:54.301735 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn92d\" (UniqueName: \"kubernetes.io/projected/32cf828a-029d-4a7e-8385-3e0d489d9106-kube-api-access-xn92d\") pod \"cert-manager-cainjector-5d99449ffd-fwkhc\" (UID: \"32cf828a-029d-4a7e-8385-3e0d489d9106\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fwkhc" Jun 16 19:53:54.402171 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:54.402133 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32cf828a-029d-4a7e-8385-3e0d489d9106-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-fwkhc\" (UID: \"32cf828a-029d-4a7e-8385-3e0d489d9106\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fwkhc" Jun 16 19:53:54.402336 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:54.402218 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn92d\" (UniqueName: \"kubernetes.io/projected/32cf828a-029d-4a7e-8385-3e0d489d9106-kube-api-access-xn92d\") pod \"cert-manager-cainjector-5d99449ffd-fwkhc\" (UID: \"32cf828a-029d-4a7e-8385-3e0d489d9106\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fwkhc" Jun 16 19:53:54.411847 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:54.411818 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32cf828a-029d-4a7e-8385-3e0d489d9106-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-fwkhc\" (UID: \"32cf828a-029d-4a7e-8385-3e0d489d9106\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fwkhc" Jun 16 19:53:54.412101 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:54.412074 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn92d\" (UniqueName: \"kubernetes.io/projected/32cf828a-029d-4a7e-8385-3e0d489d9106-kube-api-access-xn92d\") pod \"cert-manager-cainjector-5d99449ffd-fwkhc\" (UID: \"32cf828a-029d-4a7e-8385-3e0d489d9106\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fwkhc" Jun 16 19:53:54.495726 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:54.495658 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fwkhc" Jun 16 19:53:54.526196 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:53:54.526167 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58f7a5d6_c78d_479a_91ec_264706a24576.slice/crio-13c765047d7eb7398e351e2c76a6bd1d76a1a79ffb65aa20d411ccb98e661a17 WatchSource:0}: Error finding container 13c765047d7eb7398e351e2c76a6bd1d76a1a79ffb65aa20d411ccb98e661a17: Status 404 returned error can't find the container with id 13c765047d7eb7398e351e2c76a6bd1d76a1a79ffb65aa20d411ccb98e661a17 Jun 16 19:53:54.689559 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:54.689422 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-fwkhc"] Jun 16 19:53:54.691792 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:53:54.691765 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32cf828a_029d_4a7e_8385_3e0d489d9106.slice/crio-0f4b89b7e978f816d663c5454189e4f6cc65c292e85fc3517feebca26b31c3d5 WatchSource:0}: Error finding container 0f4b89b7e978f816d663c5454189e4f6cc65c292e85fc3517feebca26b31c3d5: Status 404 returned error can't find the container with id 0f4b89b7e978f816d663c5454189e4f6cc65c292e85fc3517feebca26b31c3d5 Jun 16 19:53:54.854280 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:54.854248 2557 generic.go:356] "Generic (PLEG): container finished" podID="20d7dbb0-6cec-4d46-8448-09357d5e0bcf" containerID="f51f8f843b58d2a3a207c5286dd56a96d5d3b807900a526dc6a485e0f72f93c7" exitCode=0 Jun 16 19:53:54.854427 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:54.854317 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" event={"ID":"20d7dbb0-6cec-4d46-8448-09357d5e0bcf","Type":"ContainerDied","Data":"f51f8f843b58d2a3a207c5286dd56a96d5d3b807900a526dc6a485e0f72f93c7"} Jun 16 19:53:54.855619 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:54.855592 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fwkhc" event={"ID":"32cf828a-029d-4a7e-8385-3e0d489d9106","Type":"ContainerStarted","Data":"0f4b89b7e978f816d663c5454189e4f6cc65c292e85fc3517feebca26b31c3d5"} Jun 16 19:53:54.856858 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:54.856837 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xlbt2" event={"ID":"58f7a5d6-c78d-479a-91ec-264706a24576","Type":"ContainerStarted","Data":"13c765047d7eb7398e351e2c76a6bd1d76a1a79ffb65aa20d411ccb98e661a17"} Jun 16 19:53:55.865276 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:55.865181 2557 generic.go:356] "Generic (PLEG): container finished" podID="20d7dbb0-6cec-4d46-8448-09357d5e0bcf" containerID="6b4567d47602c2d8496d9104a88fe02f45e574f3fa6ed196f97d4d025dae5348" exitCode=0 Jun 16 19:53:55.865276 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:55.865265 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" event={"ID":"20d7dbb0-6cec-4d46-8448-09357d5e0bcf","Type":"ContainerDied","Data":"6b4567d47602c2d8496d9104a88fe02f45e574f3fa6ed196f97d4d025dae5348"} Jun 16 19:53:57.238924 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:57.238896 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" Jun 16 19:53:57.327459 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:57.327436 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-util\") pod \"20d7dbb0-6cec-4d46-8448-09357d5e0bcf\" (UID: \"20d7dbb0-6cec-4d46-8448-09357d5e0bcf\") " Jun 16 19:53:57.327612 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:57.327483 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-bundle\") pod \"20d7dbb0-6cec-4d46-8448-09357d5e0bcf\" (UID: \"20d7dbb0-6cec-4d46-8448-09357d5e0bcf\") " Jun 16 19:53:57.327612 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:57.327506 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xctb8\" (UniqueName: \"kubernetes.io/projected/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-kube-api-access-xctb8\") pod \"20d7dbb0-6cec-4d46-8448-09357d5e0bcf\" (UID: \"20d7dbb0-6cec-4d46-8448-09357d5e0bcf\") " Jun 16 19:53:57.327886 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:57.327856 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-bundle" (OuterVolumeSpecName: "bundle") pod "20d7dbb0-6cec-4d46-8448-09357d5e0bcf" (UID: "20d7dbb0-6cec-4d46-8448-09357d5e0bcf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:53:57.329984 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:57.329956 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-kube-api-access-xctb8" (OuterVolumeSpecName: "kube-api-access-xctb8") pod "20d7dbb0-6cec-4d46-8448-09357d5e0bcf" (UID: "20d7dbb0-6cec-4d46-8448-09357d5e0bcf"). InnerVolumeSpecName "kube-api-access-xctb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:53:57.332815 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:57.332781 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-util" (OuterVolumeSpecName: "util") pod "20d7dbb0-6cec-4d46-8448-09357d5e0bcf" (UID: "20d7dbb0-6cec-4d46-8448-09357d5e0bcf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:53:57.428694 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:57.428662 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:53:57.428694 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:57.428687 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:53:57.428881 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:57.428696 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xctb8\" (UniqueName: \"kubernetes.io/projected/20d7dbb0-6cec-4d46-8448-09357d5e0bcf-kube-api-access-xctb8\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:53:57.876434 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:57.876402 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" Jun 16 19:53:57.876633 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:57.876399 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgh9n4" event={"ID":"20d7dbb0-6cec-4d46-8448-09357d5e0bcf","Type":"ContainerDied","Data":"7b4bbe9939814804033cb859926bc4428b147df40ce39a1ab5a9ca19e064dd1a"} Jun 16 19:53:57.876633 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:57.876517 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b4bbe9939814804033cb859926bc4428b147df40ce39a1ab5a9ca19e064dd1a" Jun 16 19:53:57.877992 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:57.877967 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fwkhc" event={"ID":"32cf828a-029d-4a7e-8385-3e0d489d9106","Type":"ContainerStarted","Data":"600e9b39582d77ea420da356997ffb3329be0f3fd82cf660254502408a27ee62"} Jun 16 19:53:58.302100 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:53:58.302049 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fwkhc" podStartSLOduration=1.7106560480000002 podStartE2EDuration="4.30203133s" totalImagesPullingTime="2.591375282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:53:57.898477262 +0000 UTC m=+261.551307866" watchObservedRunningTime="2026-06-16 19:53:58.30203133 +0000 UTC m=+261.954861925" Jun 16 19:54:01.894162 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:01.894122 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xlbt2" event={"ID":"58f7a5d6-c78d-479a-91ec-264706a24576","Type":"ContainerStarted","Data":"f4126bfd8a66c29732daf0ac39587f55bed33019381aa0f2d46a857f4159b4e2"} Jun 16 19:54:01.894538 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:01.894254 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xlbt2" Jun 16 19:54:01.916092 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:01.916054 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xlbt2" podStartSLOduration=2.263304449 podStartE2EDuration="8.916040256s" totalImagesPullingTime="6.652735807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:54:01.915602462 +0000 UTC m=+265.568433066" watchObservedRunningTime="2026-06-16 19:54:01.916040256 +0000 UTC m=+265.568870859" Jun 16 19:54:07.900347 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:07.900315 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xlbt2" Jun 16 19:54:08.134475 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.134439 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tc4vt"] Jun 16 19:54:08.134746 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.134733 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d7dbb0-6cec-4d46-8448-09357d5e0bcf" containerName="util" Jun 16 19:54:08.134794 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.134748 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d7dbb0-6cec-4d46-8448-09357d5e0bcf" containerName="util" Jun 16 19:54:08.134794 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.134758 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d7dbb0-6cec-4d46-8448-09357d5e0bcf" containerName="extract" Jun 16 19:54:08.134794 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.134763 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d7dbb0-6cec-4d46-8448-09357d5e0bcf" containerName="extract" Jun 16 19:54:08.134794 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.134780 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d7dbb0-6cec-4d46-8448-09357d5e0bcf" containerName="pull" Jun 16 19:54:08.134794 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.134786 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d7dbb0-6cec-4d46-8448-09357d5e0bcf" containerName="pull" Jun 16 19:54:08.134941 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.134825 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="20d7dbb0-6cec-4d46-8448-09357d5e0bcf" containerName="extract" Jun 16 19:54:08.180106 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.180034 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tc4vt"] Jun 16 19:54:08.180233 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.180136 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tc4vt" Jun 16 19:54:08.183035 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.183007 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 16 19:54:08.183181 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.183077 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-jc69v\"" Jun 16 19:54:08.183181 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.183118 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 16 19:54:08.311912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.311876 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hdm7\" (UniqueName: \"kubernetes.io/projected/1d73a897-bf7d-4a84-9459-d12d5cec83e4-kube-api-access-4hdm7\") pod \"openshift-lws-operator-fd8ccff4c-tc4vt\" (UID: \"1d73a897-bf7d-4a84-9459-d12d5cec83e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tc4vt" Jun 16 19:54:08.312077 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.311962 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d73a897-bf7d-4a84-9459-d12d5cec83e4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tc4vt\" (UID: \"1d73a897-bf7d-4a84-9459-d12d5cec83e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tc4vt" Jun 16 19:54:08.413301 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.413275 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hdm7\" (UniqueName: \"kubernetes.io/projected/1d73a897-bf7d-4a84-9459-d12d5cec83e4-kube-api-access-4hdm7\") pod \"openshift-lws-operator-fd8ccff4c-tc4vt\" (UID: \"1d73a897-bf7d-4a84-9459-d12d5cec83e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tc4vt" Jun 16 19:54:08.413467 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.413339 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d73a897-bf7d-4a84-9459-d12d5cec83e4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tc4vt\" (UID: \"1d73a897-bf7d-4a84-9459-d12d5cec83e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tc4vt" Jun 16 19:54:08.413654 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.413636 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d73a897-bf7d-4a84-9459-d12d5cec83e4-tmp\") pod \"openshift-lws-operator-fd8ccff4c-tc4vt\" (UID: \"1d73a897-bf7d-4a84-9459-d12d5cec83e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tc4vt" Jun 16 19:54:08.422930 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.422907 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hdm7\" (UniqueName: \"kubernetes.io/projected/1d73a897-bf7d-4a84-9459-d12d5cec83e4-kube-api-access-4hdm7\") pod \"openshift-lws-operator-fd8ccff4c-tc4vt\" (UID: \"1d73a897-bf7d-4a84-9459-d12d5cec83e4\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tc4vt" Jun 16 19:54:08.488926 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.488859 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tc4vt" Jun 16 19:54:08.641133 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.641109 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tc4vt"] Jun 16 19:54:08.643512 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:54:08.643483 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d73a897_bf7d_4a84_9459_d12d5cec83e4.slice/crio-0786df0ba58dd0db0be920996826231f767b496212821401d62f5b8beef6b3dd WatchSource:0}: Error finding container 0786df0ba58dd0db0be920996826231f767b496212821401d62f5b8beef6b3dd: Status 404 returned error can't find the container with id 0786df0ba58dd0db0be920996826231f767b496212821401d62f5b8beef6b3dd Jun 16 19:54:08.922482 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:08.922452 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tc4vt" event={"ID":"1d73a897-bf7d-4a84-9459-d12d5cec83e4","Type":"ContainerStarted","Data":"0786df0ba58dd0db0be920996826231f767b496212821401d62f5b8beef6b3dd"} Jun 16 19:54:10.932356 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:10.932267 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tc4vt" event={"ID":"1d73a897-bf7d-4a84-9459-d12d5cec83e4","Type":"ContainerStarted","Data":"c89e189155bc40cd32177fe447995590522153c5fb48018eca3dc43b8a0f889e"} Jun 16 19:54:10.950485 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:10.950441 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-tc4vt" podStartSLOduration=0.953960371 podStartE2EDuration="2.950427649s" totalImagesPullingTime="1.996467278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:54:10.949193021 +0000 UTC m=+274.602023633" watchObservedRunningTime="2026-06-16 19:54:10.950427649 +0000 UTC m=+274.603258252" Jun 16 19:54:15.984490 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:15.984455 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9"] Jun 16 19:54:15.986498 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:15.986482 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" Jun 16 19:54:15.988965 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:15.988938 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 16 19:54:15.989080 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:15.988969 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 16 19:54:15.989995 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:15.989980 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6krmm\"" Jun 16 19:54:15.998003 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:15.997982 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9"] Jun 16 19:54:16.072169 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:16.072142 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7997836f-9185-472f-92c3-6b0db3529484-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9\" (UID: \"7997836f-9185-472f-92c3-6b0db3529484\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" Jun 16 19:54:16.072323 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:16.072208 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7997836f-9185-472f-92c3-6b0db3529484-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9\" (UID: \"7997836f-9185-472f-92c3-6b0db3529484\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" Jun 16 19:54:16.072323 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:16.072273 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqwv6\" (UniqueName: \"kubernetes.io/projected/7997836f-9185-472f-92c3-6b0db3529484-kube-api-access-zqwv6\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9\" (UID: \"7997836f-9185-472f-92c3-6b0db3529484\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" Jun 16 19:54:16.173431 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:16.173393 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqwv6\" (UniqueName: \"kubernetes.io/projected/7997836f-9185-472f-92c3-6b0db3529484-kube-api-access-zqwv6\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9\" (UID: \"7997836f-9185-472f-92c3-6b0db3529484\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" Jun 16 19:54:16.173637 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:16.173457 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7997836f-9185-472f-92c3-6b0db3529484-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9\" (UID: \"7997836f-9185-472f-92c3-6b0db3529484\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" Jun 16 19:54:16.173637 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:16.173513 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7997836f-9185-472f-92c3-6b0db3529484-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9\" (UID: \"7997836f-9185-472f-92c3-6b0db3529484\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" Jun 16 19:54:16.173937 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:16.173915 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7997836f-9185-472f-92c3-6b0db3529484-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9\" (UID: \"7997836f-9185-472f-92c3-6b0db3529484\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" Jun 16 19:54:16.174011 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:16.173932 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7997836f-9185-472f-92c3-6b0db3529484-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9\" (UID: \"7997836f-9185-472f-92c3-6b0db3529484\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" Jun 16 19:54:16.183489 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:16.183458 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqwv6\" (UniqueName: \"kubernetes.io/projected/7997836f-9185-472f-92c3-6b0db3529484-kube-api-access-zqwv6\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9\" (UID: \"7997836f-9185-472f-92c3-6b0db3529484\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" Jun 16 19:54:16.295127 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:16.295037 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" Jun 16 19:54:16.423646 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:16.423614 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9"] Jun 16 19:54:16.426360 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:54:16.426330 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7997836f_9185_472f_92c3_6b0db3529484.slice/crio-dbf0e6c09171c01b104ee1fbd834da0c0a5b76d3f42eed3fc26ac5a6797189ad WatchSource:0}: Error finding container dbf0e6c09171c01b104ee1fbd834da0c0a5b76d3f42eed3fc26ac5a6797189ad: Status 404 returned error can't find the container with id dbf0e6c09171c01b104ee1fbd834da0c0a5b76d3f42eed3fc26ac5a6797189ad Jun 16 19:54:16.956894 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:16.956857 2557 generic.go:356] "Generic (PLEG): container finished" podID="7997836f-9185-472f-92c3-6b0db3529484" containerID="905ec3508c8339c147a3ed2aa7e6698ec4e20ef51156007e60d1b0f2a24f8db1" exitCode=0 Jun 16 19:54:16.957046 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:16.956918 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" event={"ID":"7997836f-9185-472f-92c3-6b0db3529484","Type":"ContainerDied","Data":"905ec3508c8339c147a3ed2aa7e6698ec4e20ef51156007e60d1b0f2a24f8db1"} Jun 16 19:54:16.957046 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:16.956966 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" event={"ID":"7997836f-9185-472f-92c3-6b0db3529484","Type":"ContainerStarted","Data":"dbf0e6c09171c01b104ee1fbd834da0c0a5b76d3f42eed3fc26ac5a6797189ad"} Jun 16 19:54:17.964033 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:17.963991 2557 generic.go:356] "Generic (PLEG): container finished" podID="7997836f-9185-472f-92c3-6b0db3529484" containerID="eed683c6493d7f76516357ffb5613378fe67fce703be0b1cc0e1b5d26273dfc3" exitCode=0 Jun 16 19:54:17.964449 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:17.964059 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" event={"ID":"7997836f-9185-472f-92c3-6b0db3529484","Type":"ContainerDied","Data":"eed683c6493d7f76516357ffb5613378fe67fce703be0b1cc0e1b5d26273dfc3"} Jun 16 19:54:18.970345 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:18.970314 2557 generic.go:356] "Generic (PLEG): container finished" podID="7997836f-9185-472f-92c3-6b0db3529484" containerID="c69d07c9cfefd7813b1eb5bd17de27a6f4fa0dc7c93388138898b379017291f0" exitCode=0 Jun 16 19:54:18.970867 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:18.970355 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" event={"ID":"7997836f-9185-472f-92c3-6b0db3529484","Type":"ContainerDied","Data":"c69d07c9cfefd7813b1eb5bd17de27a6f4fa0dc7c93388138898b379017291f0"} Jun 16 19:54:20.096715 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:20.096692 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" Jun 16 19:54:20.204697 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:20.204670 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqwv6\" (UniqueName: \"kubernetes.io/projected/7997836f-9185-472f-92c3-6b0db3529484-kube-api-access-zqwv6\") pod \"7997836f-9185-472f-92c3-6b0db3529484\" (UID: \"7997836f-9185-472f-92c3-6b0db3529484\") " Jun 16 19:54:20.204860 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:20.204741 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7997836f-9185-472f-92c3-6b0db3529484-bundle\") pod \"7997836f-9185-472f-92c3-6b0db3529484\" (UID: \"7997836f-9185-472f-92c3-6b0db3529484\") " Jun 16 19:54:20.204860 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:20.204778 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7997836f-9185-472f-92c3-6b0db3529484-util\") pod \"7997836f-9185-472f-92c3-6b0db3529484\" (UID: \"7997836f-9185-472f-92c3-6b0db3529484\") " Jun 16 19:54:20.205459 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:20.205435 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7997836f-9185-472f-92c3-6b0db3529484-bundle" (OuterVolumeSpecName: "bundle") pod "7997836f-9185-472f-92c3-6b0db3529484" (UID: "7997836f-9185-472f-92c3-6b0db3529484"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:54:20.206853 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:20.206831 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7997836f-9185-472f-92c3-6b0db3529484-kube-api-access-zqwv6" (OuterVolumeSpecName: "kube-api-access-zqwv6") pod "7997836f-9185-472f-92c3-6b0db3529484" (UID: "7997836f-9185-472f-92c3-6b0db3529484"). InnerVolumeSpecName "kube-api-access-zqwv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:54:20.210359 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:20.210333 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7997836f-9185-472f-92c3-6b0db3529484-util" (OuterVolumeSpecName: "util") pod "7997836f-9185-472f-92c3-6b0db3529484" (UID: "7997836f-9185-472f-92c3-6b0db3529484"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:54:20.305706 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:20.305686 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqwv6\" (UniqueName: \"kubernetes.io/projected/7997836f-9185-472f-92c3-6b0db3529484-kube-api-access-zqwv6\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:54:20.305835 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:20.305709 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7997836f-9185-472f-92c3-6b0db3529484-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:54:20.305835 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:20.305718 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7997836f-9185-472f-92c3-6b0db3529484-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:54:20.979755 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:20.979723 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" event={"ID":"7997836f-9185-472f-92c3-6b0db3529484","Type":"ContainerDied","Data":"dbf0e6c09171c01b104ee1fbd834da0c0a5b76d3f42eed3fc26ac5a6797189ad"} Jun 16 19:54:20.979910 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:20.979773 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbf0e6c09171c01b104ee1fbd834da0c0a5b76d3f42eed3fc26ac5a6797189ad" Jun 16 19:54:20.979910 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:20.979737 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfq2c9" Jun 16 19:54:29.033919 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.033883 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5"] Jun 16 19:54:29.034364 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.034173 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7997836f-9185-472f-92c3-6b0db3529484" containerName="extract" Jun 16 19:54:29.034364 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.034185 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7997836f-9185-472f-92c3-6b0db3529484" containerName="extract" Jun 16 19:54:29.034364 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.034197 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7997836f-9185-472f-92c3-6b0db3529484" containerName="pull" Jun 16 19:54:29.034364 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.034207 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7997836f-9185-472f-92c3-6b0db3529484" containerName="pull" Jun 16 19:54:29.034364 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.034222 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7997836f-9185-472f-92c3-6b0db3529484" containerName="util" Jun 16 19:54:29.034364 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.034228 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7997836f-9185-472f-92c3-6b0db3529484" containerName="util" Jun 16 19:54:29.034364 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.034273 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7997836f-9185-472f-92c3-6b0db3529484" containerName="extract" Jun 16 19:54:29.038333 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.038315 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.040801 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.040775 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 16 19:54:29.040913 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.040813 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 16 19:54:29.040913 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.040811 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 16 19:54:29.041000 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.040961 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-r9w4c\"" Jun 16 19:54:29.041077 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.041061 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 16 19:54:29.055336 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.055315 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5"] Jun 16 19:54:29.165827 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.165790 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdd6s\" (UniqueName: \"kubernetes.io/projected/41008e0d-5b83-474e-b410-2a58e647786b-kube-api-access-sdd6s\") pod \"opendatahub-operator-controller-manager-5cbd84db66-v8vz5\" (UID: \"41008e0d-5b83-474e-b410-2a58e647786b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.165994 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.165833 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41008e0d-5b83-474e-b410-2a58e647786b-manifests\") pod \"opendatahub-operator-controller-manager-5cbd84db66-v8vz5\" (UID: \"41008e0d-5b83-474e-b410-2a58e647786b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.165994 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.165892 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41008e0d-5b83-474e-b410-2a58e647786b-tmp\") pod \"opendatahub-operator-controller-manager-5cbd84db66-v8vz5\" (UID: \"41008e0d-5b83-474e-b410-2a58e647786b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.165994 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.165935 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41008e0d-5b83-474e-b410-2a58e647786b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-v8vz5\" (UID: \"41008e0d-5b83-474e-b410-2a58e647786b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.165994 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.165961 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41008e0d-5b83-474e-b410-2a58e647786b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-v8vz5\" (UID: \"41008e0d-5b83-474e-b410-2a58e647786b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.267243 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.267213 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdd6s\" (UniqueName: \"kubernetes.io/projected/41008e0d-5b83-474e-b410-2a58e647786b-kube-api-access-sdd6s\") pod \"opendatahub-operator-controller-manager-5cbd84db66-v8vz5\" (UID: \"41008e0d-5b83-474e-b410-2a58e647786b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.267385 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.267250 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41008e0d-5b83-474e-b410-2a58e647786b-manifests\") pod \"opendatahub-operator-controller-manager-5cbd84db66-v8vz5\" (UID: \"41008e0d-5b83-474e-b410-2a58e647786b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.267385 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.267280 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41008e0d-5b83-474e-b410-2a58e647786b-tmp\") pod \"opendatahub-operator-controller-manager-5cbd84db66-v8vz5\" (UID: \"41008e0d-5b83-474e-b410-2a58e647786b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.267453 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.267401 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41008e0d-5b83-474e-b410-2a58e647786b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-v8vz5\" (UID: \"41008e0d-5b83-474e-b410-2a58e647786b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.267453 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.267436 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41008e0d-5b83-474e-b410-2a58e647786b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-v8vz5\" (UID: \"41008e0d-5b83-474e-b410-2a58e647786b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.267751 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.267732 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41008e0d-5b83-474e-b410-2a58e647786b-manifests\") pod \"opendatahub-operator-controller-manager-5cbd84db66-v8vz5\" (UID: \"41008e0d-5b83-474e-b410-2a58e647786b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.269748 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.269721 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41008e0d-5b83-474e-b410-2a58e647786b-tmp\") pod \"opendatahub-operator-controller-manager-5cbd84db66-v8vz5\" (UID: \"41008e0d-5b83-474e-b410-2a58e647786b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.269946 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.269927 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41008e0d-5b83-474e-b410-2a58e647786b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-v8vz5\" (UID: \"41008e0d-5b83-474e-b410-2a58e647786b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.270003 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.269953 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41008e0d-5b83-474e-b410-2a58e647786b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-v8vz5\" (UID: \"41008e0d-5b83-474e-b410-2a58e647786b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.284428 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.284375 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdd6s\" (UniqueName: \"kubernetes.io/projected/41008e0d-5b83-474e-b410-2a58e647786b-kube-api-access-sdd6s\") pod \"opendatahub-operator-controller-manager-5cbd84db66-v8vz5\" (UID: \"41008e0d-5b83-474e-b410-2a58e647786b\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.347957 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.347932 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:29.520607 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:29.520560 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5"] Jun 16 19:54:29.522236 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:54:29.522212 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41008e0d_5b83_474e_b410_2a58e647786b.slice/crio-1813e0087e72862ab369cab4ea5064fbde511c03b3517a7015d5fc6cca8c5cdb WatchSource:0}: Error finding container 1813e0087e72862ab369cab4ea5064fbde511c03b3517a7015d5fc6cca8c5cdb: Status 404 returned error can't find the container with id 1813e0087e72862ab369cab4ea5064fbde511c03b3517a7015d5fc6cca8c5cdb Jun 16 19:54:30.018667 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:30.018625 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" event={"ID":"41008e0d-5b83-474e-b410-2a58e647786b","Type":"ContainerStarted","Data":"1813e0087e72862ab369cab4ea5064fbde511c03b3517a7015d5fc6cca8c5cdb"} Jun 16 19:54:33.032951 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:33.032925 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" event={"ID":"41008e0d-5b83-474e-b410-2a58e647786b","Type":"ContainerStarted","Data":"63867e0bf3ba22d57e555faec99d792db013236e5b12ca900e69126e26d89494"} Jun 16 19:54:34.038247 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:34.038218 2557 generic.go:356] "Generic (PLEG): container finished" podID="41008e0d-5b83-474e-b410-2a58e647786b" containerID="63867e0bf3ba22d57e555faec99d792db013236e5b12ca900e69126e26d89494" exitCode=0 Jun 16 19:54:34.038626 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:34.038307 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" event={"ID":"41008e0d-5b83-474e-b410-2a58e647786b","Type":"ContainerDied","Data":"63867e0bf3ba22d57e555faec99d792db013236e5b12ca900e69126e26d89494"} Jun 16 19:54:35.046180 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:35.046144 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" event={"ID":"41008e0d-5b83-474e-b410-2a58e647786b","Type":"ContainerStarted","Data":"babc7f2ba1ad5eb9386afd7bd15a19c314bcea8df7256ce29c1188da246b3008"} Jun 16 19:54:35.046680 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:35.046244 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:35.074682 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:35.074632 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" podStartSLOduration=2.285232561 podStartE2EDuration="7.074617771s" totalImagesPullingTime="3.799410311s" totalInitContainerRuntime="989.974899ms" isStatefulPod=false podCreationTimestamp="2026-06-16 19:54:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:54:35.072392127 +0000 UTC m=+298.725222730" watchObservedRunningTime="2026-06-16 19:54:35.074617771 +0000 UTC m=+298.727448374" Jun 16 19:54:36.758608 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:36.758579 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 19:54:36.760287 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:36.760266 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 19:54:36.764450 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:36.764421 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 19:54:36.766024 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:36.766005 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 19:54:36.767197 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:36.767180 2557 kubelet.go:1648] "Image garbage collection succeeded" Jun 16 19:54:46.051898 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:46.051869 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-v8vz5" Jun 16 19:54:48.985536 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:48.985501 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-675vh"] Jun 16 19:54:48.988365 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:48.988341 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-675vh" Jun 16 19:54:48.991324 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:48.991303 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rfwfn\"" Jun 16 19:54:48.991436 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:48.991355 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 16 19:54:49.001503 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.001479 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-675vh"] Jun 16 19:54:49.015843 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.015819 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0edf62e-00d7-4eed-a6d8-43022dcb0836-cert\") pod \"odh-model-controller-6dc94f689f-675vh\" (UID: \"d0edf62e-00d7-4eed-a6d8-43022dcb0836\") " pod="opendatahub/odh-model-controller-6dc94f689f-675vh" Jun 16 19:54:49.015969 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.015912 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbh48\" (UniqueName: \"kubernetes.io/projected/d0edf62e-00d7-4eed-a6d8-43022dcb0836-kube-api-access-hbh48\") pod \"odh-model-controller-6dc94f689f-675vh\" (UID: \"d0edf62e-00d7-4eed-a6d8-43022dcb0836\") " pod="opendatahub/odh-model-controller-6dc94f689f-675vh" Jun 16 19:54:49.116372 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.116345 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbh48\" (UniqueName: \"kubernetes.io/projected/d0edf62e-00d7-4eed-a6d8-43022dcb0836-kube-api-access-hbh48\") pod \"odh-model-controller-6dc94f689f-675vh\" (UID: \"d0edf62e-00d7-4eed-a6d8-43022dcb0836\") " pod="opendatahub/odh-model-controller-6dc94f689f-675vh" Jun 16 19:54:49.116531 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.116388 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0edf62e-00d7-4eed-a6d8-43022dcb0836-cert\") pod \"odh-model-controller-6dc94f689f-675vh\" (UID: \"d0edf62e-00d7-4eed-a6d8-43022dcb0836\") " pod="opendatahub/odh-model-controller-6dc94f689f-675vh" Jun 16 19:54:49.116531 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:54:49.116514 2557 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 16 19:54:49.116656 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:54:49.116591 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0edf62e-00d7-4eed-a6d8-43022dcb0836-cert podName:d0edf62e-00d7-4eed-a6d8-43022dcb0836 nodeName:}" failed. No retries permitted until 2026-06-16 19:54:49.616551388 +0000 UTC m=+313.269381972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d0edf62e-00d7-4eed-a6d8-43022dcb0836-cert") pod "odh-model-controller-6dc94f689f-675vh" (UID: "d0edf62e-00d7-4eed-a6d8-43022dcb0836") : secret "odh-model-controller-webhook-cert" not found Jun 16 19:54:49.133774 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.133741 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbh48\" (UniqueName: \"kubernetes.io/projected/d0edf62e-00d7-4eed-a6d8-43022dcb0836-kube-api-access-hbh48\") pod \"odh-model-controller-6dc94f689f-675vh\" (UID: \"d0edf62e-00d7-4eed-a6d8-43022dcb0836\") " pod="opendatahub/odh-model-controller-6dc94f689f-675vh" Jun 16 19:54:49.619991 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.619951 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0edf62e-00d7-4eed-a6d8-43022dcb0836-cert\") pod \"odh-model-controller-6dc94f689f-675vh\" (UID: \"d0edf62e-00d7-4eed-a6d8-43022dcb0836\") " pod="opendatahub/odh-model-controller-6dc94f689f-675vh" Jun 16 19:54:49.622462 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.622435 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0edf62e-00d7-4eed-a6d8-43022dcb0836-cert\") pod \"odh-model-controller-6dc94f689f-675vh\" (UID: \"d0edf62e-00d7-4eed-a6d8-43022dcb0836\") " pod="opendatahub/odh-model-controller-6dc94f689f-675vh" Jun 16 19:54:49.702312 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.702273 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sxbrm"] Jun 16 19:54:49.704283 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.704262 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-sxbrm" Jun 16 19:54:49.706729 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.706706 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 16 19:54:49.720724 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.720603 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/866d4edc-1ffe-47bf-b60c-3df45196bc79-tls-certs\") pod \"model-serving-api-5dd488fc48-sxbrm\" (UID: \"866d4edc-1ffe-47bf-b60c-3df45196bc79\") " pod="opendatahub/model-serving-api-5dd488fc48-sxbrm" Jun 16 19:54:49.720724 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.720645 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbckd\" (UniqueName: \"kubernetes.io/projected/866d4edc-1ffe-47bf-b60c-3df45196bc79-kube-api-access-tbckd\") pod \"model-serving-api-5dd488fc48-sxbrm\" (UID: \"866d4edc-1ffe-47bf-b60c-3df45196bc79\") " pod="opendatahub/model-serving-api-5dd488fc48-sxbrm" Jun 16 19:54:49.725302 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.725267 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sxbrm"] Jun 16 19:54:49.822596 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.822547 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/866d4edc-1ffe-47bf-b60c-3df45196bc79-tls-certs\") pod \"model-serving-api-5dd488fc48-sxbrm\" (UID: \"866d4edc-1ffe-47bf-b60c-3df45196bc79\") " pod="opendatahub/model-serving-api-5dd488fc48-sxbrm" Jun 16 19:54:49.822751 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.822609 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbckd\" (UniqueName: \"kubernetes.io/projected/866d4edc-1ffe-47bf-b60c-3df45196bc79-kube-api-access-tbckd\") pod \"model-serving-api-5dd488fc48-sxbrm\" (UID: \"866d4edc-1ffe-47bf-b60c-3df45196bc79\") " pod="opendatahub/model-serving-api-5dd488fc48-sxbrm" Jun 16 19:54:49.822751 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:54:49.822729 2557 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 16 19:54:49.822834 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:54:49.822822 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866d4edc-1ffe-47bf-b60c-3df45196bc79-tls-certs podName:866d4edc-1ffe-47bf-b60c-3df45196bc79 nodeName:}" failed. No retries permitted until 2026-06-16 19:54:50.322800542 +0000 UTC m=+313.975631128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/866d4edc-1ffe-47bf-b60c-3df45196bc79-tls-certs") pod "model-serving-api-5dd488fc48-sxbrm" (UID: "866d4edc-1ffe-47bf-b60c-3df45196bc79") : secret "model-serving-api-tls" not found Jun 16 19:54:49.833712 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.833684 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbckd\" (UniqueName: \"kubernetes.io/projected/866d4edc-1ffe-47bf-b60c-3df45196bc79-kube-api-access-tbckd\") pod \"model-serving-api-5dd488fc48-sxbrm\" (UID: \"866d4edc-1ffe-47bf-b60c-3df45196bc79\") " pod="opendatahub/model-serving-api-5dd488fc48-sxbrm" Jun 16 19:54:49.899729 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:49.899646 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-675vh" Jun 16 19:54:50.035429 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:50.035399 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-675vh"] Jun 16 19:54:50.039777 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:54:50.039731 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0edf62e_00d7_4eed_a6d8_43022dcb0836.slice/crio-5f1cb04117059c0f4bd14e60d09d46d028a169814f1eb672c8bce496c5034a8d WatchSource:0}: Error finding container 5f1cb04117059c0f4bd14e60d09d46d028a169814f1eb672c8bce496c5034a8d: Status 404 returned error can't find the container with id 5f1cb04117059c0f4bd14e60d09d46d028a169814f1eb672c8bce496c5034a8d Jun 16 19:54:50.042303 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:50.042285 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 16 19:54:50.107232 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:50.107197 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-675vh" event={"ID":"d0edf62e-00d7-4eed-a6d8-43022dcb0836","Type":"ContainerStarted","Data":"5f1cb04117059c0f4bd14e60d09d46d028a169814f1eb672c8bce496c5034a8d"} Jun 16 19:54:50.325728 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:50.325693 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/866d4edc-1ffe-47bf-b60c-3df45196bc79-tls-certs\") pod \"model-serving-api-5dd488fc48-sxbrm\" (UID: \"866d4edc-1ffe-47bf-b60c-3df45196bc79\") " pod="opendatahub/model-serving-api-5dd488fc48-sxbrm" Jun 16 19:54:50.328314 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:50.328279 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/866d4edc-1ffe-47bf-b60c-3df45196bc79-tls-certs\") pod \"model-serving-api-5dd488fc48-sxbrm\" (UID: \"866d4edc-1ffe-47bf-b60c-3df45196bc79\") " pod="opendatahub/model-serving-api-5dd488fc48-sxbrm" Jun 16 19:54:50.615084 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:50.615001 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-sxbrm" Jun 16 19:54:50.756696 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:50.756660 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sxbrm"] Jun 16 19:54:51.112682 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:51.112643 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-sxbrm" event={"ID":"866d4edc-1ffe-47bf-b60c-3df45196bc79","Type":"ContainerStarted","Data":"795903b395c2634bc6f927bf7f018441b16483e323aea1dd257578309227bd89"} Jun 16 19:54:55.138443 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:55.138409 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-sxbrm" event={"ID":"866d4edc-1ffe-47bf-b60c-3df45196bc79","Type":"ContainerStarted","Data":"80730bbec639dc2dc57685bd1ccfeb777c076caf228cdca6ab5922b8e5c4d0f6"} Jun 16 19:54:55.138900 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:55.138478 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-sxbrm" Jun 16 19:54:55.140036 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:55.140005 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-675vh" event={"ID":"d0edf62e-00d7-4eed-a6d8-43022dcb0836","Type":"ContainerStarted","Data":"f3b6410966a9420c842f9174e391da613df3e2e9f5799c01b78253c44112692e"} Jun 16 19:54:55.140140 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:55.140061 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-675vh" Jun 16 19:54:55.161414 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:55.161354 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-sxbrm" podStartSLOduration=2.616902872 podStartE2EDuration="6.161340625s" totalImagesPullingTime="3.544437753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:54:55.159417929 +0000 UTC m=+318.812248533" watchObservedRunningTime="2026-06-16 19:54:55.161340625 +0000 UTC m=+318.814171206" Jun 16 19:54:55.184730 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:55.184653 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-675vh" podStartSLOduration=2.9145075289999998 podStartE2EDuration="7.184633735s" totalImagesPullingTime="4.270126206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:54:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:54:55.180973012 +0000 UTC m=+318.833803618" watchObservedRunningTime="2026-06-16 19:54:55.184633735 +0000 UTC m=+318.837464339" Jun 16 19:54:59.580713 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.580677 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-58ff4d787-cflq8"] Jun 16 19:54:59.583456 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.583436 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58ff4d787-cflq8" Jun 16 19:54:59.593868 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.593842 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 16 19:54:59.594694 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.594676 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 16 19:54:59.594811 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.594709 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 16 19:54:59.594811 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.594744 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 16 19:54:59.601826 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.601805 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58ff4d787-cflq8"] Jun 16 19:54:59.606168 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.606147 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d07be61-1a3b-4262-8ad8-dae561ee544c-tls-certs\") pod \"kube-auth-proxy-58ff4d787-cflq8\" (UID: \"7d07be61-1a3b-4262-8ad8-dae561ee544c\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-cflq8" Jun 16 19:54:59.606266 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.606185 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d07be61-1a3b-4262-8ad8-dae561ee544c-tmp\") pod \"kube-auth-proxy-58ff4d787-cflq8\" (UID: \"7d07be61-1a3b-4262-8ad8-dae561ee544c\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-cflq8" Jun 16 19:54:59.606266 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.606251 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2fhq\" (UniqueName: \"kubernetes.io/projected/7d07be61-1a3b-4262-8ad8-dae561ee544c-kube-api-access-x2fhq\") pod \"kube-auth-proxy-58ff4d787-cflq8\" (UID: \"7d07be61-1a3b-4262-8ad8-dae561ee544c\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-cflq8" Jun 16 19:54:59.706677 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.706641 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2fhq\" (UniqueName: \"kubernetes.io/projected/7d07be61-1a3b-4262-8ad8-dae561ee544c-kube-api-access-x2fhq\") pod \"kube-auth-proxy-58ff4d787-cflq8\" (UID: \"7d07be61-1a3b-4262-8ad8-dae561ee544c\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-cflq8" Jun 16 19:54:59.706832 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.706713 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d07be61-1a3b-4262-8ad8-dae561ee544c-tls-certs\") pod \"kube-auth-proxy-58ff4d787-cflq8\" (UID: \"7d07be61-1a3b-4262-8ad8-dae561ee544c\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-cflq8" Jun 16 19:54:59.706832 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.706744 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d07be61-1a3b-4262-8ad8-dae561ee544c-tmp\") pod \"kube-auth-proxy-58ff4d787-cflq8\" (UID: \"7d07be61-1a3b-4262-8ad8-dae561ee544c\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-cflq8" Jun 16 19:54:59.706916 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:54:59.706841 2557 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 16 19:54:59.706953 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:54:59.706930 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d07be61-1a3b-4262-8ad8-dae561ee544c-tls-certs podName:7d07be61-1a3b-4262-8ad8-dae561ee544c nodeName:}" failed. No retries permitted until 2026-06-16 19:55:00.206907802 +0000 UTC m=+323.859738387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7d07be61-1a3b-4262-8ad8-dae561ee544c-tls-certs") pod "kube-auth-proxy-58ff4d787-cflq8" (UID: "7d07be61-1a3b-4262-8ad8-dae561ee544c") : secret "kube-auth-proxy-tls" not found Jun 16 19:54:59.709186 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.709163 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d07be61-1a3b-4262-8ad8-dae561ee544c-tmp\") pod \"kube-auth-proxy-58ff4d787-cflq8\" (UID: \"7d07be61-1a3b-4262-8ad8-dae561ee544c\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-cflq8" Jun 16 19:54:59.714281 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.714258 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq"] Jun 16 19:54:59.716509 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.716490 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2fhq\" (UniqueName: \"kubernetes.io/projected/7d07be61-1a3b-4262-8ad8-dae561ee544c-kube-api-access-x2fhq\") pod \"kube-auth-proxy-58ff4d787-cflq8\" (UID: \"7d07be61-1a3b-4262-8ad8-dae561ee544c\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-cflq8" Jun 16 19:54:59.717301 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.717285 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" Jun 16 19:54:59.719750 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.719731 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6krmm\"" Jun 16 19:54:59.719852 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.719786 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 16 19:54:59.719852 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.719795 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 16 19:54:59.726638 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.726618 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq"] Jun 16 19:54:59.807647 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.807610 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17eab0ad-8290-49a6-881a-13105beb017f-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq\" (UID: \"17eab0ad-8290-49a6-881a-13105beb017f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" Jun 16 19:54:59.807832 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.807670 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nzcx\" (UniqueName: \"kubernetes.io/projected/17eab0ad-8290-49a6-881a-13105beb017f-kube-api-access-8nzcx\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq\" (UID: \"17eab0ad-8290-49a6-881a-13105beb017f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" Jun 16 19:54:59.807832 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.807743 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17eab0ad-8290-49a6-881a-13105beb017f-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq\" (UID: \"17eab0ad-8290-49a6-881a-13105beb017f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" Jun 16 19:54:59.818322 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.818295 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-j5tlj"] Jun 16 19:54:59.821207 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.821189 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-j5tlj" Jun 16 19:54:59.822007 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.821987 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp"] Jun 16 19:54:59.824418 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.824402 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp" Jun 16 19:54:59.825065 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.825047 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gpm8h\"" Jun 16 19:54:59.828137 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.828113 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 16 19:54:59.828229 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.828122 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 16 19:54:59.828327 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.828225 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-nn2m8\"" Jun 16 19:54:59.842009 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.841990 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-j5tlj"] Jun 16 19:54:59.844908 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.844882 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp"] Jun 16 19:54:59.908884 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.908852 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17eab0ad-8290-49a6-881a-13105beb017f-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq\" (UID: \"17eab0ad-8290-49a6-881a-13105beb017f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" Jun 16 19:54:59.909058 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.908894 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6pwn\" (UniqueName: \"kubernetes.io/projected/013041b3-a14c-4ea5-b698-d6f9fb7a92ee-kube-api-access-c6pwn\") pod \"kserve-controller-manager-69fc866d76-j5tlj\" (UID: \"013041b3-a14c-4ea5-b698-d6f9fb7a92ee\") " pod="opendatahub/kserve-controller-manager-69fc866d76-j5tlj" Jun 16 19:54:59.909058 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.908921 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d696e53-6a22-4e06-8e1d-048ea44ddde6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-r8tjp\" (UID: \"1d696e53-6a22-4e06-8e1d-048ea44ddde6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp" Jun 16 19:54:59.909058 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.909035 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzvqj\" (UniqueName: \"kubernetes.io/projected/1d696e53-6a22-4e06-8e1d-048ea44ddde6-kube-api-access-gzvqj\") pod \"llmisvc-controller-manager-864bfd7bc9-r8tjp\" (UID: \"1d696e53-6a22-4e06-8e1d-048ea44ddde6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp" Jun 16 19:54:59.909222 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.909093 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17eab0ad-8290-49a6-881a-13105beb017f-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq\" (UID: \"17eab0ad-8290-49a6-881a-13105beb017f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" Jun 16 19:54:59.909222 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.909155 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/013041b3-a14c-4ea5-b698-d6f9fb7a92ee-cert\") pod \"kserve-controller-manager-69fc866d76-j5tlj\" (UID: \"013041b3-a14c-4ea5-b698-d6f9fb7a92ee\") " pod="opendatahub/kserve-controller-manager-69fc866d76-j5tlj" Jun 16 19:54:59.909222 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.909206 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17eab0ad-8290-49a6-881a-13105beb017f-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq\" (UID: \"17eab0ad-8290-49a6-881a-13105beb017f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" Jun 16 19:54:59.909396 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.909294 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nzcx\" (UniqueName: \"kubernetes.io/projected/17eab0ad-8290-49a6-881a-13105beb017f-kube-api-access-8nzcx\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq\" (UID: \"17eab0ad-8290-49a6-881a-13105beb017f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" Jun 16 19:54:59.909443 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.909427 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17eab0ad-8290-49a6-881a-13105beb017f-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq\" (UID: \"17eab0ad-8290-49a6-881a-13105beb017f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" Jun 16 19:54:59.922701 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:54:59.922676 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nzcx\" (UniqueName: \"kubernetes.io/projected/17eab0ad-8290-49a6-881a-13105beb017f-kube-api-access-8nzcx\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq\" (UID: \"17eab0ad-8290-49a6-881a-13105beb017f\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" Jun 16 19:55:00.010513 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:00.010481 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6pwn\" (UniqueName: \"kubernetes.io/projected/013041b3-a14c-4ea5-b698-d6f9fb7a92ee-kube-api-access-c6pwn\") pod \"kserve-controller-manager-69fc866d76-j5tlj\" (UID: \"013041b3-a14c-4ea5-b698-d6f9fb7a92ee\") " pod="opendatahub/kserve-controller-manager-69fc866d76-j5tlj" Jun 16 19:55:00.010513 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:00.010513 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d696e53-6a22-4e06-8e1d-048ea44ddde6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-r8tjp\" (UID: \"1d696e53-6a22-4e06-8e1d-048ea44ddde6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp" Jun 16 19:55:00.010810 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:00.010542 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzvqj\" (UniqueName: \"kubernetes.io/projected/1d696e53-6a22-4e06-8e1d-048ea44ddde6-kube-api-access-gzvqj\") pod \"llmisvc-controller-manager-864bfd7bc9-r8tjp\" (UID: \"1d696e53-6a22-4e06-8e1d-048ea44ddde6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp" Jun 16 19:55:00.010810 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:55:00.010659 2557 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 16 19:55:00.010810 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:55:00.010731 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d696e53-6a22-4e06-8e1d-048ea44ddde6-cert podName:1d696e53-6a22-4e06-8e1d-048ea44ddde6 nodeName:}" failed. No retries permitted until 2026-06-16 19:55:00.51071486 +0000 UTC m=+324.163545441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1d696e53-6a22-4e06-8e1d-048ea44ddde6-cert") pod "llmisvc-controller-manager-864bfd7bc9-r8tjp" (UID: "1d696e53-6a22-4e06-8e1d-048ea44ddde6") : secret "llmisvc-webhook-server-cert" not found Jun 16 19:55:00.010810 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:00.010748 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/013041b3-a14c-4ea5-b698-d6f9fb7a92ee-cert\") pod \"kserve-controller-manager-69fc866d76-j5tlj\" (UID: \"013041b3-a14c-4ea5-b698-d6f9fb7a92ee\") " pod="opendatahub/kserve-controller-manager-69fc866d76-j5tlj" Jun 16 19:55:00.013180 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:00.013161 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/013041b3-a14c-4ea5-b698-d6f9fb7a92ee-cert\") pod \"kserve-controller-manager-69fc866d76-j5tlj\" (UID: \"013041b3-a14c-4ea5-b698-d6f9fb7a92ee\") " pod="opendatahub/kserve-controller-manager-69fc866d76-j5tlj" Jun 16 19:55:00.020467 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:00.020440 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6pwn\" (UniqueName: \"kubernetes.io/projected/013041b3-a14c-4ea5-b698-d6f9fb7a92ee-kube-api-access-c6pwn\") pod \"kserve-controller-manager-69fc866d76-j5tlj\" (UID: \"013041b3-a14c-4ea5-b698-d6f9fb7a92ee\") " pod="opendatahub/kserve-controller-manager-69fc866d76-j5tlj" Jun 16 19:55:00.021020 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:00.020997 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzvqj\" (UniqueName: \"kubernetes.io/projected/1d696e53-6a22-4e06-8e1d-048ea44ddde6-kube-api-access-gzvqj\") pod \"llmisvc-controller-manager-864bfd7bc9-r8tjp\" (UID: \"1d696e53-6a22-4e06-8e1d-048ea44ddde6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp" Jun 16 19:55:00.033819 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:00.033797 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" Jun 16 19:55:00.132889 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:00.132860 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-j5tlj" Jun 16 19:55:00.175751 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:00.175711 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq"] Jun 16 19:55:00.180302 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:55:00.180268 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17eab0ad_8290_49a6_881a_13105beb017f.slice/crio-46bb16627feb740eb2ae959351b238bab8b45eefd22cc0b11e9e77b5dfab1b53 WatchSource:0}: Error finding container 46bb16627feb740eb2ae959351b238bab8b45eefd22cc0b11e9e77b5dfab1b53: Status 404 returned error can't find the container with id 46bb16627feb740eb2ae959351b238bab8b45eefd22cc0b11e9e77b5dfab1b53 Jun 16 19:55:00.212350 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:00.212322 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d07be61-1a3b-4262-8ad8-dae561ee544c-tls-certs\") pod \"kube-auth-proxy-58ff4d787-cflq8\" (UID: \"7d07be61-1a3b-4262-8ad8-dae561ee544c\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-cflq8" Jun 16 19:55:00.215029 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:00.215003 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d07be61-1a3b-4262-8ad8-dae561ee544c-tls-certs\") pod \"kube-auth-proxy-58ff4d787-cflq8\" (UID: \"7d07be61-1a3b-4262-8ad8-dae561ee544c\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-cflq8" Jun 16 19:55:00.306840 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:00.306802 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-j5tlj"] Jun 16 19:55:00.309989 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:55:00.309955 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod013041b3_a14c_4ea5_b698_d6f9fb7a92ee.slice/crio-463e5d2efed44c2320b3f76e74482c85a94197e264ca9bc54b42eac6164225f6 WatchSource:0}: Error finding container 463e5d2efed44c2320b3f76e74482c85a94197e264ca9bc54b42eac6164225f6: Status 404 returned error can't find the container with id 463e5d2efed44c2320b3f76e74482c85a94197e264ca9bc54b42eac6164225f6 Jun 16 19:55:00.492400 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:00.492312 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58ff4d787-cflq8" Jun 16 19:55:00.515484 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:00.515457 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d696e53-6a22-4e06-8e1d-048ea44ddde6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-r8tjp\" (UID: \"1d696e53-6a22-4e06-8e1d-048ea44ddde6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp" Jun 16 19:55:00.515658 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:55:00.515637 2557 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 16 19:55:00.515716 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:55:00.515706 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d696e53-6a22-4e06-8e1d-048ea44ddde6-cert podName:1d696e53-6a22-4e06-8e1d-048ea44ddde6 nodeName:}" failed. No retries permitted until 2026-06-16 19:55:01.515692269 +0000 UTC m=+325.168522850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1d696e53-6a22-4e06-8e1d-048ea44ddde6-cert") pod "llmisvc-controller-manager-864bfd7bc9-r8tjp" (UID: "1d696e53-6a22-4e06-8e1d-048ea44ddde6") : secret "llmisvc-webhook-server-cert" not found Jun 16 19:55:00.622803 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:00.622781 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58ff4d787-cflq8"] Jun 16 19:55:00.624494 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:55:00.624469 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d07be61_1a3b_4262_8ad8_dae561ee544c.slice/crio-70d9710011ff32a626299383f9bd985848ee43dab215716e775127eded3424f6 WatchSource:0}: Error finding container 70d9710011ff32a626299383f9bd985848ee43dab215716e775127eded3424f6: Status 404 returned error can't find the container with id 70d9710011ff32a626299383f9bd985848ee43dab215716e775127eded3424f6 Jun 16 19:55:01.167440 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:01.167406 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-j5tlj" event={"ID":"013041b3-a14c-4ea5-b698-d6f9fb7a92ee","Type":"ContainerStarted","Data":"463e5d2efed44c2320b3f76e74482c85a94197e264ca9bc54b42eac6164225f6"} Jun 16 19:55:01.168468 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:01.168430 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58ff4d787-cflq8" event={"ID":"7d07be61-1a3b-4262-8ad8-dae561ee544c","Type":"ContainerStarted","Data":"70d9710011ff32a626299383f9bd985848ee43dab215716e775127eded3424f6"} Jun 16 19:55:01.169811 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:01.169787 2557 generic.go:356] "Generic (PLEG): container finished" podID="17eab0ad-8290-49a6-881a-13105beb017f" containerID="6d6b31745d80c863c208244d1a4cc9554ab6eae3ea1c4b70d16e6754318a39a9" exitCode=0 Jun 16 19:55:01.169905 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:01.169872 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" event={"ID":"17eab0ad-8290-49a6-881a-13105beb017f","Type":"ContainerDied","Data":"6d6b31745d80c863c208244d1a4cc9554ab6eae3ea1c4b70d16e6754318a39a9"} Jun 16 19:55:01.169942 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:01.169917 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" event={"ID":"17eab0ad-8290-49a6-881a-13105beb017f","Type":"ContainerStarted","Data":"46bb16627feb740eb2ae959351b238bab8b45eefd22cc0b11e9e77b5dfab1b53"} Jun 16 19:55:01.524423 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:01.524341 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d696e53-6a22-4e06-8e1d-048ea44ddde6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-r8tjp\" (UID: \"1d696e53-6a22-4e06-8e1d-048ea44ddde6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp" Jun 16 19:55:01.526875 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:01.526844 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d696e53-6a22-4e06-8e1d-048ea44ddde6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-r8tjp\" (UID: \"1d696e53-6a22-4e06-8e1d-048ea44ddde6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp" Jun 16 19:55:01.638205 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:01.638159 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp" Jun 16 19:55:01.817421 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:01.817243 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp"] Jun 16 19:55:01.820440 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:55:01.820411 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1d696e53_6a22_4e06_8e1d_048ea44ddde6.slice/crio-9cf0b01aa345f866e9452a85aa755118b3f95fa4dce8f6ebee7710ee663afb3d WatchSource:0}: Error finding container 9cf0b01aa345f866e9452a85aa755118b3f95fa4dce8f6ebee7710ee663afb3d: Status 404 returned error can't find the container with id 9cf0b01aa345f866e9452a85aa755118b3f95fa4dce8f6ebee7710ee663afb3d Jun 16 19:55:02.178492 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:02.178416 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp" event={"ID":"1d696e53-6a22-4e06-8e1d-048ea44ddde6","Type":"ContainerStarted","Data":"9cf0b01aa345f866e9452a85aa755118b3f95fa4dce8f6ebee7710ee663afb3d"} Jun 16 19:55:03.185753 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:03.185715 2557 generic.go:356] "Generic (PLEG): container finished" podID="17eab0ad-8290-49a6-881a-13105beb017f" containerID="fcf668f6bcb94702a3117f356730a9aeb09f7cde8bb2073bcb891abfafddd7ed" exitCode=0 Jun 16 19:55:03.186227 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:03.185801 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" event={"ID":"17eab0ad-8290-49a6-881a-13105beb017f","Type":"ContainerDied","Data":"fcf668f6bcb94702a3117f356730a9aeb09f7cde8bb2073bcb891abfafddd7ed"} Jun 16 19:55:05.203842 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:05.203807 2557 generic.go:356] "Generic (PLEG): container finished" podID="17eab0ad-8290-49a6-881a-13105beb017f" containerID="76d3f3637fe56396b45cdfb5d931f7f91901026e5244975091d51feaa8b0d05b" exitCode=0 Jun 16 19:55:05.204172 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:05.203860 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" event={"ID":"17eab0ad-8290-49a6-881a-13105beb017f","Type":"ContainerDied","Data":"76d3f3637fe56396b45cdfb5d931f7f91901026e5244975091d51feaa8b0d05b"} Jun 16 19:55:06.146607 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.146550 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-675vh" Jun 16 19:55:06.148885 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.148859 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-sxbrm" Jun 16 19:55:06.212011 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.211956 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-j5tlj" event={"ID":"013041b3-a14c-4ea5-b698-d6f9fb7a92ee","Type":"ContainerStarted","Data":"0d19388204af6c558b7f8c2d02408b99808000143528d7b81e3ca4bfbace6803"} Jun 16 19:55:06.212466 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.212110 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-j5tlj" Jun 16 19:55:06.214398 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.214376 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58ff4d787-cflq8" event={"ID":"7d07be61-1a3b-4262-8ad8-dae561ee544c","Type":"ContainerStarted","Data":"ce4ee01b241acb65d676fdffd2a31cc1e43d41a24d3d29b05138007f2c8b1f7e"} Jun 16 19:55:06.244779 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.244720 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-j5tlj" podStartSLOduration=2.9318899800000002 podStartE2EDuration="7.24470126s" totalImagesPullingTime="4.31281128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:55:06.241989755 +0000 UTC m=+329.894820358" watchObservedRunningTime="2026-06-16 19:55:06.24470126 +0000 UTC m=+329.897531874" Jun 16 19:55:06.271315 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.271211 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-58ff4d787-cflq8" podStartSLOduration=3.273274589 podStartE2EDuration="7.271195421s" totalImagesPullingTime="3.997920832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:55:06.268602014 +0000 UTC m=+329.921432639" watchObservedRunningTime="2026-06-16 19:55:06.271195421 +0000 UTC m=+329.924026045" Jun 16 19:55:06.360722 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.360695 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" Jun 16 19:55:06.471040 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.470950 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17eab0ad-8290-49a6-881a-13105beb017f-util\") pod \"17eab0ad-8290-49a6-881a-13105beb017f\" (UID: \"17eab0ad-8290-49a6-881a-13105beb017f\") " Jun 16 19:55:06.471040 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.471014 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nzcx\" (UniqueName: \"kubernetes.io/projected/17eab0ad-8290-49a6-881a-13105beb017f-kube-api-access-8nzcx\") pod \"17eab0ad-8290-49a6-881a-13105beb017f\" (UID: \"17eab0ad-8290-49a6-881a-13105beb017f\") " Jun 16 19:55:06.471040 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.471041 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17eab0ad-8290-49a6-881a-13105beb017f-bundle\") pod \"17eab0ad-8290-49a6-881a-13105beb017f\" (UID: \"17eab0ad-8290-49a6-881a-13105beb017f\") " Jun 16 19:55:06.471966 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.471932 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17eab0ad-8290-49a6-881a-13105beb017f-bundle" (OuterVolumeSpecName: "bundle") pod "17eab0ad-8290-49a6-881a-13105beb017f" (UID: "17eab0ad-8290-49a6-881a-13105beb017f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:55:06.473355 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.473329 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17eab0ad-8290-49a6-881a-13105beb017f-kube-api-access-8nzcx" (OuterVolumeSpecName: "kube-api-access-8nzcx") pod "17eab0ad-8290-49a6-881a-13105beb017f" (UID: "17eab0ad-8290-49a6-881a-13105beb017f"). InnerVolumeSpecName "kube-api-access-8nzcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:55:06.475917 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.475893 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17eab0ad-8290-49a6-881a-13105beb017f-util" (OuterVolumeSpecName: "util") pod "17eab0ad-8290-49a6-881a-13105beb017f" (UID: "17eab0ad-8290-49a6-881a-13105beb017f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:55:06.571560 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.571523 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nzcx\" (UniqueName: \"kubernetes.io/projected/17eab0ad-8290-49a6-881a-13105beb017f-kube-api-access-8nzcx\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:55:06.571560 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.571552 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17eab0ad-8290-49a6-881a-13105beb017f-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:55:06.571560 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:06.571581 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17eab0ad-8290-49a6-881a-13105beb017f-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:55:07.223981 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:07.223902 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" Jun 16 19:55:07.224401 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:07.224314 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bjckq" event={"ID":"17eab0ad-8290-49a6-881a-13105beb017f","Type":"ContainerDied","Data":"46bb16627feb740eb2ae959351b238bab8b45eefd22cc0b11e9e77b5dfab1b53"} Jun 16 19:55:07.224401 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:07.224343 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46bb16627feb740eb2ae959351b238bab8b45eefd22cc0b11e9e77b5dfab1b53" Jun 16 19:55:08.230540 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:08.230494 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp" event={"ID":"1d696e53-6a22-4e06-8e1d-048ea44ddde6","Type":"ContainerStarted","Data":"141b53b1864f093b3720f3508293000f015d7508d61ccef0818890e794773d59"} Jun 16 19:55:08.230936 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:08.230750 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp" Jun 16 19:55:08.252174 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:08.252116 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp" podStartSLOduration=3.545855571 podStartE2EDuration="9.252101574s" totalImagesPullingTime="5.706246003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:55:08.250665267 +0000 UTC m=+331.903495860" watchObservedRunningTime="2026-06-16 19:55:08.252101574 +0000 UTC m=+331.904932176" Jun 16 19:55:14.172009 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.171964 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk"] Jun 16 19:55:14.172449 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.172271 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17eab0ad-8290-49a6-881a-13105beb017f" containerName="util" Jun 16 19:55:14.172449 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.172284 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="17eab0ad-8290-49a6-881a-13105beb017f" containerName="util" Jun 16 19:55:14.172449 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.172301 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17eab0ad-8290-49a6-881a-13105beb017f" containerName="pull" Jun 16 19:55:14.172449 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.172311 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="17eab0ad-8290-49a6-881a-13105beb017f" containerName="pull" Jun 16 19:55:14.172449 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.172320 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17eab0ad-8290-49a6-881a-13105beb017f" containerName="extract" Jun 16 19:55:14.172449 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.172330 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="17eab0ad-8290-49a6-881a-13105beb017f" containerName="extract" Jun 16 19:55:14.172449 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.172384 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="17eab0ad-8290-49a6-881a-13105beb017f" containerName="extract" Jun 16 19:55:14.178474 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.178450 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" Jun 16 19:55:14.183109 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.183078 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 16 19:55:14.185307 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.185280 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 16 19:55:14.186785 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.186753 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6krmm\"" Jun 16 19:55:14.194771 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.194743 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk"] Jun 16 19:55:14.236989 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.236964 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2895d\" (UniqueName: \"kubernetes.io/projected/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-kube-api-access-2895d\") pod \"90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk\" (UID: \"2105039f-130e-40c6-a2d5-3e09f9bfc8bb\") " pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" Jun 16 19:55:14.237106 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.236993 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-util\") pod \"90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk\" (UID: \"2105039f-130e-40c6-a2d5-3e09f9bfc8bb\") " pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" Jun 16 19:55:14.237106 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.237038 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-bundle\") pod \"90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk\" (UID: \"2105039f-130e-40c6-a2d5-3e09f9bfc8bb\") " pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" Jun 16 19:55:14.337617 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.337561 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2895d\" (UniqueName: \"kubernetes.io/projected/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-kube-api-access-2895d\") pod \"90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk\" (UID: \"2105039f-130e-40c6-a2d5-3e09f9bfc8bb\") " pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" Jun 16 19:55:14.337757 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.337628 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-util\") pod \"90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk\" (UID: \"2105039f-130e-40c6-a2d5-3e09f9bfc8bb\") " pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" Jun 16 19:55:14.337757 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.337678 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-bundle\") pod \"90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk\" (UID: \"2105039f-130e-40c6-a2d5-3e09f9bfc8bb\") " pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" Jun 16 19:55:14.338103 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.338081 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-util\") pod \"90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk\" (UID: \"2105039f-130e-40c6-a2d5-3e09f9bfc8bb\") " pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" Jun 16 19:55:14.338146 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.338088 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-bundle\") pod \"90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk\" (UID: \"2105039f-130e-40c6-a2d5-3e09f9bfc8bb\") " pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" Jun 16 19:55:14.352831 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.352810 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2895d\" (UniqueName: \"kubernetes.io/projected/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-kube-api-access-2895d\") pod \"90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk\" (UID: \"2105039f-130e-40c6-a2d5-3e09f9bfc8bb\") " pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" Jun 16 19:55:14.493197 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.493123 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" Jun 16 19:55:14.681510 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:14.681477 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk"] Jun 16 19:55:14.682449 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:55:14.682418 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2105039f_130e_40c6_a2d5_3e09f9bfc8bb.slice/crio-ffd1e34abfb9339ab016c8c815216fdf29a966cce10c34a51c6335b7445f9838 WatchSource:0}: Error finding container ffd1e34abfb9339ab016c8c815216fdf29a966cce10c34a51c6335b7445f9838: Status 404 returned error can't find the container with id ffd1e34abfb9339ab016c8c815216fdf29a966cce10c34a51c6335b7445f9838 Jun 16 19:55:15.263311 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:15.263274 2557 generic.go:356] "Generic (PLEG): container finished" podID="2105039f-130e-40c6-a2d5-3e09f9bfc8bb" containerID="ab089cda1ba87ea45b74aa73b47776395f8d9e1d962387a9eabfc6530f07edff" exitCode=0 Jun 16 19:55:15.263719 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:15.263349 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" event={"ID":"2105039f-130e-40c6-a2d5-3e09f9bfc8bb","Type":"ContainerDied","Data":"ab089cda1ba87ea45b74aa73b47776395f8d9e1d962387a9eabfc6530f07edff"} Jun 16 19:55:15.263719 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:15.263405 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" event={"ID":"2105039f-130e-40c6-a2d5-3e09f9bfc8bb","Type":"ContainerStarted","Data":"ffd1e34abfb9339ab016c8c815216fdf29a966cce10c34a51c6335b7445f9838"} Jun 16 19:55:15.753295 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:15.753223 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-6nvxq"] Jun 16 19:55:15.758360 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:15.758337 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-6nvxq" Jun 16 19:55:15.764281 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:15.764256 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-pb8ff\"" Jun 16 19:55:15.764790 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:15.764759 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 16 19:55:15.764898 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:15.764802 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 16 19:55:15.777348 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:15.777325 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-6nvxq"] Jun 16 19:55:15.851072 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:15.851040 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v6c2\" (UniqueName: \"kubernetes.io/projected/48261a79-1e2d-4b11-8081-f87dbf946c68-kube-api-access-7v6c2\") pod \"servicemesh-operator3-57f65f65fb-6nvxq\" (UID: \"48261a79-1e2d-4b11-8081-f87dbf946c68\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-6nvxq" Jun 16 19:55:15.851197 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:15.851124 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/48261a79-1e2d-4b11-8081-f87dbf946c68-operator-config\") pod \"servicemesh-operator3-57f65f65fb-6nvxq\" (UID: \"48261a79-1e2d-4b11-8081-f87dbf946c68\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-6nvxq" Jun 16 19:55:15.952432 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:15.952400 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/48261a79-1e2d-4b11-8081-f87dbf946c68-operator-config\") pod \"servicemesh-operator3-57f65f65fb-6nvxq\" (UID: \"48261a79-1e2d-4b11-8081-f87dbf946c68\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-6nvxq" Jun 16 19:55:15.952640 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:15.952444 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v6c2\" (UniqueName: \"kubernetes.io/projected/48261a79-1e2d-4b11-8081-f87dbf946c68-kube-api-access-7v6c2\") pod \"servicemesh-operator3-57f65f65fb-6nvxq\" (UID: \"48261a79-1e2d-4b11-8081-f87dbf946c68\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-6nvxq" Jun 16 19:55:15.955055 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:15.955032 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/48261a79-1e2d-4b11-8081-f87dbf946c68-operator-config\") pod \"servicemesh-operator3-57f65f65fb-6nvxq\" (UID: \"48261a79-1e2d-4b11-8081-f87dbf946c68\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-6nvxq" Jun 16 19:55:15.968616 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:15.968588 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v6c2\" (UniqueName: \"kubernetes.io/projected/48261a79-1e2d-4b11-8081-f87dbf946c68-kube-api-access-7v6c2\") pod \"servicemesh-operator3-57f65f65fb-6nvxq\" (UID: \"48261a79-1e2d-4b11-8081-f87dbf946c68\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-6nvxq" Jun 16 19:55:16.067478 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:16.067447 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-6nvxq" Jun 16 19:55:16.272407 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:16.272375 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-6nvxq"] Jun 16 19:55:16.358765 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:55:16.358673 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48261a79_1e2d_4b11_8081_f87dbf946c68.slice/crio-d8659d20ad2f4c607ca39898698f4f19a552492a4ee35678bd84b6be4c7728d8 WatchSource:0}: Error finding container d8659d20ad2f4c607ca39898698f4f19a552492a4ee35678bd84b6be4c7728d8: Status 404 returned error can't find the container with id d8659d20ad2f4c607ca39898698f4f19a552492a4ee35678bd84b6be4c7728d8 Jun 16 19:55:16.378860 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:16.378835 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-56694dc9bd-6cnkj"] Jun 16 19:55:16.399036 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:16.398999 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56694dc9bd-6cnkj"] Jun 16 19:55:16.399165 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:16.399095 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56694dc9bd-6cnkj" Jun 16 19:55:16.403183 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:16.403155 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 16 19:55:16.403300 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:16.403157 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zfp2n\"" Jun 16 19:55:16.558316 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:16.558282 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ded12e65-7f1a-4be9-90cd-4a8dea21b9ad-redirect-config\") pod \"dashboard-redirect-56694dc9bd-6cnkj\" (UID: \"ded12e65-7f1a-4be9-90cd-4a8dea21b9ad\") " pod="opendatahub/dashboard-redirect-56694dc9bd-6cnkj" Jun 16 19:55:16.558466 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:16.558342 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rxmp\" (UniqueName: \"kubernetes.io/projected/ded12e65-7f1a-4be9-90cd-4a8dea21b9ad-kube-api-access-9rxmp\") pod \"dashboard-redirect-56694dc9bd-6cnkj\" (UID: \"ded12e65-7f1a-4be9-90cd-4a8dea21b9ad\") " pod="opendatahub/dashboard-redirect-56694dc9bd-6cnkj" Jun 16 19:55:16.658980 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:16.658902 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ded12e65-7f1a-4be9-90cd-4a8dea21b9ad-redirect-config\") pod \"dashboard-redirect-56694dc9bd-6cnkj\" (UID: \"ded12e65-7f1a-4be9-90cd-4a8dea21b9ad\") " pod="opendatahub/dashboard-redirect-56694dc9bd-6cnkj" Jun 16 19:55:16.658980 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:16.658946 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rxmp\" (UniqueName: \"kubernetes.io/projected/ded12e65-7f1a-4be9-90cd-4a8dea21b9ad-kube-api-access-9rxmp\") pod \"dashboard-redirect-56694dc9bd-6cnkj\" (UID: \"ded12e65-7f1a-4be9-90cd-4a8dea21b9ad\") " pod="opendatahub/dashboard-redirect-56694dc9bd-6cnkj" Jun 16 19:55:16.659658 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:16.659633 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ded12e65-7f1a-4be9-90cd-4a8dea21b9ad-redirect-config\") pod \"dashboard-redirect-56694dc9bd-6cnkj\" (UID: \"ded12e65-7f1a-4be9-90cd-4a8dea21b9ad\") " pod="opendatahub/dashboard-redirect-56694dc9bd-6cnkj" Jun 16 19:55:16.672775 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:16.672750 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rxmp\" (UniqueName: \"kubernetes.io/projected/ded12e65-7f1a-4be9-90cd-4a8dea21b9ad-kube-api-access-9rxmp\") pod \"dashboard-redirect-56694dc9bd-6cnkj\" (UID: \"ded12e65-7f1a-4be9-90cd-4a8dea21b9ad\") " pod="opendatahub/dashboard-redirect-56694dc9bd-6cnkj" Jun 16 19:55:16.710611 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:16.710588 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56694dc9bd-6cnkj" Jun 16 19:55:16.871120 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:16.871096 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56694dc9bd-6cnkj"] Jun 16 19:55:16.936465 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:55:16.936393 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded12e65_7f1a_4be9_90cd_4a8dea21b9ad.slice/crio-7abb3707664566de09a0fe5ce11796dcfffd15f7bcbbf84dfabdbb000fbcab52 WatchSource:0}: Error finding container 7abb3707664566de09a0fe5ce11796dcfffd15f7bcbbf84dfabdbb000fbcab52: Status 404 returned error can't find the container with id 7abb3707664566de09a0fe5ce11796dcfffd15f7bcbbf84dfabdbb000fbcab52 Jun 16 19:55:17.276708 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:17.276626 2557 generic.go:356] "Generic (PLEG): container finished" podID="2105039f-130e-40c6-a2d5-3e09f9bfc8bb" containerID="3a70a8f02e2ccdf48309651870517e947abbb5b989531abbdad473f2a775723d" exitCode=0 Jun 16 19:55:17.277218 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:17.276713 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" event={"ID":"2105039f-130e-40c6-a2d5-3e09f9bfc8bb","Type":"ContainerDied","Data":"3a70a8f02e2ccdf48309651870517e947abbb5b989531abbdad473f2a775723d"} Jun 16 19:55:17.280585 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:17.280530 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-6nvxq" event={"ID":"48261a79-1e2d-4b11-8081-f87dbf946c68","Type":"ContainerStarted","Data":"d8659d20ad2f4c607ca39898698f4f19a552492a4ee35678bd84b6be4c7728d8"} Jun 16 19:55:17.282407 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:17.282369 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56694dc9bd-6cnkj" event={"ID":"ded12e65-7f1a-4be9-90cd-4a8dea21b9ad","Type":"ContainerStarted","Data":"7abb3707664566de09a0fe5ce11796dcfffd15f7bcbbf84dfabdbb000fbcab52"} Jun 16 19:55:18.293402 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:18.293353 2557 generic.go:356] "Generic (PLEG): container finished" podID="2105039f-130e-40c6-a2d5-3e09f9bfc8bb" containerID="bfe8c592b94e1a095cd8434601ba6f2ee474df9ba26605b071f5d0ef98ade5f9" exitCode=0 Jun 16 19:55:18.293892 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:18.293484 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" event={"ID":"2105039f-130e-40c6-a2d5-3e09f9bfc8bb","Type":"ContainerDied","Data":"bfe8c592b94e1a095cd8434601ba6f2ee474df9ba26605b071f5d0ef98ade5f9"} Jun 16 19:55:19.561705 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:19.561677 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" Jun 16 19:55:19.686908 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:19.686873 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-util\") pod \"2105039f-130e-40c6-a2d5-3e09f9bfc8bb\" (UID: \"2105039f-130e-40c6-a2d5-3e09f9bfc8bb\") " Jun 16 19:55:19.687058 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:19.686962 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-bundle\") pod \"2105039f-130e-40c6-a2d5-3e09f9bfc8bb\" (UID: \"2105039f-130e-40c6-a2d5-3e09f9bfc8bb\") " Jun 16 19:55:19.687058 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:19.687009 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2895d\" (UniqueName: \"kubernetes.io/projected/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-kube-api-access-2895d\") pod \"2105039f-130e-40c6-a2d5-3e09f9bfc8bb\" (UID: \"2105039f-130e-40c6-a2d5-3e09f9bfc8bb\") " Jun 16 19:55:19.688058 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:19.688025 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-bundle" (OuterVolumeSpecName: "bundle") pod "2105039f-130e-40c6-a2d5-3e09f9bfc8bb" (UID: "2105039f-130e-40c6-a2d5-3e09f9bfc8bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:55:19.689543 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:19.689509 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-kube-api-access-2895d" (OuterVolumeSpecName: "kube-api-access-2895d") pod "2105039f-130e-40c6-a2d5-3e09f9bfc8bb" (UID: "2105039f-130e-40c6-a2d5-3e09f9bfc8bb"). InnerVolumeSpecName "kube-api-access-2895d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:55:19.693046 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:19.693020 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-util" (OuterVolumeSpecName: "util") pod "2105039f-130e-40c6-a2d5-3e09f9bfc8bb" (UID: "2105039f-130e-40c6-a2d5-3e09f9bfc8bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:55:19.788691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:19.788656 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2895d\" (UniqueName: \"kubernetes.io/projected/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-kube-api-access-2895d\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:55:19.788691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:19.788686 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:55:19.788691 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:19.788696 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2105039f-130e-40c6-a2d5-3e09f9bfc8bb-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:55:20.306890 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:20.306860 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" Jun 16 19:55:20.307042 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:20.306887 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/90debb3ba65b6d1f0ac61524decd9f1bffc69087a9fc4e59d7b1d5553bzwdjk" event={"ID":"2105039f-130e-40c6-a2d5-3e09f9bfc8bb","Type":"ContainerDied","Data":"ffd1e34abfb9339ab016c8c815216fdf29a966cce10c34a51c6335b7445f9838"} Jun 16 19:55:20.307042 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:20.306937 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffd1e34abfb9339ab016c8c815216fdf29a966cce10c34a51c6335b7445f9838" Jun 16 19:55:23.323032 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:23.322995 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56694dc9bd-6cnkj" event={"ID":"ded12e65-7f1a-4be9-90cd-4a8dea21b9ad","Type":"ContainerStarted","Data":"eb5a1c48cc6a343c15496af8597faedbde36e724306a7a55e055ddb305dffab9"} Jun 16 19:55:23.324776 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:23.324752 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-6nvxq" event={"ID":"48261a79-1e2d-4b11-8081-f87dbf946c68","Type":"ContainerStarted","Data":"ec163d07435b9b0d371014f3d1fc3b2c77b7b65c4ddde8a258e7b94dc8d66744"} Jun 16 19:55:23.324882 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:23.324838 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-6nvxq" Jun 16 19:55:23.345357 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:23.345309 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-56694dc9bd-6cnkj" podStartSLOduration=1.8899450629999999 podStartE2EDuration="7.345296189s" totalImagesPullingTime="5.455351126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:55:23.343684627 +0000 UTC m=+346.996515230" watchObservedRunningTime="2026-06-16 19:55:23.345296189 +0000 UTC m=+346.998126804" Jun 16 19:55:23.375432 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:23.375386 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-6nvxq" podStartSLOduration=2.383481626 podStartE2EDuration="8.375368726s" totalImagesPullingTime="5.9918871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:55:23.373282333 +0000 UTC m=+347.026112947" watchObservedRunningTime="2026-06-16 19:55:23.375368726 +0000 UTC m=+347.028199331" Jun 16 19:55:25.843486 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.843446 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm"] Jun 16 19:55:25.843954 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.843909 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2105039f-130e-40c6-a2d5-3e09f9bfc8bb" containerName="util" Jun 16 19:55:25.843954 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.843927 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2105039f-130e-40c6-a2d5-3e09f9bfc8bb" containerName="util" Jun 16 19:55:25.843954 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.843946 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2105039f-130e-40c6-a2d5-3e09f9bfc8bb" containerName="pull" Jun 16 19:55:25.843954 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.843955 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2105039f-130e-40c6-a2d5-3e09f9bfc8bb" containerName="pull" Jun 16 19:55:25.844150 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.843967 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2105039f-130e-40c6-a2d5-3e09f9bfc8bb" containerName="extract" Jun 16 19:55:25.844150 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.843975 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2105039f-130e-40c6-a2d5-3e09f9bfc8bb" containerName="extract" Jun 16 19:55:25.844150 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.844073 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2105039f-130e-40c6-a2d5-3e09f9bfc8bb" containerName="extract" Jun 16 19:55:25.846282 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.846262 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:25.849403 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.849379 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 16 19:55:25.849861 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.849843 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ll6j5\"" Jun 16 19:55:25.849970 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.849949 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 16 19:55:25.850033 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.849950 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 16 19:55:25.850096 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.850051 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 16 19:55:25.864469 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.864443 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm"] Jun 16 19:55:25.943530 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.943494 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9b7p\" (UniqueName: \"kubernetes.io/projected/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-kube-api-access-v9b7p\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:25.943715 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.943535 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:25.943715 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.943581 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:25.943715 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.943667 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:25.943715 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.943691 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:25.943942 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.943723 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:25.943942 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:25.943828 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:26.044321 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.044234 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:26.044321 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.044292 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:26.044525 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.044342 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9b7p\" (UniqueName: \"kubernetes.io/projected/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-kube-api-access-v9b7p\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:26.044525 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.044468 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:26.044525 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.044509 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:26.044712 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.044543 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:26.044712 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.044588 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:26.045156 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.045128 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:26.047274 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.047246 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:26.047457 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.047426 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:26.047949 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.047931 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:26.048063 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.048043 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:26.054351 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.054315 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:26.054504 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.054485 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9b7p\" (UniqueName: \"kubernetes.io/projected/30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737-kube-api-access-v9b7p\") pod \"istiod-openshift-gateway-75c67f8887-x92jm\" (UID: \"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:26.158182 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.158153 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:26.307474 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.307433 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm"] Jun 16 19:55:26.309748 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:55:26.309714 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30cb9f3d_fdd6_4e9a_93bb_8eebc6dc9737.slice/crio-3528f917f302b650a8bae48983e8ebb8a7e5a30c9a01612d89ee3c44bde2c415 WatchSource:0}: Error finding container 3528f917f302b650a8bae48983e8ebb8a7e5a30c9a01612d89ee3c44bde2c415: Status 404 returned error can't find the container with id 3528f917f302b650a8bae48983e8ebb8a7e5a30c9a01612d89ee3c44bde2c415 Jun 16 19:55:26.341762 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:26.341725 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" event={"ID":"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737","Type":"ContainerStarted","Data":"3528f917f302b650a8bae48983e8ebb8a7e5a30c9a01612d89ee3c44bde2c415"} Jun 16 19:55:28.645620 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:28.645547 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 16 19:55:28.645942 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:28.645656 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 16 19:55:29.360162 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:29.360130 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" event={"ID":"30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737","Type":"ContainerStarted","Data":"c116aefc498a6e0d49f1113ac54bc8588948f9b9225ff12b425b85d9a6ee705e"} Jun 16 19:55:29.360354 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:29.360303 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:29.361865 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:29.361840 2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-x92jm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 16 19:55:29.362009 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:29.361885 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" podUID="30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 16 19:55:29.390506 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:29.390459 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" podStartSLOduration=2.05737952 podStartE2EDuration="4.390445538s" totalImagesPullingTime="2.333066018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:55:29.389449978 +0000 UTC m=+353.042280597" watchObservedRunningTime="2026-06-16 19:55:29.390445538 +0000 UTC m=+353.043276141" Jun 16 19:55:30.366193 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:30.366166 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-x92jm" Jun 16 19:55:34.332069 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:34.332039 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-6nvxq" Jun 16 19:55:37.229238 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:37.229210 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-j5tlj" Jun 16 19:55:39.238189 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:55:39.238161 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r8tjp" Jun 16 19:56:05.333474 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.333438 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k"] Jun 16 19:56:05.355272 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.355242 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k"] Jun 16 19:56:05.355423 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.355344 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" Jun 16 19:56:05.358069 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.358041 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 16 19:56:05.358180 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.358135 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 16 19:56:05.359112 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.359098 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8pgnj\"" Jun 16 19:56:05.474799 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.474766 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k\" (UID: \"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" Jun 16 19:56:05.474799 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.474807 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm29c\" (UniqueName: \"kubernetes.io/projected/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-kube-api-access-tm29c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k\" (UID: \"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" Jun 16 19:56:05.475020 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.474846 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k\" (UID: \"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" Jun 16 19:56:05.575874 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.575841 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k\" (UID: \"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" Jun 16 19:56:05.575874 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.575875 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm29c\" (UniqueName: \"kubernetes.io/projected/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-kube-api-access-tm29c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k\" (UID: \"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" Jun 16 19:56:05.576111 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.575912 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k\" (UID: \"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" Jun 16 19:56:05.576285 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.576263 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k\" (UID: \"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" Jun 16 19:56:05.576285 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.576277 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k\" (UID: \"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" Jun 16 19:56:05.586226 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.586163 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm29c\" (UniqueName: \"kubernetes.io/projected/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-kube-api-access-tm29c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k\" (UID: \"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" Jun 16 19:56:05.665166 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.665136 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" Jun 16 19:56:05.795390 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.795366 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k"] Jun 16 19:56:05.797841 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:56:05.797816 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4fd1de_31c2_4876_91fe_ad8fde5a9bac.slice/crio-f60b6477e8d4e98f060eceb26a6d6f6892634b5ce9de97719edb1240c60ace72 WatchSource:0}: Error finding container f60b6477e8d4e98f060eceb26a6d6f6892634b5ce9de97719edb1240c60ace72: Status 404 returned error can't find the container with id f60b6477e8d4e98f060eceb26a6d6f6892634b5ce9de97719edb1240c60ace72 Jun 16 19:56:05.937818 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.937784 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25"] Jun 16 19:56:05.939934 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.939919 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" Jun 16 19:56:05.949770 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:05.949746 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25"] Jun 16 19:56:06.081066 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.081033 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2547g\" (UniqueName: \"kubernetes.io/projected/f7b8c068-a843-427f-9a57-33b0427eabfe-kube-api-access-2547g\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25\" (UID: \"f7b8c068-a843-427f-9a57-33b0427eabfe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" Jun 16 19:56:06.081215 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.081090 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7b8c068-a843-427f-9a57-33b0427eabfe-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25\" (UID: \"f7b8c068-a843-427f-9a57-33b0427eabfe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" Jun 16 19:56:06.081215 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.081137 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7b8c068-a843-427f-9a57-33b0427eabfe-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25\" (UID: \"f7b8c068-a843-427f-9a57-33b0427eabfe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" Jun 16 19:56:06.182443 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.182366 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2547g\" (UniqueName: \"kubernetes.io/projected/f7b8c068-a843-427f-9a57-33b0427eabfe-kube-api-access-2547g\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25\" (UID: \"f7b8c068-a843-427f-9a57-33b0427eabfe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" Jun 16 19:56:06.182443 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.182431 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7b8c068-a843-427f-9a57-33b0427eabfe-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25\" (UID: \"f7b8c068-a843-427f-9a57-33b0427eabfe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" Jun 16 19:56:06.182671 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.182459 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7b8c068-a843-427f-9a57-33b0427eabfe-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25\" (UID: \"f7b8c068-a843-427f-9a57-33b0427eabfe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" Jun 16 19:56:06.182832 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.182814 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7b8c068-a843-427f-9a57-33b0427eabfe-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25\" (UID: \"f7b8c068-a843-427f-9a57-33b0427eabfe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" Jun 16 19:56:06.182868 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.182850 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7b8c068-a843-427f-9a57-33b0427eabfe-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25\" (UID: \"f7b8c068-a843-427f-9a57-33b0427eabfe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" Jun 16 19:56:06.192437 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.192418 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2547g\" (UniqueName: \"kubernetes.io/projected/f7b8c068-a843-427f-9a57-33b0427eabfe-kube-api-access-2547g\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25\" (UID: \"f7b8c068-a843-427f-9a57-33b0427eabfe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" Jun 16 19:56:06.261211 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.261169 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" Jun 16 19:56:06.396297 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.396274 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25"] Jun 16 19:56:06.398838 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:56:06.398808 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b8c068_a843_427f_9a57_33b0427eabfe.slice/crio-df5808d32e0c17040ce744e2f45fe303fe3311b2b90d307ee49a36d74e6fb577 WatchSource:0}: Error finding container df5808d32e0c17040ce744e2f45fe303fe3311b2b90d307ee49a36d74e6fb577: Status 404 returned error can't find the container with id df5808d32e0c17040ce744e2f45fe303fe3311b2b90d307ee49a36d74e6fb577 Jun 16 19:56:06.534390 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.534353 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft"] Jun 16 19:56:06.536531 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.536507 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" Jun 16 19:56:06.544114 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.543679 2557 generic.go:356] "Generic (PLEG): container finished" podID="f7b8c068-a843-427f-9a57-33b0427eabfe" containerID="5290edefbb4cd88b103812919477c50dd1c8bde7bc93d973bfe453d7e6144367" exitCode=0 Jun 16 19:56:06.544114 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.543780 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" event={"ID":"f7b8c068-a843-427f-9a57-33b0427eabfe","Type":"ContainerDied","Data":"5290edefbb4cd88b103812919477c50dd1c8bde7bc93d973bfe453d7e6144367"} Jun 16 19:56:06.544114 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.543828 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" event={"ID":"f7b8c068-a843-427f-9a57-33b0427eabfe","Type":"ContainerStarted","Data":"df5808d32e0c17040ce744e2f45fe303fe3311b2b90d307ee49a36d74e6fb577"} Jun 16 19:56:06.546360 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.546310 2557 generic.go:356] "Generic (PLEG): container finished" podID="7f4fd1de-31c2-4876-91fe-ad8fde5a9bac" containerID="43edd5c407a3e334e76bb5fa413705046ead6657c501d7bd83c4fbbf09be554a" exitCode=0 Jun 16 19:56:06.546713 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.546343 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" event={"ID":"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac","Type":"ContainerDied","Data":"43edd5c407a3e334e76bb5fa413705046ead6657c501d7bd83c4fbbf09be554a"} Jun 16 19:56:06.546713 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.546413 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" event={"ID":"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac","Type":"ContainerStarted","Data":"f60b6477e8d4e98f060eceb26a6d6f6892634b5ce9de97719edb1240c60ace72"} Jun 16 19:56:06.547163 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.547092 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft"] Jun 16 19:56:06.686070 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.686035 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f1271b6-cbe9-4148-a022-7201a34f8648-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft\" (UID: \"7f1271b6-cbe9-4148-a022-7201a34f8648\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" Jun 16 19:56:06.686247 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.686097 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l69sh\" (UniqueName: \"kubernetes.io/projected/7f1271b6-cbe9-4148-a022-7201a34f8648-kube-api-access-l69sh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft\" (UID: \"7f1271b6-cbe9-4148-a022-7201a34f8648\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" Jun 16 19:56:06.686247 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.686162 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f1271b6-cbe9-4148-a022-7201a34f8648-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft\" (UID: \"7f1271b6-cbe9-4148-a022-7201a34f8648\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" Jun 16 19:56:06.787240 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.787168 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l69sh\" (UniqueName: \"kubernetes.io/projected/7f1271b6-cbe9-4148-a022-7201a34f8648-kube-api-access-l69sh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft\" (UID: \"7f1271b6-cbe9-4148-a022-7201a34f8648\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" Jun 16 19:56:06.787240 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.787218 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f1271b6-cbe9-4148-a022-7201a34f8648-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft\" (UID: \"7f1271b6-cbe9-4148-a022-7201a34f8648\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" Jun 16 19:56:06.787419 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.787253 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f1271b6-cbe9-4148-a022-7201a34f8648-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft\" (UID: \"7f1271b6-cbe9-4148-a022-7201a34f8648\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" Jun 16 19:56:06.787555 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.787540 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f1271b6-cbe9-4148-a022-7201a34f8648-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft\" (UID: \"7f1271b6-cbe9-4148-a022-7201a34f8648\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" Jun 16 19:56:06.787617 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.787599 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f1271b6-cbe9-4148-a022-7201a34f8648-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft\" (UID: \"7f1271b6-cbe9-4148-a022-7201a34f8648\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" Jun 16 19:56:06.796967 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.796941 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l69sh\" (UniqueName: \"kubernetes.io/projected/7f1271b6-cbe9-4148-a022-7201a34f8648-kube-api-access-l69sh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft\" (UID: \"7f1271b6-cbe9-4148-a022-7201a34f8648\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" Jun 16 19:56:06.860971 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.860946 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" Jun 16 19:56:06.921905 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.921866 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb"] Jun 16 19:56:06.925397 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.925351 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" Jun 16 19:56:06.934331 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.934283 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb"] Jun 16 19:56:06.989158 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.989129 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f46v\" (UniqueName: \"kubernetes.io/projected/4a512678-0622-4a80-a213-6738138de595-kube-api-access-2f46v\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb\" (UID: \"4a512678-0622-4a80-a213-6738138de595\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" Jun 16 19:56:06.989291 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.989176 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a512678-0622-4a80-a213-6738138de595-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb\" (UID: \"4a512678-0622-4a80-a213-6738138de595\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" Jun 16 19:56:06.989336 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:06.989292 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a512678-0622-4a80-a213-6738138de595-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb\" (UID: \"4a512678-0622-4a80-a213-6738138de595\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" Jun 16 19:56:07.001268 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:07.001244 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft"] Jun 16 19:56:07.003715 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:56:07.003686 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1271b6_cbe9_4148_a022_7201a34f8648.slice/crio-8a736ec6290b31909b78687ab2b543260722fec6710e796dcfd9faa354262cc7 WatchSource:0}: Error finding container 8a736ec6290b31909b78687ab2b543260722fec6710e796dcfd9faa354262cc7: Status 404 returned error can't find the container with id 8a736ec6290b31909b78687ab2b543260722fec6710e796dcfd9faa354262cc7 Jun 16 19:56:07.089840 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:07.089806 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f46v\" (UniqueName: \"kubernetes.io/projected/4a512678-0622-4a80-a213-6738138de595-kube-api-access-2f46v\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb\" (UID: \"4a512678-0622-4a80-a213-6738138de595\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" Jun 16 19:56:07.089992 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:07.089853 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a512678-0622-4a80-a213-6738138de595-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb\" (UID: \"4a512678-0622-4a80-a213-6738138de595\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" Jun 16 19:56:07.089992 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:07.089917 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a512678-0622-4a80-a213-6738138de595-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb\" (UID: \"4a512678-0622-4a80-a213-6738138de595\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" Jun 16 19:56:07.090304 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:07.090284 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a512678-0622-4a80-a213-6738138de595-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb\" (UID: \"4a512678-0622-4a80-a213-6738138de595\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" Jun 16 19:56:07.090349 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:07.090300 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a512678-0622-4a80-a213-6738138de595-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb\" (UID: \"4a512678-0622-4a80-a213-6738138de595\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" Jun 16 19:56:07.099603 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:07.099560 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f46v\" (UniqueName: \"kubernetes.io/projected/4a512678-0622-4a80-a213-6738138de595-kube-api-access-2f46v\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb\" (UID: \"4a512678-0622-4a80-a213-6738138de595\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" Jun 16 19:56:07.238318 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:07.238291 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" Jun 16 19:56:07.542115 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:07.542090 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb"] Jun 16 19:56:07.557752 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:07.557722 2557 generic.go:356] "Generic (PLEG): container finished" podID="f7b8c068-a843-427f-9a57-33b0427eabfe" containerID="e0b69a5dcc6cdf07e2598a58d4bff9cb1868479f1644e8402e206b359da070ed" exitCode=0 Jun 16 19:56:07.557918 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:07.557805 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" event={"ID":"f7b8c068-a843-427f-9a57-33b0427eabfe","Type":"ContainerDied","Data":"e0b69a5dcc6cdf07e2598a58d4bff9cb1868479f1644e8402e206b359da070ed"} Jun 16 19:56:07.559670 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:07.559646 2557 generic.go:356] "Generic (PLEG): container finished" podID="7f4fd1de-31c2-4876-91fe-ad8fde5a9bac" containerID="ccc97af52c177368651de469c1575f044c5c742f2910dc53781e9d2a32a0e328" exitCode=0 Jun 16 19:56:07.559785 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:07.559690 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" event={"ID":"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac","Type":"ContainerDied","Data":"ccc97af52c177368651de469c1575f044c5c742f2910dc53781e9d2a32a0e328"} Jun 16 19:56:07.561219 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:07.561201 2557 generic.go:356] "Generic (PLEG): container finished" podID="7f1271b6-cbe9-4148-a022-7201a34f8648" containerID="d7fb8c5736c7e2e4beb1b1fee393b7e20b69b8dbab28bca4ecf935c6b343cd2e" exitCode=0 Jun 16 19:56:07.561309 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:07.561226 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" event={"ID":"7f1271b6-cbe9-4148-a022-7201a34f8648","Type":"ContainerDied","Data":"d7fb8c5736c7e2e4beb1b1fee393b7e20b69b8dbab28bca4ecf935c6b343cd2e"} Jun 16 19:56:07.561309 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:07.561269 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" event={"ID":"7f1271b6-cbe9-4148-a022-7201a34f8648","Type":"ContainerStarted","Data":"8a736ec6290b31909b78687ab2b543260722fec6710e796dcfd9faa354262cc7"} Jun 16 19:56:07.566765 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:56:07.566745 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a512678_0622_4a80_a213_6738138de595.slice/crio-416b4a06ab430ee4149a3e3d45b1a1785a34a461097dff0c4d44cd1fbdfed532 WatchSource:0}: Error finding container 416b4a06ab430ee4149a3e3d45b1a1785a34a461097dff0c4d44cd1fbdfed532: Status 404 returned error can't find the container with id 416b4a06ab430ee4149a3e3d45b1a1785a34a461097dff0c4d44cd1fbdfed532 Jun 16 19:56:08.571585 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:08.571533 2557 generic.go:356] "Generic (PLEG): container finished" podID="f7b8c068-a843-427f-9a57-33b0427eabfe" containerID="5843c5d7900601e470e3510869bb5540af2453baa71faf5891838d0b2039b51b" exitCode=0 Jun 16 19:56:08.571979 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:08.571605 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" event={"ID":"f7b8c068-a843-427f-9a57-33b0427eabfe","Type":"ContainerDied","Data":"5843c5d7900601e470e3510869bb5540af2453baa71faf5891838d0b2039b51b"} Jun 16 19:56:08.573744 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:08.573719 2557 generic.go:356] "Generic (PLEG): container finished" podID="7f4fd1de-31c2-4876-91fe-ad8fde5a9bac" containerID="4c230443af7c81fe623ca0fc6d6517c56d727163668f336f8b2860f0de78548a" exitCode=0 Jun 16 19:56:08.573873 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:08.573797 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" event={"ID":"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac","Type":"ContainerDied","Data":"4c230443af7c81fe623ca0fc6d6517c56d727163668f336f8b2860f0de78548a"} Jun 16 19:56:08.575198 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:08.575177 2557 generic.go:356] "Generic (PLEG): container finished" podID="4a512678-0622-4a80-a213-6738138de595" containerID="ab96c397dffe1405aaee577cf908192ad4ce5d1f640f09a5dfb976adbeb847a1" exitCode=0 Jun 16 19:56:08.575379 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:08.575305 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" event={"ID":"4a512678-0622-4a80-a213-6738138de595","Type":"ContainerDied","Data":"ab96c397dffe1405aaee577cf908192ad4ce5d1f640f09a5dfb976adbeb847a1"} Jun 16 19:56:08.575454 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:08.575402 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" event={"ID":"4a512678-0622-4a80-a213-6738138de595","Type":"ContainerStarted","Data":"416b4a06ab430ee4149a3e3d45b1a1785a34a461097dff0c4d44cd1fbdfed532"} Jun 16 19:56:09.583125 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:09.583091 2557 generic.go:356] "Generic (PLEG): container finished" podID="7f1271b6-cbe9-4148-a022-7201a34f8648" containerID="07a87cf0127c7dd62352de7568894c6c377ba969727b50017574333d59e7a0af" exitCode=0 Jun 16 19:56:09.583618 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:09.583182 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" event={"ID":"7f1271b6-cbe9-4148-a022-7201a34f8648","Type":"ContainerDied","Data":"07a87cf0127c7dd62352de7568894c6c377ba969727b50017574333d59e7a0af"} Jun 16 19:56:09.584967 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:09.584944 2557 generic.go:356] "Generic (PLEG): container finished" podID="4a512678-0622-4a80-a213-6738138de595" containerID="1e226cccc44c950b2d410b5115c9ef245d584b219dac414629af67569d78eb68" exitCode=0 Jun 16 19:56:09.585055 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:09.585033 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" event={"ID":"4a512678-0622-4a80-a213-6738138de595","Type":"ContainerDied","Data":"1e226cccc44c950b2d410b5115c9ef245d584b219dac414629af67569d78eb68"} Jun 16 19:56:09.855774 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:09.855716 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" Jun 16 19:56:09.858547 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:09.858529 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" Jun 16 19:56:10.017779 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.017742 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-bundle\") pod \"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac\" (UID: \"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac\") " Jun 16 19:56:10.017924 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.017798 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7b8c068-a843-427f-9a57-33b0427eabfe-bundle\") pod \"f7b8c068-a843-427f-9a57-33b0427eabfe\" (UID: \"f7b8c068-a843-427f-9a57-33b0427eabfe\") " Jun 16 19:56:10.017924 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.017855 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tm29c\" (UniqueName: \"kubernetes.io/projected/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-kube-api-access-tm29c\") pod \"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac\" (UID: \"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac\") " Jun 16 19:56:10.017924 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.017870 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2547g\" (UniqueName: \"kubernetes.io/projected/f7b8c068-a843-427f-9a57-33b0427eabfe-kube-api-access-2547g\") pod \"f7b8c068-a843-427f-9a57-33b0427eabfe\" (UID: \"f7b8c068-a843-427f-9a57-33b0427eabfe\") " Jun 16 19:56:10.017924 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.017887 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-util\") pod \"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac\" (UID: \"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac\") " Jun 16 19:56:10.017924 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.017919 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7b8c068-a843-427f-9a57-33b0427eabfe-util\") pod \"f7b8c068-a843-427f-9a57-33b0427eabfe\" (UID: \"f7b8c068-a843-427f-9a57-33b0427eabfe\") " Jun 16 19:56:10.018404 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.018373 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-bundle" (OuterVolumeSpecName: "bundle") pod "7f4fd1de-31c2-4876-91fe-ad8fde5a9bac" (UID: "7f4fd1de-31c2-4876-91fe-ad8fde5a9bac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:56:10.018623 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.018461 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b8c068-a843-427f-9a57-33b0427eabfe-bundle" (OuterVolumeSpecName: "bundle") pod "f7b8c068-a843-427f-9a57-33b0427eabfe" (UID: "f7b8c068-a843-427f-9a57-33b0427eabfe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:56:10.020281 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.020257 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b8c068-a843-427f-9a57-33b0427eabfe-kube-api-access-2547g" (OuterVolumeSpecName: "kube-api-access-2547g") pod "f7b8c068-a843-427f-9a57-33b0427eabfe" (UID: "f7b8c068-a843-427f-9a57-33b0427eabfe"). InnerVolumeSpecName "kube-api-access-2547g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:56:10.020368 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.020300 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-kube-api-access-tm29c" (OuterVolumeSpecName: "kube-api-access-tm29c") pod "7f4fd1de-31c2-4876-91fe-ad8fde5a9bac" (UID: "7f4fd1de-31c2-4876-91fe-ad8fde5a9bac"). InnerVolumeSpecName "kube-api-access-tm29c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:56:10.023696 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.023660 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-util" (OuterVolumeSpecName: "util") pod "7f4fd1de-31c2-4876-91fe-ad8fde5a9bac" (UID: "7f4fd1de-31c2-4876-91fe-ad8fde5a9bac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:56:10.024307 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.024284 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b8c068-a843-427f-9a57-33b0427eabfe-util" (OuterVolumeSpecName: "util") pod "f7b8c068-a843-427f-9a57-33b0427eabfe" (UID: "f7b8c068-a843-427f-9a57-33b0427eabfe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:56:10.118547 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.118472 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm29c\" (UniqueName: \"kubernetes.io/projected/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-kube-api-access-tm29c\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:56:10.118547 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.118499 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2547g\" (UniqueName: \"kubernetes.io/projected/f7b8c068-a843-427f-9a57-33b0427eabfe-kube-api-access-2547g\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:56:10.118547 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.118510 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:56:10.118547 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.118520 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7b8c068-a843-427f-9a57-33b0427eabfe-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:56:10.118547 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.118528 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f4fd1de-31c2-4876-91fe-ad8fde5a9bac-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:56:10.118547 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.118535 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7b8c068-a843-427f-9a57-33b0427eabfe-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:56:10.592286 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.592255 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" Jun 16 19:56:10.592762 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.592255 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25" event={"ID":"f7b8c068-a843-427f-9a57-33b0427eabfe","Type":"ContainerDied","Data":"df5808d32e0c17040ce744e2f45fe303fe3311b2b90d307ee49a36d74e6fb577"} Jun 16 19:56:10.592762 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.592401 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df5808d32e0c17040ce744e2f45fe303fe3311b2b90d307ee49a36d74e6fb577" Jun 16 19:56:10.594091 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.594067 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" event={"ID":"7f4fd1de-31c2-4876-91fe-ad8fde5a9bac","Type":"ContainerDied","Data":"f60b6477e8d4e98f060eceb26a6d6f6892634b5ce9de97719edb1240c60ace72"} Jun 16 19:56:10.594205 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.594110 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f60b6477e8d4e98f060eceb26a6d6f6892634b5ce9de97719edb1240c60ace72" Jun 16 19:56:10.594205 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.594076 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k" Jun 16 19:56:10.596283 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.596262 2557 generic.go:356] "Generic (PLEG): container finished" podID="7f1271b6-cbe9-4148-a022-7201a34f8648" containerID="bc13efbd6773f668f4f1f2dd4f0b33ccd257af38f2ee4fe0c505f0118aaa42b1" exitCode=0 Jun 16 19:56:10.596378 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.596341 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" event={"ID":"7f1271b6-cbe9-4148-a022-7201a34f8648","Type":"ContainerDied","Data":"bc13efbd6773f668f4f1f2dd4f0b33ccd257af38f2ee4fe0c505f0118aaa42b1"} Jun 16 19:56:10.598490 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.598465 2557 generic.go:356] "Generic (PLEG): container finished" podID="4a512678-0622-4a80-a213-6738138de595" containerID="8c1202240b76db40e539250ffe6028a6a46d65b8fd88fcc8222c8caef75b1a74" exitCode=0 Jun 16 19:56:10.598592 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:10.598554 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" event={"ID":"4a512678-0622-4a80-a213-6738138de595","Type":"ContainerDied","Data":"8c1202240b76db40e539250ffe6028a6a46d65b8fd88fcc8222c8caef75b1a74"} Jun 16 19:56:11.759754 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.759735 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" Jun 16 19:56:11.761717 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.761701 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" Jun 16 19:56:11.833158 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.833129 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f1271b6-cbe9-4148-a022-7201a34f8648-util\") pod \"7f1271b6-cbe9-4148-a022-7201a34f8648\" (UID: \"7f1271b6-cbe9-4148-a022-7201a34f8648\") " Jun 16 19:56:11.833158 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.833158 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l69sh\" (UniqueName: \"kubernetes.io/projected/7f1271b6-cbe9-4148-a022-7201a34f8648-kube-api-access-l69sh\") pod \"7f1271b6-cbe9-4148-a022-7201a34f8648\" (UID: \"7f1271b6-cbe9-4148-a022-7201a34f8648\") " Jun 16 19:56:11.833405 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.833187 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f1271b6-cbe9-4148-a022-7201a34f8648-bundle\") pod \"7f1271b6-cbe9-4148-a022-7201a34f8648\" (UID: \"7f1271b6-cbe9-4148-a022-7201a34f8648\") " Jun 16 19:56:11.833405 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.833207 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a512678-0622-4a80-a213-6738138de595-util\") pod \"4a512678-0622-4a80-a213-6738138de595\" (UID: \"4a512678-0622-4a80-a213-6738138de595\") " Jun 16 19:56:11.833405 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.833286 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a512678-0622-4a80-a213-6738138de595-bundle\") pod \"4a512678-0622-4a80-a213-6738138de595\" (UID: \"4a512678-0622-4a80-a213-6738138de595\") " Jun 16 19:56:11.833405 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.833315 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f46v\" (UniqueName: \"kubernetes.io/projected/4a512678-0622-4a80-a213-6738138de595-kube-api-access-2f46v\") pod \"4a512678-0622-4a80-a213-6738138de595\" (UID: \"4a512678-0622-4a80-a213-6738138de595\") " Jun 16 19:56:11.833767 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.833737 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1271b6-cbe9-4148-a022-7201a34f8648-bundle" (OuterVolumeSpecName: "bundle") pod "7f1271b6-cbe9-4148-a022-7201a34f8648" (UID: "7f1271b6-cbe9-4148-a022-7201a34f8648"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:56:11.834044 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.834018 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a512678-0622-4a80-a213-6738138de595-bundle" (OuterVolumeSpecName: "bundle") pod "4a512678-0622-4a80-a213-6738138de595" (UID: "4a512678-0622-4a80-a213-6738138de595"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:56:11.835451 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.835424 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f1271b6-cbe9-4148-a022-7201a34f8648-kube-api-access-l69sh" (OuterVolumeSpecName: "kube-api-access-l69sh") pod "7f1271b6-cbe9-4148-a022-7201a34f8648" (UID: "7f1271b6-cbe9-4148-a022-7201a34f8648"). InnerVolumeSpecName "kube-api-access-l69sh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:56:11.835886 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.835862 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a512678-0622-4a80-a213-6738138de595-kube-api-access-2f46v" (OuterVolumeSpecName: "kube-api-access-2f46v") pod "4a512678-0622-4a80-a213-6738138de595" (UID: "4a512678-0622-4a80-a213-6738138de595"). InnerVolumeSpecName "kube-api-access-2f46v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:56:11.839270 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.839244 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a512678-0622-4a80-a213-6738138de595-util" (OuterVolumeSpecName: "util") pod "4a512678-0622-4a80-a213-6738138de595" (UID: "4a512678-0622-4a80-a213-6738138de595"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:56:11.839663 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.839629 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1271b6-cbe9-4148-a022-7201a34f8648-util" (OuterVolumeSpecName: "util") pod "7f1271b6-cbe9-4148-a022-7201a34f8648" (UID: "7f1271b6-cbe9-4148-a022-7201a34f8648"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:56:11.934721 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.934635 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a512678-0622-4a80-a213-6738138de595-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:56:11.934721 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.934672 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f46v\" (UniqueName: \"kubernetes.io/projected/4a512678-0622-4a80-a213-6738138de595-kube-api-access-2f46v\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:56:11.934721 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.934683 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7f1271b6-cbe9-4148-a022-7201a34f8648-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:56:11.934721 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.934692 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l69sh\" (UniqueName: \"kubernetes.io/projected/7f1271b6-cbe9-4148-a022-7201a34f8648-kube-api-access-l69sh\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:56:11.934955 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.934785 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7f1271b6-cbe9-4148-a022-7201a34f8648-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:56:11.934955 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:11.934794 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a512678-0622-4a80-a213-6738138de595-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:56:12.611973 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:12.611946 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" Jun 16 19:56:12.612173 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:12.611946 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft" event={"ID":"7f1271b6-cbe9-4148-a022-7201a34f8648","Type":"ContainerDied","Data":"8a736ec6290b31909b78687ab2b543260722fec6710e796dcfd9faa354262cc7"} Jun 16 19:56:12.612173 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:12.612074 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a736ec6290b31909b78687ab2b543260722fec6710e796dcfd9faa354262cc7" Jun 16 19:56:12.614111 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:12.614091 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" Jun 16 19:56:12.614220 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:12.614108 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb" event={"ID":"4a512678-0622-4a80-a213-6738138de595","Type":"ContainerDied","Data":"416b4a06ab430ee4149a3e3d45b1a1785a34a461097dff0c4d44cd1fbdfed532"} Jun 16 19:56:12.614220 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:12.614142 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="416b4a06ab430ee4149a3e3d45b1a1785a34a461097dff0c4d44cd1fbdfed532" Jun 16 19:56:29.942277 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942243 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf262"] Jun 16 19:56:29.942650 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942614 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a512678-0622-4a80-a213-6738138de595" containerName="util" Jun 16 19:56:29.942650 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942626 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a512678-0622-4a80-a213-6738138de595" containerName="util" Jun 16 19:56:29.942650 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942639 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f1271b6-cbe9-4148-a022-7201a34f8648" containerName="util" Jun 16 19:56:29.942650 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942646 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f1271b6-cbe9-4148-a022-7201a34f8648" containerName="util" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942654 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f4fd1de-31c2-4876-91fe-ad8fde5a9bac" containerName="pull" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942662 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f4fd1de-31c2-4876-91fe-ad8fde5a9bac" containerName="pull" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942672 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f4fd1de-31c2-4876-91fe-ad8fde5a9bac" containerName="extract" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942679 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f4fd1de-31c2-4876-91fe-ad8fde5a9bac" containerName="extract" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942685 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a512678-0622-4a80-a213-6738138de595" containerName="pull" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942690 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a512678-0622-4a80-a213-6738138de595" containerName="pull" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942696 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a512678-0622-4a80-a213-6738138de595" containerName="extract" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942702 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a512678-0622-4a80-a213-6738138de595" containerName="extract" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942711 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7b8c068-a843-427f-9a57-33b0427eabfe" containerName="util" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942716 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b8c068-a843-427f-9a57-33b0427eabfe" containerName="util" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942722 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7b8c068-a843-427f-9a57-33b0427eabfe" containerName="pull" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942726 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b8c068-a843-427f-9a57-33b0427eabfe" containerName="pull" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942731 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f1271b6-cbe9-4148-a022-7201a34f8648" containerName="extract" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942738 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f1271b6-cbe9-4148-a022-7201a34f8648" containerName="extract" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942751 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f4fd1de-31c2-4876-91fe-ad8fde5a9bac" containerName="util" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942758 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f4fd1de-31c2-4876-91fe-ad8fde5a9bac" containerName="util" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942763 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7b8c068-a843-427f-9a57-33b0427eabfe" containerName="extract" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942768 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b8c068-a843-427f-9a57-33b0427eabfe" containerName="extract" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942774 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f1271b6-cbe9-4148-a022-7201a34f8648" containerName="pull" Jun 16 19:56:29.942783 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942778 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f1271b6-cbe9-4148-a022-7201a34f8648" containerName="pull" Jun 16 19:56:29.943335 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942837 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f1271b6-cbe9-4148-a022-7201a34f8648" containerName="extract" Jun 16 19:56:29.943335 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942845 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7b8c068-a843-427f-9a57-33b0427eabfe" containerName="extract" Jun 16 19:56:29.943335 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942853 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a512678-0622-4a80-a213-6738138de595" containerName="extract" Jun 16 19:56:29.943335 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.942858 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f4fd1de-31c2-4876-91fe-ad8fde5a9bac" containerName="extract" Jun 16 19:56:29.945858 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.945844 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf262" Jun 16 19:56:29.948693 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.948671 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 16 19:56:29.948809 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.948711 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 16 19:56:29.949774 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.949755 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 16 19:56:29.949830 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.949763 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qptbg\"" Jun 16 19:56:29.961522 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.961493 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf262"] Jun 16 19:56:29.975915 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:29.975892 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-799fg\" (UniqueName: \"kubernetes.io/projected/3fc4cb0b-9035-4de7-8463-6afa38f7492c-kube-api-access-799fg\") pod \"dns-operator-controller-manager-864dd78c4c-mf262\" (UID: \"3fc4cb0b-9035-4de7-8463-6afa38f7492c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf262" Jun 16 19:56:30.077218 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:30.077183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-799fg\" (UniqueName: \"kubernetes.io/projected/3fc4cb0b-9035-4de7-8463-6afa38f7492c-kube-api-access-799fg\") pod \"dns-operator-controller-manager-864dd78c4c-mf262\" (UID: \"3fc4cb0b-9035-4de7-8463-6afa38f7492c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf262" Jun 16 19:56:30.089157 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:30.089127 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-799fg\" (UniqueName: \"kubernetes.io/projected/3fc4cb0b-9035-4de7-8463-6afa38f7492c-kube-api-access-799fg\") pod \"dns-operator-controller-manager-864dd78c4c-mf262\" (UID: \"3fc4cb0b-9035-4de7-8463-6afa38f7492c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf262" Jun 16 19:56:30.262635 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:30.262538 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf262" Jun 16 19:56:30.426971 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:30.426947 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf262"] Jun 16 19:56:30.429031 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:56:30.429001 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc4cb0b_9035_4de7_8463_6afa38f7492c.slice/crio-e7e2a743c4d0ca26a94ff688f134fd4043ba70fa06bdda7e70e2851b69ee3ed5 WatchSource:0}: Error finding container e7e2a743c4d0ca26a94ff688f134fd4043ba70fa06bdda7e70e2851b69ee3ed5: Status 404 returned error can't find the container with id e7e2a743c4d0ca26a94ff688f134fd4043ba70fa06bdda7e70e2851b69ee3ed5 Jun 16 19:56:30.706550 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:30.706513 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf262" event={"ID":"3fc4cb0b-9035-4de7-8463-6afa38f7492c","Type":"ContainerStarted","Data":"e7e2a743c4d0ca26a94ff688f134fd4043ba70fa06bdda7e70e2851b69ee3ed5"} Jun 16 19:56:33.425940 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:33.425902 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jpg9b"] Jun 16 19:56:33.429538 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:33.429518 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jpg9b" Jun 16 19:56:33.432246 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:33.432225 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-x4mfl\"" Jun 16 19:56:33.438457 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:33.438435 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jpg9b"] Jun 16 19:56:33.499838 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:33.499808 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnfdd\" (UniqueName: \"kubernetes.io/projected/bd97753b-d768-4704-bbfb-5e5ef4559808-kube-api-access-cnfdd\") pod \"authorino-operator-75cc8d5cb7-jpg9b\" (UID: \"bd97753b-d768-4704-bbfb-5e5ef4559808\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jpg9b" Jun 16 19:56:33.600367 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:33.600335 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnfdd\" (UniqueName: \"kubernetes.io/projected/bd97753b-d768-4704-bbfb-5e5ef4559808-kube-api-access-cnfdd\") pod \"authorino-operator-75cc8d5cb7-jpg9b\" (UID: \"bd97753b-d768-4704-bbfb-5e5ef4559808\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jpg9b" Jun 16 19:56:33.610268 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:33.610238 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnfdd\" (UniqueName: \"kubernetes.io/projected/bd97753b-d768-4704-bbfb-5e5ef4559808-kube-api-access-cnfdd\") pod \"authorino-operator-75cc8d5cb7-jpg9b\" (UID: \"bd97753b-d768-4704-bbfb-5e5ef4559808\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jpg9b" Jun 16 19:56:33.724693 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:33.724615 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf262" event={"ID":"3fc4cb0b-9035-4de7-8463-6afa38f7492c","Type":"ContainerStarted","Data":"1039c6ff4a271a59742b7c9d04746c2529873474f86ed45f4d5d779614dc8772"} Jun 16 19:56:33.724834 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:33.724696 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf262" Jun 16 19:56:33.740744 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:33.740720 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jpg9b" Jun 16 19:56:33.746894 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:33.746855 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf262" podStartSLOduration=2.314881898 podStartE2EDuration="4.746842421s" totalImagesPullingTime="2.431960523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:56:33.744261473 +0000 UTC m=+417.397092105" watchObservedRunningTime="2026-06-16 19:56:33.746842421 +0000 UTC m=+417.399673025" Jun 16 19:56:33.875501 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:33.875477 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jpg9b"] Jun 16 19:56:33.877430 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:56:33.877381 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd97753b_d768_4704_bbfb_5e5ef4559808.slice/crio-71e66799f66edb124912b64a53cb48c4ca47168d77b526213f6f6c2dcaa866bc WatchSource:0}: Error finding container 71e66799f66edb124912b64a53cb48c4ca47168d77b526213f6f6c2dcaa866bc: Status 404 returned error can't find the container with id 71e66799f66edb124912b64a53cb48c4ca47168d77b526213f6f6c2dcaa866bc Jun 16 19:56:34.732752 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:34.732720 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jpg9b" event={"ID":"bd97753b-d768-4704-bbfb-5e5ef4559808","Type":"ContainerStarted","Data":"71e66799f66edb124912b64a53cb48c4ca47168d77b526213f6f6c2dcaa866bc"} Jun 16 19:56:36.744825 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:36.744790 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jpg9b" event={"ID":"bd97753b-d768-4704-bbfb-5e5ef4559808","Type":"ContainerStarted","Data":"dfc370f75c627e16696c059bd6195e7100a0327c7679831c434484537cc0c4ee"} Jun 16 19:56:36.745188 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:36.744939 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jpg9b" Jun 16 19:56:36.783275 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:36.783219 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jpg9b" podStartSLOduration=1.4284306469999999 podStartE2EDuration="3.783200968s" totalImagesPullingTime="2.354770321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:56:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:56:36.781999882 +0000 UTC m=+420.434830510" watchObservedRunningTime="2026-06-16 19:56:36.783200968 +0000 UTC m=+420.436031572" Jun 16 19:56:44.735091 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:44.735058 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mf262" Jun 16 19:56:45.281990 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:45.281955 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6b455f4d-hwtgh"] Jun 16 19:56:47.752011 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:47.751930 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jpg9b" Jun 16 19:56:48.138780 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:48.138745 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qrcpq"] Jun 16 19:56:48.141902 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:48.141882 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qrcpq" Jun 16 19:56:48.144382 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:48.144363 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9fmvq\"" Jun 16 19:56:48.156537 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:48.156504 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qrcpq"] Jun 16 19:56:48.222811 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:48.222780 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8wsr\" (UniqueName: \"kubernetes.io/projected/ab89ac2f-50aa-4158-aa77-232fb5623fed-kube-api-access-j8wsr\") pod \"limitador-operator-controller-manager-859d7b78bd-qrcpq\" (UID: \"ab89ac2f-50aa-4158-aa77-232fb5623fed\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qrcpq" Jun 16 19:56:48.324129 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:48.324077 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8wsr\" (UniqueName: \"kubernetes.io/projected/ab89ac2f-50aa-4158-aa77-232fb5623fed-kube-api-access-j8wsr\") pod \"limitador-operator-controller-manager-859d7b78bd-qrcpq\" (UID: \"ab89ac2f-50aa-4158-aa77-232fb5623fed\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qrcpq" Jun 16 19:56:48.337261 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:48.337228 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8wsr\" (UniqueName: \"kubernetes.io/projected/ab89ac2f-50aa-4158-aa77-232fb5623fed-kube-api-access-j8wsr\") pod \"limitador-operator-controller-manager-859d7b78bd-qrcpq\" (UID: \"ab89ac2f-50aa-4158-aa77-232fb5623fed\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qrcpq" Jun 16 19:56:48.452398 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:48.452310 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qrcpq" Jun 16 19:56:48.598703 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:48.598674 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qrcpq"] Jun 16 19:56:48.600736 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:56:48.600709 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab89ac2f_50aa_4158_aa77_232fb5623fed.slice/crio-ff99b0311691e86b8b77d2c3fc1f848372cbdfcf1e371c133fe0efc98aabddb6 WatchSource:0}: Error finding container ff99b0311691e86b8b77d2c3fc1f848372cbdfcf1e371c133fe0efc98aabddb6: Status 404 returned error can't find the container with id ff99b0311691e86b8b77d2c3fc1f848372cbdfcf1e371c133fe0efc98aabddb6 Jun 16 19:56:48.820433 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:48.820402 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qrcpq" event={"ID":"ab89ac2f-50aa-4158-aa77-232fb5623fed","Type":"ContainerStarted","Data":"ff99b0311691e86b8b77d2c3fc1f848372cbdfcf1e371c133fe0efc98aabddb6"} Jun 16 19:56:51.833600 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:51.833547 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qrcpq" event={"ID":"ab89ac2f-50aa-4158-aa77-232fb5623fed","Type":"ContainerStarted","Data":"4ca8c555e50b27060e884097294ee66788475b08c0d6288bb7006ea48204477b"} Jun 16 19:56:51.833971 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:51.833627 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qrcpq" Jun 16 19:56:51.853604 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:56:51.853536 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qrcpq" podStartSLOduration=1.4621699590000001 podStartE2EDuration="3.853523318s" totalImagesPullingTime="2.391353359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:56:51.851428839 +0000 UTC m=+435.504259464" watchObservedRunningTime="2026-06-16 19:56:51.853523318 +0000 UTC m=+435.506353921" Jun 16 19:57:02.840614 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:02.840561 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qrcpq" Jun 16 19:57:10.303096 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.303059 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d6b455f4d-hwtgh" podUID="bd369848-5878-4eb5-98c5-f785287e0896" containerName="console" containerID="cri-o://c7f29ce05bc3d41ee972dabe5cef4dfd82b78f7f8138b3d00796790584ef6ed5" gracePeriod=15 Jun 16 19:57:10.537455 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.537432 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:57:10.620221 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.620131 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-service-ca\") pod \"bd369848-5878-4eb5-98c5-f785287e0896\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " Jun 16 19:57:10.620221 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.620175 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd369848-5878-4eb5-98c5-f785287e0896-console-serving-cert\") pod \"bd369848-5878-4eb5-98c5-f785287e0896\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " Jun 16 19:57:10.620221 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.620224 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd369848-5878-4eb5-98c5-f785287e0896-console-oauth-config\") pod \"bd369848-5878-4eb5-98c5-f785287e0896\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " Jun 16 19:57:10.620503 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.620273 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-trusted-ca-bundle\") pod \"bd369848-5878-4eb5-98c5-f785287e0896\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " Jun 16 19:57:10.620503 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.620288 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-console-config\") pod \"bd369848-5878-4eb5-98c5-f785287e0896\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " Jun 16 19:57:10.620503 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.620310 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bczv\" (UniqueName: \"kubernetes.io/projected/bd369848-5878-4eb5-98c5-f785287e0896-kube-api-access-9bczv\") pod \"bd369848-5878-4eb5-98c5-f785287e0896\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " Jun 16 19:57:10.620503 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.620338 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-oauth-serving-cert\") pod \"bd369848-5878-4eb5-98c5-f785287e0896\" (UID: \"bd369848-5878-4eb5-98c5-f785287e0896\") " Jun 16 19:57:10.620737 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.620602 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-service-ca" (OuterVolumeSpecName: "service-ca") pod "bd369848-5878-4eb5-98c5-f785287e0896" (UID: "bd369848-5878-4eb5-98c5-f785287e0896"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:57:10.620805 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.620774 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-console-config" (OuterVolumeSpecName: "console-config") pod "bd369848-5878-4eb5-98c5-f785287e0896" (UID: "bd369848-5878-4eb5-98c5-f785287e0896"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:57:10.620805 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.620789 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bd369848-5878-4eb5-98c5-f785287e0896" (UID: "bd369848-5878-4eb5-98c5-f785287e0896"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:57:10.620912 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.620868 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bd369848-5878-4eb5-98c5-f785287e0896" (UID: "bd369848-5878-4eb5-98c5-f785287e0896"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:57:10.622659 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.622629 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd369848-5878-4eb5-98c5-f785287e0896-kube-api-access-9bczv" (OuterVolumeSpecName: "kube-api-access-9bczv") pod "bd369848-5878-4eb5-98c5-f785287e0896" (UID: "bd369848-5878-4eb5-98c5-f785287e0896"). InnerVolumeSpecName "kube-api-access-9bczv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:57:10.622773 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.622668 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd369848-5878-4eb5-98c5-f785287e0896-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bd369848-5878-4eb5-98c5-f785287e0896" (UID: "bd369848-5878-4eb5-98c5-f785287e0896"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:57:10.622773 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.622700 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd369848-5878-4eb5-98c5-f785287e0896-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bd369848-5878-4eb5-98c5-f785287e0896" (UID: "bd369848-5878-4eb5-98c5-f785287e0896"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:57:10.721630 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.721600 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd369848-5878-4eb5-98c5-f785287e0896-console-oauth-config\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:57:10.721630 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.721626 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-trusted-ca-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:57:10.721630 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.721636 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-console-config\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:57:10.721838 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.721646 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bczv\" (UniqueName: \"kubernetes.io/projected/bd369848-5878-4eb5-98c5-f785287e0896-kube-api-access-9bczv\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:57:10.721838 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.721655 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-oauth-serving-cert\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:57:10.721838 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.721663 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd369848-5878-4eb5-98c5-f785287e0896-service-ca\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:57:10.721838 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.721671 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd369848-5878-4eb5-98c5-f785287e0896-console-serving-cert\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:57:10.929764 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.929672 2557 generic.go:356] "Generic (PLEG): container finished" podID="bd369848-5878-4eb5-98c5-f785287e0896" containerID="c7f29ce05bc3d41ee972dabe5cef4dfd82b78f7f8138b3d00796790584ef6ed5" exitCode=0 Jun 16 19:57:10.929764 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.929732 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6b455f4d-hwtgh" Jun 16 19:57:10.929962 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.929758 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6b455f4d-hwtgh" event={"ID":"bd369848-5878-4eb5-98c5-f785287e0896","Type":"ContainerDied","Data":"c7f29ce05bc3d41ee972dabe5cef4dfd82b78f7f8138b3d00796790584ef6ed5"} Jun 16 19:57:10.929962 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.929804 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6b455f4d-hwtgh" event={"ID":"bd369848-5878-4eb5-98c5-f785287e0896","Type":"ContainerDied","Data":"90e53d996a06f7b3efb91036238cf41899e5b5d140aab365fa6bacb6639c93c7"} Jun 16 19:57:10.929962 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.929823 2557 scope.go:117] "RemoveContainer" containerID="c7f29ce05bc3d41ee972dabe5cef4dfd82b78f7f8138b3d00796790584ef6ed5" Jun 16 19:57:10.938935 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.938918 2557 scope.go:117] "RemoveContainer" containerID="c7f29ce05bc3d41ee972dabe5cef4dfd82b78f7f8138b3d00796790584ef6ed5" Jun 16 19:57:10.939215 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:57:10.939196 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7f29ce05bc3d41ee972dabe5cef4dfd82b78f7f8138b3d00796790584ef6ed5\": container with ID starting with c7f29ce05bc3d41ee972dabe5cef4dfd82b78f7f8138b3d00796790584ef6ed5 not found: ID does not exist" containerID="c7f29ce05bc3d41ee972dabe5cef4dfd82b78f7f8138b3d00796790584ef6ed5" Jun 16 19:57:10.939264 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.939224 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7f29ce05bc3d41ee972dabe5cef4dfd82b78f7f8138b3d00796790584ef6ed5"} err="failed to get container status \"c7f29ce05bc3d41ee972dabe5cef4dfd82b78f7f8138b3d00796790584ef6ed5\": rpc error: code = NotFound desc = could not find container \"c7f29ce05bc3d41ee972dabe5cef4dfd82b78f7f8138b3d00796790584ef6ed5\": container with ID starting with c7f29ce05bc3d41ee972dabe5cef4dfd82b78f7f8138b3d00796790584ef6ed5 not found: ID does not exist" Jun 16 19:57:10.958116 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.958092 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6b455f4d-hwtgh"] Jun 16 19:57:10.965240 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:10.965220 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d6b455f4d-hwtgh"] Jun 16 19:57:12.821862 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:57:12.821826 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd369848-5878-4eb5-98c5-f785287e0896" path="/var/lib/kubelet/pods/bd369848-5878-4eb5-98c5-f785287e0896/volumes" Jun 16 19:58:16.451297 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.451218 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk"] Jun 16 19:58:16.451868 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.451578 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd369848-5878-4eb5-98c5-f785287e0896" containerName="console" Jun 16 19:58:16.451868 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.451590 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd369848-5878-4eb5-98c5-f785287e0896" containerName="console" Jun 16 19:58:16.451868 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.451664 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd369848-5878-4eb5-98c5-f785287e0896" containerName="console" Jun 16 19:58:16.454991 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.454972 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" Jun 16 19:58:16.457550 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.457528 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 16 19:58:16.458721 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.458701 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 16 19:58:16.458832 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.458706 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6krmm\"" Jun 16 19:58:16.468675 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.468651 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk"] Jun 16 19:58:16.560326 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.560291 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42b35808-7ac8-4af4-b915-a1c3703890b9-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk\" (UID: \"42b35808-7ac8-4af4-b915-a1c3703890b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" Jun 16 19:58:16.560510 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.560346 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42b35808-7ac8-4af4-b915-a1c3703890b9-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk\" (UID: \"42b35808-7ac8-4af4-b915-a1c3703890b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" Jun 16 19:58:16.560510 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.560374 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbb7m\" (UniqueName: \"kubernetes.io/projected/42b35808-7ac8-4af4-b915-a1c3703890b9-kube-api-access-sbb7m\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk\" (UID: \"42b35808-7ac8-4af4-b915-a1c3703890b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" Jun 16 19:58:16.661365 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.661333 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42b35808-7ac8-4af4-b915-a1c3703890b9-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk\" (UID: \"42b35808-7ac8-4af4-b915-a1c3703890b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" Jun 16 19:58:16.661525 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.661376 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42b35808-7ac8-4af4-b915-a1c3703890b9-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk\" (UID: \"42b35808-7ac8-4af4-b915-a1c3703890b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" Jun 16 19:58:16.661525 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.661415 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbb7m\" (UniqueName: \"kubernetes.io/projected/42b35808-7ac8-4af4-b915-a1c3703890b9-kube-api-access-sbb7m\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk\" (UID: \"42b35808-7ac8-4af4-b915-a1c3703890b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" Jun 16 19:58:16.661762 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.661744 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42b35808-7ac8-4af4-b915-a1c3703890b9-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk\" (UID: \"42b35808-7ac8-4af4-b915-a1c3703890b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" Jun 16 19:58:16.661825 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.661766 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42b35808-7ac8-4af4-b915-a1c3703890b9-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk\" (UID: \"42b35808-7ac8-4af4-b915-a1c3703890b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" Jun 16 19:58:16.671383 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.671359 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbb7m\" (UniqueName: \"kubernetes.io/projected/42b35808-7ac8-4af4-b915-a1c3703890b9-kube-api-access-sbb7m\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk\" (UID: \"42b35808-7ac8-4af4-b915-a1c3703890b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" Jun 16 19:58:16.764233 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.764155 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" Jun 16 19:58:16.899198 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:16.899176 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk"] Jun 16 19:58:16.900954 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:58:16.900930 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b35808_7ac8_4af4_b915_a1c3703890b9.slice/crio-f54ffa6163bdb480d1d317193317239643176f7c5cb4217a0301a5587c17b13c WatchSource:0}: Error finding container f54ffa6163bdb480d1d317193317239643176f7c5cb4217a0301a5587c17b13c: Status 404 returned error can't find the container with id f54ffa6163bdb480d1d317193317239643176f7c5cb4217a0301a5587c17b13c Jun 16 19:58:17.290027 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:17.289996 2557 generic.go:356] "Generic (PLEG): container finished" podID="42b35808-7ac8-4af4-b915-a1c3703890b9" containerID="b9e0a6bd67ead1a9ddd1c7f43d021bf0def32a6635fc9647b5c9b1b2401197c9" exitCode=0 Jun 16 19:58:17.290221 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:17.290077 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" event={"ID":"42b35808-7ac8-4af4-b915-a1c3703890b9","Type":"ContainerDied","Data":"b9e0a6bd67ead1a9ddd1c7f43d021bf0def32a6635fc9647b5c9b1b2401197c9"} Jun 16 19:58:17.290221 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:17.290152 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" event={"ID":"42b35808-7ac8-4af4-b915-a1c3703890b9","Type":"ContainerStarted","Data":"f54ffa6163bdb480d1d317193317239643176f7c5cb4217a0301a5587c17b13c"} Jun 16 19:58:18.297137 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:18.297106 2557 generic.go:356] "Generic (PLEG): container finished" podID="42b35808-7ac8-4af4-b915-a1c3703890b9" containerID="b3c203f8f57bcec1d31a529216d6da1dadecdfe9b488343c632376bd896c8a6b" exitCode=0 Jun 16 19:58:18.297521 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:18.297194 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" event={"ID":"42b35808-7ac8-4af4-b915-a1c3703890b9","Type":"ContainerDied","Data":"b3c203f8f57bcec1d31a529216d6da1dadecdfe9b488343c632376bd896c8a6b"} Jun 16 19:58:19.304164 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:19.304131 2557 generic.go:356] "Generic (PLEG): container finished" podID="42b35808-7ac8-4af4-b915-a1c3703890b9" containerID="e41c9e0f865f3c1a57a0a95d9a911f1dfc501d1ca7b05a4516342b195b059cb2" exitCode=0 Jun 16 19:58:19.304553 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:19.304210 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" event={"ID":"42b35808-7ac8-4af4-b915-a1c3703890b9","Type":"ContainerDied","Data":"e41c9e0f865f3c1a57a0a95d9a911f1dfc501d1ca7b05a4516342b195b059cb2"} Jun 16 19:58:20.447948 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:20.447923 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" Jun 16 19:58:20.593558 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:20.593478 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42b35808-7ac8-4af4-b915-a1c3703890b9-util\") pod \"42b35808-7ac8-4af4-b915-a1c3703890b9\" (UID: \"42b35808-7ac8-4af4-b915-a1c3703890b9\") " Jun 16 19:58:20.593558 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:20.593540 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42b35808-7ac8-4af4-b915-a1c3703890b9-bundle\") pod \"42b35808-7ac8-4af4-b915-a1c3703890b9\" (UID: \"42b35808-7ac8-4af4-b915-a1c3703890b9\") " Jun 16 19:58:20.593754 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:20.593619 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbb7m\" (UniqueName: \"kubernetes.io/projected/42b35808-7ac8-4af4-b915-a1c3703890b9-kube-api-access-sbb7m\") pod \"42b35808-7ac8-4af4-b915-a1c3703890b9\" (UID: \"42b35808-7ac8-4af4-b915-a1c3703890b9\") " Jun 16 19:58:20.594052 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:20.594033 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42b35808-7ac8-4af4-b915-a1c3703890b9-bundle" (OuterVolumeSpecName: "bundle") pod "42b35808-7ac8-4af4-b915-a1c3703890b9" (UID: "42b35808-7ac8-4af4-b915-a1c3703890b9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:58:20.595864 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:20.595836 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42b35808-7ac8-4af4-b915-a1c3703890b9-kube-api-access-sbb7m" (OuterVolumeSpecName: "kube-api-access-sbb7m") pod "42b35808-7ac8-4af4-b915-a1c3703890b9" (UID: "42b35808-7ac8-4af4-b915-a1c3703890b9"). InnerVolumeSpecName "kube-api-access-sbb7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:58:20.599485 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:20.599460 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42b35808-7ac8-4af4-b915-a1c3703890b9-util" (OuterVolumeSpecName: "util") pod "42b35808-7ac8-4af4-b915-a1c3703890b9" (UID: "42b35808-7ac8-4af4-b915-a1c3703890b9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:58:20.694349 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:20.694308 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/42b35808-7ac8-4af4-b915-a1c3703890b9-bundle\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:58:20.694349 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:20.694345 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbb7m\" (UniqueName: \"kubernetes.io/projected/42b35808-7ac8-4af4-b915-a1c3703890b9-kube-api-access-sbb7m\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:58:20.694527 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:20.694367 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/42b35808-7ac8-4af4-b915-a1c3703890b9-util\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:58:21.316478 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:21.316446 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" event={"ID":"42b35808-7ac8-4af4-b915-a1c3703890b9","Type":"ContainerDied","Data":"f54ffa6163bdb480d1d317193317239643176f7c5cb4217a0301a5587c17b13c"} Jun 16 19:58:21.316666 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:21.316492 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da74869qgk" Jun 16 19:58:21.316666 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:58:21.316500 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f54ffa6163bdb480d1d317193317239643176f7c5cb4217a0301a5587c17b13c" Jun 16 19:59:16.571372 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.571330 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-667b4f66ff-7m6cp"] Jun 16 19:59:16.571943 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.571852 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42b35808-7ac8-4af4-b915-a1c3703890b9" containerName="util" Jun 16 19:59:16.571943 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.571873 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="42b35808-7ac8-4af4-b915-a1c3703890b9" containerName="util" Jun 16 19:59:16.571943 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.571884 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42b35808-7ac8-4af4-b915-a1c3703890b9" containerName="pull" Jun 16 19:59:16.571943 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.571892 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="42b35808-7ac8-4af4-b915-a1c3703890b9" containerName="pull" Jun 16 19:59:16.571943 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.571903 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42b35808-7ac8-4af4-b915-a1c3703890b9" containerName="extract" Jun 16 19:59:16.571943 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.571911 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="42b35808-7ac8-4af4-b915-a1c3703890b9" containerName="extract" Jun 16 19:59:16.572219 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.572023 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="42b35808-7ac8-4af4-b915-a1c3703890b9" containerName="extract" Jun 16 19:59:16.575225 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.575203 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-667b4f66ff-7m6cp" Jun 16 19:59:16.577851 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.577830 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 16 19:59:16.577955 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.577858 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 16 19:59:16.577955 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.577904 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5b658\"" Jun 16 19:59:16.583688 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.583664 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-667b4f66ff-7m6cp"] Jun 16 19:59:16.659489 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.659456 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca73e691-2914-4463-9a93-83a774e78efc-webhook-cert\") pod \"maas-controller-667b4f66ff-7m6cp\" (UID: \"ca73e691-2914-4463-9a93-83a774e78efc\") " pod="opendatahub/maas-controller-667b4f66ff-7m6cp" Jun 16 19:59:16.659489 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.659491 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbmq4\" (UniqueName: \"kubernetes.io/projected/ca73e691-2914-4463-9a93-83a774e78efc-kube-api-access-lbmq4\") pod \"maas-controller-667b4f66ff-7m6cp\" (UID: \"ca73e691-2914-4463-9a93-83a774e78efc\") " pod="opendatahub/maas-controller-667b4f66ff-7m6cp" Jun 16 19:59:16.760711 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.760682 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca73e691-2914-4463-9a93-83a774e78efc-webhook-cert\") pod \"maas-controller-667b4f66ff-7m6cp\" (UID: \"ca73e691-2914-4463-9a93-83a774e78efc\") " pod="opendatahub/maas-controller-667b4f66ff-7m6cp" Jun 16 19:59:16.760711 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.760714 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbmq4\" (UniqueName: \"kubernetes.io/projected/ca73e691-2914-4463-9a93-83a774e78efc-kube-api-access-lbmq4\") pod \"maas-controller-667b4f66ff-7m6cp\" (UID: \"ca73e691-2914-4463-9a93-83a774e78efc\") " pod="opendatahub/maas-controller-667b4f66ff-7m6cp" Jun 16 19:59:16.763399 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.763375 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca73e691-2914-4463-9a93-83a774e78efc-webhook-cert\") pod \"maas-controller-667b4f66ff-7m6cp\" (UID: \"ca73e691-2914-4463-9a93-83a774e78efc\") " pod="opendatahub/maas-controller-667b4f66ff-7m6cp" Jun 16 19:59:16.772473 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.772445 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbmq4\" (UniqueName: \"kubernetes.io/projected/ca73e691-2914-4463-9a93-83a774e78efc-kube-api-access-lbmq4\") pod \"maas-controller-667b4f66ff-7m6cp\" (UID: \"ca73e691-2914-4463-9a93-83a774e78efc\") " pod="opendatahub/maas-controller-667b4f66ff-7m6cp" Jun 16 19:59:16.886649 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:16.886554 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-667b4f66ff-7m6cp" Jun 16 19:59:17.027145 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:17.027116 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-667b4f66ff-7m6cp"] Jun 16 19:59:17.027252 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:59:17.027114 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca73e691_2914_4463_9a93_83a774e78efc.slice/crio-1698dee895955eccf195341322e6372f4d439281614825d1a47e98109cfe0a21 WatchSource:0}: Error finding container 1698dee895955eccf195341322e6372f4d439281614825d1a47e98109cfe0a21: Status 404 returned error can't find the container with id 1698dee895955eccf195341322e6372f4d439281614825d1a47e98109cfe0a21 Jun 16 19:59:17.622743 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:17.622710 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-667b4f66ff-7m6cp" event={"ID":"ca73e691-2914-4463-9a93-83a774e78efc","Type":"ContainerStarted","Data":"1698dee895955eccf195341322e6372f4d439281614825d1a47e98109cfe0a21"} Jun 16 19:59:19.636827 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:19.636780 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-667b4f66ff-7m6cp" event={"ID":"ca73e691-2914-4463-9a93-83a774e78efc","Type":"ContainerStarted","Data":"33bff0ebd4bdcca58d1b3727988b6032b864cfb7cac16e8593c8f1a7fea8f03f"} Jun 16 19:59:19.637215 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:19.636873 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-667b4f66ff-7m6cp" Jun 16 19:59:19.680190 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:19.680139 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-667b4f66ff-7m6cp" podStartSLOduration=1.558958415 podStartE2EDuration="3.68012448s" totalImagesPullingTime="2.121166065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:59:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:59:19.677963386 +0000 UTC m=+583.330793989" watchObservedRunningTime="2026-06-16 19:59:19.68012448 +0000 UTC m=+583.332955083" Jun 16 19:59:30.647726 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:30.647693 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-667b4f66ff-7m6cp" Jun 16 19:59:30.864397 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:30.864363 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-667b4f66ff-7m6cp"] Jun 16 19:59:30.864699 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:30.864665 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-667b4f66ff-7m6cp" podUID="ca73e691-2914-4463-9a93-83a774e78efc" containerName="manager" containerID="cri-o://33bff0ebd4bdcca58d1b3727988b6032b864cfb7cac16e8593c8f1a7fea8f03f" gracePeriod=30 Jun 16 19:59:31.107985 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:31.107960 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-667b4f66ff-7m6cp" Jun 16 19:59:31.178169 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:31.178137 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbmq4\" (UniqueName: \"kubernetes.io/projected/ca73e691-2914-4463-9a93-83a774e78efc-kube-api-access-lbmq4\") pod \"ca73e691-2914-4463-9a93-83a774e78efc\" (UID: \"ca73e691-2914-4463-9a93-83a774e78efc\") " Jun 16 19:59:31.178314 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:31.178182 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca73e691-2914-4463-9a93-83a774e78efc-webhook-cert\") pod \"ca73e691-2914-4463-9a93-83a774e78efc\" (UID: \"ca73e691-2914-4463-9a93-83a774e78efc\") " Jun 16 19:59:31.180446 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:31.180379 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca73e691-2914-4463-9a93-83a774e78efc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ca73e691-2914-4463-9a93-83a774e78efc" (UID: "ca73e691-2914-4463-9a93-83a774e78efc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:59:31.180446 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:31.180408 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca73e691-2914-4463-9a93-83a774e78efc-kube-api-access-lbmq4" (OuterVolumeSpecName: "kube-api-access-lbmq4") pod "ca73e691-2914-4463-9a93-83a774e78efc" (UID: "ca73e691-2914-4463-9a93-83a774e78efc"). InnerVolumeSpecName "kube-api-access-lbmq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:59:31.279242 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:31.279168 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbmq4\" (UniqueName: \"kubernetes.io/projected/ca73e691-2914-4463-9a93-83a774e78efc-kube-api-access-lbmq4\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:59:31.279242 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:31.279195 2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca73e691-2914-4463-9a93-83a774e78efc-webhook-cert\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 19:59:31.701150 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:31.701118 2557 generic.go:356] "Generic (PLEG): container finished" podID="ca73e691-2914-4463-9a93-83a774e78efc" containerID="33bff0ebd4bdcca58d1b3727988b6032b864cfb7cac16e8593c8f1a7fea8f03f" exitCode=0 Jun 16 19:59:31.701637 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:31.701163 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-667b4f66ff-7m6cp" Jun 16 19:59:31.701637 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:31.701210 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-667b4f66ff-7m6cp" event={"ID":"ca73e691-2914-4463-9a93-83a774e78efc","Type":"ContainerDied","Data":"33bff0ebd4bdcca58d1b3727988b6032b864cfb7cac16e8593c8f1a7fea8f03f"} Jun 16 19:59:31.701637 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:31.701269 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-667b4f66ff-7m6cp" event={"ID":"ca73e691-2914-4463-9a93-83a774e78efc","Type":"ContainerDied","Data":"1698dee895955eccf195341322e6372f4d439281614825d1a47e98109cfe0a21"} Jun 16 19:59:31.701637 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:31.701304 2557 scope.go:117] "RemoveContainer" containerID="33bff0ebd4bdcca58d1b3727988b6032b864cfb7cac16e8593c8f1a7fea8f03f" Jun 16 19:59:31.710667 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:31.710644 2557 scope.go:117] "RemoveContainer" containerID="33bff0ebd4bdcca58d1b3727988b6032b864cfb7cac16e8593c8f1a7fea8f03f" Jun 16 19:59:31.710922 ip-10-0-134-77 kubenswrapper[2557]: E0616 19:59:31.710903 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33bff0ebd4bdcca58d1b3727988b6032b864cfb7cac16e8593c8f1a7fea8f03f\": container with ID starting with 33bff0ebd4bdcca58d1b3727988b6032b864cfb7cac16e8593c8f1a7fea8f03f not found: ID does not exist" containerID="33bff0ebd4bdcca58d1b3727988b6032b864cfb7cac16e8593c8f1a7fea8f03f" Jun 16 19:59:31.710979 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:31.710929 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33bff0ebd4bdcca58d1b3727988b6032b864cfb7cac16e8593c8f1a7fea8f03f"} err="failed to get container status \"33bff0ebd4bdcca58d1b3727988b6032b864cfb7cac16e8593c8f1a7fea8f03f\": rpc error: code = NotFound desc = could not find container \"33bff0ebd4bdcca58d1b3727988b6032b864cfb7cac16e8593c8f1a7fea8f03f\": container with ID starting with 33bff0ebd4bdcca58d1b3727988b6032b864cfb7cac16e8593c8f1a7fea8f03f not found: ID does not exist" Jun 16 19:59:31.726762 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:31.726740 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-667b4f66ff-7m6cp"] Jun 16 19:59:31.731443 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:31.731424 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-667b4f66ff-7m6cp"] Jun 16 19:59:32.820866 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:32.820831 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca73e691-2914-4463-9a93-83a774e78efc" path="/var/lib/kubelet/pods/ca73e691-2914-4463-9a93-83a774e78efc/volumes" Jun 16 19:59:36.797097 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:36.797071 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 19:59:36.797607 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:36.797246 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 19:59:36.802129 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:36.802107 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 19:59:36.802271 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:36.802258 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 19:59:50.310040 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.309999 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7b5b4c6c54-rkrwd"] Jun 16 19:59:50.312686 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.310422 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca73e691-2914-4463-9a93-83a774e78efc" containerName="manager" Jun 16 19:59:50.312686 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.310436 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca73e691-2914-4463-9a93-83a774e78efc" containerName="manager" Jun 16 19:59:50.312686 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.310496 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca73e691-2914-4463-9a93-83a774e78efc" containerName="manager" Jun 16 19:59:50.313920 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.313904 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7b5b4c6c54-rkrwd" Jun 16 19:59:50.316440 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.316423 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 16 19:59:50.316598 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.316582 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-97fh2\"" Jun 16 19:59:50.322621 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.322600 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7b5b4c6c54-rkrwd"] Jun 16 19:59:50.442970 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.442924 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0edbc3cf-bfc9-40ce-9016-ef752404446f-maas-api-tls\") pod \"maas-api-7b5b4c6c54-rkrwd\" (UID: \"0edbc3cf-bfc9-40ce-9016-ef752404446f\") " pod="opendatahub/maas-api-7b5b4c6c54-rkrwd" Jun 16 19:59:50.442970 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.442969 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0edbc3cf-bfc9-40ce-9016-ef752404446f-openshift-service-ca\") pod \"maas-api-7b5b4c6c54-rkrwd\" (UID: \"0edbc3cf-bfc9-40ce-9016-ef752404446f\") " pod="opendatahub/maas-api-7b5b4c6c54-rkrwd" Jun 16 19:59:50.443190 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.442991 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwmb6\" (UniqueName: \"kubernetes.io/projected/0edbc3cf-bfc9-40ce-9016-ef752404446f-kube-api-access-wwmb6\") pod \"maas-api-7b5b4c6c54-rkrwd\" (UID: \"0edbc3cf-bfc9-40ce-9016-ef752404446f\") " pod="opendatahub/maas-api-7b5b4c6c54-rkrwd" Jun 16 19:59:50.543434 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.543401 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0edbc3cf-bfc9-40ce-9016-ef752404446f-maas-api-tls\") pod \"maas-api-7b5b4c6c54-rkrwd\" (UID: \"0edbc3cf-bfc9-40ce-9016-ef752404446f\") " pod="opendatahub/maas-api-7b5b4c6c54-rkrwd" Jun 16 19:59:50.543654 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.543444 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0edbc3cf-bfc9-40ce-9016-ef752404446f-openshift-service-ca\") pod \"maas-api-7b5b4c6c54-rkrwd\" (UID: \"0edbc3cf-bfc9-40ce-9016-ef752404446f\") " pod="opendatahub/maas-api-7b5b4c6c54-rkrwd" Jun 16 19:59:50.543654 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.543474 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwmb6\" (UniqueName: \"kubernetes.io/projected/0edbc3cf-bfc9-40ce-9016-ef752404446f-kube-api-access-wwmb6\") pod \"maas-api-7b5b4c6c54-rkrwd\" (UID: \"0edbc3cf-bfc9-40ce-9016-ef752404446f\") " pod="opendatahub/maas-api-7b5b4c6c54-rkrwd" Jun 16 19:59:50.544095 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.544075 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0edbc3cf-bfc9-40ce-9016-ef752404446f-openshift-service-ca\") pod \"maas-api-7b5b4c6c54-rkrwd\" (UID: \"0edbc3cf-bfc9-40ce-9016-ef752404446f\") " pod="opendatahub/maas-api-7b5b4c6c54-rkrwd" Jun 16 19:59:50.546156 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.546135 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0edbc3cf-bfc9-40ce-9016-ef752404446f-maas-api-tls\") pod \"maas-api-7b5b4c6c54-rkrwd\" (UID: \"0edbc3cf-bfc9-40ce-9016-ef752404446f\") " pod="opendatahub/maas-api-7b5b4c6c54-rkrwd" Jun 16 19:59:50.554862 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.554838 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwmb6\" (UniqueName: \"kubernetes.io/projected/0edbc3cf-bfc9-40ce-9016-ef752404446f-kube-api-access-wwmb6\") pod \"maas-api-7b5b4c6c54-rkrwd\" (UID: \"0edbc3cf-bfc9-40ce-9016-ef752404446f\") " pod="opendatahub/maas-api-7b5b4c6c54-rkrwd" Jun 16 19:59:50.625527 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.625450 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7b5b4c6c54-rkrwd" Jun 16 19:59:50.772016 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.771980 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7b5b4c6c54-rkrwd"] Jun 16 19:59:50.775316 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:59:50.775284 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0edbc3cf_bfc9_40ce_9016_ef752404446f.slice/crio-fee712a8210359ebdd3d3e90752facd830463297cb8978bca81d17893979bf94 WatchSource:0}: Error finding container fee712a8210359ebdd3d3e90752facd830463297cb8978bca81d17893979bf94: Status 404 returned error can't find the container with id fee712a8210359ebdd3d3e90752facd830463297cb8978bca81d17893979bf94 Jun 16 19:59:50.777389 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.777368 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 16 19:59:50.810285 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.810250 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7b5b4c6c54-rkrwd" event={"ID":"0edbc3cf-bfc9-40ce-9016-ef752404446f","Type":"ContainerStarted","Data":"fee712a8210359ebdd3d3e90752facd830463297cb8978bca81d17893979bf94"} Jun 16 19:59:50.870740 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.870706 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-2ztsz"] Jun 16 19:59:50.875895 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.875208 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-2ztsz" Jun 16 19:59:50.877858 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.877839 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-tqrmn\"" Jun 16 19:59:50.877996 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.877866 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 16 19:59:50.882803 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.882781 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-2ztsz"] Jun 16 19:59:50.887597 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.887557 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-49njt"] Jun 16 19:59:50.891135 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.891118 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-49njt" Jun 16 19:59:50.904026 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.904001 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-49njt"] Jun 16 19:59:50.947547 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.947503 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g9rs\" (UniqueName: \"kubernetes.io/projected/47431c14-7d74-4593-ada6-32a443ce4834-kube-api-access-4g9rs\") pod \"payload-processing-699b6cd6c-49njt\" (UID: \"47431c14-7d74-4593-ada6-32a443ce4834\") " pod="openshift-ingress/payload-processing-699b6cd6c-49njt" Jun 16 19:59:50.947745 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:50.947594 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfngp\" (UniqueName: \"kubernetes.io/projected/cb6a3949-72bd-4f78-8750-75f5d450f525-kube-api-access-dfngp\") pod \"payload-pre-processing-579785bc64-2ztsz\" (UID: \"cb6a3949-72bd-4f78-8750-75f5d450f525\") " pod="openshift-ingress/payload-pre-processing-579785bc64-2ztsz" Jun 16 19:59:51.048295 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:51.048253 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfngp\" (UniqueName: \"kubernetes.io/projected/cb6a3949-72bd-4f78-8750-75f5d450f525-kube-api-access-dfngp\") pod \"payload-pre-processing-579785bc64-2ztsz\" (UID: \"cb6a3949-72bd-4f78-8750-75f5d450f525\") " pod="openshift-ingress/payload-pre-processing-579785bc64-2ztsz" Jun 16 19:59:51.048459 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:51.048368 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g9rs\" (UniqueName: \"kubernetes.io/projected/47431c14-7d74-4593-ada6-32a443ce4834-kube-api-access-4g9rs\") pod \"payload-processing-699b6cd6c-49njt\" (UID: \"47431c14-7d74-4593-ada6-32a443ce4834\") " pod="openshift-ingress/payload-processing-699b6cd6c-49njt" Jun 16 19:59:51.058000 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:51.057969 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g9rs\" (UniqueName: \"kubernetes.io/projected/47431c14-7d74-4593-ada6-32a443ce4834-kube-api-access-4g9rs\") pod \"payload-processing-699b6cd6c-49njt\" (UID: \"47431c14-7d74-4593-ada6-32a443ce4834\") " pod="openshift-ingress/payload-processing-699b6cd6c-49njt" Jun 16 19:59:51.058116 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:51.058067 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfngp\" (UniqueName: \"kubernetes.io/projected/cb6a3949-72bd-4f78-8750-75f5d450f525-kube-api-access-dfngp\") pod \"payload-pre-processing-579785bc64-2ztsz\" (UID: \"cb6a3949-72bd-4f78-8750-75f5d450f525\") " pod="openshift-ingress/payload-pre-processing-579785bc64-2ztsz" Jun 16 19:59:51.189232 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:51.189149 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-2ztsz" Jun 16 19:59:51.201074 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:51.201054 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-49njt" Jun 16 19:59:51.332281 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:51.332249 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-2ztsz"] Jun 16 19:59:51.333314 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:59:51.333291 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb6a3949_72bd_4f78_8750_75f5d450f525.slice/crio-e4a6acefb37787a3cf5be2b67a2fd2c97f8b12a405aea96476b7e77157649a8d WatchSource:0}: Error finding container e4a6acefb37787a3cf5be2b67a2fd2c97f8b12a405aea96476b7e77157649a8d: Status 404 returned error can't find the container with id e4a6acefb37787a3cf5be2b67a2fd2c97f8b12a405aea96476b7e77157649a8d Jun 16 19:59:51.352597 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:51.352552 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-49njt"] Jun 16 19:59:51.353634 ip-10-0-134-77 kubenswrapper[2557]: W0616 19:59:51.353614 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47431c14_7d74_4593_ada6_32a443ce4834.slice/crio-3102948afe67e6ce559b38719c298b891a860987968b323cc7e0944452ca2257 WatchSource:0}: Error finding container 3102948afe67e6ce559b38719c298b891a860987968b323cc7e0944452ca2257: Status 404 returned error can't find the container with id 3102948afe67e6ce559b38719c298b891a860987968b323cc7e0944452ca2257 Jun 16 19:59:51.818610 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:51.818546 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-2ztsz" event={"ID":"cb6a3949-72bd-4f78-8750-75f5d450f525","Type":"ContainerStarted","Data":"e4a6acefb37787a3cf5be2b67a2fd2c97f8b12a405aea96476b7e77157649a8d"} Jun 16 19:59:51.819852 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:51.819829 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-49njt" event={"ID":"47431c14-7d74-4593-ada6-32a443ce4834","Type":"ContainerStarted","Data":"3102948afe67e6ce559b38719c298b891a860987968b323cc7e0944452ca2257"} Jun 16 19:59:53.835035 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:53.835014 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7b5b4c6c54-rkrwd" event={"ID":"0edbc3cf-bfc9-40ce-9016-ef752404446f","Type":"ContainerStarted","Data":"323b2370ffdf2a48faec67e74ee527508d5b3c861d02ea92cace786754f16afe"} Jun 16 19:59:53.835314 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:53.835156 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7b5b4c6c54-rkrwd" Jun 16 19:59:53.855955 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:53.855910 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7b5b4c6c54-rkrwd" podStartSLOduration=1.8808520739999999 podStartE2EDuration="3.855894963s" totalImagesPullingTime="1.975042889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:59:53.854181211 +0000 UTC m=+617.507011815" watchObservedRunningTime="2026-06-16 19:59:53.855894963 +0000 UTC m=+617.508725566" Jun 16 19:59:54.848633 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:54.848560 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-49njt" event={"ID":"47431c14-7d74-4593-ada6-32a443ce4834","Type":"ContainerStarted","Data":"2160525112faf6fdb4563afb708e4d2fe9701a2619a0e9f51c7cddde2760387f"} Jun 16 19:59:54.849109 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:54.848694 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-49njt" Jun 16 19:59:54.850162 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:54.850132 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-2ztsz" event={"ID":"cb6a3949-72bd-4f78-8750-75f5d450f525","Type":"ContainerStarted","Data":"ba70d87344256763f4483cd9ebed717a37f8be0776dd9e123d5d5b0cb5ffa58f"} Jun 16 19:59:54.884312 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:54.884262 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-49njt" podStartSLOduration=2.413197962 podStartE2EDuration="4.884248053s" totalImagesPullingTime="2.471050091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:59:54.879024734 +0000 UTC m=+618.531855338" watchObservedRunningTime="2026-06-16 19:59:54.884248053 +0000 UTC m=+618.537078655" Jun 16 19:59:54.903578 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:54.903530 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-2ztsz" podStartSLOduration=2.405463119 podStartE2EDuration="4.90351155s" totalImagesPullingTime="2.498048431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:59:54.899893099 +0000 UTC m=+618.552723701" watchObservedRunningTime="2026-06-16 19:59:54.90351155 +0000 UTC m=+618.556342340" Jun 16 19:59:55.855813 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:55.855783 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-2ztsz" Jun 16 19:59:59.855730 ip-10-0-134-77 kubenswrapper[2557]: I0616 19:59:59.855702 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7b5b4c6c54-rkrwd" Jun 16 20:00:00.157793 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:00.157715 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29694000-pvcvq"] Jun 16 20:00:00.162060 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:00.162033 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29694000-pvcvq" Jun 16 20:00:00.233207 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:00.233165 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nps9x\" (UniqueName: \"kubernetes.io/projected/295bc413-5f92-4ab4-8493-477154a6de4f-kube-api-access-nps9x\") pod \"maas-api-key-cleanup-29694000-pvcvq\" (UID: \"295bc413-5f92-4ab4-8493-477154a6de4f\") " pod="opendatahub/maas-api-key-cleanup-29694000-pvcvq" Jun 16 20:00:00.334237 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:00.334203 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nps9x\" (UniqueName: \"kubernetes.io/projected/295bc413-5f92-4ab4-8493-477154a6de4f-kube-api-access-nps9x\") pod \"maas-api-key-cleanup-29694000-pvcvq\" (UID: \"295bc413-5f92-4ab4-8493-477154a6de4f\") " pod="opendatahub/maas-api-key-cleanup-29694000-pvcvq" Jun 16 20:00:00.353907 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:00.353881 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nps9x\" (UniqueName: \"kubernetes.io/projected/295bc413-5f92-4ab4-8493-477154a6de4f-kube-api-access-nps9x\") pod \"maas-api-key-cleanup-29694000-pvcvq\" (UID: \"295bc413-5f92-4ab4-8493-477154a6de4f\") " pod="opendatahub/maas-api-key-cleanup-29694000-pvcvq" Jun 16 20:00:00.474434 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:00.474350 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29694000-pvcvq" Jun 16 20:00:00.759469 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:00.759390 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29694000-pvcvq"] Jun 16 20:00:01.020792 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:01.020762 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29694000-pvcvq"] Jun 16 20:00:01.022177 ip-10-0-134-77 kubenswrapper[2557]: W0616 20:00:01.022145 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod295bc413_5f92_4ab4_8493_477154a6de4f.slice/crio-f92a93547f261cb5ac50408bc5773963fe4d755556db8a292f6a0ce425e689d4 WatchSource:0}: Error finding container f92a93547f261cb5ac50408bc5773963fe4d755556db8a292f6a0ce425e689d4: Status 404 returned error can't find the container with id f92a93547f261cb5ac50408bc5773963fe4d755556db8a292f6a0ce425e689d4 Jun 16 20:00:01.889619 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:01.889583 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29694000-pvcvq" event={"ID":"295bc413-5f92-4ab4-8493-477154a6de4f","Type":"ContainerStarted","Data":"f92a93547f261cb5ac50408bc5773963fe4d755556db8a292f6a0ce425e689d4"} Jun 16 20:00:05.857754 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:05.857726 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-49njt" Jun 16 20:00:06.863248 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:06.863215 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-2ztsz" Jun 16 20:00:12.951618 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:12.951515 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29694000-pvcvq" event={"ID":"295bc413-5f92-4ab4-8493-477154a6de4f","Type":"ContainerStarted","Data":"a0901e3043cdabed4b2006783ecc4a7ae8c00cefa5675ee251c989ced3ff92f0"} Jun 16 20:00:12.971790 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:12.971745 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29694000-pvcvq" podStartSLOduration=1.653919873 podStartE2EDuration="12.971729545s" totalImagesPullingTime="11.317809672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:00:12.969866169 +0000 UTC m=+636.622696774" watchObservedRunningTime="2026-06-16 20:00:12.971729545 +0000 UTC m=+636.624560147" Jun 16 20:00:13.958276 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:13.958243 2557 generic.go:356] "Generic (PLEG): container finished" podID="295bc413-5f92-4ab4-8493-477154a6de4f" containerID="a0901e3043cdabed4b2006783ecc4a7ae8c00cefa5675ee251c989ced3ff92f0" exitCode=0 Jun 16 20:00:13.958644 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:13.958302 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29694000-pvcvq" event={"ID":"295bc413-5f92-4ab4-8493-477154a6de4f","Type":"ContainerDied","Data":"a0901e3043cdabed4b2006783ecc4a7ae8c00cefa5675ee251c989ced3ff92f0"} Jun 16 20:00:15.099361 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:15.099339 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29694000-pvcvq" Jun 16 20:00:15.267245 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:15.267166 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nps9x\" (UniqueName: \"kubernetes.io/projected/295bc413-5f92-4ab4-8493-477154a6de4f-kube-api-access-nps9x\") pod \"295bc413-5f92-4ab4-8493-477154a6de4f\" (UID: \"295bc413-5f92-4ab4-8493-477154a6de4f\") " Jun 16 20:00:15.269264 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:15.269238 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/295bc413-5f92-4ab4-8493-477154a6de4f-kube-api-access-nps9x" (OuterVolumeSpecName: "kube-api-access-nps9x") pod "295bc413-5f92-4ab4-8493-477154a6de4f" (UID: "295bc413-5f92-4ab4-8493-477154a6de4f"). InnerVolumeSpecName "kube-api-access-nps9x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 20:00:15.368496 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:15.368463 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nps9x\" (UniqueName: \"kubernetes.io/projected/295bc413-5f92-4ab4-8493-477154a6de4f-kube-api-access-nps9x\") on node \"ip-10-0-134-77.ec2.internal\" DevicePath \"\"" Jun 16 20:00:15.970218 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:15.970189 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29694000-pvcvq" Jun 16 20:00:15.970389 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:15.970189 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29694000-pvcvq" event={"ID":"295bc413-5f92-4ab4-8493-477154a6de4f","Type":"ContainerDied","Data":"f92a93547f261cb5ac50408bc5773963fe4d755556db8a292f6a0ce425e689d4"} Jun 16 20:00:15.970389 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:00:15.970303 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f92a93547f261cb5ac50408bc5773963fe4d755556db8a292f6a0ce425e689d4" Jun 16 20:01:00.491652 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.491323 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm"] Jun 16 20:01:00.492120 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.491834 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="295bc413-5f92-4ab4-8493-477154a6de4f" containerName="cleanup" Jun 16 20:01:00.492120 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.491852 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="295bc413-5f92-4ab4-8493-477154a6de4f" containerName="cleanup" Jun 16 20:01:00.492120 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.491941 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="295bc413-5f92-4ab4-8493-477154a6de4f" containerName="cleanup" Jun 16 20:01:00.495081 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.495063 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.497761 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.497742 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 16 20:01:00.499086 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.499069 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mrjxh\"" Jun 16 20:01:00.499177 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.499118 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 16 20:01:00.499177 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.499131 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 16 20:01:00.507961 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.507939 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm"] Jun 16 20:01:00.632989 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.632962 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f99ee49-2f53-46c9-a3d8-292b9ceb0198-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-gq6mm\" (UID: \"2f99ee49-2f53-46c9-a3d8-292b9ceb0198\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.633144 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.633004 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f99ee49-2f53-46c9-a3d8-292b9ceb0198-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-gq6mm\" (UID: \"2f99ee49-2f53-46c9-a3d8-292b9ceb0198\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.633144 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.633034 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f99ee49-2f53-46c9-a3d8-292b9ceb0198-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-gq6mm\" (UID: \"2f99ee49-2f53-46c9-a3d8-292b9ceb0198\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.633144 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.633075 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jng4n\" (UniqueName: \"kubernetes.io/projected/2f99ee49-2f53-46c9-a3d8-292b9ceb0198-kube-api-access-jng4n\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-gq6mm\" (UID: \"2f99ee49-2f53-46c9-a3d8-292b9ceb0198\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.633144 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.633122 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f99ee49-2f53-46c9-a3d8-292b9ceb0198-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-gq6mm\" (UID: \"2f99ee49-2f53-46c9-a3d8-292b9ceb0198\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.734340 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.734308 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f99ee49-2f53-46c9-a3d8-292b9ceb0198-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-gq6mm\" (UID: \"2f99ee49-2f53-46c9-a3d8-292b9ceb0198\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.734492 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.734346 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jng4n\" (UniqueName: \"kubernetes.io/projected/2f99ee49-2f53-46c9-a3d8-292b9ceb0198-kube-api-access-jng4n\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-gq6mm\" (UID: \"2f99ee49-2f53-46c9-a3d8-292b9ceb0198\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.734492 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.734380 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f99ee49-2f53-46c9-a3d8-292b9ceb0198-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-gq6mm\" (UID: \"2f99ee49-2f53-46c9-a3d8-292b9ceb0198\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.734492 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.734410 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f99ee49-2f53-46c9-a3d8-292b9ceb0198-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-gq6mm\" (UID: \"2f99ee49-2f53-46c9-a3d8-292b9ceb0198\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.734492 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.734440 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f99ee49-2f53-46c9-a3d8-292b9ceb0198-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-gq6mm\" (UID: \"2f99ee49-2f53-46c9-a3d8-292b9ceb0198\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.734747 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.734706 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f99ee49-2f53-46c9-a3d8-292b9ceb0198-model-cache\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-gq6mm\" (UID: \"2f99ee49-2f53-46c9-a3d8-292b9ceb0198\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.734880 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.734859 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f99ee49-2f53-46c9-a3d8-292b9ceb0198-home\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-gq6mm\" (UID: \"2f99ee49-2f53-46c9-a3d8-292b9ceb0198\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.736745 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.736723 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f99ee49-2f53-46c9-a3d8-292b9ceb0198-dshm\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-gq6mm\" (UID: \"2f99ee49-2f53-46c9-a3d8-292b9ceb0198\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.736998 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.736981 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f99ee49-2f53-46c9-a3d8-292b9ceb0198-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-gq6mm\" (UID: \"2f99ee49-2f53-46c9-a3d8-292b9ceb0198\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.743770 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.743710 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jng4n\" (UniqueName: \"kubernetes.io/projected/2f99ee49-2f53-46c9-a3d8-292b9ceb0198-kube-api-access-jng4n\") pod \"e2e-distinct-2-simulated-kserve-74f954f784-gq6mm\" (UID: \"2f99ee49-2f53-46c9-a3d8-292b9ceb0198\") " pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.808742 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.808713 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:00.953276 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:00.953245 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm"] Jun 16 20:01:00.954582 ip-10-0-134-77 kubenswrapper[2557]: W0616 20:01:00.954538 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f99ee49_2f53_46c9_a3d8_292b9ceb0198.slice/crio-6148e7c00d352505f98980c7bb30b438fbe9087f8e1aba806dc80127b959ee95 WatchSource:0}: Error finding container 6148e7c00d352505f98980c7bb30b438fbe9087f8e1aba806dc80127b959ee95: Status 404 returned error can't find the container with id 6148e7c00d352505f98980c7bb30b438fbe9087f8e1aba806dc80127b959ee95 Jun 16 20:01:01.218891 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:01.218850 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" event={"ID":"2f99ee49-2f53-46c9-a3d8-292b9ceb0198","Type":"ContainerStarted","Data":"6148e7c00d352505f98980c7bb30b438fbe9087f8e1aba806dc80127b959ee95"} Jun 16 20:01:07.260522 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:07.260484 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" event={"ID":"2f99ee49-2f53-46c9-a3d8-292b9ceb0198","Type":"ContainerStarted","Data":"37c56fd9979fc15af5b9a97f0ef03a05311f819c0c21cc3ebde4836aea3eceda"} Jun 16 20:01:07.298796 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:07.298740 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" podStartSLOduration=2.012963035 podStartE2EDuration="7.298723895s" totalImagesPullingTime="5.28576086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:01:07.297033558 +0000 UTC m=+690.949864184" watchObservedRunningTime="2026-06-16 20:01:07.298723895 +0000 UTC m=+690.951554498" Jun 16 20:01:10.809134 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:10.809101 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:10.809519 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:10.809154 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:10.822688 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:10.822664 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:11.293326 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:11.293237 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-74f954f784-gq6mm" Jun 16 20:01:39.887642 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:39.887608 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5"] Jun 16 20:01:39.891097 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:39.891081 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:39.893978 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:39.893950 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 16 20:01:39.902146 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:39.902126 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5"] Jun 16 20:01:39.961546 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:39.961512 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfxbf\" (UniqueName: \"kubernetes.io/projected/66800360-ada3-4c16-ad65-d1ab7bf0e23b-kube-api-access-dfxbf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5\" (UID: \"66800360-ada3-4c16-ad65-d1ab7bf0e23b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:39.961723 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:39.961555 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66800360-ada3-4c16-ad65-d1ab7bf0e23b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5\" (UID: \"66800360-ada3-4c16-ad65-d1ab7bf0e23b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:39.961723 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:39.961658 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66800360-ada3-4c16-ad65-d1ab7bf0e23b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5\" (UID: \"66800360-ada3-4c16-ad65-d1ab7bf0e23b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:39.961723 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:39.961721 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66800360-ada3-4c16-ad65-d1ab7bf0e23b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5\" (UID: \"66800360-ada3-4c16-ad65-d1ab7bf0e23b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:39.961850 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:39.961748 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66800360-ada3-4c16-ad65-d1ab7bf0e23b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5\" (UID: \"66800360-ada3-4c16-ad65-d1ab7bf0e23b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:40.062548 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:40.062512 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfxbf\" (UniqueName: \"kubernetes.io/projected/66800360-ada3-4c16-ad65-d1ab7bf0e23b-kube-api-access-dfxbf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5\" (UID: \"66800360-ada3-4c16-ad65-d1ab7bf0e23b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:40.062739 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:40.062554 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66800360-ada3-4c16-ad65-d1ab7bf0e23b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5\" (UID: \"66800360-ada3-4c16-ad65-d1ab7bf0e23b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:40.062739 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:40.062606 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66800360-ada3-4c16-ad65-d1ab7bf0e23b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5\" (UID: \"66800360-ada3-4c16-ad65-d1ab7bf0e23b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:40.062739 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:40.062633 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66800360-ada3-4c16-ad65-d1ab7bf0e23b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5\" (UID: \"66800360-ada3-4c16-ad65-d1ab7bf0e23b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:40.062739 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:40.062649 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66800360-ada3-4c16-ad65-d1ab7bf0e23b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5\" (UID: \"66800360-ada3-4c16-ad65-d1ab7bf0e23b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:40.063019 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:40.063001 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66800360-ada3-4c16-ad65-d1ab7bf0e23b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5\" (UID: \"66800360-ada3-4c16-ad65-d1ab7bf0e23b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:40.063126 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:40.063104 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66800360-ada3-4c16-ad65-d1ab7bf0e23b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5\" (UID: \"66800360-ada3-4c16-ad65-d1ab7bf0e23b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:40.065118 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:40.065092 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66800360-ada3-4c16-ad65-d1ab7bf0e23b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5\" (UID: \"66800360-ada3-4c16-ad65-d1ab7bf0e23b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:40.065360 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:40.065343 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66800360-ada3-4c16-ad65-d1ab7bf0e23b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5\" (UID: \"66800360-ada3-4c16-ad65-d1ab7bf0e23b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:40.072529 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:40.072502 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfxbf\" (UniqueName: \"kubernetes.io/projected/66800360-ada3-4c16-ad65-d1ab7bf0e23b-kube-api-access-dfxbf\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5\" (UID: \"66800360-ada3-4c16-ad65-d1ab7bf0e23b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:40.202251 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:40.202163 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:40.360926 ip-10-0-134-77 kubenswrapper[2557]: W0616 20:01:40.360885 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66800360_ada3_4c16_ad65_d1ab7bf0e23b.slice/crio-3702a9c3adf7577d72015c4c4c84262cd8fd015b4658058397edb8a2cbbca0a4 WatchSource:0}: Error finding container 3702a9c3adf7577d72015c4c4c84262cd8fd015b4658058397edb8a2cbbca0a4: Status 404 returned error can't find the container with id 3702a9c3adf7577d72015c4c4c84262cd8fd015b4658058397edb8a2cbbca0a4 Jun 16 20:01:40.363836 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:40.363814 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5"] Jun 16 20:01:40.445420 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:40.445385 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" event={"ID":"66800360-ada3-4c16-ad65-d1ab7bf0e23b","Type":"ContainerStarted","Data":"3702a9c3adf7577d72015c4c4c84262cd8fd015b4658058397edb8a2cbbca0a4"} Jun 16 20:01:41.452387 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:41.452350 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" event={"ID":"66800360-ada3-4c16-ad65-d1ab7bf0e23b","Type":"ContainerStarted","Data":"ead8d116afc65d6bd47509a5d3757755060fc5bd4b2387cb4cfe959a91b5e242"} Jun 16 20:01:41.474154 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:41.474100 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" podStartSLOduration=2.225041422 podStartE2EDuration="2.474086081s" totalImagesPullingTime="249.044659ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:01:41.471004389 +0000 UTC m=+725.123834992" watchObservedRunningTime="2026-06-16 20:01:41.474086081 +0000 UTC m=+725.126916683" Jun 16 20:01:44.893099 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:44.893064 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz"] Jun 16 20:01:44.895534 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:44.895519 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:44.898899 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:44.898882 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 16 20:01:44.917330 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:44.917300 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz"] Jun 16 20:01:45.003010 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.002966 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca825b35-ff1b-4bdb-8ca7-401633470e21-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz\" (UID: \"ca825b35-ff1b-4bdb-8ca7-401633470e21\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:45.003191 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.003046 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca825b35-ff1b-4bdb-8ca7-401633470e21-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz\" (UID: \"ca825b35-ff1b-4bdb-8ca7-401633470e21\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:45.003191 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.003072 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca825b35-ff1b-4bdb-8ca7-401633470e21-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz\" (UID: \"ca825b35-ff1b-4bdb-8ca7-401633470e21\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:45.003191 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.003090 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxmdn\" (UniqueName: \"kubernetes.io/projected/ca825b35-ff1b-4bdb-8ca7-401633470e21-kube-api-access-qxmdn\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz\" (UID: \"ca825b35-ff1b-4bdb-8ca7-401633470e21\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:45.003191 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.003111 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca825b35-ff1b-4bdb-8ca7-401633470e21-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz\" (UID: \"ca825b35-ff1b-4bdb-8ca7-401633470e21\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:45.104472 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.104437 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca825b35-ff1b-4bdb-8ca7-401633470e21-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz\" (UID: \"ca825b35-ff1b-4bdb-8ca7-401633470e21\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:45.104775 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.104483 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca825b35-ff1b-4bdb-8ca7-401633470e21-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz\" (UID: \"ca825b35-ff1b-4bdb-8ca7-401633470e21\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:45.104775 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.104503 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxmdn\" (UniqueName: \"kubernetes.io/projected/ca825b35-ff1b-4bdb-8ca7-401633470e21-kube-api-access-qxmdn\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz\" (UID: \"ca825b35-ff1b-4bdb-8ca7-401633470e21\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:45.104775 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.104530 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca825b35-ff1b-4bdb-8ca7-401633470e21-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz\" (UID: \"ca825b35-ff1b-4bdb-8ca7-401633470e21\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:45.104775 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.104579 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca825b35-ff1b-4bdb-8ca7-401633470e21-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz\" (UID: \"ca825b35-ff1b-4bdb-8ca7-401633470e21\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:45.105059 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.105036 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca825b35-ff1b-4bdb-8ca7-401633470e21-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz\" (UID: \"ca825b35-ff1b-4bdb-8ca7-401633470e21\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:45.105124 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.105040 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca825b35-ff1b-4bdb-8ca7-401633470e21-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz\" (UID: \"ca825b35-ff1b-4bdb-8ca7-401633470e21\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:45.106964 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.106947 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca825b35-ff1b-4bdb-8ca7-401633470e21-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz\" (UID: \"ca825b35-ff1b-4bdb-8ca7-401633470e21\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:45.107125 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.107109 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca825b35-ff1b-4bdb-8ca7-401633470e21-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz\" (UID: \"ca825b35-ff1b-4bdb-8ca7-401633470e21\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:45.115279 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.115259 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxmdn\" (UniqueName: \"kubernetes.io/projected/ca825b35-ff1b-4bdb-8ca7-401633470e21-kube-api-access-qxmdn\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz\" (UID: \"ca825b35-ff1b-4bdb-8ca7-401633470e21\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:45.206142 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.206053 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:45.356143 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.356112 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz"] Jun 16 20:01:45.356760 ip-10-0-134-77 kubenswrapper[2557]: W0616 20:01:45.356738 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca825b35_ff1b_4bdb_8ca7_401633470e21.slice/crio-44956c8b9a313e9aaa1b5f6691546cae1245c948831801cbefcd839346108319 WatchSource:0}: Error finding container 44956c8b9a313e9aaa1b5f6691546cae1245c948831801cbefcd839346108319: Status 404 returned error can't find the container with id 44956c8b9a313e9aaa1b5f6691546cae1245c948831801cbefcd839346108319 Jun 16 20:01:45.477496 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:45.477412 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" event={"ID":"ca825b35-ff1b-4bdb-8ca7-401633470e21","Type":"ContainerStarted","Data":"44956c8b9a313e9aaa1b5f6691546cae1245c948831801cbefcd839346108319"} Jun 16 20:01:46.484708 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:46.484672 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" event={"ID":"ca825b35-ff1b-4bdb-8ca7-401633470e21","Type":"ContainerStarted","Data":"b479ff06041f22ff447d3216fc5aac64414568350c3bedacbb3fa3c2b051082f"} Jun 16 20:01:46.509597 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:46.509524 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" podStartSLOduration=2.282963282 podStartE2EDuration="2.509504607s" totalImagesPullingTime="226.541325ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:01:46.507071752 +0000 UTC m=+730.159902357" watchObservedRunningTime="2026-06-16 20:01:46.509504607 +0000 UTC m=+730.162335209" Jun 16 20:01:50.202987 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:50.202947 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:50.203400 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:50.203007 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:50.215506 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:50.215472 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:50.518118 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:50.518038 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5" Jun 16 20:01:55.206640 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:55.206606 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:55.207103 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:55.206677 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:55.219645 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:55.219622 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:01:55.546184 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:01:55.546105 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz" Jun 16 20:04:36.845352 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:04:36.845311 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 20:04:36.846640 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:04:36.846610 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 20:04:36.850347 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:04:36.850328 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 20:04:36.851761 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:04:36.851741 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 20:09:36.882119 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:09:36.882089 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 20:09:36.884800 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:09:36.884778 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 20:09:36.887162 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:09:36.887139 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 20:09:36.889500 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:09:36.889485 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 20:14:36.920938 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:14:36.920912 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 20:14:36.924607 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:14:36.924560 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 20:14:36.925971 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:14:36.925951 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 20:14:36.929349 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:14:36.929331 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 20:19:36.958272 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:19:36.958245 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 20:19:36.962961 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:19:36.962938 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 20:19:36.963424 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:19:36.963406 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 20:19:36.968171 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:19:36.968154 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 20:24:36.995899 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:24:36.995871 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 20:24:37.001246 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:24:37.001220 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 20:24:37.003671 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:24:37.003649 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8dt4_c70e4a62-c85d-4f3d-9509-25c257bdb0af/ovn-acl-logging/0.log" Jun 16 20:24:37.008576 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:24:37.008544 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-134-77.ec2.internal_cc6da1b13bca282ef865b3244f5b60b1/kube-rbac-proxy-crio/1.log" Jun 16 20:28:03.845382 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:03.845355 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56694dc9bd-6cnkj_ded12e65-7f1a-4be9-90cd-4a8dea21b9ad/nginx/0.log" Jun 16 20:28:04.060726 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:04.060694 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-j5tlj_013041b3-a14c-4ea5-b698-d6f9fb7a92ee/manager/0.log" Jun 16 20:28:04.179278 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:04.179207 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-r8tjp_1d696e53-6a22-4e06-8e1d-048ea44ddde6/manager/0.log" Jun 16 20:28:04.304109 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:04.304083 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7b5b4c6c54-rkrwd_0edbc3cf-bfc9-40ce-9016-ef752404446f/maas-api/0.log" Jun 16 20:28:04.423409 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:04.423382 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29694000-pvcvq_295bc413-5f92-4ab4-8493-477154a6de4f/cleanup/0.log" Jun 16 20:28:04.853028 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:04.852995 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-sxbrm_866d4edc-1ffe-47bf-b60c-3df45196bc79/server/0.log" Jun 16 20:28:04.969900 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:04.969864 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-675vh_d0edf62e-00d7-4eed-a6d8-43022dcb0836/manager/0.log" Jun 16 20:28:05.248249 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:05.248175 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cbd84db66-v8vz5_41008e0d-5b83-474e-b410-2a58e647786b/manager/0.log" Jun 16 20:28:05.273732 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:05.273713 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cbd84db66-v8vz5_41008e0d-5b83-474e-b410-2a58e647786b/copy-manifests/0.log" Jun 16 20:28:06.276436 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:06.276409 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft_7f1271b6-cbe9-4148-a022-7201a34f8648/util/0.log" Jun 16 20:28:06.284458 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:06.284439 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft_7f1271b6-cbe9-4148-a022-7201a34f8648/pull/0.log" Jun 16 20:28:06.292197 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:06.292182 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft_7f1271b6-cbe9-4148-a022-7201a34f8648/extract/0.log" Jun 16 20:28:06.405152 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:06.405133 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k_7f4fd1de-31c2-4876-91fe-ad8fde5a9bac/util/0.log" Jun 16 20:28:06.416833 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:06.416816 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k_7f4fd1de-31c2-4876-91fe-ad8fde5a9bac/pull/0.log" Jun 16 20:28:06.424469 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:06.424453 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k_7f4fd1de-31c2-4876-91fe-ad8fde5a9bac/extract/0.log" Jun 16 20:28:06.533672 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:06.533560 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb_4a512678-0622-4a80-a213-6738138de595/util/0.log" Jun 16 20:28:06.541302 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:06.541281 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb_4a512678-0622-4a80-a213-6738138de595/pull/0.log" Jun 16 20:28:06.549320 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:06.549300 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb_4a512678-0622-4a80-a213-6738138de595/extract/0.log" Jun 16 20:28:06.657994 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:06.657966 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25_f7b8c068-a843-427f-9a57-33b0427eabfe/util/0.log" Jun 16 20:28:06.665802 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:06.665782 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25_f7b8c068-a843-427f-9a57-33b0427eabfe/pull/0.log" Jun 16 20:28:06.675371 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:06.675353 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25_f7b8c068-a843-427f-9a57-33b0427eabfe/extract/0.log" Jun 16 20:28:06.910582 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:06.910534 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jpg9b_bd97753b-d768-4704-bbfb-5e5ef4559808/manager/0.log" Jun 16 20:28:07.023927 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:07.023900 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mf262_3fc4cb0b-9035-4de7-8463-6afa38f7492c/manager/0.log" Jun 16 20:28:07.589654 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:07.589622 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qrcpq_ab89ac2f-50aa-4158-aa77-232fb5623fed/manager/0.log" Jun 16 20:28:08.050811 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:08.050734 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-x92jm_30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737/discovery/0.log" Jun 16 20:28:08.272472 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:08.272443 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58ff4d787-cflq8_7d07be61-1a3b-4262-8ad8-dae561ee544c/kube-auth-proxy/0.log" Jun 16 20:28:08.503627 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:08.503596 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-2ztsz_cb6a3949-72bd-4f78-8750-75f5d450f525/payload-pre-processing/0.log" Jun 16 20:28:08.622503 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:08.622477 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-49njt_47431c14-7d74-4593-ada6-32a443ce4834/payload-processing/0.log" Jun 16 20:28:09.073022 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:09.072992 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-74f954f784-gq6mm_2f99ee49-2f53-46c9-a3d8-292b9ceb0198/main/0.log" Jun 16 20:28:09.424804 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:09.424731 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-66d649j9zq5_66800360-ada3-4c16-ad65-d1ab7bf0e23b/main/0.log" Jun 16 20:28:09.568437 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:09.568407 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-99c7dfb5c-6xslz_ca825b35-ff1b-4bdb-8ca7-401633470e21/main/0.log" Jun 16 20:28:17.095288 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:17.095213 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g82pv_3b922c97-fed5-44e6-b134-192a137564e7/global-pull-secret-syncer/0.log" Jun 16 20:28:17.359598 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:17.359509 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sq5nb_c183ed90-881e-4a72-bb89-056cc0f54cd3/konnectivity-agent/0.log" Jun 16 20:28:17.464412 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:17.464386 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-77.ec2.internal_b9d047301ade34e187f662d0538c7f23/haproxy/0.log" Jun 16 20:28:20.450371 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:20.450342 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-6nvxq_48261a79-1e2d-4b11-8081-f87dbf946c68/sail-operator/0.log" Jun 16 20:28:21.403204 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:21.403175 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft_7f1271b6-cbe9-4148-a022-7201a34f8648/extract/0.log" Jun 16 20:28:21.437161 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:21.437124 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft_7f1271b6-cbe9-4148-a022-7201a34f8648/util/0.log" Jun 16 20:28:21.465546 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:21.465520 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ql5ft_7f1271b6-cbe9-4148-a022-7201a34f8648/pull/0.log" Jun 16 20:28:21.500024 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:21.500001 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k_7f4fd1de-31c2-4876-91fe-ad8fde5a9bac/extract/0.log" Jun 16 20:28:21.526680 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:21.526650 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k_7f4fd1de-31c2-4876-91fe-ad8fde5a9bac/util/0.log" Jun 16 20:28:21.559059 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:21.559037 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0chw7k_7f4fd1de-31c2-4876-91fe-ad8fde5a9bac/pull/0.log" Jun 16 20:28:21.591321 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:21.591300 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb_4a512678-0622-4a80-a213-6738138de595/extract/0.log" Jun 16 20:28:21.621494 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:21.621469 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb_4a512678-0622-4a80-a213-6738138de595/util/0.log" Jun 16 20:28:21.653802 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:21.653731 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nkljb_4a512678-0622-4a80-a213-6738138de595/pull/0.log" Jun 16 20:28:21.685617 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:21.685590 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25_f7b8c068-a843-427f-9a57-33b0427eabfe/extract/0.log" Jun 16 20:28:21.716710 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:21.716685 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25_f7b8c068-a843-427f-9a57-33b0427eabfe/util/0.log" Jun 16 20:28:21.743960 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:21.743938 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pcd25_f7b8c068-a843-427f-9a57-33b0427eabfe/pull/0.log" Jun 16 20:28:22.132623 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:22.132596 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jpg9b_bd97753b-d768-4704-bbfb-5e5ef4559808/manager/0.log" Jun 16 20:28:22.167601 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:22.167560 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mf262_3fc4cb0b-9035-4de7-8463-6afa38f7492c/manager/0.log" Jun 16 20:28:22.530025 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:22.529949 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qrcpq_ab89ac2f-50aa-4158-aa77-232fb5623fed/manager/0.log" Jun 16 20:28:24.271716 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:24.271687 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9276f312-ae06-4c06-a5ab-3d6d1cab48ed/alertmanager/0.log" Jun 16 20:28:24.313048 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:24.313022 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9276f312-ae06-4c06-a5ab-3d6d1cab48ed/config-reloader/0.log" Jun 16 20:28:24.348912 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:24.348881 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9276f312-ae06-4c06-a5ab-3d6d1cab48ed/kube-rbac-proxy-web/0.log" Jun 16 20:28:24.382842 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:24.382803 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9276f312-ae06-4c06-a5ab-3d6d1cab48ed/kube-rbac-proxy/0.log" Jun 16 20:28:24.427493 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:24.427466 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9276f312-ae06-4c06-a5ab-3d6d1cab48ed/kube-rbac-proxy-metric/0.log" Jun 16 20:28:24.469220 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:24.469200 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9276f312-ae06-4c06-a5ab-3d6d1cab48ed/prom-label-proxy/0.log" Jun 16 20:28:24.517278 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:24.517255 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9276f312-ae06-4c06-a5ab-3d6d1cab48ed/init-config-reloader/0.log" Jun 16 20:28:24.802380 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:24.802351 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9dhlv_e5d94e20-efe5-4e15-b1e1-23ce4c887636/node-exporter/0.log" Jun 16 20:28:24.835158 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:24.835129 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9dhlv_e5d94e20-efe5-4e15-b1e1-23ce4c887636/kube-rbac-proxy/0.log" Jun 16 20:28:24.875635 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:24.875594 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9dhlv_e5d94e20-efe5-4e15-b1e1-23ce4c887636/init-textfile/0.log" Jun 16 20:28:25.776414 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:25.776379 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78ccfd488b-2jb4d_28f96171-0eb5-419e-a6ff-359fcb6d15c0/telemeter-client/0.log" Jun 16 20:28:25.807856 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:25.807787 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78ccfd488b-2jb4d_28f96171-0eb5-419e-a6ff-359fcb6d15c0/reload/0.log" Jun 16 20:28:25.848948 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:25.848926 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78ccfd488b-2jb4d_28f96171-0eb5-419e-a6ff-359fcb6d15c0/kube-rbac-proxy/0.log" Jun 16 20:28:28.542175 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.542134 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr"] Jun 16 20:28:28.546034 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.546012 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.548611 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.548590 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tqlq7\"/\"kube-root-ca.crt\"" Jun 16 20:28:28.549684 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.549620 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tqlq7\"/\"openshift-service-ca.crt\"" Jun 16 20:28:28.549796 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.549704 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tqlq7\"/\"default-dockercfg-mg6j4\"" Jun 16 20:28:28.556098 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.556073 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr"] Jun 16 20:28:28.572113 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.572087 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/793df243-74a9-4cb8-80a9-d6f5fb41c63e-podres\") pod \"perf-node-gather-daemonset-84kjr\" (UID: \"793df243-74a9-4cb8-80a9-d6f5fb41c63e\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.572267 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.572121 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c587n\" (UniqueName: \"kubernetes.io/projected/793df243-74a9-4cb8-80a9-d6f5fb41c63e-kube-api-access-c587n\") pod \"perf-node-gather-daemonset-84kjr\" (UID: \"793df243-74a9-4cb8-80a9-d6f5fb41c63e\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.572267 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.572203 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/793df243-74a9-4cb8-80a9-d6f5fb41c63e-proc\") pod \"perf-node-gather-daemonset-84kjr\" (UID: \"793df243-74a9-4cb8-80a9-d6f5fb41c63e\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.572391 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.572285 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/793df243-74a9-4cb8-80a9-d6f5fb41c63e-sys\") pod \"perf-node-gather-daemonset-84kjr\" (UID: \"793df243-74a9-4cb8-80a9-d6f5fb41c63e\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.572391 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.572326 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/793df243-74a9-4cb8-80a9-d6f5fb41c63e-lib-modules\") pod \"perf-node-gather-daemonset-84kjr\" (UID: \"793df243-74a9-4cb8-80a9-d6f5fb41c63e\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.672898 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.672861 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/793df243-74a9-4cb8-80a9-d6f5fb41c63e-lib-modules\") pod \"perf-node-gather-daemonset-84kjr\" (UID: \"793df243-74a9-4cb8-80a9-d6f5fb41c63e\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.672898 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.672900 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/793df243-74a9-4cb8-80a9-d6f5fb41c63e-podres\") pod \"perf-node-gather-daemonset-84kjr\" (UID: \"793df243-74a9-4cb8-80a9-d6f5fb41c63e\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.673115 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.672919 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c587n\" (UniqueName: \"kubernetes.io/projected/793df243-74a9-4cb8-80a9-d6f5fb41c63e-kube-api-access-c587n\") pod \"perf-node-gather-daemonset-84kjr\" (UID: \"793df243-74a9-4cb8-80a9-d6f5fb41c63e\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.673115 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.672972 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/793df243-74a9-4cb8-80a9-d6f5fb41c63e-proc\") pod \"perf-node-gather-daemonset-84kjr\" (UID: \"793df243-74a9-4cb8-80a9-d6f5fb41c63e\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.673115 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.673035 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/793df243-74a9-4cb8-80a9-d6f5fb41c63e-sys\") pod \"perf-node-gather-daemonset-84kjr\" (UID: \"793df243-74a9-4cb8-80a9-d6f5fb41c63e\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.673115 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.673054 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/793df243-74a9-4cb8-80a9-d6f5fb41c63e-podres\") pod \"perf-node-gather-daemonset-84kjr\" (UID: \"793df243-74a9-4cb8-80a9-d6f5fb41c63e\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.673115 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.673054 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/793df243-74a9-4cb8-80a9-d6f5fb41c63e-lib-modules\") pod \"perf-node-gather-daemonset-84kjr\" (UID: \"793df243-74a9-4cb8-80a9-d6f5fb41c63e\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.673115 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.673102 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/793df243-74a9-4cb8-80a9-d6f5fb41c63e-proc\") pod \"perf-node-gather-daemonset-84kjr\" (UID: \"793df243-74a9-4cb8-80a9-d6f5fb41c63e\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.673115 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.673114 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/793df243-74a9-4cb8-80a9-d6f5fb41c63e-sys\") pod \"perf-node-gather-daemonset-84kjr\" (UID: \"793df243-74a9-4cb8-80a9-d6f5fb41c63e\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.682742 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.682714 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c587n\" (UniqueName: \"kubernetes.io/projected/793df243-74a9-4cb8-80a9-d6f5fb41c63e-kube-api-access-c587n\") pod \"perf-node-gather-daemonset-84kjr\" (UID: \"793df243-74a9-4cb8-80a9-d6f5fb41c63e\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.856625 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.856596 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:28.994504 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:28.994472 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr"] Jun 16 20:28:28.995913 ip-10-0-134-77 kubenswrapper[2557]: W0616 20:28:28.995883 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod793df243_74a9_4cb8_80a9_d6f5fb41c63e.slice/crio-6d6e4a9f13e8147fb5e2545744227f29a4d9eca264bc170dc8cc1a171ea3d0dc WatchSource:0}: Error finding container 6d6e4a9f13e8147fb5e2545744227f29a4d9eca264bc170dc8cc1a171ea3d0dc: Status 404 returned error can't find the container with id 6d6e4a9f13e8147fb5e2545744227f29a4d9eca264bc170dc8cc1a171ea3d0dc Jun 16 20:28:29.643526 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:29.643491 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" event={"ID":"793df243-74a9-4cb8-80a9-d6f5fb41c63e","Type":"ContainerStarted","Data":"e6b56404279e5ecc54c6d7d10eb4076472be8f216125b79ddf777459660292df"} Jun 16 20:28:29.643938 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:29.643545 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" event={"ID":"793df243-74a9-4cb8-80a9-d6f5fb41c63e","Type":"ContainerStarted","Data":"6d6e4a9f13e8147fb5e2545744227f29a4d9eca264bc170dc8cc1a171ea3d0dc"} Jun 16 20:28:29.643938 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:29.643613 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:29.662248 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:29.662202 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" podStartSLOduration=1.6621887800000001 podStartE2EDuration="1.66218878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 20:28:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:28:29.661463958 +0000 UTC m=+2333.314294584" watchObservedRunningTime="2026-06-16 20:28:29.66218878 +0000 UTC m=+2333.315019382" Jun 16 20:28:30.833792 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:30.833767 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d7qqp_00be44e7-5d9a-48be-aa2e-3354d49154c0/dns/0.log" Jun 16 20:28:30.864535 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:30.864509 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d7qqp_00be44e7-5d9a-48be-aa2e-3354d49154c0/kube-rbac-proxy/0.log" Jun 16 20:28:31.017108 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:31.017081 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2hdpp_cf160577-a0e9-40fa-8392-f06851ff4e56/dns-node-resolver/0.log" Jun 16 20:28:31.751759 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:31.751725 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zkxmt_fbbf7145-3244-4200-8748-797f2c7ac75a/node-ca/0.log" Jun 16 20:28:32.966269 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:32.966235 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-x92jm_30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737/discovery/0.log" Jun 16 20:28:33.024652 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:33.024629 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58ff4d787-cflq8_7d07be61-1a3b-4262-8ad8-dae561ee544c/kube-auth-proxy/0.log" Jun 16 20:28:33.161031 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:33.161003 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-2ztsz_cb6a3949-72bd-4f78-8750-75f5d450f525/payload-pre-processing/0.log" Jun 16 20:28:33.251019 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:33.250942 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-49njt_47431c14-7d74-4593-ada6-32a443ce4834/payload-processing/0.log" Jun 16 20:28:34.037033 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:34.037003 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7qpv6_c812a43c-91e5-47bd-a649-2e27a20db227/serve-healthcheck-canary/0.log" Jun 16 20:28:34.730745 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:34.730719 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xprhm_07faee47-5575-472d-a8a0-809677d270f1/kube-rbac-proxy/0.log" Jun 16 20:28:34.758574 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:34.758545 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xprhm_07faee47-5575-472d-a8a0-809677d270f1/exporter/0.log" Jun 16 20:28:34.785282 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:34.785240 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xprhm_07faee47-5575-472d-a8a0-809677d270f1/extractor/0.log" Jun 16 20:28:35.658964 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:35.658940 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-84kjr" Jun 16 20:28:37.393735 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:37.393655 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56694dc9bd-6cnkj_ded12e65-7f1a-4be9-90cd-4a8dea21b9ad/nginx/0.log" Jun 16 20:28:37.452844 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:37.452819 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-j5tlj_013041b3-a14c-4ea5-b698-d6f9fb7a92ee/manager/0.log" Jun 16 20:28:37.528645 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:37.528622 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-r8tjp_1d696e53-6a22-4e06-8e1d-048ea44ddde6/manager/0.log" Jun 16 20:28:37.568317 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:37.568288 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7b5b4c6c54-rkrwd_0edbc3cf-bfc9-40ce-9016-ef752404446f/maas-api/0.log" Jun 16 20:28:37.593592 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:37.592828 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29694000-pvcvq_295bc413-5f92-4ab4-8493-477154a6de4f/cleanup/0.log" Jun 16 20:28:37.784300 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:37.784215 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-sxbrm_866d4edc-1ffe-47bf-b60c-3df45196bc79/server/0.log" Jun 16 20:28:37.843644 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:37.843615 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-675vh_d0edf62e-00d7-4eed-a6d8-43022dcb0836/manager/0.log" Jun 16 20:28:38.078087 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:38.078055 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cbd84db66-v8vz5_41008e0d-5b83-474e-b410-2a58e647786b/manager/0.log" Jun 16 20:28:38.135695 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:38.135673 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cbd84db66-v8vz5_41008e0d-5b83-474e-b410-2a58e647786b/copy-manifests/0.log" Jun 16 20:28:40.012632 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:40.012606 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-tc4vt_1d73a897-bf7d-4a84-9459-d12d5cec83e4/openshift-lws-operator/0.log" Jun 16 20:28:42.002124 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:42.002093 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-x92jm_30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737/discovery/0.log" Jun 16 20:28:42.049922 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:42.049897 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58ff4d787-cflq8_7d07be61-1a3b-4262-8ad8-dae561ee544c/kube-auth-proxy/0.log" Jun 16 20:28:42.140586 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:42.140543 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-2ztsz_cb6a3949-72bd-4f78-8750-75f5d450f525/payload-pre-processing/0.log" Jun 16 20:28:42.196308 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:42.196279 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-49njt_47431c14-7d74-4593-ada6-32a443ce4834/payload-processing/0.log" Jun 16 20:28:43.387043 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:43.387011 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-x92jm_30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737/discovery/0.log" Jun 16 20:28:43.465793 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:43.465764 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58ff4d787-cflq8_7d07be61-1a3b-4262-8ad8-dae561ee544c/kube-auth-proxy/0.log" Jun 16 20:28:43.583663 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:43.583633 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-2ztsz_cb6a3949-72bd-4f78-8750-75f5d450f525/payload-pre-processing/0.log" Jun 16 20:28:43.655377 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:43.655305 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-49njt_47431c14-7d74-4593-ada6-32a443ce4834/payload-processing/0.log" Jun 16 20:28:45.557269 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:45.557238 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-x92jm_30cb9f3d-fdd6-4e9a-93bb-8eebc6dc9737/discovery/0.log" Jun 16 20:28:45.590353 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:45.590321 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58ff4d787-cflq8_7d07be61-1a3b-4262-8ad8-dae561ee544c/kube-auth-proxy/0.log" Jun 16 20:28:45.683293 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:45.683267 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-2ztsz_cb6a3949-72bd-4f78-8750-75f5d450f525/payload-pre-processing/0.log" Jun 16 20:28:45.748078 ip-10-0-134-77 kubenswrapper[2557]: I0616 20:28:45.748049 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-49njt_47431c14-7d74-4593-ada6-32a443ce4834/payload-processing/0.log"