Jun 08 12:58:27.902936 ip-10-0-129-96 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 12:58:27.902945 ip-10-0-129-96 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 12:58:27.902952 ip-10-0-129-96 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 12:58:27.903104 ip-10-0-129-96 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 12:58:37.910238 ip-10-0-129-96 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 12:58:37.910253 ip-10-0-129-96 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0adad52403104f98bd78eef577177979 -- Jun 08 13:01:21.327869 ip-10-0-129-96 systemd[1]: Starting Kubernetes Kubelet... Jun 08 13:01:21.676484 ip-10-0-129-96 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:01:21.676484 ip-10-0-129-96 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 13:01:21.676484 ip-10-0-129-96 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:01:21.676484 ip-10-0-129-96 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 13:01:21.676484 ip-10-0-129-96 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:01:21.677150 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.677069 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 13:01:21.682479 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682455 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:21.682520 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682482 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:21.682520 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682487 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:21.682520 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682490 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:21.682520 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682494 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:21.682520 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682498 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:21.682520 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682501 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:21.682520 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682503 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:21.682520 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682506 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:21.682520 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682509 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:21.682520 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682512 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:21.682520 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682514 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:21.682520 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682517 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:21.682520 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682520 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:21.682520 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682522 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:21.682520 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682525 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:21.682520 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682528 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682531 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682534 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682536 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682539 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682542 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682546 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682550 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682554 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682557 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682560 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682563 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682566 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682569 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682572 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682575 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682578 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682581 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682583 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682586 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:21.682902 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682588 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682591 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682594 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682597 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682599 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682602 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682604 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682607 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682609 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682611 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682614 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682617 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682619 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682622 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682625 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682628 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682631 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682633 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682636 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682639 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:21.683415 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682641 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682644 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682647 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682649 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682654 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682657 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682660 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682663 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682665 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682668 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682671 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682673 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682676 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682678 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682681 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682684 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682686 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682689 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682691 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682694 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:21.683925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682696 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682699 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682701 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682704 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682706 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682709 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682712 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682715 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682717 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682720 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682723 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682725 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682728 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682730 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682733 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682735 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682737 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682740 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682743 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682747 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:21.684412 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682750 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682753 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.682755 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683435 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683441 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683444 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683446 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683448 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683452 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683454 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683457 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683460 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683463 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683465 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683483 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683486 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683488 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683491 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683495 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:21.684906 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683499 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683503 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683507 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683510 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683513 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683516 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683518 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683521 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683525 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683528 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683532 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683534 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683537 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683541 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683544 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683547 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683551 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683554 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683557 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:21.685365 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683560 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683562 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683565 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683568 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683571 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683574 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683576 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683579 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683581 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683584 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683586 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683589 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683592 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683595 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683597 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683600 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683603 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683605 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683608 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683610 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:21.685870 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683613 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683615 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683618 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683621 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683623 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683625 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683629 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683632 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683634 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683637 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683639 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683642 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683644 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683646 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683649 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683651 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683655 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683657 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683660 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683662 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:21.686379 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683665 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683667 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683670 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683672 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683675 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683678 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683681 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683683 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683685 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683688 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683691 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683693 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683696 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683699 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683701 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683704 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683706 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683709 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683711 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:21.686886 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683714 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683717 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683720 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683722 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.683725 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684105 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684111 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684114 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684117 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684120 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684123 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684126 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684129 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684133 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684135 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684138 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684141 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684144 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684147 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684149 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:21.687350 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684152 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684156 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684159 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684162 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684165 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684168 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684171 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684174 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684177 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684181 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684183 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684186 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684189 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684192 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684195 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684197 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684200 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684203 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684206 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:21.687852 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684208 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684211 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684213 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684216 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684218 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684221 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684223 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684225 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684228 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684231 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684233 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684236 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684238 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684241 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684243 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684246 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684248 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684251 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684254 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684257 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684259 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:21.688323 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684262 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684264 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684267 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684269 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684272 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684274 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684277 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684279 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684281 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684284 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684286 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684289 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684291 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684294 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684296 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684300 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684304 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684306 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684309 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684312 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:21.688858 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684314 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684317 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684320 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684322 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684325 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684327 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684330 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684332 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684335 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684340 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684343 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684345 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684349 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684352 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684354 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684357 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684359 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684362 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684364 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:21.689381 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684366 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684369 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684372 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684374 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.684377 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684445 2564 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684452 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684457 2564 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684461 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684466 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684484 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684488 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684493 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684496 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684502 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684505 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684508 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684512 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684515 2564 flags.go:64] FLAG: --cgroup-root="" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684518 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684521 2564 flags.go:64] FLAG: --client-ca-file="" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684523 2564 flags.go:64] FLAG: --cloud-provider="external" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684528 2564 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 13:01:21.689866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684533 2564 flags.go:64] FLAG: --cluster-domain="" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684535 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684538 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684542 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684545 2564 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684549 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684551 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684554 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684557 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684561 2564 flags.go:64] FLAG: --contention-profiling="false" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684563 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684567 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684570 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684573 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684577 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684580 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684583 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684586 2564 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684588 2564 flags.go:64] FLAG: --enable-server="true" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684592 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684596 2564 flags.go:64] FLAG: --event-burst="100" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684599 2564 flags.go:64] FLAG: --event-qps="50" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684601 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684605 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 13:01:21.690525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684608 2564 flags.go:64] FLAG: --eviction-hard="" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684612 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684615 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684618 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684621 2564 flags.go:64] FLAG: --eviction-soft="" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684623 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684626 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684631 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684634 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684637 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684639 2564 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684642 2564 flags.go:64] FLAG: --feature-gates="" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684646 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684649 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684652 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684655 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684658 2564 flags.go:64] FLAG: --healthz-port="10248" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684661 2564 flags.go:64] FLAG: --help="false" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684664 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-129-96.ec2.internal" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684667 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684670 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684672 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684676 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 13:01:21.691160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684679 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684682 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684685 2564 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684687 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684691 2564 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684695 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684698 2564 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684701 2564 flags.go:64] FLAG: --kube-reserved="" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684706 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684708 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684712 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684714 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684717 2564 flags.go:64] FLAG: --lock-file="" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684720 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684723 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684726 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684732 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684735 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684738 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684741 2564 flags.go:64] FLAG: --logging-format="text" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684744 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684747 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684750 2564 flags.go:64] FLAG: --manifest-url="" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684753 2564 flags.go:64] FLAG: --manifest-url-header="" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684757 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 13:01:21.692177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684760 2564 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684764 2564 flags.go:64] FLAG: --max-pods="110" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684767 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684770 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684773 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684776 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684779 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684782 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684785 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684792 2564 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684795 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684798 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684801 2564 flags.go:64] FLAG: --pod-cidr="" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684804 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684809 2564 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684812 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684817 2564 flags.go:64] FLAG: --pods-per-core="0" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684819 2564 flags.go:64] FLAG: --port="10250" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684822 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684826 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00b3d4efef28c46e4" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684829 2564 flags.go:64] FLAG: --qos-reserved="" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684832 2564 flags.go:64] FLAG: --read-only-port="10255" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684835 2564 flags.go:64] FLAG: --register-node="true" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684839 2564 flags.go:64] FLAG: --register-with-taints="" Jun 08 13:01:21.693252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684842 2564 flags.go:64] FLAG: --registry-burst="10" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684845 2564 flags.go:64] FLAG: --registry-qps="5" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684848 2564 flags.go:64] FLAG: --reserved-cpus="" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684851 2564 flags.go:64] FLAG: --reserved-memory="" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684854 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684857 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684860 2564 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684863 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684865 2564 flags.go:64] FLAG: --runonce="false" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684868 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684871 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684874 2564 flags.go:64] FLAG: --seccomp-default="false" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684877 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684880 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684882 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684885 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684888 2564 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684891 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684894 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684897 2564 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684900 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684903 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684906 2564 flags.go:64] FLAG: --system-cgroups="" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684909 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684916 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 13:01:21.694387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684919 2564 flags.go:64] FLAG: --tls-cert-file="" Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684922 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684926 2564 flags.go:64] FLAG: --tls-min-version="" Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684929 2564 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684932 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684935 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684939 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684942 2564 flags.go:64] FLAG: --v="2" Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684951 2564 flags.go:64] FLAG: --version="false" Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684955 2564 flags.go:64] FLAG: --vmodule="" Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684958 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.684962 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685073 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685077 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685080 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685083 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685086 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685089 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685091 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685094 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685096 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685099 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685102 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:21.695203 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685104 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685107 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685109 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685112 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685114 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685117 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685119 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685122 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685127 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685130 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685132 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685135 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685138 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685140 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685143 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685146 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685149 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685152 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685154 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:21.696167 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685157 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685160 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685162 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685165 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685168 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685170 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685173 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685175 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685178 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685181 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685183 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685186 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685189 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685191 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685194 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685196 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685198 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685201 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685204 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685206 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:21.696834 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685209 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685213 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685216 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685218 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685221 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685223 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685226 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685228 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685232 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685234 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685237 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685239 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685242 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685244 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685247 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685251 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685254 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685257 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685259 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685262 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:21.697458 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685265 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685268 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685271 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685273 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685277 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685281 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685283 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685286 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685289 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685291 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685294 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685297 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685300 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685305 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685309 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685312 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685315 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685317 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685320 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:21.697997 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685322 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:21.698544 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685329 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:21.698544 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685331 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:21.698544 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685334 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:21.698544 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685336 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:21.698544 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685339 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:21.698544 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685341 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:21.698544 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685344 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:21.698544 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685347 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:21.698544 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.685349 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:21.698544 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.685847 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:01:21.698544 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.693236 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 13:01:21.698544 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.693253 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 13:01:21.698544 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.693270 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 13:01:21.698544 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.693278 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 13:01:21.698544 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693360 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693368 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693372 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693378 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693382 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693387 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693392 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693396 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693400 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693404 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693409 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693414 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693419 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693424 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693429 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693433 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693438 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693442 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693446 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693450 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:21.698931 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693457 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693462 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693466 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693489 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693493 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693497 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693501 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693506 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693510 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693516 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693520 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693525 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693530 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693535 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693540 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693544 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693548 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693555 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693561 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:21.699452 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693566 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693570 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693575 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693579 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693583 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693587 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693593 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693597 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693602 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693606 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693610 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693614 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693618 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693622 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693627 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693632 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693636 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693640 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693644 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693649 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:21.699961 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693653 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693657 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693661 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693666 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693670 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693674 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693679 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693683 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693687 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693692 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693696 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693700 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693704 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693708 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693713 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693717 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693722 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693726 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693730 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693735 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:21.700626 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693739 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693746 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693751 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693756 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693760 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693764 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693769 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693774 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693778 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693783 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693787 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693791 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693796 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693799 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693803 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693808 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693812 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693817 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693821 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:21.701508 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.693825 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:21.702170 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.693833 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:01:21.702170 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694008 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:21.702170 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694015 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:21.702170 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694020 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:21.702170 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694024 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:21.702170 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694029 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:21.702170 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694034 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:21.702170 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694039 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:21.702170 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694043 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:21.702170 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694047 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:21.702170 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694051 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:21.702170 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694055 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:21.702170 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694060 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:21.702170 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694065 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694071 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694077 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694082 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694087 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694091 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694096 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694100 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694105 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694109 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694113 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694117 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694121 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694127 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694133 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694137 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694142 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694146 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694151 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:21.702764 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694155 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694160 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694164 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694168 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694172 2564 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694176 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694180 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694184 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694189 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694193 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694197 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694201 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694205 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694210 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694214 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694218 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694222 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694227 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694232 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694236 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694240 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:21.703546 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694244 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694248 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694252 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694256 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694261 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694265 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694269 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694273 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694277 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694291 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694296 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694300 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694304 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694308 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694312 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694316 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694320 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694324 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694328 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:21.704344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694333 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694337 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694341 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694345 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694349 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694353 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694358 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694363 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694367 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694371 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694375 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694379 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694383 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694387 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694391 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694394 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694398 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694403 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694407 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694417 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:21.705070 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694422 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:21.705579 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694427 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:21.705579 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694431 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:21.705579 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694435 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:21.705579 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694440 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:21.705579 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694444 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:21.705579 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694448 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:21.705579 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:21.694452 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:21.705579 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.694460 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:01:21.705579 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.694616 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 13:01:21.705579 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.697144 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 13:01:21.705579 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.698444 2564 server.go:1019] "Starting client certificate rotation" Jun 08 13:01:21.705579 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.698501 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 13:01:21.705579 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.698533 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 13:01:21.705579 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.700946 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 13:01:21.705926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.704231 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 13:01:21.716330 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.716313 2564 log.go:25] "Validated CRI v1 runtime API" Jun 08 13:01:21.718686 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.718672 2564 log.go:25] "Validated CRI v1 image API" Jun 08 13:01:21.719392 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.719370 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 13:01:21.722169 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.722151 2564 fs.go:135] Filesystem UUIDs: map[73b4359e-de44-4f34-92e8-97402c37bf9d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 808ab713-ce51-4f53-944a-923bd6377601:/dev/nvme0n1p4] Jun 08 13:01:21.722226 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.722168 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 13:01:21.726930 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.726823 2564 manager.go:216] Machine: {Timestamp:2026-06-08 13:01:21.725797817 +0000 UTC m=+0.294206889 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3075184 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e74c0b6e305c419d6ca9f8e6bcc59 SystemUUID:ec2e74c0-b6e3-05c4-19d6-ca9f8e6bcc59 BootID:0adad524-0310-4f98-bd78-eef577177979 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6f:c7:a1:e5:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6f:c7:a1:e5:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:e1:45:84:a9:23 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 13:01:21.726930 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.726923 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 13:01:21.727039 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.727026 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 13:01:21.729514 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.729489 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 13:01:21.729644 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.729516 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-96.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 13:01:21.730784 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.730764 2564 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 13:01:21.730784 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.730786 2564 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 13:01:21.730857 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.730793 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 13:01:21.731398 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.731388 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 13:01:21.732354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.732344 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 13:01:21.735057 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.735045 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 08 13:01:21.735176 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.735167 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 13:01:21.735212 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.735197 2564 kubelet.go:486] "Attempting to sync node with API server" Jun 08 13:01:21.735212 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.735208 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 13:01:21.735265 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.735222 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 13:01:21.735265 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.735231 2564 kubelet.go:398] "Adding apiserver pod source" Jun 08 13:01:21.735265 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.735241 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 13:01:21.735635 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.735622 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 13:01:21.735686 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.735645 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 13:01:21.736337 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.736318 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 13:01:21.737605 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.737591 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 13:01:21.739380 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.739367 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 13:01:21.739428 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.739397 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 13:01:21.740065 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.740054 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 13:01:21.740105 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.740070 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 13:01:21.740105 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.740080 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 13:01:21.740105 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.740088 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 13:01:21.740105 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.740099 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 13:01:21.740203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.740107 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 13:01:21.740203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.740119 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 13:01:21.740203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.740124 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 13:01:21.740203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.740130 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 13:01:21.740203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.740135 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 13:01:21.740203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.740149 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 13:01:21.740203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.740156 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 13:01:21.740892 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.740882 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 13:01:21.740892 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.740891 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 13:01:21.744204 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.744190 2564 server.go:1268] "Started kubelet" Jun 08 13:01:21.744309 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.744283 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 13:01:21.744737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.744672 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 13:01:21.744737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.744732 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 13:01:21.745135 ip-10-0-129-96 systemd[1]: Started Kubernetes Kubelet. Jun 08 13:01:21.747700 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.747545 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 13:01:21.747947 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.747865 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 13:01:21.748033 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.748001 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 13:01:21.748097 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.748057 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-96.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 13:01:21.749023 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.748633 2564 server.go:310] "Adding debug handlers to kubelet server" Jun 08 13:01:21.752321 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.752297 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 13:01:21.754004 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.753187 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-96.ec2.internal.18b71ca71e7132ea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-96.ec2.internal,UID:ip-10-0-129-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-96.ec2.internal,},FirstTimestamp:2026-06-08 13:01:21.744171754 +0000 UTC m=+0.312580825,LastTimestamp:2026-06-08 13:01:21.744171754 +0000 UTC m=+0.312580825,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-96.ec2.internal,}" Jun 08 13:01:21.755263 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.755242 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 13:01:21.755351 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.755251 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 13:01:21.755407 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.755372 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-96.ec2.internal\" not found" Jun 08 13:01:21.755815 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.755792 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 13:01:21.755938 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.755794 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 13:01:21.756036 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.756026 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 13:01:21.756164 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.756148 2564 reconstruct.go:97] "Volume reconstruction finished" Jun 08 13:01:21.756321 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.756301 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 13:01:21.756321 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.756321 2564 factory.go:55] Registering systemd factory Jun 08 13:01:21.756494 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.756330 2564 factory.go:223] Registration of the systemd container factory successfully Jun 08 13:01:21.756494 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.756172 2564 reconciler.go:29] "Reconciler: start to sync state" Jun 08 13:01:21.756592 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.756560 2564 factory.go:153] Registering CRI-O factory Jun 08 13:01:21.756592 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.756575 2564 factory.go:223] Registration of the crio container factory successfully Jun 08 13:01:21.756592 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.756593 2564 factory.go:103] Registering Raw factory Jun 08 13:01:21.756711 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.756604 2564 manager.go:1196] Started watching for new ooms in manager Jun 08 13:01:21.756930 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.756917 2564 manager.go:349] Starting recovery of all containers Jun 08 13:01:21.757775 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.757753 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 13:01:21.758035 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.758013 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 13:01:21.767339 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.767324 2564 manager.go:354] Recovery completed Jun 08 13:01:21.771304 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.771292 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:21.774043 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.774028 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:21.774104 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.774061 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:21.774104 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.774074 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:21.774636 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.774618 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 13:01:21.774636 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.774636 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 13:01:21.774779 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.774656 2564 state_mem.go:36] "Initialized new in-memory state store" Jun 08 13:01:21.774779 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.774621 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:21.776043 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.776031 2564 policy_none.go:49] "None policy: Start" Jun 08 13:01:21.776094 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.776048 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 13:01:21.776094 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.776060 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 13:01:21.776775 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.776755 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:21.776846 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.776793 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:21.776846 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.776810 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:21.777049 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.777038 2564 policy_none.go:47] "Start" Jun 08 13:01:21.789153 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.789088 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-96.ec2.internal.18b71ca72038ff80 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-96.ec2.internal,UID:ip-10-0-129-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-96.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-96.ec2.internal,},FirstTimestamp:2026-06-08 13:01:21.774043008 +0000 UTC m=+0.342452080,LastTimestamp:2026-06-08 13:01:21.774043008 +0000 UTC m=+0.342452080,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-96.ec2.internal,}" Jun 08 13:01:21.796880 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.796860 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnsbc" Jun 08 13:01:21.799483 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.799390 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-96.ec2.internal.18b71ca720395f2b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-96.ec2.internal,UID:ip-10-0-129-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-96.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-96.ec2.internal,},FirstTimestamp:2026-06-08 13:01:21.774067499 +0000 UTC m=+0.342476780,LastTimestamp:2026-06-08 13:01:21.774067499 +0000 UTC m=+0.342476780,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-96.ec2.internal,}" Jun 08 13:01:21.809060 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.809038 2564 manager.go:337] "Starting Device Plugin manager" Jun 08 13:01:21.816031 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.809073 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 13:01:21.816031 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.809082 2564 server.go:87] "Starting device plugin registration server" Jun 08 13:01:21.816031 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.809249 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cnsbc" Jun 08 13:01:21.816031 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.809306 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 13:01:21.816031 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.809318 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 13:01:21.816031 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.809390 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 13:01:21.816031 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.809464 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 13:01:21.816031 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.809497 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 13:01:21.816031 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.809865 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-96.ec2.internal.18b71ca720398852 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-96.ec2.internal,UID:ip-10-0-129-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-96.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-96.ec2.internal,},FirstTimestamp:2026-06-08 13:01:21.774078034 +0000 UTC m=+0.342487106,LastTimestamp:2026-06-08 13:01:21.774078034 +0000 UTC m=+0.342487106,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-96.ec2.internal,}" Jun 08 13:01:21.816031 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.810049 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 13:01:21.816031 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.810099 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-96.ec2.internal\" not found" Jun 08 13:01:21.816463 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.816442 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 13:01:21.817576 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.817562 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 13:01:21.817636 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.817600 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 13:01:21.817636 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.817617 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 13:01:21.817698 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.817650 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 13:01:21.819594 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.819576 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:01:21.909689 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.909670 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:21.910463 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.910447 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:21.910559 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.910487 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:21.910559 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.910498 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:21.910559 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.910519 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-96.ec2.internal" Jun 08 13:01:21.917797 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.917782 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-96.ec2.internal"] Jun 08 13:01:21.917845 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.917839 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:21.918532 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.918517 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-96.ec2.internal" Jun 08 13:01:21.918599 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.918534 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-96.ec2.internal\": node \"ip-10-0-129-96.ec2.internal\" not found" Jun 08 13:01:21.918998 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.918985 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:21.919063 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.919010 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:21.919063 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.919019 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:21.920053 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.920041 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:21.920154 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.920140 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal" Jun 08 13:01:21.920205 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.920167 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:21.920720 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.920704 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:21.920792 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.920708 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:21.920792 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.920732 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:21.920792 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.920743 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:21.920792 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.920752 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:21.920792 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.920764 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:21.921677 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.921665 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-96.ec2.internal" Jun 08 13:01:21.921731 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.921687 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:21.922324 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.922308 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:21.922398 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.922331 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:21.922398 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.922344 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:21.939620 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.939579 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-96.ec2.internal\" not found" Jun 08 13:01:21.956091 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.956076 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-96.ec2.internal\" not found" node="ip-10-0-129-96.ec2.internal" Jun 08 13:01:21.958080 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.958039 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a527134d158f127d20cef615b894ecd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal\" (UID: \"8a527134d158f127d20cef615b894ecd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal" Jun 08 13:01:21.958159 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.958076 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a527134d158f127d20cef615b894ecd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal\" (UID: \"8a527134d158f127d20cef615b894ecd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal" Jun 08 13:01:21.958159 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:21.958114 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ca2e778a4908d259d8d0253f0a8ed1a-config\") pod \"kube-apiserver-proxy-ip-10-0-129-96.ec2.internal\" (UID: \"2ca2e778a4908d259d8d0253f0a8ed1a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-96.ec2.internal" Jun 08 13:01:21.960458 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:21.960439 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-96.ec2.internal\" not found" node="ip-10-0-129-96.ec2.internal" Jun 08 13:01:22.040552 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:22.040522 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-96.ec2.internal\" not found" Jun 08 13:01:22.058335 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.058315 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a527134d158f127d20cef615b894ecd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal\" (UID: \"8a527134d158f127d20cef615b894ecd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal" Jun 08 13:01:22.058444 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.058343 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a527134d158f127d20cef615b894ecd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal\" (UID: \"8a527134d158f127d20cef615b894ecd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal" Jun 08 13:01:22.058444 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.058362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ca2e778a4908d259d8d0253f0a8ed1a-config\") pod \"kube-apiserver-proxy-ip-10-0-129-96.ec2.internal\" (UID: \"2ca2e778a4908d259d8d0253f0a8ed1a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-96.ec2.internal" Jun 08 13:01:22.058444 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.058400 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ca2e778a4908d259d8d0253f0a8ed1a-config\") pod \"kube-apiserver-proxy-ip-10-0-129-96.ec2.internal\" (UID: \"2ca2e778a4908d259d8d0253f0a8ed1a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-96.ec2.internal" Jun 08 13:01:22.058444 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.058426 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a527134d158f127d20cef615b894ecd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal\" (UID: \"8a527134d158f127d20cef615b894ecd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal" Jun 08 13:01:22.058612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.058451 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a527134d158f127d20cef615b894ecd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal\" (UID: \"8a527134d158f127d20cef615b894ecd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal" Jun 08 13:01:22.141597 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:22.141569 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-96.ec2.internal\" not found" Jun 08 13:01:22.241818 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:22.241756 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-96.ec2.internal\" not found" Jun 08 13:01:22.260110 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.260080 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal" Jun 08 13:01:22.264513 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.264490 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-96.ec2.internal" Jun 08 13:01:22.342258 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:22.342226 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-96.ec2.internal\" not found" Jun 08 13:01:22.442694 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:22.442667 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-96.ec2.internal\" not found" Jun 08 13:01:22.543217 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:22.543165 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-96.ec2.internal\" not found" Jun 08 13:01:22.643792 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:22.643762 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-96.ec2.internal\" not found" Jun 08 13:01:22.698271 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.698248 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 13:01:22.698901 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.698419 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 13:01:22.731834 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.731810 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:01:22.743849 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:22.743819 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-96.ec2.internal\" not found" Jun 08 13:01:22.811839 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.811808 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 12:56:21 +0000 UTC" deadline="2027-12-28 16:38:41.975941681 +0000 UTC" Jun 08 13:01:22.811839 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.811837 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13635h37m19.16410755s" Jun 08 13:01:22.814428 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:22.814401 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca2e778a4908d259d8d0253f0a8ed1a.slice/crio-d1ac528e36accffdccb22d250cc80ff77f3be90de9ae06b8670844568c6efc86 WatchSource:0}: Error finding container d1ac528e36accffdccb22d250cc80ff77f3be90de9ae06b8670844568c6efc86: Status 404 returned error can't find the container with id d1ac528e36accffdccb22d250cc80ff77f3be90de9ae06b8670844568c6efc86 Jun 08 13:01:22.814658 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:22.814645 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a527134d158f127d20cef615b894ecd.slice/crio-80901896ef4f1c14d3bbfd3ebf9a44a6c033766bf33ffb6d727796a93d675da7 WatchSource:0}: Error finding container 80901896ef4f1c14d3bbfd3ebf9a44a6c033766bf33ffb6d727796a93d675da7: Status 404 returned error can't find the container with id 80901896ef4f1c14d3bbfd3ebf9a44a6c033766bf33ffb6d727796a93d675da7 Jun 08 13:01:22.818671 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.818657 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:01:22.820742 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.820681 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal" event={"ID":"8a527134d158f127d20cef615b894ecd","Type":"ContainerStarted","Data":"80901896ef4f1c14d3bbfd3ebf9a44a6c033766bf33ffb6d727796a93d675da7"} Jun 08 13:01:22.821981 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.821960 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-96.ec2.internal" event={"ID":"2ca2e778a4908d259d8d0253f0a8ed1a","Type":"ContainerStarted","Data":"d1ac528e36accffdccb22d250cc80ff77f3be90de9ae06b8670844568c6efc86"} Jun 08 13:01:22.829971 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.829952 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:01:22.844452 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:22.844435 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-96.ec2.internal\" not found" Jun 08 13:01:22.944959 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:22.944928 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-96.ec2.internal\" not found" Jun 08 13:01:22.957162 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.957138 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:22.960101 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.960085 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:22.960196 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.960121 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:22.960196 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:22.960135 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:23.045177 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:23.045158 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-96.ec2.internal\" not found" Jun 08 13:01:23.145694 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:23.145619 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-96.ec2.internal\" not found" Jun 08 13:01:23.203057 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.203009 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:01:23.256254 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.256221 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal" Jun 08 13:01:23.269336 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.269313 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 13:01:23.270595 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.270574 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-96.ec2.internal" Jun 08 13:01:23.279266 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.279233 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 13:01:23.521046 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.520972 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:01:23.736048 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.736014 2564 apiserver.go:52] "Watching apiserver" Jun 08 13:01:23.747682 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.747652 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 13:01:23.748947 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.748915 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-bjxm8","openshift-multus/multus-additional-cni-plugins-cjnpd","openshift-multus/network-metrics-daemon-jh77v","openshift-network-diagnostics/network-check-target-78dp6","openshift-network-operator/iptables-alerter-hfzks","openshift-ovn-kubernetes/ovnkube-node-2jgr6","kube-system/global-pull-secret-syncer-4s2t4","kube-system/kube-apiserver-proxy-ip-10-0-129-96.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg","openshift-cluster-node-tuning-operator/tuned-7rp4z","openshift-dns/node-resolver-pkk6k","openshift-image-registry/node-ca-qffqs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal","openshift-multus/multus-8h6z8"] Jun 08 13:01:23.751598 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.751571 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.753692 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.753671 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.755121 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.755100 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 13:01:23.755216 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.755172 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9x4f6\"" Jun 08 13:01:23.755557 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.755541 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:01:23.755850 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.755834 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.756495 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.756464 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 13:01:23.757952 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.757898 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:23.758038 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:23.757966 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:23.758657 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.758633 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-99px5\"" Jun 08 13:01:23.758758 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.758656 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 13:01:23.758758 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.758634 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 13:01:23.759141 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.758943 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 13:01:23.759141 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.758971 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 13:01:23.759795 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.759712 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 13:01:23.759795 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.759750 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jbmvx\"" Jun 08 13:01:23.759912 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.759806 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 13:01:23.761097 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.761079 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hfzks" Jun 08 13:01:23.763242 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.763212 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qffqs" Jun 08 13:01:23.763335 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.763263 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 13:01:23.763739 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.763718 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 13:01:23.763739 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.763738 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:01:23.763896 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.763788 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-497wg\"" Jun 08 13:01:23.765592 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.765460 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pkk6k" Jun 08 13:01:23.765592 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.765506 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 13:01:23.765921 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.765848 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 13:01:23.766145 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.766114 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-czqpr\"" Jun 08 13:01:23.766251 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.766145 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 13:01:23.768128 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.767851 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 13:01:23.768128 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.767981 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nfl2d\"" Jun 08 13:01:23.768128 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.768047 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 13:01:23.768297 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.768240 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.768378 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.768357 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 13:01:23.769012 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.768979 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-hostroot\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.769113 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769037 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2eff2662-ab9b-4b82-9015-cf14f65fffb0-multus-daemon-config\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.769113 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769069 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-kubernetes\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.769113 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-sys\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.769266 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-var-lib-kubelet\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.769266 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769165 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/453df3f1-2f91-4834-a7fd-db011cba44d9-cnibin\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.769266 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769198 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/453df3f1-2f91-4834-a7fd-db011cba44d9-os-release\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.769266 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769225 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2eff2662-ab9b-4b82-9015-cf14f65fffb0-cni-binary-copy\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.769266 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769248 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-etc-kubernetes\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.769446 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-run\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.769446 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769302 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf246719-4d56-405e-9a7d-0a7e819c868a-tmp\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.769446 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769345 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-os-release\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.769446 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769370 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-multus-socket-dir-parent\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.769446 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769398 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9slf\" (UniqueName: \"kubernetes.io/projected/2eff2662-ab9b-4b82-9015-cf14f65fffb0-kube-api-access-g9slf\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.769446 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktwbc\" (UniqueName: \"kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc\") pod \"network-check-target-78dp6\" (UID: \"0a7ffd62-b58c-4993-ac03-0ec92420ea42\") " pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:23.769694 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769447 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-sysconfig\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.769694 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769467 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-host\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.769694 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769507 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm25q\" (UniqueName: \"kubernetes.io/projected/453df3f1-2f91-4834-a7fd-db011cba44d9-kube-api-access-hm25q\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.769694 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769564 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-run-multus-certs\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.769694 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769595 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-sysctl-d\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.769694 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-systemd\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.769694 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769642 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-var-lib-cni-multus\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.769694 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/453df3f1-2f91-4834-a7fd-db011cba44d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.770042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769719 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-system-cni-dir\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.770042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769739 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-cnibin\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.770042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-modprobe-d\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.770042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769802 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/453df3f1-2f91-4834-a7fd-db011cba44d9-system-cni-dir\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.770042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769820 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/453df3f1-2f91-4834-a7fd-db011cba44d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.770042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-multus-conf-dir\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.770042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769883 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-multus-cni-dir\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.770042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769900 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-sysctl-conf\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.770042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-tuned\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.770042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769971 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk4nq\" (UniqueName: \"kubernetes.io/projected/bf246719-4d56-405e-9a7d-0a7e819c868a-kube-api-access-kk4nq\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.770042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.769995 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/453df3f1-2f91-4834-a7fd-db011cba44d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.770042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.770014 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bjxm8" Jun 08 13:01:23.770042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.770022 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/453df3f1-2f91-4834-a7fd-db011cba44d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.770546 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.770046 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-run-k8s-cni-cncf-io\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.770546 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.770075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-run-netns\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.770546 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.770100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-lib-modules\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.770546 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.770121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-var-lib-cni-bin\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.770546 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.770166 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-var-lib-kubelet\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.770546 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.770434 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 13:01:23.770546 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.770436 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 13:01:23.771213 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.771170 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jjcmf\"" Jun 08 13:01:23.771213 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.771175 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 13:01:23.772140 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.772125 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 13:01:23.772259 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.772241 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gkrht\"" Jun 08 13:01:23.772361 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.772348 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 13:01:23.772503 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.772485 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:23.772573 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:23.772546 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:23.774732 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.774713 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.776997 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.776972 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:23.777089 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:23.777040 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:23.777820 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.777793 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 13:01:23.777953 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.777933 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 13:01:23.778042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.778027 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 13:01:23.778632 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.778384 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 13:01:23.778632 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.778422 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 13:01:23.778963 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.778865 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9fhl7\"" Jun 08 13:01:23.779362 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.779343 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 13:01:23.797550 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.797531 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zl449" Jun 08 13:01:23.809493 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.809459 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zl449" Jun 08 13:01:23.857416 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.857384 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 13:01:23.870784 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.870751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs\") pod \"network-metrics-daemon-jh77v\" (UID: \"0b82f214-ed29-4b52-8974-b1f8e4fd9a14\") " pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:23.870784 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.870792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b4d19e3-e415-4cd0-90f3-076ab16ff1dc-host\") pod \"node-ca-qffqs\" (UID: \"5b4d19e3-e415-4cd0-90f3-076ab16ff1dc\") " pod="openshift-image-registry/node-ca-qffqs" Jun 08 13:01:23.871010 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.870815 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-run\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.871010 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.870868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-run-multus-certs\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.871010 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.870919 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-run-ovn\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.871010 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.870940 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-run\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.871010 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.870947 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/363cc718-04aa-4180-a333-0efaaac5dd5d-ovnkube-config\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.871010 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.870987 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe818a7a-77d6-48bb-9efd-3639c7f8df67-host-slash\") pod \"iptables-alerter-hfzks\" (UID: \"fe818a7a-77d6-48bb-9efd-3639c7f8df67\") " pod="openshift-network-operator/iptables-alerter-hfzks" Jun 08 13:01:23.871260 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871017 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-run-multus-certs\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.871260 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871151 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-sysctl-d\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.871260 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871181 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-var-lib-cni-multus\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.871260 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871215 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b4d19e3-e415-4cd0-90f3-076ab16ff1dc-serviceca\") pod \"node-ca-qffqs\" (UID: \"5b4d19e3-e415-4cd0-90f3-076ab16ff1dc\") " pod="openshift-image-registry/node-ca-qffqs" Jun 08 13:01:23.871260 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-run-systemd\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.871654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871259 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/363cc718-04aa-4180-a333-0efaaac5dd5d-ovnkube-script-lib\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.871654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871283 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be941842-dde4-47f6-9308-75450cdd10b6-hosts-file\") pod \"node-resolver-pkk6k\" (UID: \"be941842-dde4-47f6-9308-75450cdd10b6\") " pod="openshift-dns/node-resolver-pkk6k" Jun 08 13:01:23.871654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871302 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-socket-dir\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.871654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871316 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-sysctl-d\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.871654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871322 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mkcf\" (UniqueName: \"kubernetes.io/projected/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-kube-api-access-9mkcf\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.871654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871323 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-var-lib-cni-multus\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.871654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-system-cni-dir\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.871654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871388 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-cnibin\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.871654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871455 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-modprobe-d\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.871654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/453df3f1-2f91-4834-a7fd-db011cba44d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.871654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871536 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-system-cni-dir\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.871654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871573 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-kubelet\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.871654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871594 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-run-openvswitch\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.871654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-log-socket\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.871654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871636 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-cnibin\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.871654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871659 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fe818a7a-77d6-48bb-9efd-3639c7f8df67-iptables-alerter-script\") pod \"iptables-alerter-hfzks\" (UID: \"fe818a7a-77d6-48bb-9efd-3639c7f8df67\") " pod="openshift-network-operator/iptables-alerter-hfzks" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871682 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-run-netns\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871714 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-multus-cni-dir\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871727 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-modprobe-d\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-sysctl-conf\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871771 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/453df3f1-2f91-4834-a7fd-db011cba44d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871815 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-run-k8s-cni-cncf-io\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871839 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-cni-netd\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871859 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-sysctl-conf\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871864 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c-konnectivity-ca\") pod \"konnectivity-agent-bjxm8\" (UID: \"b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c\") " pod="kube-system/konnectivity-agent-bjxm8" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871896 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-run-k8s-cni-cncf-io\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871923 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-multus-cni-dir\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.871982 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-var-lib-cni-bin\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872141 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-cni-bin\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872094 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-var-lib-cni-bin\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872215 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872241 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/453df3f1-2f91-4834-a7fd-db011cba44d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.872354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2eff2662-ab9b-4b82-9015-cf14f65fffb0-multus-daemon-config\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872316 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-systemd-units\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872335 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/363cc718-04aa-4180-a333-0efaaac5dd5d-env-overrides\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872359 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckvrq\" (UniqueName: \"kubernetes.io/projected/be941842-dde4-47f6-9308-75450cdd10b6-kube-api-access-ckvrq\") pod \"node-resolver-pkk6k\" (UID: \"be941842-dde4-47f6-9308-75450cdd10b6\") " pod="openshift-dns/node-resolver-pkk6k" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872385 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-sys-fs\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-sys\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872423 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2eff2662-ab9b-4b82-9015-cf14f65fffb0-cni-binary-copy\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-etc-kubernetes\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872467 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktwbc\" (UniqueName: \"kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc\") pod \"network-check-target-78dp6\" (UID: \"0a7ffd62-b58c-4993-ac03-0ec92420ea42\") " pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872504 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-sys\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872516 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c-agent-certs\") pod \"konnectivity-agent-bjxm8\" (UID: \"b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c\") " pod="kube-system/konnectivity-agent-bjxm8" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872537 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-etc-kubernetes\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf246719-4d56-405e-9a7d-0a7e819c868a-tmp\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872581 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-os-release\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-multus-socket-dir-parent\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-sysconfig\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-host\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.873152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872679 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm25q\" (UniqueName: \"kubernetes.io/projected/453df3f1-2f91-4834-a7fd-db011cba44d9-kube-api-access-hm25q\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-etc-openvswitch\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872727 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/363cc718-04aa-4180-a333-0efaaac5dd5d-ovn-node-metrics-cert\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-systemd\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872780 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-sysconfig\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872794 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872825 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjjpg\" (UniqueName: \"kubernetes.io/projected/363cc718-04aa-4180-a333-0efaaac5dd5d-kube-api-access-wjjpg\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872843 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-os-release\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872851 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-device-dir\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872855 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2eff2662-ab9b-4b82-9015-cf14f65fffb0-multus-daemon-config\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872875 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-slash\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872855 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872872 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-multus-socket-dir-parent\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.872894 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2eff2662-ab9b-4b82-9015-cf14f65fffb0-cni-binary-copy\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873010 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/453df3f1-2f91-4834-a7fd-db011cba44d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/453df3f1-2f91-4834-a7fd-db011cba44d9-system-cni-dir\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873058 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-systemd\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.873926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-multus-conf-dir\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873085 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/453df3f1-2f91-4834-a7fd-db011cba44d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873100 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-host\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873102 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-var-lib-openvswitch\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873128 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw845\" (UniqueName: \"kubernetes.io/projected/fe818a7a-77d6-48bb-9efd-3639c7f8df67-kube-api-access-rw845\") pod \"iptables-alerter-hfzks\" (UID: \"fe818a7a-77d6-48bb-9efd-3639c7f8df67\") " pod="openshift-network-operator/iptables-alerter-hfzks" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873175 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-multus-conf-dir\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-tuned\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873220 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/453df3f1-2f91-4834-a7fd-db011cba44d9-system-cni-dir\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873254 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk4nq\" (UniqueName: \"kubernetes.io/projected/bf246719-4d56-405e-9a7d-0a7e819c868a-kube-api-access-kk4nq\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873296 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/453df3f1-2f91-4834-a7fd-db011cba44d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873370 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-run-netns\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873459 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/453df3f1-2f91-4834-a7fd-db011cba44d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873499 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873521 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-run-netns\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873550 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/453df3f1-2f91-4834-a7fd-db011cba44d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873565 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be941842-dde4-47f6-9308-75450cdd10b6-tmp-dir\") pod \"node-resolver-pkk6k\" (UID: \"be941842-dde4-47f6-9308-75450cdd10b6\") " pod="openshift-dns/node-resolver-pkk6k" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873614 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-registration-dir\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.874737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873644 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-etc-selinux\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873671 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-lib-modules\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873694 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-var-lib-kubelet\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873718 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/65844758-3d62-45e6-93a7-44543a222e80-kubelet-config\") pod \"global-pull-secret-syncer-4s2t4\" (UID: \"65844758-3d62-45e6-93a7-44543a222e80\") " pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873735 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-node-log\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873753 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-hostroot\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873770 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-lib-modules\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873797 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg6rt\" (UniqueName: \"kubernetes.io/projected/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-kube-api-access-mg6rt\") pod \"network-metrics-daemon-jh77v\" (UID: \"0b82f214-ed29-4b52-8974-b1f8e4fd9a14\") " pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873823 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-host-var-lib-kubelet\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873828 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2eff2662-ab9b-4b82-9015-cf14f65fffb0-hostroot\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873842 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sm9x\" (UniqueName: \"kubernetes.io/projected/5b4d19e3-e415-4cd0-90f3-076ab16ff1dc-kube-api-access-7sm9x\") pod \"node-ca-qffqs\" (UID: \"5b4d19e3-e415-4cd0-90f3-076ab16ff1dc\") " pod="openshift-image-registry/node-ca-qffqs" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873864 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/65844758-3d62-45e6-93a7-44543a222e80-dbus\") pod \"global-pull-secret-syncer-4s2t4\" (UID: \"65844758-3d62-45e6-93a7-44543a222e80\") " pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873887 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret\") pod \"global-pull-secret-syncer-4s2t4\" (UID: \"65844758-3d62-45e6-93a7-44543a222e80\") " pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873915 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-kubernetes\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873954 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-var-lib-kubelet\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873974 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/453df3f1-2f91-4834-a7fd-db011cba44d9-cnibin\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873986 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-kubernetes\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.875510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.873990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/453df3f1-2f91-4834-a7fd-db011cba44d9-os-release\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.876232 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.874023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9slf\" (UniqueName: \"kubernetes.io/projected/2eff2662-ab9b-4b82-9015-cf14f65fffb0-kube-api-access-g9slf\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.876232 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.874033 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf246719-4d56-405e-9a7d-0a7e819c868a-var-lib-kubelet\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.876232 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.874043 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/453df3f1-2f91-4834-a7fd-db011cba44d9-os-release\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.876232 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.874108 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/453df3f1-2f91-4834-a7fd-db011cba44d9-cnibin\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.876232 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.876092 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf246719-4d56-405e-9a7d-0a7e819c868a-etc-tuned\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.876232 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.876149 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf246719-4d56-405e-9a7d-0a7e819c868a-tmp\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.882751 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:23.882732 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:23.882751 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:23.882755 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:23.882881 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:23.882764 2564 projected.go:196] Error preparing data for projected volume kube-api-access-ktwbc for pod openshift-network-diagnostics/network-check-target-78dp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:23.882881 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:23.882821 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc podName:0a7ffd62-b58c-4993-ac03-0ec92420ea42 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:24.382806266 +0000 UTC m=+2.951215326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ktwbc" (UniqueName: "kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc") pod "network-check-target-78dp6" (UID: "0a7ffd62-b58c-4993-ac03-0ec92420ea42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:23.887102 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.887076 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9slf\" (UniqueName: \"kubernetes.io/projected/2eff2662-ab9b-4b82-9015-cf14f65fffb0-kube-api-access-g9slf\") pod \"multus-8h6z8\" (UID: \"2eff2662-ab9b-4b82-9015-cf14f65fffb0\") " pod="openshift-multus/multus-8h6z8" Jun 08 13:01:23.887546 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.887522 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm25q\" (UniqueName: \"kubernetes.io/projected/453df3f1-2f91-4834-a7fd-db011cba44d9-kube-api-access-hm25q\") pod \"multus-additional-cni-plugins-cjnpd\" (UID: \"453df3f1-2f91-4834-a7fd-db011cba44d9\") " pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:23.887666 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.887524 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk4nq\" (UniqueName: \"kubernetes.io/projected/bf246719-4d56-405e-9a7d-0a7e819c868a-kube-api-access-kk4nq\") pod \"tuned-7rp4z\" (UID: \"bf246719-4d56-405e-9a7d-0a7e819c868a\") " pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:23.974827 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.974797 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c-agent-certs\") pod \"konnectivity-agent-bjxm8\" (UID: \"b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c\") " pod="kube-system/konnectivity-agent-bjxm8" Jun 08 13:01:23.974827 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.974831 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-etc-openvswitch\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.975054 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.974847 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/363cc718-04aa-4180-a333-0efaaac5dd5d-ovn-node-metrics-cert\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.975054 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.974991 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.975054 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975031 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjjpg\" (UniqueName: \"kubernetes.io/projected/363cc718-04aa-4180-a333-0efaaac5dd5d-kube-api-access-wjjpg\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.975209 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-device-dir\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.975209 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-slash\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.975209 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975085 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.975209 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975114 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-var-lib-openvswitch\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.975209 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975140 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw845\" (UniqueName: \"kubernetes.io/projected/fe818a7a-77d6-48bb-9efd-3639c7f8df67-kube-api-access-rw845\") pod \"iptables-alerter-hfzks\" (UID: \"fe818a7a-77d6-48bb-9efd-3639c7f8df67\") " pod="openshift-network-operator/iptables-alerter-hfzks" Jun 08 13:01:23.975209 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975165 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-device-dir\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.975209 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975173 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.975209 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be941842-dde4-47f6-9308-75450cdd10b6-tmp-dir\") pod \"node-resolver-pkk6k\" (UID: \"be941842-dde4-47f6-9308-75450cdd10b6\") " pod="openshift-dns/node-resolver-pkk6k" Jun 08 13:01:23.975612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-registration-dir\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.975612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-etc-selinux\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.975612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975271 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/65844758-3d62-45e6-93a7-44543a222e80-kubelet-config\") pod \"global-pull-secret-syncer-4s2t4\" (UID: \"65844758-3d62-45e6-93a7-44543a222e80\") " pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:23.975612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-node-log\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.975612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6rt\" (UniqueName: \"kubernetes.io/projected/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-kube-api-access-mg6rt\") pod \"network-metrics-daemon-jh77v\" (UID: \"0b82f214-ed29-4b52-8974-b1f8e4fd9a14\") " pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:23.975612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975341 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-var-lib-openvswitch\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.975612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975345 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sm9x\" (UniqueName: \"kubernetes.io/projected/5b4d19e3-e415-4cd0-90f3-076ab16ff1dc-kube-api-access-7sm9x\") pod \"node-ca-qffqs\" (UID: \"5b4d19e3-e415-4cd0-90f3-076ab16ff1dc\") " pod="openshift-image-registry/node-ca-qffqs" Jun 08 13:01:23.975612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/65844758-3d62-45e6-93a7-44543a222e80-dbus\") pod \"global-pull-secret-syncer-4s2t4\" (UID: \"65844758-3d62-45e6-93a7-44543a222e80\") " pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:23.975612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975400 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.975612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975442 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-node-log\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.975612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975459 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-etc-selinux\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.975612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975527 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-slash\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.975612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret\") pod \"global-pull-secret-syncer-4s2t4\" (UID: \"65844758-3d62-45e6-93a7-44543a222e80\") " pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:23.975612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975592 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs\") pod \"network-metrics-daemon-jh77v\" (UID: \"0b82f214-ed29-4b52-8974-b1f8e4fd9a14\") " pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:23.975612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975608 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/65844758-3d62-45e6-93a7-44543a222e80-kubelet-config\") pod \"global-pull-secret-syncer-4s2t4\" (UID: \"65844758-3d62-45e6-93a7-44543a222e80\") " pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:23.975612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975615 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b4d19e3-e415-4cd0-90f3-076ab16ff1dc-host\") pod \"node-ca-qffqs\" (UID: \"5b4d19e3-e415-4cd0-90f3-076ab16ff1dc\") " pod="openshift-image-registry/node-ca-qffqs" Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975640 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-run-ovn\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975658 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/363cc718-04aa-4180-a333-0efaaac5dd5d-ovnkube-config\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975678 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe818a7a-77d6-48bb-9efd-3639c7f8df67-host-slash\") pod \"iptables-alerter-hfzks\" (UID: \"fe818a7a-77d6-48bb-9efd-3639c7f8df67\") " pod="openshift-network-operator/iptables-alerter-hfzks" Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975701 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b4d19e3-e415-4cd0-90f3-076ab16ff1dc-serviceca\") pod \"node-ca-qffqs\" (UID: \"5b4d19e3-e415-4cd0-90f3-076ab16ff1dc\") " pod="openshift-image-registry/node-ca-qffqs" Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975706 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-registration-dir\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975720 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/65844758-3d62-45e6-93a7-44543a222e80-dbus\") pod \"global-pull-secret-syncer-4s2t4\" (UID: \"65844758-3d62-45e6-93a7-44543a222e80\") " pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975726 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-run-systemd\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975750 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/363cc718-04aa-4180-a333-0efaaac5dd5d-ovnkube-script-lib\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975757 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-run-ovn\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be941842-dde4-47f6-9308-75450cdd10b6-hosts-file\") pod \"node-resolver-pkk6k\" (UID: \"be941842-dde4-47f6-9308-75450cdd10b6\") " pod="openshift-dns/node-resolver-pkk6k" Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975796 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-socket-dir\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975818 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mkcf\" (UniqueName: \"kubernetes.io/projected/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-kube-api-access-9mkcf\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:23.975832 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975847 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-kubelet\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975872 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-run-openvswitch\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:23.975903 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret podName:65844758-3d62-45e6-93a7-44543a222e80 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:24.475882909 +0000 UTC m=+3.044291982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret") pod "global-pull-secret-syncer-4s2t4" (UID: "65844758-3d62-45e6-93a7-44543a222e80") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:23.976370 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975912 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-run-openvswitch\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975921 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-log-socket\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975950 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fe818a7a-77d6-48bb-9efd-3639c7f8df67-iptables-alerter-script\") pod \"iptables-alerter-hfzks\" (UID: \"fe818a7a-77d6-48bb-9efd-3639c7f8df67\") " pod="openshift-network-operator/iptables-alerter-hfzks" Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975962 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be941842-dde4-47f6-9308-75450cdd10b6-hosts-file\") pod \"node-resolver-pkk6k\" (UID: \"be941842-dde4-47f6-9308-75450cdd10b6\") " pod="openshift-dns/node-resolver-pkk6k" Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975975 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be941842-dde4-47f6-9308-75450cdd10b6-tmp-dir\") pod \"node-resolver-pkk6k\" (UID: \"be941842-dde4-47f6-9308-75450cdd10b6\") " pod="openshift-dns/node-resolver-pkk6k" Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.975976 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-run-netns\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976015 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-cni-netd\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976018 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-run-netns\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c-konnectivity-ca\") pod \"konnectivity-agent-bjxm8\" (UID: \"b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c\") " pod="kube-system/konnectivity-agent-bjxm8" Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976053 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-socket-dir\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-cni-bin\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:23.976080 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976093 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:23.976117 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs podName:0b82f214-ed29-4b52-8974-b1f8e4fd9a14 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:24.476104836 +0000 UTC m=+3.044513895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs") pod "network-metrics-daemon-jh77v" (UID: "0b82f214-ed29-4b52-8974-b1f8e4fd9a14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-systemd-units\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976142 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/363cc718-04aa-4180-a333-0efaaac5dd5d-env-overrides\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977180 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976178 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-cni-netd\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976184 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckvrq\" (UniqueName: \"kubernetes.io/projected/be941842-dde4-47f6-9308-75450cdd10b6-kube-api-access-ckvrq\") pod \"node-resolver-pkk6k\" (UID: \"be941842-dde4-47f6-9308-75450cdd10b6\") " pod="openshift-dns/node-resolver-pkk6k" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-sys-fs\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976220 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-cni-bin\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976292 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-log-socket\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976498 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/363cc718-04aa-4180-a333-0efaaac5dd5d-ovnkube-script-lib\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976558 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-run-systemd\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976607 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-host-kubelet\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976653 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-sys-fs\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976689 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe818a7a-77d6-48bb-9efd-3639c7f8df67-host-slash\") pod \"iptables-alerter-hfzks\" (UID: \"fe818a7a-77d6-48bb-9efd-3639c7f8df67\") " pod="openshift-network-operator/iptables-alerter-hfzks" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976753 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/363cc718-04aa-4180-a333-0efaaac5dd5d-env-overrides\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976862 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c-konnectivity-ca\") pod \"konnectivity-agent-bjxm8\" (UID: \"b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c\") " pod="kube-system/konnectivity-agent-bjxm8" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976880 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-systemd-units\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976911 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fe818a7a-77d6-48bb-9efd-3639c7f8df67-iptables-alerter-script\") pod \"iptables-alerter-hfzks\" (UID: \"fe818a7a-77d6-48bb-9efd-3639c7f8df67\") " pod="openshift-network-operator/iptables-alerter-hfzks" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976915 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b4d19e3-e415-4cd0-90f3-076ab16ff1dc-host\") pod \"node-ca-qffqs\" (UID: \"5b4d19e3-e415-4cd0-90f3-076ab16ff1dc\") " pod="openshift-image-registry/node-ca-qffqs" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.976949 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/363cc718-04aa-4180-a333-0efaaac5dd5d-etc-openvswitch\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.977170 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/363cc718-04aa-4180-a333-0efaaac5dd5d-ovnkube-config\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.977205 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5b4d19e3-e415-4cd0-90f3-076ab16ff1dc-serviceca\") pod \"node-ca-qffqs\" (UID: \"5b4d19e3-e415-4cd0-90f3-076ab16ff1dc\") " pod="openshift-image-registry/node-ca-qffqs" Jun 08 13:01:23.977778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.977570 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c-agent-certs\") pod \"konnectivity-agent-bjxm8\" (UID: \"b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c\") " pod="kube-system/konnectivity-agent-bjxm8" Jun 08 13:01:23.978265 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.977856 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/363cc718-04aa-4180-a333-0efaaac5dd5d-ovn-node-metrics-cert\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.988892 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.988863 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg6rt\" (UniqueName: \"kubernetes.io/projected/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-kube-api-access-mg6rt\") pod \"network-metrics-daemon-jh77v\" (UID: \"0b82f214-ed29-4b52-8974-b1f8e4fd9a14\") " pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:23.989036 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.988940 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjjpg\" (UniqueName: \"kubernetes.io/projected/363cc718-04aa-4180-a333-0efaaac5dd5d-kube-api-access-wjjpg\") pod \"ovnkube-node-2jgr6\" (UID: \"363cc718-04aa-4180-a333-0efaaac5dd5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:23.989036 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.989003 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sm9x\" (UniqueName: \"kubernetes.io/projected/5b4d19e3-e415-4cd0-90f3-076ab16ff1dc-kube-api-access-7sm9x\") pod \"node-ca-qffqs\" (UID: \"5b4d19e3-e415-4cd0-90f3-076ab16ff1dc\") " pod="openshift-image-registry/node-ca-qffqs" Jun 08 13:01:23.989495 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.989427 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw845\" (UniqueName: \"kubernetes.io/projected/fe818a7a-77d6-48bb-9efd-3639c7f8df67-kube-api-access-rw845\") pod \"iptables-alerter-hfzks\" (UID: \"fe818a7a-77d6-48bb-9efd-3639c7f8df67\") " pod="openshift-network-operator/iptables-alerter-hfzks" Jun 08 13:01:23.989614 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.989597 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mkcf\" (UniqueName: \"kubernetes.io/projected/9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb-kube-api-access-9mkcf\") pod \"aws-ebs-csi-driver-node-2ddcg\" (UID: \"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:23.990159 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:23.990136 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckvrq\" (UniqueName: \"kubernetes.io/projected/be941842-dde4-47f6-9308-75450cdd10b6-kube-api-access-ckvrq\") pod \"node-resolver-pkk6k\" (UID: \"be941842-dde4-47f6-9308-75450cdd10b6\") " pod="openshift-dns/node-resolver-pkk6k" Jun 08 13:01:24.063729 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.063642 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" Jun 08 13:01:24.071320 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.071296 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cjnpd" Jun 08 13:01:24.083411 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.083387 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8h6z8" Jun 08 13:01:24.085522 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.085500 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hfzks" Jun 08 13:01:24.092212 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.092192 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qffqs" Jun 08 13:01:24.098616 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.098601 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pkk6k" Jun 08 13:01:24.104052 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.104029 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" Jun 08 13:01:24.110366 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.110352 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bjxm8" Jun 08 13:01:24.116007 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.115988 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:24.479392 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.479307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs\") pod \"network-metrics-daemon-jh77v\" (UID: \"0b82f214-ed29-4b52-8974-b1f8e4fd9a14\") " pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:24.479392 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.479366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktwbc\" (UniqueName: \"kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc\") pod \"network-check-target-78dp6\" (UID: \"0a7ffd62-b58c-4993-ac03-0ec92420ea42\") " pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:24.479647 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.479400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret\") pod \"global-pull-secret-syncer-4s2t4\" (UID: \"65844758-3d62-45e6-93a7-44543a222e80\") " pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:24.479647 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:24.479459 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:24.479647 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:24.479510 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:24.479647 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:24.479549 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs podName:0b82f214-ed29-4b52-8974-b1f8e4fd9a14 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:25.479527551 +0000 UTC m=+4.047936630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs") pod "network-metrics-daemon-jh77v" (UID: "0b82f214-ed29-4b52-8974-b1f8e4fd9a14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:24.479647 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:24.479552 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:24.479647 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:24.479568 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret podName:65844758-3d62-45e6-93a7-44543a222e80 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:25.479559987 +0000 UTC m=+4.047969046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret") pod "global-pull-secret-syncer-4s2t4" (UID: "65844758-3d62-45e6-93a7-44543a222e80") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:24.479647 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:24.479576 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:24.479647 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:24.479587 2564 projected.go:196] Error preparing data for projected volume kube-api-access-ktwbc for pod openshift-network-diagnostics/network-check-target-78dp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:24.479952 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:24.479699 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc podName:0a7ffd62-b58c-4993-ac03-0ec92420ea42 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:25.479686786 +0000 UTC m=+4.048095849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktwbc" (UniqueName: "kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc") pod "network-check-target-78dp6" (UID: "0a7ffd62-b58c-4993-ac03-0ec92420ea42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:24.672148 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:24.671899 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf246719_4d56_405e_9a7d_0a7e819c868a.slice/crio-b71809c7021b930593bc8cd801b8c3dce9cae67b4d78b3fe33a42f4e9c2775e2 WatchSource:0}: Error finding container b71809c7021b930593bc8cd801b8c3dce9cae67b4d78b3fe33a42f4e9c2775e2: Status 404 returned error can't find the container with id b71809c7021b930593bc8cd801b8c3dce9cae67b4d78b3fe33a42f4e9c2775e2 Jun 08 13:01:24.673708 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:24.673684 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363cc718_04aa_4180_a333_0efaaac5dd5d.slice/crio-ece3ace3311f54a35d71651499a886aaf638d78b76f3686e185c6307a762d61f WatchSource:0}: Error finding container ece3ace3311f54a35d71651499a886aaf638d78b76f3686e185c6307a762d61f: Status 404 returned error can't find the container with id ece3ace3311f54a35d71651499a886aaf638d78b76f3686e185c6307a762d61f Jun 08 13:01:24.676359 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:24.676334 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eff2662_ab9b_4b82_9015_cf14f65fffb0.slice/crio-279653ccd774b635aec3ac2f9ca24331e037bed0a20fb3d109692add1c72cbee WatchSource:0}: Error finding container 279653ccd774b635aec3ac2f9ca24331e037bed0a20fb3d109692add1c72cbee: Status 404 returned error can't find the container with id 279653ccd774b635aec3ac2f9ca24331e037bed0a20fb3d109692add1c72cbee Jun 08 13:01:24.677168 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:24.677144 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe818a7a_77d6_48bb_9efd_3639c7f8df67.slice/crio-85035cee8b0bd0b132c3d7ae6b558148be3acf77cccf2b7a105c80d56b097ca6 WatchSource:0}: Error finding container 85035cee8b0bd0b132c3d7ae6b558148be3acf77cccf2b7a105c80d56b097ca6: Status 404 returned error can't find the container with id 85035cee8b0bd0b132c3d7ae6b558148be3acf77cccf2b7a105c80d56b097ca6 Jun 08 13:01:24.678310 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:24.678280 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe941842_dde4_47f6_9308_75450cdd10b6.slice/crio-3c6501b5cf899aa781f31b0d3225a0955590195fb990e1bf79bc41428ffef0ca WatchSource:0}: Error finding container 3c6501b5cf899aa781f31b0d3225a0955590195fb990e1bf79bc41428ffef0ca: Status 404 returned error can't find the container with id 3c6501b5cf899aa781f31b0d3225a0955590195fb990e1bf79bc41428ffef0ca Jun 08 13:01:24.679117 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:24.679094 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4d19e3_e415_4cd0_90f3_076ab16ff1dc.slice/crio-0968a16b252e5ad8faab60a4d72f4b3c7aef64c67c386c85f40dcff4bd44cc11 WatchSource:0}: Error finding container 0968a16b252e5ad8faab60a4d72f4b3c7aef64c67c386c85f40dcff4bd44cc11: Status 404 returned error can't find the container with id 0968a16b252e5ad8faab60a4d72f4b3c7aef64c67c386c85f40dcff4bd44cc11 Jun 08 13:01:24.680613 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:24.680055 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453df3f1_2f91_4834_a7fd_db011cba44d9.slice/crio-b219b55142452873c9b6d8b38a7f3ecc03f00e75f4cb997b88a70c4c84bd2ff0 WatchSource:0}: Error finding container b219b55142452873c9b6d8b38a7f3ecc03f00e75f4cb997b88a70c4c84bd2ff0: Status 404 returned error can't find the container with id b219b55142452873c9b6d8b38a7f3ecc03f00e75f4cb997b88a70c4c84bd2ff0 Jun 08 13:01:24.681898 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:24.681450 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d2bcc5_1d0a_46f1_9e91_32b5b22c943c.slice/crio-327b2a5540f264cc9cb32766c852c51e957339e4d27a08253c058d664745c88c WatchSource:0}: Error finding container 327b2a5540f264cc9cb32766c852c51e957339e4d27a08253c058d664745c88c: Status 404 returned error can't find the container with id 327b2a5540f264cc9cb32766c852c51e957339e4d27a08253c058d664745c88c Jun 08 13:01:24.682328 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:24.682233 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb1c100_23ef_4397_93e2_ee5dbdc6b8cb.slice/crio-778f546384c52a1aeb59dad1b33be59bac536dcbdccfe894e3c7293c0c387765 WatchSource:0}: Error finding container 778f546384c52a1aeb59dad1b33be59bac536dcbdccfe894e3c7293c0c387765: Status 404 returned error can't find the container with id 778f546384c52a1aeb59dad1b33be59bac536dcbdccfe894e3c7293c0c387765 Jun 08 13:01:24.813321 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.813290 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 12:56:23 +0000 UTC" deadline="2028-01-04 04:03:21.490143312 +0000 UTC" Jun 08 13:01:24.813321 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.813317 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13791h1m56.676829013s" Jun 08 13:01:24.825993 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.825958 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjnpd" event={"ID":"453df3f1-2f91-4834-a7fd-db011cba44d9","Type":"ContainerStarted","Data":"b219b55142452873c9b6d8b38a7f3ecc03f00e75f4cb997b88a70c4c84bd2ff0"} Jun 08 13:01:24.827058 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.827036 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qffqs" event={"ID":"5b4d19e3-e415-4cd0-90f3-076ab16ff1dc","Type":"ContainerStarted","Data":"0968a16b252e5ad8faab60a4d72f4b3c7aef64c67c386c85f40dcff4bd44cc11"} Jun 08 13:01:24.828201 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.828178 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8h6z8" event={"ID":"2eff2662-ab9b-4b82-9015-cf14f65fffb0","Type":"ContainerStarted","Data":"279653ccd774b635aec3ac2f9ca24331e037bed0a20fb3d109692add1c72cbee"} Jun 08 13:01:24.829957 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.829932 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-96.ec2.internal" event={"ID":"2ca2e778a4908d259d8d0253f0a8ed1a","Type":"ContainerStarted","Data":"04929ffe35b9db8db9b75f59c115f7cc8f7b383e1b053f200dc337405cce2168"} Jun 08 13:01:24.831033 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.831012 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" event={"ID":"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb","Type":"ContainerStarted","Data":"778f546384c52a1aeb59dad1b33be59bac536dcbdccfe894e3c7293c0c387765"} Jun 08 13:01:24.832036 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.832017 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pkk6k" event={"ID":"be941842-dde4-47f6-9308-75450cdd10b6","Type":"ContainerStarted","Data":"3c6501b5cf899aa781f31b0d3225a0955590195fb990e1bf79bc41428ffef0ca"} Jun 08 13:01:24.833128 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.833104 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hfzks" event={"ID":"fe818a7a-77d6-48bb-9efd-3639c7f8df67","Type":"ContainerStarted","Data":"85035cee8b0bd0b132c3d7ae6b558148be3acf77cccf2b7a105c80d56b097ca6"} Jun 08 13:01:24.834140 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.834120 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" event={"ID":"363cc718-04aa-4180-a333-0efaaac5dd5d","Type":"ContainerStarted","Data":"ece3ace3311f54a35d71651499a886aaf638d78b76f3686e185c6307a762d61f"} Jun 08 13:01:24.835246 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.835226 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" event={"ID":"bf246719-4d56-405e-9a7d-0a7e819c868a","Type":"ContainerStarted","Data":"b71809c7021b930593bc8cd801b8c3dce9cae67b4d78b3fe33a42f4e9c2775e2"} Jun 08 13:01:24.836228 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.836211 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bjxm8" event={"ID":"b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c","Type":"ContainerStarted","Data":"327b2a5540f264cc9cb32766c852c51e957339e4d27a08253c058d664745c88c"} Jun 08 13:01:24.850192 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:24.850138 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-96.ec2.internal" podStartSLOduration=1.850124106 podStartE2EDuration="1.850124106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:24.849747727 +0000 UTC m=+3.418156809" watchObservedRunningTime="2026-06-08 13:01:24.850124106 +0000 UTC m=+3.418533186" Jun 08 13:01:25.487498 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:25.487197 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktwbc\" (UniqueName: \"kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc\") pod \"network-check-target-78dp6\" (UID: \"0a7ffd62-b58c-4993-ac03-0ec92420ea42\") " pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:25.487498 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:25.487272 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret\") pod \"global-pull-secret-syncer-4s2t4\" (UID: \"65844758-3d62-45e6-93a7-44543a222e80\") " pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:25.487498 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:25.487306 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs\") pod \"network-metrics-daemon-jh77v\" (UID: \"0b82f214-ed29-4b52-8974-b1f8e4fd9a14\") " pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:25.487787 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:25.487518 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:25.487787 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:25.487583 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs podName:0b82f214-ed29-4b52-8974-b1f8e4fd9a14 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:27.487564316 +0000 UTC m=+6.055973374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs") pod "network-metrics-daemon-jh77v" (UID: "0b82f214-ed29-4b52-8974-b1f8e4fd9a14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:25.488065 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:25.487981 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:25.488065 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:25.488032 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:25.488065 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:25.488051 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:25.488065 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:25.488064 2564 projected.go:196] Error preparing data for projected volume kube-api-access-ktwbc for pod openshift-network-diagnostics/network-check-target-78dp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:25.488327 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:25.488034 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret podName:65844758-3d62-45e6-93a7-44543a222e80 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:27.488018648 +0000 UTC m=+6.056427711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret") pod "global-pull-secret-syncer-4s2t4" (UID: "65844758-3d62-45e6-93a7-44543a222e80") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:25.488327 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:25.488183 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc podName:0a7ffd62-b58c-4993-ac03-0ec92420ea42 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:27.488169085 +0000 UTC m=+6.056578152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktwbc" (UniqueName: "kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc") pod "network-check-target-78dp6" (UID: "0a7ffd62-b58c-4993-ac03-0ec92420ea42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:25.813693 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:25.813555 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 12:56:23 +0000 UTC" deadline="2027-11-26 04:03:13.639162175 +0000 UTC" Jun 08 13:01:25.813693 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:25.813615 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12855h1m47.825551195s" Jun 08 13:01:25.820012 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:25.819980 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:25.820141 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:25.820121 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:25.820242 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:25.820224 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:25.820325 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:25.820308 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:25.820385 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:25.820368 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:25.820447 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:25.820434 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:25.848497 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:25.848304 2564 generic.go:356] "Generic (PLEG): container finished" podID="8a527134d158f127d20cef615b894ecd" containerID="7b0f89cbef575888cd6e05670b32c1f4a8d6751463ef3117f4e4d5b2aa309eec" exitCode=0 Jun 08 13:01:25.848497 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:25.848436 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal" event={"ID":"8a527134d158f127d20cef615b894ecd","Type":"ContainerDied","Data":"7b0f89cbef575888cd6e05670b32c1f4a8d6751463ef3117f4e4d5b2aa309eec"} Jun 08 13:01:26.866533 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:26.866491 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal" event={"ID":"8a527134d158f127d20cef615b894ecd","Type":"ContainerStarted","Data":"3954e3833c8f1f0561df631b1f0e7d80dfefe5fa3cd92332e4b2e358e780282b"} Jun 08 13:01:27.504868 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:27.504798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktwbc\" (UniqueName: \"kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc\") pod \"network-check-target-78dp6\" (UID: \"0a7ffd62-b58c-4993-ac03-0ec92420ea42\") " pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:27.504868 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:27.504868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret\") pod \"global-pull-secret-syncer-4s2t4\" (UID: \"65844758-3d62-45e6-93a7-44543a222e80\") " pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:27.505130 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:27.504901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs\") pod \"network-metrics-daemon-jh77v\" (UID: \"0b82f214-ed29-4b52-8974-b1f8e4fd9a14\") " pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:27.505130 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:27.505024 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:27.505130 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:27.505085 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs podName:0b82f214-ed29-4b52-8974-b1f8e4fd9a14 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:31.505067458 +0000 UTC m=+10.073476517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs") pod "network-metrics-daemon-jh77v" (UID: "0b82f214-ed29-4b52-8974-b1f8e4fd9a14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:27.505513 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:27.505495 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:27.505610 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:27.505523 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:27.505610 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:27.505538 2564 projected.go:196] Error preparing data for projected volume kube-api-access-ktwbc for pod openshift-network-diagnostics/network-check-target-78dp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:27.505610 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:27.505586 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc podName:0a7ffd62-b58c-4993-ac03-0ec92420ea42 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:31.505570658 +0000 UTC m=+10.073979723 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktwbc" (UniqueName: "kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc") pod "network-check-target-78dp6" (UID: "0a7ffd62-b58c-4993-ac03-0ec92420ea42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:27.505763 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:27.505658 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:27.505763 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:27.505722 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret podName:65844758-3d62-45e6-93a7-44543a222e80 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:31.505679975 +0000 UTC m=+10.074089040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret") pod "global-pull-secret-syncer-4s2t4" (UID: "65844758-3d62-45e6-93a7-44543a222e80") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:27.818862 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:27.818783 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:27.819024 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:27.818785 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:27.819024 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:27.818921 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:27.819131 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:27.819033 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:27.819131 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:27.819080 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:27.819227 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:27.819150 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:29.821905 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:29.821767 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:29.821905 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:29.821894 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:29.822408 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:29.822252 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:29.822408 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:29.822284 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:29.822408 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:29.822401 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:29.822587 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:29.822501 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:31.540747 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:31.540709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktwbc\" (UniqueName: \"kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc\") pod \"network-check-target-78dp6\" (UID: \"0a7ffd62-b58c-4993-ac03-0ec92420ea42\") " pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:31.541197 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:31.540788 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret\") pod \"global-pull-secret-syncer-4s2t4\" (UID: \"65844758-3d62-45e6-93a7-44543a222e80\") " pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:31.541197 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:31.540821 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs\") pod \"network-metrics-daemon-jh77v\" (UID: \"0b82f214-ed29-4b52-8974-b1f8e4fd9a14\") " pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:31.541197 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:31.540913 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:31.541197 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:31.540941 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:31.541197 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:31.540941 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:31.541197 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:31.540955 2564 projected.go:196] Error preparing data for projected volume kube-api-access-ktwbc for pod openshift-network-diagnostics/network-check-target-78dp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:31.541197 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:31.540943 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:31.541197 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:31.540995 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs podName:0b82f214-ed29-4b52-8974-b1f8e4fd9a14 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:39.540979084 +0000 UTC m=+18.109388143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs") pod "network-metrics-daemon-jh77v" (UID: "0b82f214-ed29-4b52-8974-b1f8e4fd9a14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:31.541197 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:31.541013 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc podName:0a7ffd62-b58c-4993-ac03-0ec92420ea42 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:39.541003373 +0000 UTC m=+18.109412439 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktwbc" (UniqueName: "kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc") pod "network-check-target-78dp6" (UID: "0a7ffd62-b58c-4993-ac03-0ec92420ea42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:31.541197 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:31.541030 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret podName:65844758-3d62-45e6-93a7-44543a222e80 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:39.541022168 +0000 UTC m=+18.109431228 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret") pod "global-pull-secret-syncer-4s2t4" (UID: "65844758-3d62-45e6-93a7-44543a222e80") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:31.819857 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:31.819779 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:31.820016 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:31.819916 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:31.820016 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:31.819948 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:31.820016 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:31.819968 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:31.820234 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:31.820201 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:31.820348 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:31.820297 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:33.822224 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:33.822186 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:33.822642 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:33.822185 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:33.822642 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:33.822309 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:33.822642 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:33.822321 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:33.822642 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:33.822447 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:33.822642 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:33.822553 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:35.818499 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:35.818454 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:35.818949 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:35.818613 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:35.818949 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:35.818708 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:35.818949 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:35.818798 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:35.818949 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:35.818835 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:35.818949 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:35.818911 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:37.817845 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:37.817810 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:37.817845 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:37.817842 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:37.818392 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:37.817810 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:37.818392 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:37.817931 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:37.818392 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:37.817993 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:37.818392 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:37.818095 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:39.601986 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:39.601951 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs\") pod \"network-metrics-daemon-jh77v\" (UID: \"0b82f214-ed29-4b52-8974-b1f8e4fd9a14\") " pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:39.602421 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:39.602017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktwbc\" (UniqueName: \"kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc\") pod \"network-check-target-78dp6\" (UID: \"0a7ffd62-b58c-4993-ac03-0ec92420ea42\") " pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:39.602421 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:39.602065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret\") pod \"global-pull-secret-syncer-4s2t4\" (UID: \"65844758-3d62-45e6-93a7-44543a222e80\") " pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:39.602421 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:39.602130 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:39.602421 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:39.602147 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:39.602421 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:39.602175 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:39.602421 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:39.602181 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:39.602421 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:39.602198 2564 projected.go:196] Error preparing data for projected volume kube-api-access-ktwbc for pod openshift-network-diagnostics/network-check-target-78dp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:39.602421 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:39.602206 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs podName:0b82f214-ed29-4b52-8974-b1f8e4fd9a14 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:55.602180065 +0000 UTC m=+34.170589125 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs") pod "network-metrics-daemon-jh77v" (UID: "0b82f214-ed29-4b52-8974-b1f8e4fd9a14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:39.602421 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:39.602240 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret podName:65844758-3d62-45e6-93a7-44543a222e80 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:55.602222935 +0000 UTC m=+34.170632009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret") pod "global-pull-secret-syncer-4s2t4" (UID: "65844758-3d62-45e6-93a7-44543a222e80") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:39.602421 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:39.602258 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc podName:0a7ffd62-b58c-4993-ac03-0ec92420ea42 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:55.602248989 +0000 UTC m=+34.170658079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktwbc" (UniqueName: "kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc") pod "network-check-target-78dp6" (UID: "0a7ffd62-b58c-4993-ac03-0ec92420ea42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:39.820917 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:39.820886 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:39.821082 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:39.820886 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:39.821082 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:39.821011 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:39.821082 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:39.821010 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:39.821250 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:39.821111 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:39.821250 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:39.821215 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:41.818847 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:41.818810 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:41.818847 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:41.818844 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:41.819429 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:41.818915 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:41.819429 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:41.818977 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:41.819429 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:41.819009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:41.819429 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:41.819124 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:43.821966 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.821665 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:43.822652 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.821730 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:43.822652 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:43.822039 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:43.822652 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:43.822163 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:43.822652 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.821729 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:43.822652 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:43.822281 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:43.900180 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.899885 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bjxm8" event={"ID":"b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c","Type":"ContainerStarted","Data":"2eaa60c1030b9577ac4c1442fdb4517b1557b0f2d50bbf17b4c7c233aa954f53"} Jun 08 13:01:43.901715 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.901688 2564 generic.go:356] "Generic (PLEG): container finished" podID="453df3f1-2f91-4834-a7fd-db011cba44d9" containerID="1d648ca566b5ac252e851be3c5cbe74afabc79d7ba2fe7408200dd4a6e45b6f6" exitCode=0 Jun 08 13:01:43.901856 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.901777 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjnpd" event={"ID":"453df3f1-2f91-4834-a7fd-db011cba44d9","Type":"ContainerDied","Data":"1d648ca566b5ac252e851be3c5cbe74afabc79d7ba2fe7408200dd4a6e45b6f6"} Jun 08 13:01:43.903795 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.903754 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qffqs" event={"ID":"5b4d19e3-e415-4cd0-90f3-076ab16ff1dc","Type":"ContainerStarted","Data":"7cbeec994d685cd17a8dab101b67278491d6ede7c753682283622e076b9e4bd8"} Jun 08 13:01:43.905576 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.905545 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8h6z8" event={"ID":"2eff2662-ab9b-4b82-9015-cf14f65fffb0","Type":"ContainerStarted","Data":"6cb939d3a522f722cec3ad068ee6b5d371b96235c3bffb5e60cfdb11c249381c"} Jun 08 13:01:43.907087 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.907066 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" event={"ID":"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb","Type":"ContainerStarted","Data":"93f83d3f2625e2307992779e4571186e505f93556ae1c99669abb8b96243d54a"} Jun 08 13:01:43.908558 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.908534 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pkk6k" event={"ID":"be941842-dde4-47f6-9308-75450cdd10b6","Type":"ContainerStarted","Data":"ee46476c03985ad50aaa8e858d4d6cebfe98a20192fb7c70dfb0a60a361bec59"} Jun 08 13:01:43.912185 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.912139 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" event={"ID":"363cc718-04aa-4180-a333-0efaaac5dd5d","Type":"ContainerStarted","Data":"90afa9e6a6f65fde48b74d73971855806ed276709bb936c9d2ebccd2c21095fc"} Jun 08 13:01:43.912274 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.912237 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" event={"ID":"363cc718-04aa-4180-a333-0efaaac5dd5d","Type":"ContainerStarted","Data":"04a5ed06038298723d5ddf24d445c25be1b079cefda01efb358f5f9e538842c5"} Jun 08 13:01:43.912350 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.912290 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" event={"ID":"363cc718-04aa-4180-a333-0efaaac5dd5d","Type":"ContainerStarted","Data":"a3057a77c4a83edd9bc506db22a49f8a757f36a406f586f01325c17ebe4590ed"} Jun 08 13:01:43.912350 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.912336 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" event={"ID":"363cc718-04aa-4180-a333-0efaaac5dd5d","Type":"ContainerStarted","Data":"10e3cd550bbb6cecd729e4aedafc8b21032e44f71b205c0ec816ded03801bcb0"} Jun 08 13:01:43.912446 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.912383 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" event={"ID":"363cc718-04aa-4180-a333-0efaaac5dd5d","Type":"ContainerStarted","Data":"f8698c410b020e75703b034cc3b5d4ccb51fe99e146fe9f555a5274b1aec7e4a"} Jun 08 13:01:43.912446 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.912429 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" event={"ID":"363cc718-04aa-4180-a333-0efaaac5dd5d","Type":"ContainerStarted","Data":"4ede6a140faeead01361106b2cfd9825069339efb4fbbc1ee11b045ea5e8664c"} Jun 08 13:01:43.913652 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.913629 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" event={"ID":"bf246719-4d56-405e-9a7d-0a7e819c868a","Type":"ContainerStarted","Data":"4d159b114fc95bf35356e2fbfd9435c16e3dfe94bf2e1d457c1c6186b0970671"} Jun 08 13:01:43.917338 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.917278 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-96.ec2.internal" podStartSLOduration=20.917260897 podStartE2EDuration="20.917260897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:26.888028053 +0000 UTC m=+5.456437135" watchObservedRunningTime="2026-06-08 13:01:43.917260897 +0000 UTC m=+22.485669981" Jun 08 13:01:43.917517 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.917484 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bjxm8" podStartSLOduration=11.765431675 podStartE2EDuration="21.917462951s" totalImagesPullingTime="10.152031276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:43.91651663 +0000 UTC m=+22.484925712" watchObservedRunningTime="2026-06-08 13:01:43.917462951 +0000 UTC m=+22.485872034" Jun 08 13:01:43.935435 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.935398 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7rp4z" podStartSLOduration=4.3533761 podStartE2EDuration="22.935384602s" totalImagesPullingTime="18.582008502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:43.935188067 +0000 UTC m=+22.503597151" watchObservedRunningTime="2026-06-08 13:01:43.935384602 +0000 UTC m=+22.503793683" Jun 08 13:01:43.986325 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:43.986270 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8h6z8" podStartSLOduration=4.386177974 podStartE2EDuration="22.986250666s" totalImagesPullingTime="18.600072692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:43.986083174 +0000 UTC m=+22.554492256" watchObservedRunningTime="2026-06-08 13:01:43.986250666 +0000 UTC m=+22.554659748" Jun 08 13:01:44.000183 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:44.000153 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:44.003450 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:44.003410 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qffqs" podStartSLOduration=4.448197073 podStartE2EDuration="23.003398115s" totalImagesPullingTime="18.555201042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:44.003052774 +0000 UTC m=+22.571462052" watchObservedRunningTime="2026-06-08 13:01:44.003398115 +0000 UTC m=+22.571807195" Jun 08 13:01:44.024213 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:44.024135 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pkk6k" podStartSLOduration=3.452242881 podStartE2EDuration="22.024117584s" totalImagesPullingTime="18.571874703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:44.023768925 +0000 UTC m=+22.592178006" watchObservedRunningTime="2026-06-08 13:01:44.024117584 +0000 UTC m=+22.592526667" Jun 08 13:01:44.109196 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:44.109154 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:44.209615 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:44.209575 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:44.320972 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:44.320948 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 13:01:44.764684 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:44.764616 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:44.821008 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:44.820886 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T13:01:44.320967359Z","UUID":"d42602c4-1516-46ae-82ba-a053c56b8f35","Handler":null,"Name":"","Endpoint":""} Jun 08 13:01:44.825067 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:44.823220 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 13:01:44.825067 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:44.823290 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 13:01:44.917971 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:44.917882 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" event={"ID":"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb","Type":"ContainerStarted","Data":"bc35c750a9063750b328d52c4b766158d39d9cba4cada655e20f482df0a699ee"} Jun 08 13:01:44.919592 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:44.919568 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hfzks" event={"ID":"fe818a7a-77d6-48bb-9efd-3639c7f8df67","Type":"ContainerStarted","Data":"31601b7d00130d748f9b965b8d50d2db9a6799f9267d838044cdd37ca9636330"} Jun 08 13:01:45.166893 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:45.166863 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:45.242911 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:45.242834 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:45.818717 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:45.818508 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:45.818891 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:45.818516 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:45.818891 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:45.818755 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:45.818891 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:45.818516 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:45.818891 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:45.818837 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:45.819069 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:45.818901 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:45.924741 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:45.924703 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" event={"ID":"9bb1c100-23ef-4397-93e2-ee5dbdc6b8cb","Type":"ContainerStarted","Data":"7ab38580f0f31cef61f9cbbb64b52859ee5978e4fc95e19e6cc9cf17f6764bd9"} Jun 08 13:01:45.929097 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:45.929068 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" event={"ID":"363cc718-04aa-4180-a333-0efaaac5dd5d","Type":"ContainerStarted","Data":"a8d6d98fdf6e4da9790cb8a41a0cb48f6679e3bc7e6b67bfe570d27b7be65eeb"} Jun 08 13:01:45.947868 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:45.947826 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hfzks" podStartSLOduration=6.390226712 podStartE2EDuration="24.947809972s" totalImagesPullingTime="18.55758326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:44.962151707 +0000 UTC m=+23.530560787" watchObservedRunningTime="2026-06-08 13:01:45.947809972 +0000 UTC m=+24.516219055" Jun 08 13:01:45.948158 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:45.948130 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2ddcg" podStartSLOduration=3.543854131 podStartE2EDuration="23.948122815s" totalImagesPullingTime="20.404268684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:45.94778345 +0000 UTC m=+24.516192548" watchObservedRunningTime="2026-06-08 13:01:45.948122815 +0000 UTC m=+24.516531895" Jun 08 13:01:45.970679 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:45.970645 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:46.374798 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:46.374763 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:46.443517 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:46.443465 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:46.811532 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:46.811441 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bjxm8" Jun 08 13:01:46.812159 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:46.812134 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bjxm8" Jun 08 13:01:46.931765 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:46.931733 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bjxm8" Jun 08 13:01:46.932282 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:46.932263 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bjxm8" Jun 08 13:01:47.007275 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:47.007242 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:47.822154 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:47.822124 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:47.822154 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:47.822137 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:47.822154 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:47.822161 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:47.822430 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:47.822267 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:47.822430 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:47.822399 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:47.822533 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:47.822511 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:48.938955 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:48.938784 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" event={"ID":"363cc718-04aa-4180-a333-0efaaac5dd5d","Type":"ContainerStarted","Data":"a9a1e3c0b8f660971b06c86fb1f114d79e10fad9488d76adcaf028354fb74ba9"} Jun 08 13:01:48.969934 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:48.969883 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" podStartSLOduration=8.327491281 podStartE2EDuration="26.969867398s" totalImagesPullingTime="18.642376117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:48.969251994 +0000 UTC m=+27.537661098" watchObservedRunningTime="2026-06-08 13:01:48.969867398 +0000 UTC m=+27.538276478" Jun 08 13:01:49.395563 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:49.395532 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:49.817990 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:49.817907 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:49.817990 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:49.817920 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:49.818197 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:49.818019 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:49.818197 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:49.818157 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:49.818302 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:49.818215 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:49.818302 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:49.818292 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:49.942784 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:49.942746 2564 generic.go:356] "Generic (PLEG): container finished" podID="453df3f1-2f91-4834-a7fd-db011cba44d9" containerID="12cb74fbac3dd2f08a444b35f8b9c101cf806c05ec08019f767edbf86698ccce" exitCode=0 Jun 08 13:01:49.943202 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:49.942821 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjnpd" event={"ID":"453df3f1-2f91-4834-a7fd-db011cba44d9","Type":"ContainerDied","Data":"12cb74fbac3dd2f08a444b35f8b9c101cf806c05ec08019f767edbf86698ccce"} Jun 08 13:01:49.943926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:49.943895 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:49.944082 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:49.944058 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:49.944141 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:49.944134 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:49.961314 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:49.961293 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:49.961415 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:49.961387 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:01:50.801564 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:50.801525 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-78dp6"] Jun 08 13:01:50.801702 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:50.801676 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:50.801801 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:50.801779 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:50.803279 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:50.803252 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jh77v"] Jun 08 13:01:50.803404 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:50.803358 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:50.803500 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:50.803459 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:50.816952 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:50.816929 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4s2t4"] Jun 08 13:01:50.817085 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:50.817003 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:50.817085 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:50.817071 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:51.948359 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:51.948116 2564 generic.go:356] "Generic (PLEG): container finished" podID="453df3f1-2f91-4834-a7fd-db011cba44d9" containerID="dd3352921548c7b63db1532779ddb2b922ab6e854656acda497a8de216d17fde" exitCode=0 Jun 08 13:01:51.948747 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:51.948182 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjnpd" event={"ID":"453df3f1-2f91-4834-a7fd-db011cba44d9","Type":"ContainerDied","Data":"dd3352921548c7b63db1532779ddb2b922ab6e854656acda497a8de216d17fde"} Jun 08 13:01:52.818241 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:52.818218 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:52.818342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:52.818306 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:52.818342 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:52.818311 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:52.818342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:52.818333 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:52.818524 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:52.818415 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:52.818524 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:52.818483 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:52.952653 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:52.952574 2564 generic.go:356] "Generic (PLEG): container finished" podID="453df3f1-2f91-4834-a7fd-db011cba44d9" containerID="a258ee423e7ce0ecc816a3215534a76e67bece82bbdebe8f7ffb2df187716a83" exitCode=0 Jun 08 13:01:52.952653 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:52.952608 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjnpd" event={"ID":"453df3f1-2f91-4834-a7fd-db011cba44d9","Type":"ContainerDied","Data":"a258ee423e7ce0ecc816a3215534a76e67bece82bbdebe8f7ffb2df187716a83"} Jun 08 13:01:54.817865 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:54.817827 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:54.817865 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:54.817866 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:54.818440 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:54.817867 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:54.818440 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:54.817957 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4s2t4" podUID="65844758-3d62-45e6-93a7-44543a222e80" Jun 08 13:01:54.818440 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:54.818061 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:01:54.818440 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:54.818151 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-78dp6" podUID="0a7ffd62-b58c-4993-ac03-0ec92420ea42" Jun 08 13:01:55.628944 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:55.628912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret\") pod \"global-pull-secret-syncer-4s2t4\" (UID: \"65844758-3d62-45e6-93a7-44543a222e80\") " pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:55.628944 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:55.628947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs\") pod \"network-metrics-daemon-jh77v\" (UID: \"0b82f214-ed29-4b52-8974-b1f8e4fd9a14\") " pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:55.629174 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:55.628976 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktwbc\" (UniqueName: \"kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc\") pod \"network-check-target-78dp6\" (UID: \"0a7ffd62-b58c-4993-ac03-0ec92420ea42\") " pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:55.629174 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:55.629086 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:55.629174 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:55.629098 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:55.629174 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:55.629113 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:55.629174 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:55.629124 2564 projected.go:196] Error preparing data for projected volume kube-api-access-ktwbc for pod openshift-network-diagnostics/network-check-target-78dp6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:55.629174 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:55.629090 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:55.629174 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:55.629151 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs podName:0b82f214-ed29-4b52-8974-b1f8e4fd9a14 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:27.629133521 +0000 UTC m=+66.197542597 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs") pod "network-metrics-daemon-jh77v" (UID: "0b82f214-ed29-4b52-8974-b1f8e4fd9a14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:55.629174 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:55.629169 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc podName:0a7ffd62-b58c-4993-ac03-0ec92420ea42 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:27.629160145 +0000 UTC m=+66.197569208 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktwbc" (UniqueName: "kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc") pod "network-check-target-78dp6" (UID: "0a7ffd62-b58c-4993-ac03-0ec92420ea42") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:55.629491 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:55.629184 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret podName:65844758-3d62-45e6-93a7-44543a222e80 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:27.629177618 +0000 UTC m=+66.197586677 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret") pod "global-pull-secret-syncer-4s2t4" (UID: "65844758-3d62-45e6-93a7-44543a222e80") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:56.073700 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.073617 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:56.298906 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.298877 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-96.ec2.internal" event="NodeReady" Jun 08 13:01:56.299078 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.299031 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 13:01:56.385157 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.385125 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wc4l8"] Jun 08 13:01:56.419376 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.419344 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r4ngf"] Jun 08 13:01:56.419560 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.419432 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wc4l8" Jun 08 13:01:56.422267 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.422240 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8gt5m\"" Jun 08 13:01:56.422406 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.422240 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 13:01:56.422505 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.422419 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 13:01:56.445363 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.445338 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wc4l8"] Jun 08 13:01:56.445490 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.445382 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r4ngf"] Jun 08 13:01:56.445490 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.445456 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r4ngf" Jun 08 13:01:56.449015 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.448985 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 13:01:56.449015 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.449002 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 13:01:56.449260 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.448985 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 13:01:56.450671 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.450626 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b76ln\"" Jun 08 13:01:56.499573 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.499545 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:56.537675 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.537640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:01:56.537828 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.537703 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-config-volume\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:01:56.537828 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.537748 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-tmp-dir\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:01:56.537828 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.537776 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcc69\" (UniqueName: \"kubernetes.io/projected/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-kube-api-access-jcc69\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:01:56.537988 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.537802 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr46g\" (UniqueName: \"kubernetes.io/projected/4fcf4863-891b-4b40-b03b-b5a139f5b1d8-kube-api-access-kr46g\") pod \"ingress-canary-r4ngf\" (UID: \"4fcf4863-891b-4b40-b03b-b5a139f5b1d8\") " pod="openshift-ingress-canary/ingress-canary-r4ngf" Jun 08 13:01:56.537988 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.537888 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fcf4863-891b-4b40-b03b-b5a139f5b1d8-cert\") pod \"ingress-canary-r4ngf\" (UID: \"4fcf4863-891b-4b40-b03b-b5a139f5b1d8\") " pod="openshift-ingress-canary/ingress-canary-r4ngf" Jun 08 13:01:56.599368 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.599326 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:56.639068 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.638989 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:01:56.639068 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.639032 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-config-volume\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:01:56.639068 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.639060 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-tmp-dir\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:01:56.639322 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.639083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcc69\" (UniqueName: \"kubernetes.io/projected/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-kube-api-access-jcc69\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:01:56.639322 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.639110 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr46g\" (UniqueName: \"kubernetes.io/projected/4fcf4863-891b-4b40-b03b-b5a139f5b1d8-kube-api-access-kr46g\") pod \"ingress-canary-r4ngf\" (UID: \"4fcf4863-891b-4b40-b03b-b5a139f5b1d8\") " pod="openshift-ingress-canary/ingress-canary-r4ngf" Jun 08 13:01:56.639322 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:56.639145 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:01:56.639322 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.639160 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fcf4863-891b-4b40-b03b-b5a139f5b1d8-cert\") pod \"ingress-canary-r4ngf\" (UID: \"4fcf4863-891b-4b40-b03b-b5a139f5b1d8\") " pod="openshift-ingress-canary/ingress-canary-r4ngf" Jun 08 13:01:56.639322 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:56.639208 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls podName:2a6e9a0a-4cff-4501-88d4-ff243a63a8b1 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:57.139186682 +0000 UTC m=+35.707595755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls") pod "dns-default-wc4l8" (UID: "2a6e9a0a-4cff-4501-88d4-ff243a63a8b1") : secret "dns-default-metrics-tls" not found Jun 08 13:01:56.639783 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.639727 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-tmp-dir\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:01:56.640182 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.640153 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-config-volume\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:01:56.644190 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.644168 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fcf4863-891b-4b40-b03b-b5a139f5b1d8-cert\") pod \"ingress-canary-r4ngf\" (UID: \"4fcf4863-891b-4b40-b03b-b5a139f5b1d8\") " pod="openshift-ingress-canary/ingress-canary-r4ngf" Jun 08 13:01:56.649060 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.649011 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr46g\" (UniqueName: \"kubernetes.io/projected/4fcf4863-891b-4b40-b03b-b5a139f5b1d8-kube-api-access-kr46g\") pod \"ingress-canary-r4ngf\" (UID: \"4fcf4863-891b-4b40-b03b-b5a139f5b1d8\") " pod="openshift-ingress-canary/ingress-canary-r4ngf" Jun 08 13:01:56.649060 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.649016 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcc69\" (UniqueName: \"kubernetes.io/projected/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-kube-api-access-jcc69\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:01:56.754867 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.754833 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r4ngf" Jun 08 13:01:56.818216 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.818168 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:01:56.818383 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.818297 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:01:56.818445 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.818400 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:01:56.821275 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.821212 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 13:01:56.821403 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.821295 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 13:01:56.821520 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.821503 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 13:01:56.821594 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.821503 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g4dhf\"" Jun 08 13:01:56.821652 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.821504 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wn2mf\"" Jun 08 13:01:56.821652 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:56.821633 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 13:01:57.089665 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:57.089636 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r4ngf"] Jun 08 13:01:57.093246 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:01:57.093221 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fcf4863_891b_4b40_b03b_b5a139f5b1d8.slice/crio-52e7f9708e89d12f014e7a14acc16676df6008d5b386726c158a299d51bd4ea1 WatchSource:0}: Error finding container 52e7f9708e89d12f014e7a14acc16676df6008d5b386726c158a299d51bd4ea1: Status 404 returned error can't find the container with id 52e7f9708e89d12f014e7a14acc16676df6008d5b386726c158a299d51bd4ea1 Jun 08 13:01:57.142616 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:57.142586 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:01:57.142727 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:57.142708 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:01:57.142796 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:57.142784 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls podName:2a6e9a0a-4cff-4501-88d4-ff243a63a8b1 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:58.142763975 +0000 UTC m=+36.711173042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls") pod "dns-default-wc4l8" (UID: "2a6e9a0a-4cff-4501-88d4-ff243a63a8b1") : secret "dns-default-metrics-tls" not found Jun 08 13:01:57.966417 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:57.966376 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r4ngf" event={"ID":"4fcf4863-891b-4b40-b03b-b5a139f5b1d8","Type":"ContainerStarted","Data":"52e7f9708e89d12f014e7a14acc16676df6008d5b386726c158a299d51bd4ea1"} Jun 08 13:01:57.969749 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:57.969721 2564 generic.go:356] "Generic (PLEG): container finished" podID="453df3f1-2f91-4834-a7fd-db011cba44d9" containerID="3ffbc52543318e1093c99f484402a633427295fe8e3d6ff48aff2cc304d8105f" exitCode=0 Jun 08 13:01:57.969954 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:57.969765 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjnpd" event={"ID":"453df3f1-2f91-4834-a7fd-db011cba44d9","Type":"ContainerDied","Data":"3ffbc52543318e1093c99f484402a633427295fe8e3d6ff48aff2cc304d8105f"} Jun 08 13:01:58.150027 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:58.149991 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:01:58.150464 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:58.150137 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:01:58.150464 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:01:58.150212 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls podName:2a6e9a0a-4cff-4501-88d4-ff243a63a8b1 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:00.150190194 +0000 UTC m=+38.718599252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls") pod "dns-default-wc4l8" (UID: "2a6e9a0a-4cff-4501-88d4-ff243a63a8b1") : secret "dns-default-metrics-tls" not found Jun 08 13:01:58.872331 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:58.872300 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:58.953557 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:58.953496 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:01:58.974815 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:58.974787 2564 generic.go:356] "Generic (PLEG): container finished" podID="453df3f1-2f91-4834-a7fd-db011cba44d9" containerID="f4dd145fbc1537fa0dcfbe1282f59d1052df6af1c140b35d6341e8ce7052407e" exitCode=0 Jun 08 13:01:58.974947 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:58.974838 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjnpd" event={"ID":"453df3f1-2f91-4834-a7fd-db011cba44d9","Type":"ContainerDied","Data":"f4dd145fbc1537fa0dcfbe1282f59d1052df6af1c140b35d6341e8ce7052407e"} Jun 08 13:01:59.978660 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:59.978422 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r4ngf" event={"ID":"4fcf4863-891b-4b40-b03b-b5a139f5b1d8","Type":"ContainerStarted","Data":"04fb634234445efdfd00490ac0f361cd484c1daa6f211d08d6fe33c0ce76c400"} Jun 08 13:01:59.981562 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:59.981532 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjnpd" event={"ID":"453df3f1-2f91-4834-a7fd-db011cba44d9","Type":"ContainerStarted","Data":"051551b77a2194b1abed238d9e74c40c5577633479fbb0bb0b2e7783aa22f044"} Jun 08 13:01:59.997038 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:01:59.997000 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r4ngf" podStartSLOduration=1.939808469 podStartE2EDuration="3.996987588s" totalImagesPullingTime="2.057179119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:59.996875963 +0000 UTC m=+38.565285043" watchObservedRunningTime="2026-06-08 13:01:59.996987588 +0000 UTC m=+38.565396668" Jun 08 13:02:00.021437 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:00.021390 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cjnpd" podStartSLOduration=9.166866309 podStartE2EDuration="39.021372311s" totalImagesPullingTime="29.854506002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:02:00.019906962 +0000 UTC m=+38.588316043" watchObservedRunningTime="2026-06-08 13:02:00.021372311 +0000 UTC m=+38.589781393" Jun 08 13:02:00.149900 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:00.149866 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:02:00.164998 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:00.164967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:02:00.165204 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:02:00.165182 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:02:00.165284 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:02:00.165263 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls podName:2a6e9a0a-4cff-4501-88d4-ff243a63a8b1 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:04.165236254 +0000 UTC m=+42.733645326 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls") pod "dns-default-wc4l8" (UID: "2a6e9a0a-4cff-4501-88d4-ff243a63a8b1") : secret "dns-default-metrics-tls" not found Jun 08 13:02:00.268085 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:00.268014 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:02:01.380608 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:01.380575 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:02:01.448435 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:01.448401 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:02:01.516532 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:01.516498 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:02:02.649135 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:02.649102 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:02:02.711914 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:02.711886 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:02:02.970461 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:02.970383 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v"] Jun 08 13:02:02.976326 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:02.976310 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" Jun 08 13:02:02.984553 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:02.984525 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 13:02:02.984724 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:02.984640 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 13:02:02.985315 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:02.985293 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 13:02:02.985410 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:02.985334 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v"] Jun 08 13:02:02.985466 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:02.985420 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 08 13:02:03.086350 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:03.086305 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b6d02e3-901e-46a0-9a5b-0ed5d92a3969-tmp\") pod \"klusterlet-addon-workmgr-6d6f54d65b-qsf2v\" (UID: \"2b6d02e3-901e-46a0-9a5b-0ed5d92a3969\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" Jun 08 13:02:03.086565 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:03.086363 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z75xf\" (UniqueName: \"kubernetes.io/projected/2b6d02e3-901e-46a0-9a5b-0ed5d92a3969-kube-api-access-z75xf\") pod \"klusterlet-addon-workmgr-6d6f54d65b-qsf2v\" (UID: \"2b6d02e3-901e-46a0-9a5b-0ed5d92a3969\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" Jun 08 13:02:03.086565 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:03.086393 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2b6d02e3-901e-46a0-9a5b-0ed5d92a3969-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d6f54d65b-qsf2v\" (UID: \"2b6d02e3-901e-46a0-9a5b-0ed5d92a3969\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" Jun 08 13:02:03.187576 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:03.187540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b6d02e3-901e-46a0-9a5b-0ed5d92a3969-tmp\") pod \"klusterlet-addon-workmgr-6d6f54d65b-qsf2v\" (UID: \"2b6d02e3-901e-46a0-9a5b-0ed5d92a3969\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" Jun 08 13:02:03.187746 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:03.187591 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z75xf\" (UniqueName: \"kubernetes.io/projected/2b6d02e3-901e-46a0-9a5b-0ed5d92a3969-kube-api-access-z75xf\") pod \"klusterlet-addon-workmgr-6d6f54d65b-qsf2v\" (UID: \"2b6d02e3-901e-46a0-9a5b-0ed5d92a3969\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" Jun 08 13:02:03.187746 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:03.187619 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2b6d02e3-901e-46a0-9a5b-0ed5d92a3969-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d6f54d65b-qsf2v\" (UID: \"2b6d02e3-901e-46a0-9a5b-0ed5d92a3969\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" Jun 08 13:02:03.187923 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:03.187903 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b6d02e3-901e-46a0-9a5b-0ed5d92a3969-tmp\") pod \"klusterlet-addon-workmgr-6d6f54d65b-qsf2v\" (UID: \"2b6d02e3-901e-46a0-9a5b-0ed5d92a3969\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" Jun 08 13:02:03.191632 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:03.191613 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2b6d02e3-901e-46a0-9a5b-0ed5d92a3969-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d6f54d65b-qsf2v\" (UID: \"2b6d02e3-901e-46a0-9a5b-0ed5d92a3969\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" Jun 08 13:02:03.196085 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:03.196063 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z75xf\" (UniqueName: \"kubernetes.io/projected/2b6d02e3-901e-46a0-9a5b-0ed5d92a3969-kube-api-access-z75xf\") pod \"klusterlet-addon-workmgr-6d6f54d65b-qsf2v\" (UID: \"2b6d02e3-901e-46a0-9a5b-0ed5d92a3969\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" Jun 08 13:02:03.285275 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:03.285178 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" Jun 08 13:02:03.406346 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:03.406314 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v"] Jun 08 13:02:03.410196 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:02:03.410162 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6d02e3_901e_46a0_9a5b_0ed5d92a3969.slice/crio-bf4d3b718323344c9f4e099c506652e6e8a9cb04734eef570d66c2a3394776af WatchSource:0}: Error finding container bf4d3b718323344c9f4e099c506652e6e8a9cb04734eef570d66c2a3394776af: Status 404 returned error can't find the container with id bf4d3b718323344c9f4e099c506652e6e8a9cb04734eef570d66c2a3394776af Jun 08 13:02:03.991883 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:03.991844 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" event={"ID":"2b6d02e3-901e-46a0-9a5b-0ed5d92a3969","Type":"ContainerStarted","Data":"bf4d3b718323344c9f4e099c506652e6e8a9cb04734eef570d66c2a3394776af"} Jun 08 13:02:04.193592 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:04.193561 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:02:04.193777 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:02:04.193740 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:02:04.193857 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:02:04.193843 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls podName:2a6e9a0a-4cff-4501-88d4-ff243a63a8b1 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:12.193819315 +0000 UTC m=+50.762228388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls") pod "dns-default-wc4l8" (UID: "2a6e9a0a-4cff-4501-88d4-ff243a63a8b1") : secret "dns-default-metrics-tls" not found Jun 08 13:02:08.002236 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:08.002198 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" event={"ID":"2b6d02e3-901e-46a0-9a5b-0ed5d92a3969","Type":"ContainerStarted","Data":"df9330bafeb5a739d21f95bbc4525acd77743eab84d23f609e3123435e84c04b"} Jun 08 13:02:08.002795 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:08.002413 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" Jun 08 13:02:08.004051 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:08.004031 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" Jun 08 13:02:08.020043 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:08.020002 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" podStartSLOduration=1.857528398 podStartE2EDuration="6.019991078s" totalImagesPullingTime="4.16246268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:02:08.018762921 +0000 UTC m=+46.587172002" watchObservedRunningTime="2026-06-08 13:02:08.019991078 +0000 UTC m=+46.588400158" Jun 08 13:02:12.252344 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:12.252307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:02:12.252839 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:02:12.252425 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:02:12.252839 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:02:12.252501 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls podName:2a6e9a0a-4cff-4501-88d4-ff243a63a8b1 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:28.252462316 +0000 UTC m=+66.820871375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls") pod "dns-default-wc4l8" (UID: "2a6e9a0a-4cff-4501-88d4-ff243a63a8b1") : secret "dns-default-metrics-tls" not found Jun 08 13:02:21.958538 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:21.958508 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2jgr6" Jun 08 13:02:22.118901 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:22.118872 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:02:22.276287 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:22.276202 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:02:22.828700 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:22.828663 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:02:22.896062 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:22.896036 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:02:27.657691 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:27.657657 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs\") pod \"network-metrics-daemon-jh77v\" (UID: \"0b82f214-ed29-4b52-8974-b1f8e4fd9a14\") " pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:02:27.658196 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:27.657714 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktwbc\" (UniqueName: \"kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc\") pod \"network-check-target-78dp6\" (UID: \"0a7ffd62-b58c-4993-ac03-0ec92420ea42\") " pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:02:27.658196 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:27.657749 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret\") pod \"global-pull-secret-syncer-4s2t4\" (UID: \"65844758-3d62-45e6-93a7-44543a222e80\") " pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:02:27.660439 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:27.660421 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 13:02:27.660540 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:27.660448 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 13:02:27.660610 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:27.660578 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 13:02:27.668717 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:02:27.668701 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 13:02:27.668825 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:02:27.668760 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs podName:0b82f214-ed29-4b52-8974-b1f8e4fd9a14 nodeName:}" failed. No retries permitted until 2026-06-08 13:03:31.668744011 +0000 UTC m=+130.237153071 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs") pod "network-metrics-daemon-jh77v" (UID: "0b82f214-ed29-4b52-8974-b1f8e4fd9a14") : secret "metrics-daemon-secret" not found Jun 08 13:02:27.670870 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:27.670850 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65844758-3d62-45e6-93a7-44543a222e80-original-pull-secret\") pod \"global-pull-secret-syncer-4s2t4\" (UID: \"65844758-3d62-45e6-93a7-44543a222e80\") " pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:02:27.672440 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:27.672428 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 13:02:27.681695 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:27.681671 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktwbc\" (UniqueName: \"kubernetes.io/projected/0a7ffd62-b58c-4993-ac03-0ec92420ea42-kube-api-access-ktwbc\") pod \"network-check-target-78dp6\" (UID: \"0a7ffd62-b58c-4993-ac03-0ec92420ea42\") " pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:02:27.734308 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:27.734285 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g4dhf\"" Jun 08 13:02:27.742424 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:27.742407 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:02:27.744705 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:27.744687 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4s2t4" Jun 08 13:02:27.893149 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:27.893126 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-78dp6"] Jun 08 13:02:27.895344 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:02:27.895320 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a7ffd62_b58c_4993_ac03_0ec92420ea42.slice/crio-6c3a14ef7a1c9221f5e7f9c0c3ef2924487829008d59c36a321156bc4fe3f04d WatchSource:0}: Error finding container 6c3a14ef7a1c9221f5e7f9c0c3ef2924487829008d59c36a321156bc4fe3f04d: Status 404 returned error can't find the container with id 6c3a14ef7a1c9221f5e7f9c0c3ef2924487829008d59c36a321156bc4fe3f04d Jun 08 13:02:27.908223 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:27.908131 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4s2t4"] Jun 08 13:02:27.911993 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:02:27.911971 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65844758_3d62_45e6_93a7_44543a222e80.slice/crio-4a997cf902d3b20c1b83c9a7bcba7180de81c5705d05f29726b35c93af172e88 WatchSource:0}: Error finding container 4a997cf902d3b20c1b83c9a7bcba7180de81c5705d05f29726b35c93af172e88: Status 404 returned error can't find the container with id 4a997cf902d3b20c1b83c9a7bcba7180de81c5705d05f29726b35c93af172e88 Jun 08 13:02:28.049062 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:28.049026 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4s2t4" event={"ID":"65844758-3d62-45e6-93a7-44543a222e80","Type":"ContainerStarted","Data":"4a997cf902d3b20c1b83c9a7bcba7180de81c5705d05f29726b35c93af172e88"} Jun 08 13:02:28.050072 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:28.050049 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-78dp6" event={"ID":"0a7ffd62-b58c-4993-ac03-0ec92420ea42","Type":"ContainerStarted","Data":"6c3a14ef7a1c9221f5e7f9c0c3ef2924487829008d59c36a321156bc4fe3f04d"} Jun 08 13:02:28.261445 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:28.261365 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:02:28.261682 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:02:28.261519 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:02:28.261682 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:02:28.261589 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls podName:2a6e9a0a-4cff-4501-88d4-ff243a63a8b1 nodeName:}" failed. No retries permitted until 2026-06-08 13:03:00.261568349 +0000 UTC m=+98.829977414 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls") pod "dns-default-wc4l8" (UID: "2a6e9a0a-4cff-4501-88d4-ff243a63a8b1") : secret "dns-default-metrics-tls" not found Jun 08 13:02:33.065132 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:33.065094 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4s2t4" event={"ID":"65844758-3d62-45e6-93a7-44543a222e80","Type":"ContainerStarted","Data":"ea112fd881299498fb1970263aae5519927b4d4c18a30aca4b3975c97bc78846"} Jun 08 13:02:33.066585 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:33.066561 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-78dp6" event={"ID":"0a7ffd62-b58c-4993-ac03-0ec92420ea42","Type":"ContainerStarted","Data":"1e560bf3a31d0fc56f898a27dbfa5806efbc2c10738eebaa55cc0d9206cf904c"} Jun 08 13:02:33.066714 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:33.066699 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:02:33.084141 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:33.084094 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4s2t4" podStartSLOduration=66.870997224 podStartE2EDuration="1m11.084081625s" totalImagesPullingTime="4.213084401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:02:33.083209771 +0000 UTC m=+71.651618851" watchObservedRunningTime="2026-06-08 13:02:33.084081625 +0000 UTC m=+71.652490705" Jun 08 13:02:33.104868 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:02:33.104823 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-78dp6" podStartSLOduration=67.878985245 podStartE2EDuration="1m12.104808721s" totalImagesPullingTime="4.225823476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:02:33.103408334 +0000 UTC m=+71.671817414" watchObservedRunningTime="2026-06-08 13:02:33.104808721 +0000 UTC m=+71.673217801" Jun 08 13:03:00.285958 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:03:00.285914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:03:00.286464 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:03:00.286076 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:03:00.286464 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:03:00.286175 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls podName:2a6e9a0a-4cff-4501-88d4-ff243a63a8b1 nodeName:}" failed. No retries permitted until 2026-06-08 13:04:04.286156126 +0000 UTC m=+162.854565204 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls") pod "dns-default-wc4l8" (UID: "2a6e9a0a-4cff-4501-88d4-ff243a63a8b1") : secret "dns-default-metrics-tls" not found Jun 08 13:03:04.071229 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:03:04.071199 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-78dp6" Jun 08 13:03:31.693588 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:03:31.693546 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs\") pod \"network-metrics-daemon-jh77v\" (UID: \"0b82f214-ed29-4b52-8974-b1f8e4fd9a14\") " pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:03:31.694054 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:03:31.693699 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 13:03:31.694054 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:03:31.693766 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs podName:0b82f214-ed29-4b52-8974-b1f8e4fd9a14 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:33.69374927 +0000 UTC m=+252.262158328 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs") pod "network-metrics-daemon-jh77v" (UID: "0b82f214-ed29-4b52-8974-b1f8e4fd9a14") : secret "metrics-daemon-secret" not found Jun 08 13:03:59.431097 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:03:59.431041 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wc4l8" podUID="2a6e9a0a-4cff-4501-88d4-ff243a63a8b1" Jun 08 13:03:59.838813 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:03:59.838735 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:04:00.270447 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:04:00.270418 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wc4l8" Jun 08 13:04:04.311402 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:04:04.311346 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:04:04.311848 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:04:04.311516 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:04:04.311848 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:04:04.311593 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls podName:2a6e9a0a-4cff-4501-88d4-ff243a63a8b1 nodeName:}" failed. No retries permitted until 2026-06-08 13:06:06.311575672 +0000 UTC m=+284.879984730 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls") pod "dns-default-wc4l8" (UID: "2a6e9a0a-4cff-4501-88d4-ff243a63a8b1") : secret "dns-default-metrics-tls" not found Jun 08 13:04:08.003254 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:04:08.003203 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" podUID="2b6d02e3-901e-46a0-9a5b-0ed5d92a3969" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jun 08 13:04:08.290982 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:04:08.290947 2564 generic.go:356] "Generic (PLEG): container finished" podID="2b6d02e3-901e-46a0-9a5b-0ed5d92a3969" containerID="df9330bafeb5a739d21f95bbc4525acd77743eab84d23f609e3123435e84c04b" exitCode=1 Jun 08 13:04:08.291178 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:04:08.291023 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" event={"ID":"2b6d02e3-901e-46a0-9a5b-0ed5d92a3969","Type":"ContainerDied","Data":"df9330bafeb5a739d21f95bbc4525acd77743eab84d23f609e3123435e84c04b"} Jun 08 13:04:08.291415 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:04:08.291398 2564 scope.go:117] "RemoveContainer" containerID="df9330bafeb5a739d21f95bbc4525acd77743eab84d23f609e3123435e84c04b" Jun 08 13:04:09.295314 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:04:09.295281 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" event={"ID":"2b6d02e3-901e-46a0-9a5b-0ed5d92a3969","Type":"ContainerStarted","Data":"6fa44ecb11cbef8c713a394c0e48ada286858fb2b2d7e348470b2343d2bab35b"} Jun 08 13:04:09.295731 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:04:09.295578 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" Jun 08 13:04:09.296157 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:04:09.296141 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d6f54d65b-qsf2v" Jun 08 13:04:15.818615 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:04:15.818573 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:04:18.498718 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:04:18.498675 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:17.225435 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.225400 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6498b68ff5-glft8"] Jun 08 13:05:17.228272 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.228253 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.232500 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.232462 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v"] Jun 08 13:05:17.233349 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.233327 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 13:05:17.233492 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.233401 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 13:05:17.233492 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.233401 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2kwt7\"" Jun 08 13:05:17.234053 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.234039 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 13:05:17.235176 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.235159 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" Jun 08 13:05:17.241460 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.241439 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9xmsd\"" Jun 08 13:05:17.241710 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.241692 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 08 13:05:17.242410 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.242388 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:05:17.242498 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.242422 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 08 13:05:17.257104 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.257053 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v"] Jun 08 13:05:17.257715 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.257686 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 13:05:17.261343 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.261319 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6498b68ff5-glft8"] Jun 08 13:05:17.297692 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.297654 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-fb45v\" (UID: \"d0a0da61-7a6e-498a-9228-2e7849874051\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" Jun 08 13:05:17.297692 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.297690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmk68\" (UniqueName: \"kubernetes.io/projected/d0a0da61-7a6e-498a-9228-2e7849874051-kube-api-access-jmk68\") pod \"cluster-samples-operator-854f8b96b6-fb45v\" (UID: \"d0a0da61-7a6e-498a-9228-2e7849874051\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" Jun 08 13:05:17.297944 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.297773 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-bound-sa-token\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.297944 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.297812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9c901e6-9eb6-4acc-b28d-83f63207f869-image-registry-private-configuration\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.297944 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.297839 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9c901e6-9eb6-4acc-b28d-83f63207f869-installation-pull-secrets\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.297944 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.297884 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9c901e6-9eb6-4acc-b28d-83f63207f869-ca-trust-extracted\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.297944 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.297929 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.298130 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.297959 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-certificates\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.298130 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.297980 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dt8j\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-kube-api-access-8dt8j\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.298130 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.298004 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9c901e6-9eb6-4acc-b28d-83f63207f869-trusted-ca\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.320987 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.320957 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5595dd76b9-v9wcr"] Jun 08 13:05:17.323912 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.323897 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:17.326672 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.326647 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 08 13:05:17.326909 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.326891 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kv8xz\"" Jun 08 13:05:17.327652 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.327638 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 08 13:05:17.329302 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.329284 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 08 13:05:17.329581 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.329558 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 13:05:17.329889 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.329823 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 08 13:05:17.332205 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.332188 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 13:05:17.357544 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.357512 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5595dd76b9-v9wcr"] Jun 08 13:05:17.398691 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.398658 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9c901e6-9eb6-4acc-b28d-83f63207f869-ca-trust-extracted\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.398691 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.398698 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.398903 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.398716 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-certificates\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.398903 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.398771 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dt8j\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-kube-api-access-8dt8j\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.398903 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:17.398814 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:05:17.398903 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:17.398834 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6498b68ff5-glft8: secret "image-registry-tls" not found Jun 08 13:05:17.398903 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:17.398883 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls podName:a9c901e6-9eb6-4acc-b28d-83f63207f869 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:17.898866295 +0000 UTC m=+236.467275357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls") pod "image-registry-6498b68ff5-glft8" (UID: "a9c901e6-9eb6-4acc-b28d-83f63207f869") : secret "image-registry-tls" not found Jun 08 13:05:17.398903 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.398815 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8zqr\" (UniqueName: \"kubernetes.io/projected/50e14859-9356-4e8c-bf60-beb946fea0b3-kube-api-access-t8zqr\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:17.399136 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.398941 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9c901e6-9eb6-4acc-b28d-83f63207f869-trusted-ca\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.399136 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.398983 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-fb45v\" (UID: \"d0a0da61-7a6e-498a-9228-2e7849874051\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" Jun 08 13:05:17.399136 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.399012 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmk68\" (UniqueName: \"kubernetes.io/projected/d0a0da61-7a6e-498a-9228-2e7849874051-kube-api-access-jmk68\") pod \"cluster-samples-operator-854f8b96b6-fb45v\" (UID: \"d0a0da61-7a6e-498a-9228-2e7849874051\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" Jun 08 13:05:17.399136 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.399075 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-bound-sa-token\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.399136 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.399101 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:17.399136 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.399135 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-stats-auth\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:17.399410 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.399157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:17.399410 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:17.399165 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 13:05:17.399410 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.399188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9c901e6-9eb6-4acc-b28d-83f63207f869-image-registry-private-configuration\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.399410 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.399208 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9c901e6-9eb6-4acc-b28d-83f63207f869-ca-trust-extracted\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.399410 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.399217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9c901e6-9eb6-4acc-b28d-83f63207f869-installation-pull-secrets\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.399410 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:17.399243 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls podName:d0a0da61-7a6e-498a-9228-2e7849874051 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:17.899223712 +0000 UTC m=+236.467632784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-fb45v" (UID: "d0a0da61-7a6e-498a-9228-2e7849874051") : secret "samples-operator-tls" not found Jun 08 13:05:17.399410 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.399290 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-default-certificate\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:17.399410 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.399372 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-certificates\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.399810 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.399795 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9c901e6-9eb6-4acc-b28d-83f63207f869-trusted-ca\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.401534 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.401506 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9c901e6-9eb6-4acc-b28d-83f63207f869-installation-pull-secrets\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.401647 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.401573 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9c901e6-9eb6-4acc-b28d-83f63207f869-image-registry-private-configuration\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.412793 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.412772 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dt8j\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-kube-api-access-8dt8j\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.414324 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.414303 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-bound-sa-token\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.415871 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.415853 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmk68\" (UniqueName: \"kubernetes.io/projected/d0a0da61-7a6e-498a-9228-2e7849874051-kube-api-access-jmk68\") pod \"cluster-samples-operator-854f8b96b6-fb45v\" (UID: \"d0a0da61-7a6e-498a-9228-2e7849874051\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" Jun 08 13:05:17.499924 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.499861 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:17.499924 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.499888 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-stats-auth\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:17.499924 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.499904 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:17.500108 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.499928 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-default-certificate\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:17.500108 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.499993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8zqr\" (UniqueName: \"kubernetes.io/projected/50e14859-9356-4e8c-bf60-beb946fea0b3-kube-api-access-t8zqr\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:17.500108 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:17.500022 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 13:05:17.500108 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:17.500036 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle podName:50e14859-9356-4e8c-bf60-beb946fea0b3 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:18.000014618 +0000 UTC m=+236.568423693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle") pod "router-default-5595dd76b9-v9wcr" (UID: "50e14859-9356-4e8c-bf60-beb946fea0b3") : configmap references non-existent config key: service-ca.crt Jun 08 13:05:17.500108 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:17.500072 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs podName:50e14859-9356-4e8c-bf60-beb946fea0b3 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:18.000056392 +0000 UTC m=+236.568465484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs") pod "router-default-5595dd76b9-v9wcr" (UID: "50e14859-9356-4e8c-bf60-beb946fea0b3") : secret "router-metrics-certs-default" not found Jun 08 13:05:17.502138 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.502115 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-stats-auth\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:17.502232 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.502146 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-default-certificate\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:17.514978 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.514925 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8zqr\" (UniqueName: \"kubernetes.io/projected/50e14859-9356-4e8c-bf60-beb946fea0b3-kube-api-access-t8zqr\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:17.545425 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.545396 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:17.903319 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.903291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:17.903508 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:17.903345 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-fb45v\" (UID: \"d0a0da61-7a6e-498a-9228-2e7849874051\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" Jun 08 13:05:17.903508 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:17.903428 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 13:05:17.903508 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:17.903504 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls podName:d0a0da61-7a6e-498a-9228-2e7849874051 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:18.903461965 +0000 UTC m=+237.471871023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-fb45v" (UID: "d0a0da61-7a6e-498a-9228-2e7849874051") : secret "samples-operator-tls" not found Jun 08 13:05:17.903680 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:17.903545 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:05:17.903680 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:17.903567 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6498b68ff5-glft8: secret "image-registry-tls" not found Jun 08 13:05:17.903680 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:17.903637 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls podName:a9c901e6-9eb6-4acc-b28d-83f63207f869 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:18.903619125 +0000 UTC m=+237.472028198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls") pod "image-registry-6498b68ff5-glft8" (UID: "a9c901e6-9eb6-4acc-b28d-83f63207f869") : secret "image-registry-tls" not found Jun 08 13:05:18.003994 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:18.003955 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:18.003994 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:18.003995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:18.004229 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:18.004110 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 13:05:18.004229 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:18.004116 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle podName:50e14859-9356-4e8c-bf60-beb946fea0b3 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:19.004100065 +0000 UTC m=+237.572509123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle") pod "router-default-5595dd76b9-v9wcr" (UID: "50e14859-9356-4e8c-bf60-beb946fea0b3") : configmap references non-existent config key: service-ca.crt Jun 08 13:05:18.004229 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:18.004174 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs podName:50e14859-9356-4e8c-bf60-beb946fea0b3 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:19.004157575 +0000 UTC m=+237.572566637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs") pod "router-default-5595dd76b9-v9wcr" (UID: "50e14859-9356-4e8c-bf60-beb946fea0b3") : secret "router-metrics-certs-default" not found Jun 08 13:05:18.733811 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:18.733773 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:18.911546 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:18.911512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:18.911753 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:18.911568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-fb45v\" (UID: \"d0a0da61-7a6e-498a-9228-2e7849874051\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" Jun 08 13:05:18.911753 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:18.911647 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:05:18.911753 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:18.911666 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6498b68ff5-glft8: secret "image-registry-tls" not found Jun 08 13:05:18.911753 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:18.911689 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 13:05:18.911753 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:18.911719 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls podName:a9c901e6-9eb6-4acc-b28d-83f63207f869 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:20.911703591 +0000 UTC m=+239.480112649 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls") pod "image-registry-6498b68ff5-glft8" (UID: "a9c901e6-9eb6-4acc-b28d-83f63207f869") : secret "image-registry-tls" not found Jun 08 13:05:18.911753 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:18.911735 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls podName:d0a0da61-7a6e-498a-9228-2e7849874051 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:20.911729083 +0000 UTC m=+239.480138141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-fb45v" (UID: "d0a0da61-7a6e-498a-9228-2e7849874051") : secret "samples-operator-tls" not found Jun 08 13:05:19.012109 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:19.012038 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:19.012109 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:19.012075 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:19.012222 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:19.012206 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle podName:50e14859-9356-4e8c-bf60-beb946fea0b3 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:21.012180895 +0000 UTC m=+239.580589970 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle") pod "router-default-5595dd76b9-v9wcr" (UID: "50e14859-9356-4e8c-bf60-beb946fea0b3") : configmap references non-existent config key: service-ca.crt Jun 08 13:05:19.012265 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:19.012223 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 13:05:19.012265 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:19.012261 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs podName:50e14859-9356-4e8c-bf60-beb946fea0b3 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:21.012251646 +0000 UTC m=+239.580660706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs") pod "router-default-5595dd76b9-v9wcr" (UID: "50e14859-9356-4e8c-bf60-beb946fea0b3") : secret "router-metrics-certs-default" not found Jun 08 13:05:20.926548 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:20.926511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-fb45v\" (UID: \"d0a0da61-7a6e-498a-9228-2e7849874051\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" Jun 08 13:05:20.926968 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:20.926607 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:20.926968 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:20.926669 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 13:05:20.926968 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:20.926748 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls podName:d0a0da61-7a6e-498a-9228-2e7849874051 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:24.926729281 +0000 UTC m=+243.495138345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-fb45v" (UID: "d0a0da61-7a6e-498a-9228-2e7849874051") : secret "samples-operator-tls" not found Jun 08 13:05:20.926968 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:20.926777 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:05:20.926968 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:20.926797 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6498b68ff5-glft8: secret "image-registry-tls" not found Jun 08 13:05:20.926968 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:20.926868 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls podName:a9c901e6-9eb6-4acc-b28d-83f63207f869 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:24.926850887 +0000 UTC m=+243.495259945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls") pod "image-registry-6498b68ff5-glft8" (UID: "a9c901e6-9eb6-4acc-b28d-83f63207f869") : secret "image-registry-tls" not found Jun 08 13:05:21.027327 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:21.027297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:21.027327 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:21.027330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:21.027540 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:21.027450 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 13:05:21.027540 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:21.027525 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs podName:50e14859-9356-4e8c-bf60-beb946fea0b3 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:25.027508731 +0000 UTC m=+243.595917789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs") pod "router-default-5595dd76b9-v9wcr" (UID: "50e14859-9356-4e8c-bf60-beb946fea0b3") : secret "router-metrics-certs-default" not found Jun 08 13:05:21.027618 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:21.027555 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle podName:50e14859-9356-4e8c-bf60-beb946fea0b3 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:25.027541207 +0000 UTC m=+243.595950265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle") pod "router-default-5595dd76b9-v9wcr" (UID: "50e14859-9356-4e8c-bf60-beb946fea0b3") : configmap references non-existent config key: service-ca.crt Jun 08 13:05:22.857548 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:22.857510 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:23.010751 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:23.010720 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:23.079006 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:23.078969 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:23.206463 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:23.206432 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:23.290632 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:23.290601 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:23.522740 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:23.522643 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:23.617429 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:23.617398 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:23.871641 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:23.871546 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:23.977429 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:23.977390 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:24.958948 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:24.958901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:24.959344 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:24.958974 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-fb45v\" (UID: \"d0a0da61-7a6e-498a-9228-2e7849874051\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" Jun 08 13:05:24.959344 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:24.959072 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 13:05:24.959344 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:24.959088 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 08 13:05:24.959344 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:24.959094 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6498b68ff5-glft8: secret "image-registry-tls" not found Jun 08 13:05:24.959344 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:24.959150 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls podName:d0a0da61-7a6e-498a-9228-2e7849874051 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:32.95913441 +0000 UTC m=+251.527543468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-fb45v" (UID: "d0a0da61-7a6e-498a-9228-2e7849874051") : secret "samples-operator-tls" not found Jun 08 13:05:24.959344 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:24.959163 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls podName:a9c901e6-9eb6-4acc-b28d-83f63207f869 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:32.959157373 +0000 UTC m=+251.527566431 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls") pod "image-registry-6498b68ff5-glft8" (UID: "a9c901e6-9eb6-4acc-b28d-83f63207f869") : secret "image-registry-tls" not found Jun 08 13:05:25.059723 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:25.059689 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:25.059723 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:25.059724 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:25.059965 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:25.059829 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 13:05:25.059965 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:25.059855 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle podName:50e14859-9356-4e8c-bf60-beb946fea0b3 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:33.059834998 +0000 UTC m=+251.628244077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle") pod "router-default-5595dd76b9-v9wcr" (UID: "50e14859-9356-4e8c-bf60-beb946fea0b3") : configmap references non-existent config key: service-ca.crt Jun 08 13:05:25.059965 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:25.059946 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs podName:50e14859-9356-4e8c-bf60-beb946fea0b3 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:33.059938034 +0000 UTC m=+251.628347092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs") pod "router-default-5595dd76b9-v9wcr" (UID: "50e14859-9356-4e8c-bf60-beb946fea0b3") : secret "router-metrics-certs-default" not found Jun 08 13:05:25.515602 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:25.515558 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:25.639441 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:25.639414 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:25.826936 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:25.826850 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:25.952606 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:25.952572 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:25.967442 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:25.967415 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pkk6k_be941842-dde4-47f6-9308-75450cdd10b6/dns-node-resolver/0.log" Jun 08 13:05:26.768058 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:26.768032 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qffqs_5b4d19e3-e415-4cd0-90f3-076ab16ff1dc/node-ca/0.log" Jun 08 13:05:26.787671 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:26.787644 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:27.738778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:27.738745 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:27.910200 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:27.910169 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:27.980442 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:27.980418 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r4ngf_4fcf4863-891b-4b40-b03b-b5a139f5b1d8/serve-healthcheck-canary/0.log" Jun 08 13:05:28.075697 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:28.075601 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:28.193131 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:28.193090 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:28.363866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:28.363770 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:28.614874 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:28.614791 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:29.341653 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:29.341597 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:29.715116 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:29.715086 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:29.920095 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:29.920057 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:30.134491 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:30.134447 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:30.544387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:30.544299 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:31.052787 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:31.052760 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:31.152323 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:31.152295 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:31.516600 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:31.516554 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:31.620695 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:31.620667 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:31.748838 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:31.748811 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:31.991863 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:31.991816 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:32.205163 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:32.205132 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:32.514220 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:32.514187 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:33.026889 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.026840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-fb45v\" (UID: \"d0a0da61-7a6e-498a-9228-2e7849874051\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" Jun 08 13:05:33.027265 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.026937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:33.029290 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.029263 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d0a0da61-7a6e-498a-9228-2e7849874051-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-fb45v\" (UID: \"d0a0da61-7a6e-498a-9228-2e7849874051\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" Jun 08 13:05:33.029392 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.029310 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls\") pod \"image-registry-6498b68ff5-glft8\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:33.127536 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.127487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:33.127536 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.127535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:33.127735 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:33.127666 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle podName:50e14859-9356-4e8c-bf60-beb946fea0b3 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:49.127645745 +0000 UTC m=+267.696054804 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle") pod "router-default-5595dd76b9-v9wcr" (UID: "50e14859-9356-4e8c-bf60-beb946fea0b3") : configmap references non-existent config key: service-ca.crt Jun 08 13:05:33.129727 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.129709 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50e14859-9356-4e8c-bf60-beb946fea0b3-metrics-certs\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:33.140545 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.140518 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2kwt7\"" Jun 08 13:05:33.146265 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.146249 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9xmsd\"" Jun 08 13:05:33.148237 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.148221 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:33.154215 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.154202 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" Jun 08 13:05:33.284394 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.284303 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6498b68ff5-glft8"] Jun 08 13:05:33.287188 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:05:33.287161 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c901e6_9eb6_4acc_b28d_83f63207f869.slice/crio-d91a7972e67e1efbfa33722f02d139f98f386c323e5377390f6124f449262fc6 WatchSource:0}: Error finding container d91a7972e67e1efbfa33722f02d139f98f386c323e5377390f6124f449262fc6: Status 404 returned error can't find the container with id d91a7972e67e1efbfa33722f02d139f98f386c323e5377390f6124f449262fc6 Jun 08 13:05:33.301437 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.301408 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v"] Jun 08 13:05:33.313515 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.313491 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:33.499793 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.499755 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" event={"ID":"d0a0da61-7a6e-498a-9228-2e7849874051","Type":"ContainerStarted","Data":"d5fdb5e0f0593ed6e77f6fb7bdca51ce25082d92cd56cead2da5463770cf43d8"} Jun 08 13:05:33.501247 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.501221 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6498b68ff5-glft8" event={"ID":"a9c901e6-9eb6-4acc-b28d-83f63207f869","Type":"ContainerStarted","Data":"9b50f515b8bdd8512696d53324a2af4d75af83d8cc3ce082ab0c2c8120897e97"} Jun 08 13:05:33.501363 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.501262 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6498b68ff5-glft8" event={"ID":"a9c901e6-9eb6-4acc-b28d-83f63207f869","Type":"ContainerStarted","Data":"d91a7972e67e1efbfa33722f02d139f98f386c323e5377390f6124f449262fc6"} Jun 08 13:05:33.501363 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.501359 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:05:33.523467 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.523416 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6498b68ff5-glft8" podStartSLOduration=16.523399281 podStartE2EDuration="16.523399281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:05:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:33.523360236 +0000 UTC m=+252.091769327" watchObservedRunningTime="2026-06-08 13:05:33.523399281 +0000 UTC m=+252.091808361" Jun 08 13:05:33.525964 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.525936 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:33.733270 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.733231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs\") pod \"network-metrics-daemon-jh77v\" (UID: \"0b82f214-ed29-4b52-8974-b1f8e4fd9a14\") " pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:05:33.733448 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:33.733373 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 13:05:33.733448 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:05:33.733440 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs podName:0b82f214-ed29-4b52-8974-b1f8e4fd9a14 nodeName:}" failed. No retries permitted until 2026-06-08 13:07:35.733424446 +0000 UTC m=+374.301833505 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs") pod "network-metrics-daemon-jh77v" (UID: "0b82f214-ed29-4b52-8974-b1f8e4fd9a14") : secret "metrics-daemon-secret" not found Jun 08 13:05:33.908785 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:33.908749 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:34.162488 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:34.162408 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:34.307563 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:34.307529 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:34.535449 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:34.535368 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:35.108984 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:35.108946 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:35.507525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:35.507489 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:35.510348 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:35.510325 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" event={"ID":"d0a0da61-7a6e-498a-9228-2e7849874051","Type":"ContainerStarted","Data":"99b586a71f7972a53d0510016a3a4aa8a151d49d3e02991a8ea0355c270c12cd"} Jun 08 13:05:35.510489 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:35.510370 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" event={"ID":"d0a0da61-7a6e-498a-9228-2e7849874051","Type":"ContainerStarted","Data":"b374702092db53d8136f3a8aa6a4ee061d8ccbc2d1683506c5538a818f80b05e"} Jun 08 13:05:35.538259 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:35.536697 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-fb45v" podStartSLOduration=16.688300343 podStartE2EDuration="18.536678697s" totalImagesPullingTime="1.848378354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:35.534963241 +0000 UTC m=+254.103372323" watchObservedRunningTime="2026-06-08 13:05:35.536678697 +0000 UTC m=+254.105087779" Jun 08 13:05:35.708858 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:35.708829 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:35.824594 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:35.824508 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:36.142117 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:36.142085 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:36.930020 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:36.929991 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:37.345613 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:37.345526 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:37.575097 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:37.575069 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:37.746679 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:37.746642 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:37.934177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:37.934137 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:38.354942 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:38.354910 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:39.154866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:39.154832 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:39.353242 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:39.353205 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:40.013492 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:40.013447 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:40.116007 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:40.115971 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:47.486617 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.486585 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kv8tp"] Jun 08 13:05:47.491358 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.491340 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.495064 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.495043 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 13:05:47.495621 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.495606 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 13:05:47.496167 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.496147 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 13:05:47.496301 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.496168 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 13:05:47.496389 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.496371 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h74dt\"" Jun 08 13:05:47.508572 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.508546 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kv8tp"] Jun 08 13:05:47.526018 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.525984 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6498b68ff5-glft8"] Jun 08 13:05:47.626428 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.626391 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58dff7d848-97qq4"] Jun 08 13:05:47.629565 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.629539 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.634322 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.634286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b562dbc-4104-43fd-b271-5435f01b9fb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kv8tp\" (UID: \"2b562dbc-4104-43fd-b271-5435f01b9fb7\") " pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.634496 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.634352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b562dbc-4104-43fd-b271-5435f01b9fb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kv8tp\" (UID: \"2b562dbc-4104-43fd-b271-5435f01b9fb7\") " pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.634496 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.634444 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b562dbc-4104-43fd-b271-5435f01b9fb7-crio-socket\") pod \"insights-runtime-extractor-kv8tp\" (UID: \"2b562dbc-4104-43fd-b271-5435f01b9fb7\") " pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.634600 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.634524 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b562dbc-4104-43fd-b271-5435f01b9fb7-data-volume\") pod \"insights-runtime-extractor-kv8tp\" (UID: \"2b562dbc-4104-43fd-b271-5435f01b9fb7\") " pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.634600 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.634546 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-545j6\" (UniqueName: \"kubernetes.io/projected/2b562dbc-4104-43fd-b271-5435f01b9fb7-kube-api-access-545j6\") pod \"insights-runtime-extractor-kv8tp\" (UID: \"2b562dbc-4104-43fd-b271-5435f01b9fb7\") " pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.649597 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.649567 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58dff7d848-97qq4"] Jun 08 13:05:47.702619 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.702581 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:47.735829 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.735792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68aef9b0-125e-408f-a4e2-9fda3d8eb111-trusted-ca\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.735962 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.735833 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68aef9b0-125e-408f-a4e2-9fda3d8eb111-bound-sa-token\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.736005 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.735955 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b562dbc-4104-43fd-b271-5435f01b9fb7-crio-socket\") pod \"insights-runtime-extractor-kv8tp\" (UID: \"2b562dbc-4104-43fd-b271-5435f01b9fb7\") " pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.736005 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.735986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68aef9b0-125e-408f-a4e2-9fda3d8eb111-installation-pull-secrets\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.736073 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.736012 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snhcs\" (UniqueName: \"kubernetes.io/projected/68aef9b0-125e-408f-a4e2-9fda3d8eb111-kube-api-access-snhcs\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.736073 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.736047 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b562dbc-4104-43fd-b271-5435f01b9fb7-data-volume\") pod \"insights-runtime-extractor-kv8tp\" (UID: \"2b562dbc-4104-43fd-b271-5435f01b9fb7\") " pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.736073 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.736070 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68aef9b0-125e-408f-a4e2-9fda3d8eb111-ca-trust-extracted\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.736163 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.736071 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b562dbc-4104-43fd-b271-5435f01b9fb7-crio-socket\") pod \"insights-runtime-extractor-kv8tp\" (UID: \"2b562dbc-4104-43fd-b271-5435f01b9fb7\") " pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.736163 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.736087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-545j6\" (UniqueName: \"kubernetes.io/projected/2b562dbc-4104-43fd-b271-5435f01b9fb7-kube-api-access-545j6\") pod \"insights-runtime-extractor-kv8tp\" (UID: \"2b562dbc-4104-43fd-b271-5435f01b9fb7\") " pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.736225 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.736211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b562dbc-4104-43fd-b271-5435f01b9fb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kv8tp\" (UID: \"2b562dbc-4104-43fd-b271-5435f01b9fb7\") " pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.736260 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.736246 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68aef9b0-125e-408f-a4e2-9fda3d8eb111-image-registry-private-configuration\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.736293 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.736283 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68aef9b0-125e-408f-a4e2-9fda3d8eb111-registry-tls\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.736338 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.736308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b562dbc-4104-43fd-b271-5435f01b9fb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kv8tp\" (UID: \"2b562dbc-4104-43fd-b271-5435f01b9fb7\") " pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.736374 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.736346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68aef9b0-125e-408f-a4e2-9fda3d8eb111-registry-certificates\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.736505 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.736490 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b562dbc-4104-43fd-b271-5435f01b9fb7-data-volume\") pod \"insights-runtime-extractor-kv8tp\" (UID: \"2b562dbc-4104-43fd-b271-5435f01b9fb7\") " pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.736834 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.736792 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b562dbc-4104-43fd-b271-5435f01b9fb7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kv8tp\" (UID: \"2b562dbc-4104-43fd-b271-5435f01b9fb7\") " pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.738529 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.738511 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b562dbc-4104-43fd-b271-5435f01b9fb7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kv8tp\" (UID: \"2b562dbc-4104-43fd-b271-5435f01b9fb7\") " pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.749869 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.749835 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-545j6\" (UniqueName: \"kubernetes.io/projected/2b562dbc-4104-43fd-b271-5435f01b9fb7-kube-api-access-545j6\") pod \"insights-runtime-extractor-kv8tp\" (UID: \"2b562dbc-4104-43fd-b271-5435f01b9fb7\") " pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.800366 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.800326 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kv8tp" Jun 08 13:05:47.837426 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.837394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68aef9b0-125e-408f-a4e2-9fda3d8eb111-image-registry-private-configuration\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.837609 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.837435 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68aef9b0-125e-408f-a4e2-9fda3d8eb111-registry-tls\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.837658 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.837637 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68aef9b0-125e-408f-a4e2-9fda3d8eb111-registry-certificates\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.837706 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.837692 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68aef9b0-125e-408f-a4e2-9fda3d8eb111-trusted-ca\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.837756 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.837725 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68aef9b0-125e-408f-a4e2-9fda3d8eb111-bound-sa-token\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.837809 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.837797 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68aef9b0-125e-408f-a4e2-9fda3d8eb111-installation-pull-secrets\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.837873 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.837835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snhcs\" (UniqueName: \"kubernetes.io/projected/68aef9b0-125e-408f-a4e2-9fda3d8eb111-kube-api-access-snhcs\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.837930 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.837880 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68aef9b0-125e-408f-a4e2-9fda3d8eb111-ca-trust-extracted\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.838332 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.838306 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68aef9b0-125e-408f-a4e2-9fda3d8eb111-ca-trust-extracted\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.838498 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.838464 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68aef9b0-125e-408f-a4e2-9fda3d8eb111-registry-certificates\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.838688 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.838660 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68aef9b0-125e-408f-a4e2-9fda3d8eb111-trusted-ca\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.840251 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.840232 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68aef9b0-125e-408f-a4e2-9fda3d8eb111-image-registry-private-configuration\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.840334 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.840316 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68aef9b0-125e-408f-a4e2-9fda3d8eb111-installation-pull-secrets\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.840695 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.840674 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68aef9b0-125e-408f-a4e2-9fda3d8eb111-registry-tls\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.856645 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.856607 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68aef9b0-125e-408f-a4e2-9fda3d8eb111-bound-sa-token\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.865949 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.865909 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snhcs\" (UniqueName: \"kubernetes.io/projected/68aef9b0-125e-408f-a4e2-9fda3d8eb111-kube-api-access-snhcs\") pod \"image-registry-58dff7d848-97qq4\" (UID: \"68aef9b0-125e-408f-a4e2-9fda3d8eb111\") " pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.938218 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.938179 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:47.950970 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.950943 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kv8tp"] Jun 08 13:05:47.954005 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:05:47.953982 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b562dbc_4104_43fd_b271_5435f01b9fb7.slice/crio-f2eb0606667535c5427547796714e6517071bba977cd25eeec37c0c6cc927ad8 WatchSource:0}: Error finding container f2eb0606667535c5427547796714e6517071bba977cd25eeec37c0c6cc927ad8: Status 404 returned error can't find the container with id f2eb0606667535c5427547796714e6517071bba977cd25eeec37c0c6cc927ad8 Jun 08 13:05:47.966881 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:47.966816 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:48.110543 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:48.110516 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58dff7d848-97qq4"] Jun 08 13:05:48.112812 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:05:48.112789 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68aef9b0_125e_408f_a4e2_9fda3d8eb111.slice/crio-12d978a2257c6ae291a5fb39cc6654c99723ef7d8fcbccf6b8ab9f4176cfbc07 WatchSource:0}: Error finding container 12d978a2257c6ae291a5fb39cc6654c99723ef7d8fcbccf6b8ab9f4176cfbc07: Status 404 returned error can't find the container with id 12d978a2257c6ae291a5fb39cc6654c99723ef7d8fcbccf6b8ab9f4176cfbc07 Jun 08 13:05:48.150139 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:48.150111 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:48.552035 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:48.552000 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58dff7d848-97qq4" event={"ID":"68aef9b0-125e-408f-a4e2-9fda3d8eb111","Type":"ContainerStarted","Data":"a185aca0d9159bfb493e1b891dbd41ba8049328869859fd94c246a3a960fa767"} Jun 08 13:05:48.552455 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:48.552056 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58dff7d848-97qq4" event={"ID":"68aef9b0-125e-408f-a4e2-9fda3d8eb111","Type":"ContainerStarted","Data":"12d978a2257c6ae291a5fb39cc6654c99723ef7d8fcbccf6b8ab9f4176cfbc07"} Jun 08 13:05:48.552455 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:48.552100 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:05:48.553447 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:48.553426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kv8tp" event={"ID":"2b562dbc-4104-43fd-b271-5435f01b9fb7","Type":"ContainerStarted","Data":"ac92db6a00d78d915cfb3bd4aef82f683bb88c1d17aa1f2329e37192c5e81a79"} Jun 08 13:05:48.553572 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:48.553466 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kv8tp" event={"ID":"2b562dbc-4104-43fd-b271-5435f01b9fb7","Type":"ContainerStarted","Data":"f2eb0606667535c5427547796714e6517071bba977cd25eeec37c0c6cc927ad8"} Jun 08 13:05:48.577203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:48.577153 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58dff7d848-97qq4" podStartSLOduration=1.5771378249999999 podStartE2EDuration="1.577137825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:05:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:48.576673168 +0000 UTC m=+267.145082262" watchObservedRunningTime="2026-06-08 13:05:48.577137825 +0000 UTC m=+267.145546911" Jun 08 13:05:49.148134 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:49.148084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:49.148763 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:49.148742 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50e14859-9356-4e8c-bf60-beb946fea0b3-service-ca-bundle\") pod \"router-default-5595dd76b9-v9wcr\" (UID: \"50e14859-9356-4e8c-bf60-beb946fea0b3\") " pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:49.436421 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:49.436345 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kv8xz\"" Jun 08 13:05:49.443825 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:49.443803 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:49.560276 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:49.560241 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kv8tp" event={"ID":"2b562dbc-4104-43fd-b271-5435f01b9fb7","Type":"ContainerStarted","Data":"95b6b1cdee37ae0ce0d3eb6cc5899e1f6e2f116d91b18e56657decc5e92f0f94"} Jun 08 13:05:49.603203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:49.603177 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5595dd76b9-v9wcr"] Jun 08 13:05:49.606158 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:05:49.606134 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e14859_9356_4e8c_bf60_beb946fea0b3.slice/crio-04a0bbdad5dc141826ee7fe2c9f7492b4ae6fa505b953fb532d8f8333548b5b0 WatchSource:0}: Error finding container 04a0bbdad5dc141826ee7fe2c9f7492b4ae6fa505b953fb532d8f8333548b5b0: Status 404 returned error can't find the container with id 04a0bbdad5dc141826ee7fe2c9f7492b4ae6fa505b953fb532d8f8333548b5b0 Jun 08 13:05:50.564685 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:50.564648 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5595dd76b9-v9wcr" event={"ID":"50e14859-9356-4e8c-bf60-beb946fea0b3","Type":"ContainerStarted","Data":"2e65fb5041666c13b5e2e4a566c0750db13ff841e924da4a30f88b0a2b3f9b91"} Jun 08 13:05:50.564685 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:50.564694 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5595dd76b9-v9wcr" event={"ID":"50e14859-9356-4e8c-bf60-beb946fea0b3","Type":"ContainerStarted","Data":"04a0bbdad5dc141826ee7fe2c9f7492b4ae6fa505b953fb532d8f8333548b5b0"} Jun 08 13:05:50.604892 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:50.604848 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5595dd76b9-v9wcr" podStartSLOduration=33.604832867 podStartE2EDuration="33.604832867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:05:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:50.604422631 +0000 UTC m=+269.172831713" watchObservedRunningTime="2026-06-08 13:05:50.604832867 +0000 UTC m=+269.173241948" Jun 08 13:05:51.444918 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:51.444880 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:51.447267 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:51.447246 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:51.569614 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:51.569579 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kv8tp" event={"ID":"2b562dbc-4104-43fd-b271-5435f01b9fb7","Type":"ContainerStarted","Data":"55f620121bb6fb30e608211447fbf30ee701a38d713b653166c58ca5408f6bba"} Jun 08 13:05:51.569998 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:51.569947 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:51.571014 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:51.570998 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5595dd76b9-v9wcr" Jun 08 13:05:51.631339 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:51.631288 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kv8tp" podStartSLOduration=2.118276883 podStartE2EDuration="4.631269344s" totalImagesPullingTime="2.512992461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:05:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:51.630461612 +0000 UTC m=+270.198870692" watchObservedRunningTime="2026-06-08 13:05:51.631269344 +0000 UTC m=+270.199678406" Jun 08 13:05:51.670221 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:51.670196 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:51.801830 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:51.801798 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:51.926230 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:51.926193 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:52.454419 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:52.454380 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:55.059225 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:55.059183 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:55.214566 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:55.214534 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:55.357769 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:55.357682 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:57.510228 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:57.510174 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:57.531912 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:57.531869 2564 patch_prober.go:28] interesting pod/image-registry-6498b68ff5-glft8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 13:05:57.532086 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:57.531946 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6498b68ff5-glft8" podUID="a9c901e6-9eb6-4acc-b28d-83f63207f869" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 13:05:59.488994 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:59.488961 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:59.788764 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:59.788683 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:05:59.929360 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:05:59.929323 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:00.126998 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.126962 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rrgzc"] Jun 08 13:06:00.132845 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.132822 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.137214 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.137194 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 13:06:00.137337 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.137269 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 13:06:00.138563 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.138542 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 13:06:00.138659 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.138563 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 13:06:00.138999 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.138977 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 13:06:00.139953 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.139935 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 13:06:00.140966 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.140950 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c4gz5\"" Jun 08 13:06:00.167990 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.167960 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:00.232123 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.232094 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-node-exporter-textfile\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.232293 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.232144 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-root\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.232293 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.232172 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-metrics-client-ca\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.232293 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.232197 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-sys\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.232293 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.232220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-node-exporter-wtmp\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.232293 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.232237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.232450 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.232288 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpxdh\" (UniqueName: \"kubernetes.io/projected/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-kube-api-access-vpxdh\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.232450 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.232319 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-node-exporter-tls\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.232450 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.232344 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.315351 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.315319 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:00.333553 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.333524 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.333637 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.333573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-node-exporter-textfile\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.333637 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.333618 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-root\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.333721 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.333641 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-metrics-client-ca\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.333721 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.333663 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-sys\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.333721 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.333692 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-node-exporter-wtmp\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.333721 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.333709 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-root\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.333721 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.333715 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.333949 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.333758 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-sys\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.333949 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.333775 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpxdh\" (UniqueName: \"kubernetes.io/projected/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-kube-api-access-vpxdh\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.333949 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.333819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-node-exporter-tls\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.333949 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.333857 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-node-exporter-wtmp\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.334170 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.334150 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-node-exporter-textfile\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.334287 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.334266 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-node-exporter-accelerators-collector-config\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.334382 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.334362 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-metrics-client-ca\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.335867 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.335848 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.336090 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.336074 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-node-exporter-tls\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.344139 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.344118 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpxdh\" (UniqueName: \"kubernetes.io/projected/98cf22d5-33d5-4d84-9476-96fd1b7a73cd-kube-api-access-vpxdh\") pod \"node-exporter-rrgzc\" (UID: \"98cf22d5-33d5-4d84-9476-96fd1b7a73cd\") " pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.442204 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.442114 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rrgzc" Jun 08 13:06:00.454740 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:06:00.454714 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98cf22d5_33d5_4d84_9476_96fd1b7a73cd.slice/crio-f87be4dd00cd58156a705c37085776b2e7edcec34c3fde9917c3692824946d4e WatchSource:0}: Error finding container f87be4dd00cd58156a705c37085776b2e7edcec34c3fde9917c3692824946d4e: Status 404 returned error can't find the container with id f87be4dd00cd58156a705c37085776b2e7edcec34c3fde9917c3692824946d4e Jun 08 13:06:00.475329 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.475288 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:00.598895 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.598860 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rrgzc" event={"ID":"98cf22d5-33d5-4d84-9476-96fd1b7a73cd","Type":"ContainerStarted","Data":"f87be4dd00cd58156a705c37085776b2e7edcec34c3fde9917c3692824946d4e"} Jun 08 13:06:00.966981 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:00.966946 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:01.085531 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.085494 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:06:01.089590 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.089569 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.094682 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.094657 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 13:06:01.094682 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.094658 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 13:06:01.095622 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.095595 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 13:06:01.095732 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.095597 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5xt7f\"" Jun 08 13:06:01.098128 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.097811 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 13:06:01.098128 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.097958 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 13:06:01.098128 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.098023 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 13:06:01.098128 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.098025 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 13:06:01.098407 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.098231 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 13:06:01.098407 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.098290 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 13:06:01.113309 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.113249 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:06:01.125031 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.124992 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:01.141688 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.141656 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.141874 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.141707 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e360251b-847e-479c-bf13-4828b767b09d-config-out\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.141874 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.141786 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-config-volume\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.141874 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.141824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.141874 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.141848 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e360251b-847e-479c-bf13-4828b767b09d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.142102 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.141876 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.142102 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.141960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e360251b-847e-479c-bf13-4828b767b09d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.142102 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.141994 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e360251b-847e-479c-bf13-4828b767b09d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.142102 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.142020 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k4wk\" (UniqueName: \"kubernetes.io/projected/e360251b-847e-479c-bf13-4828b767b09d-kube-api-access-5k4wk\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.142102 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.142082 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-web-config\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.142314 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.142110 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.142314 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.142165 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.142314 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.142199 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e360251b-847e-479c-bf13-4828b767b09d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.242756 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.242732 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-web-config\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.242852 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.242769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.242852 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.242793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.242852 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.242810 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e360251b-847e-479c-bf13-4828b767b09d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.243001 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.242866 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.243001 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.242890 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e360251b-847e-479c-bf13-4828b767b09d-config-out\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.243001 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.242916 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-config-volume\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.243001 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.242940 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.243001 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.242962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e360251b-847e-479c-bf13-4828b767b09d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.243001 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.242989 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.243293 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.243016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e360251b-847e-479c-bf13-4828b767b09d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.243293 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.243044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e360251b-847e-479c-bf13-4828b767b09d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.243293 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.243067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k4wk\" (UniqueName: \"kubernetes.io/projected/e360251b-847e-479c-bf13-4828b767b09d-kube-api-access-5k4wk\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.244159 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:06:01.243836 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e360251b-847e-479c-bf13-4828b767b09d-alertmanager-trusted-ca-bundle podName:e360251b-847e-479c-bf13-4828b767b09d nodeName:}" failed. No retries permitted until 2026-06-08 13:06:01.74381078 +0000 UTC m=+280.312220059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e360251b-847e-479c-bf13-4828b767b09d-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e360251b-847e-479c-bf13-4828b767b09d") : configmap references non-existent config key: ca-bundle.crt Jun 08 13:06:01.244428 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.244398 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e360251b-847e-479c-bf13-4828b767b09d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.244747 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.244692 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e360251b-847e-479c-bf13-4828b767b09d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.245987 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.245957 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-web-config\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.246080 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.246044 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.246525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.246501 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e360251b-847e-479c-bf13-4828b767b09d-config-out\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.246611 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.246502 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e360251b-847e-479c-bf13-4828b767b09d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.246611 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.246600 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.247259 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.247236 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.247337 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.247243 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-config-volume\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.247582 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.247561 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.248411 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.248392 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.271597 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.271565 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k4wk\" (UniqueName: \"kubernetes.io/projected/e360251b-847e-479c-bf13-4828b767b09d-kube-api-access-5k4wk\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.290425 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.290399 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:01.607149 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.607062 2564 generic.go:356] "Generic (PLEG): container finished" podID="98cf22d5-33d5-4d84-9476-96fd1b7a73cd" containerID="44c64da6f06f71d96d6e565c3ce711ad1faef6ba9bcabbf18ad7310c300e38ee" exitCode=0 Jun 08 13:06:01.607606 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.607142 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rrgzc" event={"ID":"98cf22d5-33d5-4d84-9476-96fd1b7a73cd","Type":"ContainerDied","Data":"44c64da6f06f71d96d6e565c3ce711ad1faef6ba9bcabbf18ad7310c300e38ee"} Jun 08 13:06:01.747986 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.747952 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e360251b-847e-479c-bf13-4828b767b09d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:01.749012 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:01.748985 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e360251b-847e-479c-bf13-4828b767b09d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:02.001164 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:02.001130 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:06:02.160422 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:06:02.160388 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode360251b_847e_479c_bf13_4828b767b09d.slice/crio-ac2bdeb81a763be6f0dd3e3735a8b27f4a47e7faf48fc67b5dd6ae9e7d79cba8 WatchSource:0}: Error finding container ac2bdeb81a763be6f0dd3e3735a8b27f4a47e7faf48fc67b5dd6ae9e7d79cba8: Status 404 returned error can't find the container with id ac2bdeb81a763be6f0dd3e3735a8b27f4a47e7faf48fc67b5dd6ae9e7d79cba8 Jun 08 13:06:02.161130 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:02.161083 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:06:02.292930 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:02.292850 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:02.475396 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:02.475360 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:02.612145 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:02.612059 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rrgzc" event={"ID":"98cf22d5-33d5-4d84-9476-96fd1b7a73cd","Type":"ContainerStarted","Data":"fddfeb729805b72a5fb54fb76c85421a6b3d511d8b3307ede20e663ba81766d9"} Jun 08 13:06:02.612145 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:02.612116 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rrgzc" event={"ID":"98cf22d5-33d5-4d84-9476-96fd1b7a73cd","Type":"ContainerStarted","Data":"999327613d7ad09c9c922d06daed2433e811a5191eb1cc191e42a610b3ed9296"} Jun 08 13:06:02.613203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:02.613180 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e360251b-847e-479c-bf13-4828b767b09d","Type":"ContainerStarted","Data":"ac2bdeb81a763be6f0dd3e3735a8b27f4a47e7faf48fc67b5dd6ae9e7d79cba8"} Jun 08 13:06:02.649489 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:02.649418 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rrgzc" podStartSLOduration=1.804069272 podStartE2EDuration="2.64940009s" totalImagesPullingTime="776.416848ms" totalInitContainerRuntime="68.91397ms" isStatefulPod=true podCreationTimestamp="2026-06-08 13:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:06:02.647801288 +0000 UTC m=+281.216210361" watchObservedRunningTime="2026-06-08 13:06:02.64940009 +0000 UTC m=+281.217809171" Jun 08 13:06:02.763178 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:02.763140 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:02.944564 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:02.944531 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:03.245418 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:03.245327 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:03.271862 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:06:03.271818 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wc4l8" podUID="2a6e9a0a-4cff-4501-88d4-ff243a63a8b1" Jun 08 13:06:03.359049 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:03.359013 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:03.618731 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:03.618696 2564 generic.go:356] "Generic (PLEG): container finished" podID="e360251b-847e-479c-bf13-4828b767b09d" containerID="eb17fd44803613625ae4cf06d4fd3eb142475dd14b9f1c4c03907da913f7b71f" exitCode=0 Jun 08 13:06:03.619196 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:03.618785 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e360251b-847e-479c-bf13-4828b767b09d","Type":"ContainerDied","Data":"eb17fd44803613625ae4cf06d4fd3eb142475dd14b9f1c4c03907da913f7b71f"} Jun 08 13:06:03.619196 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:03.619074 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wc4l8" Jun 08 13:06:03.948448 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:03.948416 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:04.157740 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.157703 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:04.442254 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.442220 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:04.613838 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.613808 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5f4d69dd8d-kftjv"] Jun 08 13:06:04.618074 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.618056 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.626231 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.626207 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 08 13:06:04.626595 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.626337 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 08 13:06:04.626659 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.626609 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 13:06:04.628342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.628309 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5hqzw\"" Jun 08 13:06:04.630653 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.628591 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-be8tts225e0vb\"" Jun 08 13:06:04.630653 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.629173 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 08 13:06:04.650506 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.650463 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f4d69dd8d-kftjv"] Jun 08 13:06:04.670458 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.670426 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:04.674566 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.674544 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/74eb20df-e068-433e-a818-03c2668fa939-audit-log\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.674641 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.674598 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/74eb20df-e068-433e-a818-03c2668fa939-metrics-server-audit-profiles\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.674688 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.674638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74eb20df-e068-433e-a818-03c2668fa939-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.674688 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.674667 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw6g7\" (UniqueName: \"kubernetes.io/projected/74eb20df-e068-433e-a818-03c2668fa939-kube-api-access-cw6g7\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.674766 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.674723 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/74eb20df-e068-433e-a818-03c2668fa939-secret-metrics-server-client-certs\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.674766 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.674749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/74eb20df-e068-433e-a818-03c2668fa939-secret-metrics-server-tls\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.674766 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.674763 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74eb20df-e068-433e-a818-03c2668fa939-client-ca-bundle\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.775910 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.775825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/74eb20df-e068-433e-a818-03c2668fa939-metrics-server-audit-profiles\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.775910 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.775874 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74eb20df-e068-433e-a818-03c2668fa939-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.776097 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.776061 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw6g7\" (UniqueName: \"kubernetes.io/projected/74eb20df-e068-433e-a818-03c2668fa939-kube-api-access-cw6g7\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.776156 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.776145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/74eb20df-e068-433e-a818-03c2668fa939-secret-metrics-server-client-certs\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.776205 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.776185 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/74eb20df-e068-433e-a818-03c2668fa939-secret-metrics-server-tls\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.776259 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.776213 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74eb20df-e068-433e-a818-03c2668fa939-client-ca-bundle\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.776259 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.776253 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/74eb20df-e068-433e-a818-03c2668fa939-audit-log\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.776700 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.776678 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/74eb20df-e068-433e-a818-03c2668fa939-audit-log\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.776825 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.776744 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74eb20df-e068-433e-a818-03c2668fa939-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.776967 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.776946 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/74eb20df-e068-433e-a818-03c2668fa939-metrics-server-audit-profiles\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.778931 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.778903 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/74eb20df-e068-433e-a818-03c2668fa939-secret-metrics-server-client-certs\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.779048 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.778915 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74eb20df-e068-433e-a818-03c2668fa939-client-ca-bundle\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.779142 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.779122 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/74eb20df-e068-433e-a818-03c2668fa939-secret-metrics-server-tls\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.791611 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.791566 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw6g7\" (UniqueName: \"kubernetes.io/projected/74eb20df-e068-433e-a818-03c2668fa939-kube-api-access-cw6g7\") pod \"metrics-server-5f4d69dd8d-kftjv\" (UID: \"74eb20df-e068-433e-a818-03c2668fa939\") " pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.930612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.930568 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:04.934725 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:04.934695 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:05.264354 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:05.264327 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:05.316545 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:06:05.316515 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74eb20df_e068_433e_a818_03c2668fa939.slice/crio-1fc411457dbfeb69993a191c65c2ede273079b95f76a7c9635053c78afa5955f WatchSource:0}: Error finding container 1fc411457dbfeb69993a191c65c2ede273079b95f76a7c9635053c78afa5955f: Status 404 returned error can't find the container with id 1fc411457dbfeb69993a191c65c2ede273079b95f76a7c9635053c78afa5955f Jun 08 13:06:05.319637 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:05.319604 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f4d69dd8d-kftjv"] Jun 08 13:06:05.628966 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:05.628931 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e360251b-847e-479c-bf13-4828b767b09d","Type":"ContainerStarted","Data":"2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319"} Jun 08 13:06:05.629381 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:05.629006 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e360251b-847e-479c-bf13-4828b767b09d","Type":"ContainerStarted","Data":"f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913"} Jun 08 13:06:05.629381 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:05.629037 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e360251b-847e-479c-bf13-4828b767b09d","Type":"ContainerStarted","Data":"781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca"} Jun 08 13:06:05.629381 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:05.629074 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e360251b-847e-479c-bf13-4828b767b09d","Type":"ContainerStarted","Data":"901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0"} Jun 08 13:06:05.629381 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:05.629100 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e360251b-847e-479c-bf13-4828b767b09d","Type":"ContainerStarted","Data":"8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2"} Jun 08 13:06:05.630038 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:05.630015 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" event={"ID":"74eb20df-e068-433e-a818-03c2668fa939","Type":"ContainerStarted","Data":"1fc411457dbfeb69993a191c65c2ede273079b95f76a7c9635053c78afa5955f"} Jun 08 13:06:06.390436 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:06.390344 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:06:06.392613 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:06.392584 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a6e9a0a-4cff-4501-88d4-ff243a63a8b1-metrics-tls\") pod \"dns-default-wc4l8\" (UID: \"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1\") " pod="openshift-dns/dns-default-wc4l8" Jun 08 13:06:06.567097 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:06.567060 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:06.623293 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:06.623264 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8gt5m\"" Jun 08 13:06:06.630158 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:06.630130 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wc4l8" Jun 08 13:06:06.641799 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:06.641733 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e360251b-847e-479c-bf13-4828b767b09d","Type":"ContainerStarted","Data":"e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe"} Jun 08 13:06:06.724267 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:06.724206 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.195365743 podStartE2EDuration="5.724185928s" totalImagesPullingTime="3.514153364s" totalInitContainerRuntime="14.666821ms" isStatefulPod=false podCreationTimestamp="2026-06-08 13:06:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:06:06.722319297 +0000 UTC m=+285.290728363" watchObservedRunningTime="2026-06-08 13:06:06.724185928 +0000 UTC m=+285.292595008" Jun 08 13:06:06.814823 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:06.814784 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wc4l8"] Jun 08 13:06:06.818052 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:06:06.818019 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a6e9a0a_4cff_4501_88d4_ff243a63a8b1.slice/crio-eec2e98a09a2886757756f0a1da5560782935627f953263f4c26766d52fc2881 WatchSource:0}: Error finding container eec2e98a09a2886757756f0a1da5560782935627f953263f4c26766d52fc2881: Status 404 returned error can't find the container with id eec2e98a09a2886757756f0a1da5560782935627f953263f4c26766d52fc2881 Jun 08 13:06:07.021413 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:07.021338 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:07.128448 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:07.128374 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:07.263403 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:07.263344 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:07.364004 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:07.363977 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:07.533668 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:07.533639 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:06:07.648005 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:07.647687 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" event={"ID":"74eb20df-e068-433e-a818-03c2668fa939","Type":"ContainerStarted","Data":"59f8c211f1151773c3e1e1e9d25e35fdfc31368e5f6cb1a75ac692fe7c11a140"} Jun 08 13:06:07.649179 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:07.649150 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wc4l8" event={"ID":"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1","Type":"ContainerStarted","Data":"eec2e98a09a2886757756f0a1da5560782935627f953263f4c26766d52fc2881"} Jun 08 13:06:07.676004 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:07.675939 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" podStartSLOduration=1.679049451 podStartE2EDuration="3.675918112s" totalImagesPullingTime="1.996868661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:06:07.674560159 +0000 UTC m=+286.242969238" watchObservedRunningTime="2026-06-08 13:06:07.675918112 +0000 UTC m=+286.244327194" Jun 08 13:06:08.006348 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:08.006267 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:08.655039 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:08.655008 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wc4l8" event={"ID":"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1","Type":"ContainerStarted","Data":"1da25b111fe06fbe3ae5215f2573c71f1d4cce5b67eeb2e9606e50f8c9542305"} Jun 08 13:06:09.565100 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:09.565074 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58dff7d848-97qq4" Jun 08 13:06:09.660385 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:09.660355 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wc4l8" event={"ID":"2a6e9a0a-4cff-4501-88d4-ff243a63a8b1","Type":"ContainerStarted","Data":"bd9837bf342da9d223f85c8c64a402406aaa9c45f88bfd158fac49feba200b11"} Jun 08 13:06:09.660777 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:09.660503 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wc4l8" Jun 08 13:06:09.684999 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:09.684953 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wc4l8" podStartSLOduration=252.033545455 podStartE2EDuration="4m13.684937817s" totalImagesPullingTime="1.651392362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:06:09.684352572 +0000 UTC m=+288.252761665" watchObservedRunningTime="2026-06-08 13:06:09.684937817 +0000 UTC m=+288.253346875" Jun 08 13:06:09.796825 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:09.796790 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:09.895320 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:09.895289 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:10.006660 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:10.006623 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:11.325712 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:11.325680 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:11.424883 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:11.424849 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:11.942693 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:11.942662 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d68c68f6d-ccfk5"] Jun 08 13:06:11.945880 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:11.945864 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:11.951573 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:11.951550 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 13:06:11.951736 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:11.951665 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 13:06:11.951839 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:11.951822 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 13:06:11.951898 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:11.951846 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6jptz\"" Jun 08 13:06:11.951898 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:11.951821 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 13:06:11.952768 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:11.952746 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 13:06:11.952885 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:11.952866 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 13:06:11.952971 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:11.952953 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 13:06:11.960847 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:11.960817 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d68c68f6d-ccfk5"] Jun 08 13:06:12.040806 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.040772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-service-ca\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.040970 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.040814 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-oauth-config\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.040970 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.040869 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vgwg\" (UniqueName: \"kubernetes.io/projected/600407ca-40ac-4fbe-aa24-3cc7de5ace83-kube-api-access-2vgwg\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.040970 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.040903 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-serving-cert\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.041087 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.040985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-config\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.041087 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.041004 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-oauth-serving-cert\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.141533 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.141498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-service-ca\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.141533 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.141532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-oauth-config\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.141712 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.141574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vgwg\" (UniqueName: \"kubernetes.io/projected/600407ca-40ac-4fbe-aa24-3cc7de5ace83-kube-api-access-2vgwg\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.141712 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.141601 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-serving-cert\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.141712 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.141678 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-config\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.141712 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.141701 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-oauth-serving-cert\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.142254 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.142231 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-config\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.142334 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.142305 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-service-ca\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.142391 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.142334 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-oauth-serving-cert\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.144129 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.144107 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-serving-cert\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.144215 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.144144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-oauth-config\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.150737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.150719 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vgwg\" (UniqueName: \"kubernetes.io/projected/600407ca-40ac-4fbe-aa24-3cc7de5ace83-kube-api-access-2vgwg\") pod \"console-d68c68f6d-ccfk5\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.255672 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.255592 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:12.388622 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.388593 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d68c68f6d-ccfk5"] Jun 08 13:06:12.391925 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:06:12.391900 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod600407ca_40ac_4fbe_aa24_3cc7de5ace83.slice/crio-caacffafd0ac5e5dffc62a12194d4f4190efb11ed512c57c94dda56ff98a0d39 WatchSource:0}: Error finding container caacffafd0ac5e5dffc62a12194d4f4190efb11ed512c57c94dda56ff98a0d39: Status 404 returned error can't find the container with id caacffafd0ac5e5dffc62a12194d4f4190efb11ed512c57c94dda56ff98a0d39 Jun 08 13:06:12.546421 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.546340 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6498b68ff5-glft8" podUID="a9c901e6-9eb6-4acc-b28d-83f63207f869" containerName="registry" containerID="cri-o://9b50f515b8bdd8512696d53324a2af4d75af83d8cc3ce082ab0c2c8120897e97" gracePeriod=30 Jun 08 13:06:12.671777 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.671747 2564 generic.go:356] "Generic (PLEG): container finished" podID="a9c901e6-9eb6-4acc-b28d-83f63207f869" containerID="9b50f515b8bdd8512696d53324a2af4d75af83d8cc3ce082ab0c2c8120897e97" exitCode=0 Jun 08 13:06:12.671899 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.671834 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6498b68ff5-glft8" event={"ID":"a9c901e6-9eb6-4acc-b28d-83f63207f869","Type":"ContainerDied","Data":"9b50f515b8bdd8512696d53324a2af4d75af83d8cc3ce082ab0c2c8120897e97"} Jun 08 13:06:12.673096 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.673073 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d68c68f6d-ccfk5" event={"ID":"600407ca-40ac-4fbe-aa24-3cc7de5ace83","Type":"ContainerStarted","Data":"caacffafd0ac5e5dffc62a12194d4f4190efb11ed512c57c94dda56ff98a0d39"} Jun 08 13:06:12.774037 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.774014 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:06:12.847361 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.847288 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9c901e6-9eb6-4acc-b28d-83f63207f869-installation-pull-secrets\") pod \"a9c901e6-9eb6-4acc-b28d-83f63207f869\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " Jun 08 13:06:12.847361 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.847330 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9c901e6-9eb6-4acc-b28d-83f63207f869-image-registry-private-configuration\") pod \"a9c901e6-9eb6-4acc-b28d-83f63207f869\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " Jun 08 13:06:12.847361 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.847360 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9c901e6-9eb6-4acc-b28d-83f63207f869-trusted-ca\") pod \"a9c901e6-9eb6-4acc-b28d-83f63207f869\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " Jun 08 13:06:12.847647 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.847387 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-bound-sa-token\") pod \"a9c901e6-9eb6-4acc-b28d-83f63207f869\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " Jun 08 13:06:12.847647 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.847412 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9c901e6-9eb6-4acc-b28d-83f63207f869-ca-trust-extracted\") pod \"a9c901e6-9eb6-4acc-b28d-83f63207f869\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " Jun 08 13:06:12.847647 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.847452 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-certificates\") pod \"a9c901e6-9eb6-4acc-b28d-83f63207f869\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " Jun 08 13:06:12.847647 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.847487 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls\") pod \"a9c901e6-9eb6-4acc-b28d-83f63207f869\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " Jun 08 13:06:12.847647 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.847529 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dt8j\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-kube-api-access-8dt8j\") pod \"a9c901e6-9eb6-4acc-b28d-83f63207f869\" (UID: \"a9c901e6-9eb6-4acc-b28d-83f63207f869\") " Jun 08 13:06:12.847961 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.847925 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9c901e6-9eb6-4acc-b28d-83f63207f869-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a9c901e6-9eb6-4acc-b28d-83f63207f869" (UID: "a9c901e6-9eb6-4acc-b28d-83f63207f869"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:06:12.848082 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.847927 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a9c901e6-9eb6-4acc-b28d-83f63207f869" (UID: "a9c901e6-9eb6-4acc-b28d-83f63207f869"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:06:12.849661 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.849630 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9c901e6-9eb6-4acc-b28d-83f63207f869-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a9c901e6-9eb6-4acc-b28d-83f63207f869" (UID: "a9c901e6-9eb6-4acc-b28d-83f63207f869"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:06:12.849755 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.849658 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9c901e6-9eb6-4acc-b28d-83f63207f869-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a9c901e6-9eb6-4acc-b28d-83f63207f869" (UID: "a9c901e6-9eb6-4acc-b28d-83f63207f869"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:06:12.850041 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.850013 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a9c901e6-9eb6-4acc-b28d-83f63207f869" (UID: "a9c901e6-9eb6-4acc-b28d-83f63207f869"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:06:12.850143 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.850095 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-kube-api-access-8dt8j" (OuterVolumeSpecName: "kube-api-access-8dt8j") pod "a9c901e6-9eb6-4acc-b28d-83f63207f869" (UID: "a9c901e6-9eb6-4acc-b28d-83f63207f869"). InnerVolumeSpecName "kube-api-access-8dt8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:06:12.850274 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.850254 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a9c901e6-9eb6-4acc-b28d-83f63207f869" (UID: "a9c901e6-9eb6-4acc-b28d-83f63207f869"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:06:12.855897 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.855875 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9c901e6-9eb6-4acc-b28d-83f63207f869-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a9c901e6-9eb6-4acc-b28d-83f63207f869" (UID: "a9c901e6-9eb6-4acc-b28d-83f63207f869"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:06:12.948403 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.948369 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9c901e6-9eb6-4acc-b28d-83f63207f869-installation-pull-secrets\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:06:12.948403 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.948404 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9c901e6-9eb6-4acc-b28d-83f63207f869-image-registry-private-configuration\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:06:12.948636 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.948420 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9c901e6-9eb6-4acc-b28d-83f63207f869-trusted-ca\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:06:12.948636 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.948434 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-bound-sa-token\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:06:12.948636 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.948447 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9c901e6-9eb6-4acc-b28d-83f63207f869-ca-trust-extracted\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:06:12.948636 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.948461 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-certificates\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:06:12.948636 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.948490 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-registry-tls\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:06:12.948636 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:12.948503 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dt8j\" (UniqueName: \"kubernetes.io/projected/a9c901e6-9eb6-4acc-b28d-83f63207f869-kube-api-access-8dt8j\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:06:13.678518 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:13.678492 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6498b68ff5-glft8" Jun 08 13:06:13.678885 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:13.678486 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6498b68ff5-glft8" event={"ID":"a9c901e6-9eb6-4acc-b28d-83f63207f869","Type":"ContainerDied","Data":"d91a7972e67e1efbfa33722f02d139f98f386c323e5377390f6124f449262fc6"} Jun 08 13:06:13.678885 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:13.678621 2564 scope.go:117] "RemoveContainer" containerID="9b50f515b8bdd8512696d53324a2af4d75af83d8cc3ce082ab0c2c8120897e97" Jun 08 13:06:13.703702 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:13.703668 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6498b68ff5-glft8"] Jun 08 13:06:13.708419 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:13.708396 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6498b68ff5-glft8"] Jun 08 13:06:13.729514 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:13.729451 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:13.823708 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:13.823676 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9c901e6-9eb6-4acc-b28d-83f63207f869" path="/var/lib/kubelet/pods/a9c901e6-9eb6-4acc-b28d-83f63207f869/volumes" Jun 08 13:06:13.823984 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:13.823951 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:16.692617 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:16.692580 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d68c68f6d-ccfk5" event={"ID":"600407ca-40ac-4fbe-aa24-3cc7de5ace83","Type":"ContainerStarted","Data":"704694bbb88d4a4ef34d783ca477834e809e86dd02996afa315507716c771166"} Jun 08 13:06:16.712045 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:16.712017 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:16.712045 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:16.711991 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d68c68f6d-ccfk5" podStartSLOduration=2.171071966 podStartE2EDuration="5.711974441s" totalImagesPullingTime="3.540902475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:06:16.710685041 +0000 UTC m=+295.279094149" watchObservedRunningTime="2026-06-08 13:06:16.711974441 +0000 UTC m=+295.280383522" Jun 08 13:06:16.811361 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:16.811327 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:18.655711 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:18.655674 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:18.732874 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:18.732839 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:18.819064 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:06:18.819030 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jh77v" podUID="0b82f214-ed29-4b52-8974-b1f8e4fd9a14" Jun 08 13:06:19.665978 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:19.665944 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wc4l8" Jun 08 13:06:20.960686 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:20.960654 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:21.063456 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.063423 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:21.107335 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.107302 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f899575cb-fw8cz"] Jun 08 13:06:21.107594 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.107581 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9c901e6-9eb6-4acc-b28d-83f63207f869" containerName="registry" Jun 08 13:06:21.107658 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.107595 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9c901e6-9eb6-4acc-b28d-83f63207f869" containerName="registry" Jun 08 13:06:21.107658 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.107639 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9c901e6-9eb6-4acc-b28d-83f63207f869" containerName="registry" Jun 08 13:06:21.109292 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.109277 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.118502 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.118463 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 08 13:06:21.123930 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.123909 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f899575cb-fw8cz"] Jun 08 13:06:21.216233 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.216131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-trusted-ca-bundle\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.216233 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.216199 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-oauth-serving-cert\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.216233 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.216236 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-serving-cert\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.216468 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.216257 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccr8g\" (UniqueName: \"kubernetes.io/projected/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-kube-api-access-ccr8g\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.216468 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.216284 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-service-ca\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.216468 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.216352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-oauth-config\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.216468 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.216392 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-config\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.219761 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.219737 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:21.313629 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.313597 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:21.317743 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.317719 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-serving-cert\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.317841 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.317751 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccr8g\" (UniqueName: \"kubernetes.io/projected/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-kube-api-access-ccr8g\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.317841 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.317769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-service-ca\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.317841 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.317798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-oauth-config\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.317841 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.317827 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-config\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.318031 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.317885 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-trusted-ca-bundle\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.318031 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.317927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-oauth-serving-cert\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.318677 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.318641 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-service-ca\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.318677 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.318662 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-config\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.318846 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.318710 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-oauth-serving-cert\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.318846 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.318834 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-trusted-ca-bundle\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.320332 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.320290 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-oauth-config\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.320465 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.320447 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-serving-cert\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.337778 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.337751 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccr8g\" (UniqueName: \"kubernetes.io/projected/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-kube-api-access-ccr8g\") pod \"console-6f899575cb-fw8cz\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.418444 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.418404 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:21.562177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.562142 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f899575cb-fw8cz"] Jun 08 13:06:21.565189 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:06:21.565166 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d45d6c_a73a_4c45_9072_d8f8e0c004fe.slice/crio-c4b098848f0d242c51732e4d539eae6052654f62bb38a71118b75d2399709405 WatchSource:0}: Error finding container c4b098848f0d242c51732e4d539eae6052654f62bb38a71118b75d2399709405: Status 404 returned error can't find the container with id c4b098848f0d242c51732e4d539eae6052654f62bb38a71118b75d2399709405 Jun 08 13:06:21.716979 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.716942 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f899575cb-fw8cz" event={"ID":"27d45d6c-a73a-4c45-9072-d8f8e0c004fe","Type":"ContainerStarted","Data":"8b2caf2d581ee3db7374d82610dea565805d035cd61aa0494cc7571524ae4869"} Jun 08 13:06:21.717147 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.717015 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f899575cb-fw8cz" event={"ID":"27d45d6c-a73a-4c45-9072-d8f8e0c004fe","Type":"ContainerStarted","Data":"c4b098848f0d242c51732e4d539eae6052654f62bb38a71118b75d2399709405"} Jun 08 13:06:21.746859 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.746731 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f899575cb-fw8cz" podStartSLOduration=0.746715234 podStartE2EDuration="746.715234ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:06:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:06:21.745436876 +0000 UTC m=+300.313845956" watchObservedRunningTime="2026-06-08 13:06:21.746715234 +0000 UTC m=+300.315124315" Jun 08 13:06:21.788060 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:21.788038 2564 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 13:06:22.256349 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:22.256314 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:22.257729 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:22.256370 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:22.261144 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:22.261125 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:22.724797 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:22.724768 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:24.931106 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:24.931064 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:24.931610 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:24.931139 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:24.960266 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:24.960218 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:25.058519 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:25.058483 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:25.168547 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:25.168517 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:26.729880 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:26.729849 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:26.827834 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:26.827801 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:27.787753 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:27.787718 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:27.865986 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:27.865952 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:28.639564 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:28.639516 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:29.427016 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:29.426990 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wc4l8_2a6e9a0a-4cff-4501-88d4-ff243a63a8b1/dns/0.log" Jun 08 13:06:29.629537 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:29.629511 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wc4l8_2a6e9a0a-4cff-4501-88d4-ff243a63a8b1/kube-rbac-proxy/0.log" Jun 08 13:06:30.029349 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:30.029321 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pkk6k_be941842-dde4-47f6-9308-75450cdd10b6/dns-node-resolver/0.log" Jun 08 13:06:30.429668 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:30.429639 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5595dd76b9-v9wcr_50e14859-9356-4e8c-bf60-beb946fea0b3/router/0.log" Jun 08 13:06:30.817982 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:30.817896 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:06:31.028427 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:31.028401 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r4ngf_4fcf4863-891b-4b40-b03b-b5a139f5b1d8/serve-healthcheck-canary/0.log" Jun 08 13:06:31.418691 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:31.418650 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:31.418896 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:31.418715 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:31.423518 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:31.423491 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:31.758208 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:31.758124 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:06:31.826956 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:31.826921 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d68c68f6d-ccfk5"] Jun 08 13:06:31.897792 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:31.897760 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:32.015164 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:32.015084 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:32.108753 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:32.108724 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:34.734202 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:34.734166 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:34.842014 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:34.841975 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:35.326843 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:35.326808 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:35.435597 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:35.435564 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:40.021332 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:40.021255 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:40.138999 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:40.138959 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:06:44.936597 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:44.936568 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:44.940536 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:44.940513 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5f4d69dd8d-kftjv" Jun 08 13:06:56.847255 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:56.847219 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-d68c68f6d-ccfk5" podUID="600407ca-40ac-4fbe-aa24-3cc7de5ace83" containerName="console" containerID="cri-o://704694bbb88d4a4ef34d783ca477834e809e86dd02996afa315507716c771166" gracePeriod=15 Jun 08 13:06:57.082848 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.082823 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:57.123954 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.123935 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-oauth-config\") pod \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " Jun 08 13:06:57.124092 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.123963 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-serving-cert\") pod \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " Jun 08 13:06:57.124092 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.123986 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-oauth-serving-cert\") pod \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " Jun 08 13:06:57.124092 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.124023 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-config\") pod \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " Jun 08 13:06:57.124092 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.124082 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vgwg\" (UniqueName: \"kubernetes.io/projected/600407ca-40ac-4fbe-aa24-3cc7de5ace83-kube-api-access-2vgwg\") pod \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " Jun 08 13:06:57.124281 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.124127 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-service-ca\") pod \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\" (UID: \"600407ca-40ac-4fbe-aa24-3cc7de5ace83\") " Jun 08 13:06:57.124420 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.124385 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "600407ca-40ac-4fbe-aa24-3cc7de5ace83" (UID: "600407ca-40ac-4fbe-aa24-3cc7de5ace83"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:06:57.124504 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.124428 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-config" (OuterVolumeSpecName: "console-config") pod "600407ca-40ac-4fbe-aa24-3cc7de5ace83" (UID: "600407ca-40ac-4fbe-aa24-3cc7de5ace83"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:06:57.124710 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.124690 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-service-ca" (OuterVolumeSpecName: "service-ca") pod "600407ca-40ac-4fbe-aa24-3cc7de5ace83" (UID: "600407ca-40ac-4fbe-aa24-3cc7de5ace83"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:06:57.126212 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.126183 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "600407ca-40ac-4fbe-aa24-3cc7de5ace83" (UID: "600407ca-40ac-4fbe-aa24-3cc7de5ace83"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:06:57.126305 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.126252 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/600407ca-40ac-4fbe-aa24-3cc7de5ace83-kube-api-access-2vgwg" (OuterVolumeSpecName: "kube-api-access-2vgwg") pod "600407ca-40ac-4fbe-aa24-3cc7de5ace83" (UID: "600407ca-40ac-4fbe-aa24-3cc7de5ace83"). InnerVolumeSpecName "kube-api-access-2vgwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:06:57.126305 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.126290 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "600407ca-40ac-4fbe-aa24-3cc7de5ace83" (UID: "600407ca-40ac-4fbe-aa24-3cc7de5ace83"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:06:57.225003 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.224973 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vgwg\" (UniqueName: \"kubernetes.io/projected/600407ca-40ac-4fbe-aa24-3cc7de5ace83-kube-api-access-2vgwg\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:06:57.225003 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.224998 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-service-ca\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:06:57.225003 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.225007 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-oauth-config\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:06:57.225204 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.225017 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-serving-cert\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:06:57.225204 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.225026 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-oauth-serving-cert\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:06:57.225204 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.225035 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/600407ca-40ac-4fbe-aa24-3cc7de5ace83-console-config\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:06:57.846964 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.846934 2564 generic.go:356] "Generic (PLEG): container finished" podID="600407ca-40ac-4fbe-aa24-3cc7de5ace83" containerID="704694bbb88d4a4ef34d783ca477834e809e86dd02996afa315507716c771166" exitCode=0 Jun 08 13:06:57.847093 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.846983 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d68c68f6d-ccfk5" Jun 08 13:06:57.847093 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.846984 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d68c68f6d-ccfk5" event={"ID":"600407ca-40ac-4fbe-aa24-3cc7de5ace83","Type":"ContainerDied","Data":"704694bbb88d4a4ef34d783ca477834e809e86dd02996afa315507716c771166"} Jun 08 13:06:57.847168 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.847104 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d68c68f6d-ccfk5" event={"ID":"600407ca-40ac-4fbe-aa24-3cc7de5ace83","Type":"ContainerDied","Data":"caacffafd0ac5e5dffc62a12194d4f4190efb11ed512c57c94dda56ff98a0d39"} Jun 08 13:06:57.847168 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.847133 2564 scope.go:117] "RemoveContainer" containerID="704694bbb88d4a4ef34d783ca477834e809e86dd02996afa315507716c771166" Jun 08 13:06:57.854854 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.854835 2564 scope.go:117] "RemoveContainer" containerID="704694bbb88d4a4ef34d783ca477834e809e86dd02996afa315507716c771166" Jun 08 13:06:57.855143 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:06:57.855123 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"704694bbb88d4a4ef34d783ca477834e809e86dd02996afa315507716c771166\": container with ID starting with 704694bbb88d4a4ef34d783ca477834e809e86dd02996afa315507716c771166 not found: ID does not exist" containerID="704694bbb88d4a4ef34d783ca477834e809e86dd02996afa315507716c771166" Jun 08 13:06:57.855186 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.855152 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"704694bbb88d4a4ef34d783ca477834e809e86dd02996afa315507716c771166"} err="failed to get container status \"704694bbb88d4a4ef34d783ca477834e809e86dd02996afa315507716c771166\": rpc error: code = NotFound desc = could not find container \"704694bbb88d4a4ef34d783ca477834e809e86dd02996afa315507716c771166\": container with ID starting with 704694bbb88d4a4ef34d783ca477834e809e86dd02996afa315507716c771166 not found: ID does not exist" Jun 08 13:06:57.864871 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.864847 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d68c68f6d-ccfk5"] Jun 08 13:06:57.868955 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:57.868937 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d68c68f6d-ccfk5"] Jun 08 13:06:59.822617 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:06:59.822584 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="600407ca-40ac-4fbe-aa24-3cc7de5ace83" path="/var/lib/kubelet/pods/600407ca-40ac-4fbe-aa24-3cc7de5ace83/volumes" Jun 08 13:07:16.326052 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:16.325972 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:16.395646 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:16.395616 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:19.536152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:19.536116 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:20.561695 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:20.561657 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:20.669970 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:20.669936 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:07:20.670265 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:20.670236 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="alertmanager" containerID="cri-o://8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2" gracePeriod=120 Jun 08 13:07:20.670345 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:20.670316 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="kube-rbac-proxy-metric" containerID="cri-o://2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319" gracePeriod=120 Jun 08 13:07:20.670408 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:20.670357 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="kube-rbac-proxy" containerID="cri-o://f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913" gracePeriod=120 Jun 08 13:07:20.670467 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:20.670403 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="prom-label-proxy" containerID="cri-o://e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe" gracePeriod=120 Jun 08 13:07:20.670467 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:20.670323 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="kube-rbac-proxy-web" containerID="cri-o://781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca" gracePeriod=120 Jun 08 13:07:20.670606 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:20.670369 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="config-reloader" containerID="cri-o://901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0" gracePeriod=120 Jun 08 13:07:20.930079 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:20.930049 2564 generic.go:356] "Generic (PLEG): container finished" podID="e360251b-847e-479c-bf13-4828b767b09d" containerID="e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe" exitCode=0 Jun 08 13:07:20.930079 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:20.930071 2564 generic.go:356] "Generic (PLEG): container finished" podID="e360251b-847e-479c-bf13-4828b767b09d" containerID="f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913" exitCode=0 Jun 08 13:07:20.930079 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:20.930078 2564 generic.go:356] "Generic (PLEG): container finished" podID="e360251b-847e-479c-bf13-4828b767b09d" containerID="901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0" exitCode=0 Jun 08 13:07:20.930079 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:20.930084 2564 generic.go:356] "Generic (PLEG): container finished" podID="e360251b-847e-479c-bf13-4828b767b09d" containerID="8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2" exitCode=0 Jun 08 13:07:20.930351 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:20.930119 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e360251b-847e-479c-bf13-4828b767b09d","Type":"ContainerDied","Data":"e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe"} Jun 08 13:07:20.930351 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:20.930218 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e360251b-847e-479c-bf13-4828b767b09d","Type":"ContainerDied","Data":"f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913"} Jun 08 13:07:20.930351 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:20.930254 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e360251b-847e-479c-bf13-4828b767b09d","Type":"ContainerDied","Data":"901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0"} Jun 08 13:07:20.930351 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:20.930279 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e360251b-847e-479c-bf13-4828b767b09d","Type":"ContainerDied","Data":"8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2"} Jun 08 13:07:21.919834 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.919811 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:21.936042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.936014 2564 generic.go:356] "Generic (PLEG): container finished" podID="e360251b-847e-479c-bf13-4828b767b09d" containerID="2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319" exitCode=0 Jun 08 13:07:21.936042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.936036 2564 generic.go:356] "Generic (PLEG): container finished" podID="e360251b-847e-479c-bf13-4828b767b09d" containerID="781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca" exitCode=0 Jun 08 13:07:21.936263 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.936067 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e360251b-847e-479c-bf13-4828b767b09d","Type":"ContainerDied","Data":"2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319"} Jun 08 13:07:21.936263 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.936103 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:21.936263 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.936130 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e360251b-847e-479c-bf13-4828b767b09d","Type":"ContainerDied","Data":"781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca"} Jun 08 13:07:21.936263 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.936159 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e360251b-847e-479c-bf13-4828b767b09d","Type":"ContainerDied","Data":"ac2bdeb81a763be6f0dd3e3735a8b27f4a47e7faf48fc67b5dd6ae9e7d79cba8"} Jun 08 13:07:21.936263 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.936192 2564 scope.go:117] "RemoveContainer" containerID="e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe" Jun 08 13:07:21.943291 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.943268 2564 scope.go:117] "RemoveContainer" containerID="2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319" Jun 08 13:07:21.950318 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.950303 2564 scope.go:117] "RemoveContainer" containerID="f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913" Jun 08 13:07:21.959208 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.959182 2564 scope.go:117] "RemoveContainer" containerID="781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca" Jun 08 13:07:21.966783 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.966759 2564 scope.go:117] "RemoveContainer" containerID="901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0" Jun 08 13:07:21.974408 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.974391 2564 scope.go:117] "RemoveContainer" containerID="8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2" Jun 08 13:07:21.982519 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.982500 2564 scope.go:117] "RemoveContainer" containerID="eb17fd44803613625ae4cf06d4fd3eb142475dd14b9f1c4c03907da913f7b71f" Jun 08 13:07:21.989752 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.989729 2564 scope.go:117] "RemoveContainer" containerID="e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe" Jun 08 13:07:21.990069 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:07:21.990048 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe\": container with ID starting with e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe not found: ID does not exist" containerID="e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe" Jun 08 13:07:21.990133 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.990078 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe"} err="failed to get container status \"e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe\": rpc error: code = NotFound desc = could not find container \"e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe\": container with ID starting with e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe not found: ID does not exist" Jun 08 13:07:21.990133 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.990097 2564 scope.go:117] "RemoveContainer" containerID="2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319" Jun 08 13:07:21.990385 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:07:21.990365 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319\": container with ID starting with 2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319 not found: ID does not exist" containerID="2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319" Jun 08 13:07:21.990433 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.990396 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319"} err="failed to get container status \"2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319\": rpc error: code = NotFound desc = could not find container \"2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319\": container with ID starting with 2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319 not found: ID does not exist" Jun 08 13:07:21.990433 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.990415 2564 scope.go:117] "RemoveContainer" containerID="f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913" Jun 08 13:07:21.990732 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:07:21.990716 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913\": container with ID starting with f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913 not found: ID does not exist" containerID="f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913" Jun 08 13:07:21.990783 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.990737 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913"} err="failed to get container status \"f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913\": rpc error: code = NotFound desc = could not find container \"f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913\": container with ID starting with f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913 not found: ID does not exist" Jun 08 13:07:21.990783 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.990751 2564 scope.go:117] "RemoveContainer" containerID="781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca" Jun 08 13:07:21.990954 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:07:21.990938 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca\": container with ID starting with 781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca not found: ID does not exist" containerID="781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca" Jun 08 13:07:21.990996 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.990957 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca"} err="failed to get container status \"781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca\": rpc error: code = NotFound desc = could not find container \"781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca\": container with ID starting with 781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca not found: ID does not exist" Jun 08 13:07:21.990996 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.990970 2564 scope.go:117] "RemoveContainer" containerID="901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0" Jun 08 13:07:21.991176 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:07:21.991157 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0\": container with ID starting with 901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0 not found: ID does not exist" containerID="901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0" Jun 08 13:07:21.991239 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.991184 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0"} err="failed to get container status \"901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0\": rpc error: code = NotFound desc = could not find container \"901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0\": container with ID starting with 901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0 not found: ID does not exist" Jun 08 13:07:21.991239 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.991207 2564 scope.go:117] "RemoveContainer" containerID="8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2" Jun 08 13:07:21.991510 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:07:21.991494 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2\": container with ID starting with 8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2 not found: ID does not exist" containerID="8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2" Jun 08 13:07:21.991567 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.991511 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2"} err="failed to get container status \"8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2\": rpc error: code = NotFound desc = could not find container \"8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2\": container with ID starting with 8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2 not found: ID does not exist" Jun 08 13:07:21.991567 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.991523 2564 scope.go:117] "RemoveContainer" containerID="eb17fd44803613625ae4cf06d4fd3eb142475dd14b9f1c4c03907da913f7b71f" Jun 08 13:07:21.991751 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:07:21.991735 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb17fd44803613625ae4cf06d4fd3eb142475dd14b9f1c4c03907da913f7b71f\": container with ID starting with eb17fd44803613625ae4cf06d4fd3eb142475dd14b9f1c4c03907da913f7b71f not found: ID does not exist" containerID="eb17fd44803613625ae4cf06d4fd3eb142475dd14b9f1c4c03907da913f7b71f" Jun 08 13:07:21.991794 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.991756 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb17fd44803613625ae4cf06d4fd3eb142475dd14b9f1c4c03907da913f7b71f"} err="failed to get container status \"eb17fd44803613625ae4cf06d4fd3eb142475dd14b9f1c4c03907da913f7b71f\": rpc error: code = NotFound desc = could not find container \"eb17fd44803613625ae4cf06d4fd3eb142475dd14b9f1c4c03907da913f7b71f\": container with ID starting with eb17fd44803613625ae4cf06d4fd3eb142475dd14b9f1c4c03907da913f7b71f not found: ID does not exist" Jun 08 13:07:21.991794 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.991771 2564 scope.go:117] "RemoveContainer" containerID="e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe" Jun 08 13:07:21.991984 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.991969 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe"} err="failed to get container status \"e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe\": rpc error: code = NotFound desc = could not find container \"e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe\": container with ID starting with e1fd90291c4150e0ad7597f03ab1f0bfb27ec4640362a7dfc429bca13aba1ffe not found: ID does not exist" Jun 08 13:07:21.991984 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.991984 2564 scope.go:117] "RemoveContainer" containerID="2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319" Jun 08 13:07:21.992241 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.992225 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319"} err="failed to get container status \"2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319\": rpc error: code = NotFound desc = could not find container \"2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319\": container with ID starting with 2402599a2a21e9689dfdf6cfd3d200f444070c8b3fcb1f3076f445739afb4319 not found: ID does not exist" Jun 08 13:07:21.992285 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.992241 2564 scope.go:117] "RemoveContainer" containerID="f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913" Jun 08 13:07:21.992490 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.992443 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913"} err="failed to get container status \"f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913\": rpc error: code = NotFound desc = could not find container \"f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913\": container with ID starting with f171bd09ed7b377c8daac6497f52fbeefbea40e77da65b7f23cdf40143d44913 not found: ID does not exist" Jun 08 13:07:21.992583 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.992492 2564 scope.go:117] "RemoveContainer" containerID="781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca" Jun 08 13:07:21.992776 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.992756 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca"} err="failed to get container status \"781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca\": rpc error: code = NotFound desc = could not find container \"781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca\": container with ID starting with 781df1be1d0292eecdbc0218885d4615d3312ad8bbcccad4556c121af60cadca not found: ID does not exist" Jun 08 13:07:21.992820 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.992779 2564 scope.go:117] "RemoveContainer" containerID="901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0" Jun 08 13:07:21.993062 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.993044 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0"} err="failed to get container status \"901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0\": rpc error: code = NotFound desc = could not find container \"901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0\": container with ID starting with 901c3fb3f59b3efe68b26ad4f3fd7cd68e35da97bb1a1392a89fb00a4bced6b0 not found: ID does not exist" Jun 08 13:07:21.993128 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.993063 2564 scope.go:117] "RemoveContainer" containerID="8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2" Jun 08 13:07:21.993279 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.993256 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2"} err="failed to get container status \"8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2\": rpc error: code = NotFound desc = could not find container \"8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2\": container with ID starting with 8c1b072196c803933dd3a4f8a3541ed273ae10ae52ed54e09fe523b1d6692ce2 not found: ID does not exist" Jun 08 13:07:21.993324 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.993281 2564 scope.go:117] "RemoveContainer" containerID="eb17fd44803613625ae4cf06d4fd3eb142475dd14b9f1c4c03907da913f7b71f" Jun 08 13:07:21.993499 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:21.993462 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb17fd44803613625ae4cf06d4fd3eb142475dd14b9f1c4c03907da913f7b71f"} err="failed to get container status \"eb17fd44803613625ae4cf06d4fd3eb142475dd14b9f1c4c03907da913f7b71f\": rpc error: code = NotFound desc = could not find container \"eb17fd44803613625ae4cf06d4fd3eb142475dd14b9f1c4c03907da913f7b71f\": container with ID starting with eb17fd44803613625ae4cf06d4fd3eb142475dd14b9f1c4c03907da913f7b71f not found: ID does not exist" Jun 08 13:07:22.027943 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.027912 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e360251b-847e-479c-bf13-4828b767b09d-alertmanager-trusted-ca-bundle\") pod \"e360251b-847e-479c-bf13-4828b767b09d\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " Jun 08 13:07:22.028105 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.027957 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5k4wk\" (UniqueName: \"kubernetes.io/projected/e360251b-847e-479c-bf13-4828b767b09d-kube-api-access-5k4wk\") pod \"e360251b-847e-479c-bf13-4828b767b09d\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " Jun 08 13:07:22.028105 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.027976 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e360251b-847e-479c-bf13-4828b767b09d-tls-assets\") pod \"e360251b-847e-479c-bf13-4828b767b09d\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " Jun 08 13:07:22.028105 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.028000 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy-web\") pod \"e360251b-847e-479c-bf13-4828b767b09d\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " Jun 08 13:07:22.028105 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.028024 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-web-config\") pod \"e360251b-847e-479c-bf13-4828b767b09d\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " Jun 08 13:07:22.028300 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.028156 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-config-volume\") pod \"e360251b-847e-479c-bf13-4828b767b09d\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " Jun 08 13:07:22.028300 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.028226 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-main-tls\") pod \"e360251b-847e-479c-bf13-4828b767b09d\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " Jun 08 13:07:22.028300 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.028267 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy\") pod \"e360251b-847e-479c-bf13-4828b767b09d\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " Jun 08 13:07:22.028300 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.028295 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e360251b-847e-479c-bf13-4828b767b09d\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " Jun 08 13:07:22.028518 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.028340 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e360251b-847e-479c-bf13-4828b767b09d-config-out\") pod \"e360251b-847e-479c-bf13-4828b767b09d\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " Jun 08 13:07:22.028518 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.028369 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e360251b-847e-479c-bf13-4828b767b09d-alertmanager-main-db\") pod \"e360251b-847e-479c-bf13-4828b767b09d\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " Jun 08 13:07:22.028518 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.028407 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-cluster-tls-config\") pod \"e360251b-847e-479c-bf13-4828b767b09d\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " Jun 08 13:07:22.028518 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.028433 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e360251b-847e-479c-bf13-4828b767b09d-metrics-client-ca\") pod \"e360251b-847e-479c-bf13-4828b767b09d\" (UID: \"e360251b-847e-479c-bf13-4828b767b09d\") " Jun 08 13:07:22.028787 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.028720 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e360251b-847e-479c-bf13-4828b767b09d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e360251b-847e-479c-bf13-4828b767b09d" (UID: "e360251b-847e-479c-bf13-4828b767b09d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:07:22.029685 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.029463 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e360251b-847e-479c-bf13-4828b767b09d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e360251b-847e-479c-bf13-4828b767b09d" (UID: "e360251b-847e-479c-bf13-4828b767b09d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:07:22.029685 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.029643 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e360251b-847e-479c-bf13-4828b767b09d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e360251b-847e-479c-bf13-4828b767b09d" (UID: "e360251b-847e-479c-bf13-4828b767b09d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:07:22.030919 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.030888 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e360251b-847e-479c-bf13-4828b767b09d-kube-api-access-5k4wk" (OuterVolumeSpecName: "kube-api-access-5k4wk") pod "e360251b-847e-479c-bf13-4828b767b09d" (UID: "e360251b-847e-479c-bf13-4828b767b09d"). InnerVolumeSpecName "kube-api-access-5k4wk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:07:22.031640 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.031599 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-config-volume" (OuterVolumeSpecName: "config-volume") pod "e360251b-847e-479c-bf13-4828b767b09d" (UID: "e360251b-847e-479c-bf13-4828b767b09d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:07:22.031745 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.031676 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e360251b-847e-479c-bf13-4828b767b09d" (UID: "e360251b-847e-479c-bf13-4828b767b09d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:07:22.031745 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.031731 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e360251b-847e-479c-bf13-4828b767b09d" (UID: "e360251b-847e-479c-bf13-4828b767b09d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:07:22.031861 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.031799 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e360251b-847e-479c-bf13-4828b767b09d" (UID: "e360251b-847e-479c-bf13-4828b767b09d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:07:22.032063 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.032031 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e360251b-847e-479c-bf13-4828b767b09d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e360251b-847e-479c-bf13-4828b767b09d" (UID: "e360251b-847e-479c-bf13-4828b767b09d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:07:22.032527 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.032500 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e360251b-847e-479c-bf13-4828b767b09d" (UID: "e360251b-847e-479c-bf13-4828b767b09d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:07:22.032527 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.032516 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e360251b-847e-479c-bf13-4828b767b09d-config-out" (OuterVolumeSpecName: "config-out") pod "e360251b-847e-479c-bf13-4828b767b09d" (UID: "e360251b-847e-479c-bf13-4828b767b09d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:07:22.035504 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.035355 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e360251b-847e-479c-bf13-4828b767b09d" (UID: "e360251b-847e-479c-bf13-4828b767b09d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:07:22.041102 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.041080 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-web-config" (OuterVolumeSpecName: "web-config") pod "e360251b-847e-479c-bf13-4828b767b09d" (UID: "e360251b-847e-479c-bf13-4828b767b09d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:07:22.129701 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.129651 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e360251b-847e-479c-bf13-4828b767b09d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:07:22.129701 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.129695 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k4wk\" (UniqueName: \"kubernetes.io/projected/e360251b-847e-479c-bf13-4828b767b09d-kube-api-access-5k4wk\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:07:22.129701 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.129706 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e360251b-847e-479c-bf13-4828b767b09d-tls-assets\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:07:22.129701 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.129715 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:07:22.129701 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.129724 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-web-config\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:07:22.130018 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.129732 2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-config-volume\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:07:22.130018 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.129740 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-main-tls\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:07:22.130018 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.129748 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:07:22.130018 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.129759 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:07:22.130018 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.129770 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e360251b-847e-479c-bf13-4828b767b09d-config-out\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:07:22.130018 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.129779 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e360251b-847e-479c-bf13-4828b767b09d-alertmanager-main-db\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:07:22.130018 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.129787 2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e360251b-847e-479c-bf13-4828b767b09d-cluster-tls-config\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:07:22.130018 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.129796 2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e360251b-847e-479c-bf13-4828b767b09d-metrics-client-ca\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:07:22.262497 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.262449 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:07:22.267878 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.267854 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:07:22.297944 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.297919 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:07:22.298154 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298142 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="600407ca-40ac-4fbe-aa24-3cc7de5ace83" containerName="console" Jun 08 13:07:22.298191 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298155 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="600407ca-40ac-4fbe-aa24-3cc7de5ace83" containerName="console" Jun 08 13:07:22.298191 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298168 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="kube-rbac-proxy-metric" Jun 08 13:07:22.298191 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298173 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="kube-rbac-proxy-metric" Jun 08 13:07:22.298191 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298181 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="config-reloader" Jun 08 13:07:22.298191 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298187 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="config-reloader" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298197 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="init-config-reloader" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298203 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="init-config-reloader" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298210 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="kube-rbac-proxy" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298215 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="kube-rbac-proxy" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298221 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="prom-label-proxy" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298226 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="prom-label-proxy" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298233 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="alertmanager" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298237 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="alertmanager" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298243 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="kube-rbac-proxy-web" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298257 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="kube-rbac-proxy-web" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298294 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="config-reloader" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298301 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="kube-rbac-proxy-web" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298307 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="kube-rbac-proxy" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298314 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="alertmanager" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298319 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="kube-rbac-proxy-metric" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298324 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e360251b-847e-479c-bf13-4828b767b09d" containerName="prom-label-proxy" Jun 08 13:07:22.298342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.298329 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="600407ca-40ac-4fbe-aa24-3cc7de5ace83" containerName="console" Jun 08 13:07:22.303042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.303026 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.309506 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.308702 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 13:07:22.309506 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.308821 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 13:07:22.313608 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.310084 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 13:07:22.313608 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.310217 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 13:07:22.313608 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.310346 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 13:07:22.313608 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.310499 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 13:07:22.313608 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.310591 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 13:07:22.313608 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.310737 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5xt7f\"" Jun 08 13:07:22.313608 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.310994 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 13:07:22.316189 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.316168 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 13:07:22.318100 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.318078 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:07:22.431089 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.431053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.431089 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.431089 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a39daf39-648d-4878-b65b-fe5a05841353-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.431289 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.431112 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a39daf39-648d-4878-b65b-fe5a05841353-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.431289 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.431159 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a39daf39-648d-4878-b65b-fe5a05841353-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.431289 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.431182 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.431289 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.431200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-web-config\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.431289 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.431221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.431289 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.431239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.431289 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.431256 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a39daf39-648d-4878-b65b-fe5a05841353-config-out\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.431289 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.431290 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.431555 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.431306 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf8kt\" (UniqueName: \"kubernetes.io/projected/a39daf39-648d-4878-b65b-fe5a05841353-kube-api-access-wf8kt\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.431555 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.431320 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-config-volume\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.431555 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.431340 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a39daf39-648d-4878-b65b-fe5a05841353-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.532166 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.532095 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a39daf39-648d-4878-b65b-fe5a05841353-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.532166 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.532148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.532329 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.532183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a39daf39-648d-4878-b65b-fe5a05841353-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.532329 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.532208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a39daf39-648d-4878-b65b-fe5a05841353-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.532329 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.532234 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a39daf39-648d-4878-b65b-fe5a05841353-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.532329 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.532260 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.532329 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.532282 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-web-config\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.532329 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.532318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.532632 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.532347 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.532632 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.532375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a39daf39-648d-4878-b65b-fe5a05841353-config-out\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.532632 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.532405 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.532632 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.532422 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf8kt\" (UniqueName: \"kubernetes.io/projected/a39daf39-648d-4878-b65b-fe5a05841353-kube-api-access-wf8kt\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.532632 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.532444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-config-volume\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.532874 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.532804 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a39daf39-648d-4878-b65b-fe5a05841353-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.533080 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.533049 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a39daf39-648d-4878-b65b-fe5a05841353-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.533269 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.533243 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a39daf39-648d-4878-b65b-fe5a05841353-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.535224 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.535202 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a39daf39-648d-4878-b65b-fe5a05841353-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.535343 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.535316 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-config-volume\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.535463 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.535359 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.535546 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.535509 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a39daf39-648d-4878-b65b-fe5a05841353-config-out\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.535764 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.535734 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.535865 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.535742 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.535865 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.535797 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-web-config\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.535960 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.535863 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.537318 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.537302 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a39daf39-648d-4878-b65b-fe5a05841353-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.543578 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.543554 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf8kt\" (UniqueName: \"kubernetes.io/projected/a39daf39-648d-4878-b65b-fe5a05841353-kube-api-access-wf8kt\") pod \"alertmanager-main-0\" (UID: \"a39daf39-648d-4878-b65b-fe5a05841353\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.616165 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.616132 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 13:07:22.754666 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.754639 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 13:07:22.756092 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:07:22.756068 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda39daf39_648d_4878_b65b_fe5a05841353.slice/crio-5855a6c97e34dabf738b4a70cc74e730732c5ccffbe15189303b3f630ba91c9b WatchSource:0}: Error finding container 5855a6c97e34dabf738b4a70cc74e730732c5ccffbe15189303b3f630ba91c9b: Status 404 returned error can't find the container with id 5855a6c97e34dabf738b4a70cc74e730732c5ccffbe15189303b3f630ba91c9b Jun 08 13:07:22.940976 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.940941 2564 generic.go:356] "Generic (PLEG): container finished" podID="a39daf39-648d-4878-b65b-fe5a05841353" containerID="90101454b0a15cdb270a47e824c8fc857764fbc9c2b5a9b5ff92450925e1790d" exitCode=0 Jun 08 13:07:22.941404 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.941020 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39daf39-648d-4878-b65b-fe5a05841353","Type":"ContainerDied","Data":"90101454b0a15cdb270a47e824c8fc857764fbc9c2b5a9b5ff92450925e1790d"} Jun 08 13:07:22.941404 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:22.941084 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39daf39-648d-4878-b65b-fe5a05841353","Type":"ContainerStarted","Data":"5855a6c97e34dabf738b4a70cc74e730732c5ccffbe15189303b3f630ba91c9b"} Jun 08 13:07:23.824335 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:23.824300 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e360251b-847e-479c-bf13-4828b767b09d" path="/var/lib/kubelet/pods/e360251b-847e-479c-bf13-4828b767b09d/volumes" Jun 08 13:07:23.953804 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:23.953767 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39daf39-648d-4878-b65b-fe5a05841353","Type":"ContainerStarted","Data":"1c20629bdad61f9f265c85a23a1ee210c95fe5c7a5376d11b203e57604b6db03"} Jun 08 13:07:23.954230 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:23.953875 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39daf39-648d-4878-b65b-fe5a05841353","Type":"ContainerStarted","Data":"0565202b02c8435b4b6e7e90df09789c9567d3a4b4982005f6c9f6da407536d8"} Jun 08 13:07:23.954230 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:23.953917 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39daf39-648d-4878-b65b-fe5a05841353","Type":"ContainerStarted","Data":"4d18a40e7a6c7408db4dfceaa6b4439d856e897ec3677ddef08fa233d62ef1d8"} Jun 08 13:07:23.954230 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:23.953953 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39daf39-648d-4878-b65b-fe5a05841353","Type":"ContainerStarted","Data":"93dff013311e96bacb621b36f1488f8e5e1dc14f22f50195f9b41ef396e3869b"} Jun 08 13:07:23.954230 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:23.953987 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39daf39-648d-4878-b65b-fe5a05841353","Type":"ContainerStarted","Data":"628a71ff0868fdf24c076c71ad5b5c03ec8b1babbdd81e1c7141a035795e6545"} Jun 08 13:07:23.954230 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:23.954022 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a39daf39-648d-4878-b65b-fe5a05841353","Type":"ContainerStarted","Data":"2e63a38d57b456634389b076f0a25f05e51564d279e092b1f3eb15e0de7a0413"} Jun 08 13:07:23.988081 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:23.987969 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.970941055 podStartE2EDuration="1.987952091s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.011036ms" isStatefulPod=false podCreationTimestamp="2026-06-08 13:07:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:07:23.985983868 +0000 UTC m=+362.554392974" watchObservedRunningTime="2026-06-08 13:07:23.987952091 +0000 UTC m=+362.556361172" Jun 08 13:07:24.637578 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.637544 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8476b8f769-f42z4"] Jun 08 13:07:24.641061 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.641044 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.643733 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.643713 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 08 13:07:24.643837 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.643766 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 08 13:07:24.644250 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.644234 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 08 13:07:24.644452 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.644439 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 08 13:07:24.644554 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.644538 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 08 13:07:24.644641 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.644626 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bb7s9\"" Jun 08 13:07:24.650637 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.650616 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 08 13:07:24.655746 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.655724 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8476b8f769-f42z4"] Jun 08 13:07:24.752249 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.752202 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbql6\" (UniqueName: \"kubernetes.io/projected/198708ad-d8ec-4170-b122-61ce2d6e876f-kube-api-access-pbql6\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.752429 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.752269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/198708ad-d8ec-4170-b122-61ce2d6e876f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.752429 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.752300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/198708ad-d8ec-4170-b122-61ce2d6e876f-federate-client-tls\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.752429 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.752369 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/198708ad-d8ec-4170-b122-61ce2d6e876f-metrics-client-ca\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.752429 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.752422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/198708ad-d8ec-4170-b122-61ce2d6e876f-telemeter-client-tls\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.752658 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.752464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/198708ad-d8ec-4170-b122-61ce2d6e876f-secret-telemeter-client\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.752658 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.752539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/198708ad-d8ec-4170-b122-61ce2d6e876f-serving-certs-ca-bundle\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.752658 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.752568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/198708ad-d8ec-4170-b122-61ce2d6e876f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.853963 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.853926 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/198708ad-d8ec-4170-b122-61ce2d6e876f-serving-certs-ca-bundle\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.853963 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.853964 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/198708ad-d8ec-4170-b122-61ce2d6e876f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.854187 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.854000 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbql6\" (UniqueName: \"kubernetes.io/projected/198708ad-d8ec-4170-b122-61ce2d6e876f-kube-api-access-pbql6\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.854187 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.854026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/198708ad-d8ec-4170-b122-61ce2d6e876f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.854187 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.854044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/198708ad-d8ec-4170-b122-61ce2d6e876f-federate-client-tls\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.854187 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.854067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/198708ad-d8ec-4170-b122-61ce2d6e876f-metrics-client-ca\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.854187 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.854089 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/198708ad-d8ec-4170-b122-61ce2d6e876f-telemeter-client-tls\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.854187 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.854121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/198708ad-d8ec-4170-b122-61ce2d6e876f-secret-telemeter-client\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.854946 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.854912 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/198708ad-d8ec-4170-b122-61ce2d6e876f-metrics-client-ca\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.854946 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.854935 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/198708ad-d8ec-4170-b122-61ce2d6e876f-serving-certs-ca-bundle\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.855114 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.854984 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/198708ad-d8ec-4170-b122-61ce2d6e876f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.856801 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.856779 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/198708ad-d8ec-4170-b122-61ce2d6e876f-telemeter-client-tls\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.857042 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.857025 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/198708ad-d8ec-4170-b122-61ce2d6e876f-secret-telemeter-client\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.857097 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.857068 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/198708ad-d8ec-4170-b122-61ce2d6e876f-federate-client-tls\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.857185 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.857167 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/198708ad-d8ec-4170-b122-61ce2d6e876f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.877218 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.877190 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbql6\" (UniqueName: \"kubernetes.io/projected/198708ad-d8ec-4170-b122-61ce2d6e876f-kube-api-access-pbql6\") pod \"telemeter-client-8476b8f769-f42z4\" (UID: \"198708ad-d8ec-4170-b122-61ce2d6e876f\") " pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:24.951200 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:24.951121 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" Jun 08 13:07:25.094387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:25.094355 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8476b8f769-f42z4"] Jun 08 13:07:25.098391 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:07:25.098355 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod198708ad_d8ec_4170_b122_61ce2d6e876f.slice/crio-03687b339ffd4202349ceac143d42e9afd5b508e9bf3ccd66a5a4c36721230f6 WatchSource:0}: Error finding container 03687b339ffd4202349ceac143d42e9afd5b508e9bf3ccd66a5a4c36721230f6: Status 404 returned error can't find the container with id 03687b339ffd4202349ceac143d42e9afd5b508e9bf3ccd66a5a4c36721230f6 Jun 08 13:07:25.100424 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:25.100406 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:07:25.962195 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:25.962161 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" event={"ID":"198708ad-d8ec-4170-b122-61ce2d6e876f","Type":"ContainerStarted","Data":"03687b339ffd4202349ceac143d42e9afd5b508e9bf3ccd66a5a4c36721230f6"} Jun 08 13:07:28.978700 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:28.978665 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" event={"ID":"198708ad-d8ec-4170-b122-61ce2d6e876f","Type":"ContainerStarted","Data":"9f0178d3850cc953976dfdea141c7f9ffda30067653349d62460f1ccf1f6fcad"} Jun 08 13:07:28.979134 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:28.978719 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" event={"ID":"198708ad-d8ec-4170-b122-61ce2d6e876f","Type":"ContainerStarted","Data":"cb6c947b175cbffd906a9a5729f4676fcb03a6c0c1c0fc2058f5f17bcf7fc032"} Jun 08 13:07:28.979134 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:28.978738 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" event={"ID":"198708ad-d8ec-4170-b122-61ce2d6e876f","Type":"ContainerStarted","Data":"05940e585555e33dd3ee09b33582250d943503f083a57b49af1cd1c17eef0ab2"} Jun 08 13:07:29.004108 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.004063 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8476b8f769-f42z4" podStartSLOduration=2.084946664 podStartE2EDuration="5.004049442s" totalImagesPullingTime="2.919102778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:07:29.00259674 +0000 UTC m=+367.571005822" watchObservedRunningTime="2026-06-08 13:07:29.004049442 +0000 UTC m=+367.572458523" Jun 08 13:07:29.552612 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.552577 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-887747894-b9tzk"] Jun 08 13:07:29.555706 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.555685 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.570392 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.570364 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-887747894-b9tzk"] Jun 08 13:07:29.614683 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.614649 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:29.697208 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.697147 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-serving-cert\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.697380 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.697222 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-service-ca\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.697380 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.697251 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-config\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.697380 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.697274 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7j4q\" (UniqueName: \"kubernetes.io/projected/74b1b296-baeb-4a7d-b18a-47fb72bfa264-kube-api-access-w7j4q\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.697380 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.697326 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-trusted-ca-bundle\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.697380 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.697348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-oauth-serving-cert\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.697610 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.697384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-oauth-config\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.717934 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.717889 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:29.798417 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.798381 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-oauth-config\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.798571 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.798438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-serving-cert\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.798571 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.798466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-service-ca\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.798571 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.798505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-config\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.798571 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.798533 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7j4q\" (UniqueName: \"kubernetes.io/projected/74b1b296-baeb-4a7d-b18a-47fb72bfa264-kube-api-access-w7j4q\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.798768 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.798575 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-trusted-ca-bundle\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.798768 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.798596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-oauth-serving-cert\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.799392 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.799364 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-config\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.799392 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.799379 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-service-ca\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.799583 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.799379 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-oauth-serving-cert\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.799631 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.799576 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-trusted-ca-bundle\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.800959 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.800939 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-serving-cert\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.801040 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.800972 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-oauth-config\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.806301 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.806234 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7j4q\" (UniqueName: \"kubernetes.io/projected/74b1b296-baeb-4a7d-b18a-47fb72bfa264-kube-api-access-w7j4q\") pod \"console-887747894-b9tzk\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.858607 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.858559 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:29.865524 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.865501 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:29.939683 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:29.939639 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:30.004746 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:30.004669 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-887747894-b9tzk"] Jun 08 13:07:30.007371 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:07:30.007338 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b1b296_baeb_4a7d_b18a_47fb72bfa264.slice/crio-1fd257597f41df2f6d900d7c57413f19439995999633e6c724f2931237f5e92f WatchSource:0}: Error finding container 1fd257597f41df2f6d900d7c57413f19439995999633e6c724f2931237f5e92f: Status 404 returned error can't find the container with id 1fd257597f41df2f6d900d7c57413f19439995999633e6c724f2931237f5e92f Jun 08 13:07:30.439762 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:30.439730 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:30.992578 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:30.992545 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-887747894-b9tzk" event={"ID":"74b1b296-baeb-4a7d-b18a-47fb72bfa264","Type":"ContainerStarted","Data":"0e81a5d84efad9994706b3a1b6ab8cf10352e3ec1d5fd7e81c7150887bbb2769"} Jun 08 13:07:30.992764 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:30.992621 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-887747894-b9tzk" event={"ID":"74b1b296-baeb-4a7d-b18a-47fb72bfa264","Type":"ContainerStarted","Data":"1fd257597f41df2f6d900d7c57413f19439995999633e6c724f2931237f5e92f"} Jun 08 13:07:31.014661 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:31.014589 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-887747894-b9tzk" podStartSLOduration=2.014571812 podStartE2EDuration="2.014571812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:07:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:07:31.01291688 +0000 UTC m=+369.581325960" watchObservedRunningTime="2026-06-08 13:07:31.014571812 +0000 UTC m=+369.582980893" Jun 08 13:07:35.749719 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:35.749673 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs\") pod \"network-metrics-daemon-jh77v\" (UID: \"0b82f214-ed29-4b52-8974-b1f8e4fd9a14\") " pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:07:35.752006 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:35.751975 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b82f214-ed29-4b52-8974-b1f8e4fd9a14-metrics-certs\") pod \"network-metrics-daemon-jh77v\" (UID: \"0b82f214-ed29-4b52-8974-b1f8e4fd9a14\") " pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:07:35.921403 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:35.921369 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wn2mf\"" Jun 08 13:07:35.929564 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:35.929525 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh77v" Jun 08 13:07:36.062324 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:36.062199 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jh77v"] Jun 08 13:07:36.064872 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:07:36.064836 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b82f214_ed29_4b52_8974_b1f8e4fd9a14.slice/crio-3437714e84619ac75a37fafd385892d34e8a7177d5db6d321e7b717d75d279d6 WatchSource:0}: Error finding container 3437714e84619ac75a37fafd385892d34e8a7177d5db6d321e7b717d75d279d6: Status 404 returned error can't find the container with id 3437714e84619ac75a37fafd385892d34e8a7177d5db6d321e7b717d75d279d6 Jun 08 13:07:37.016163 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:37.016136 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jh77v" event={"ID":"0b82f214-ed29-4b52-8974-b1f8e4fd9a14","Type":"ContainerStarted","Data":"cdab68f8ce79a6b407620050eeeb24de2963094db548fc595fa1437b81df4d77"} Jun 08 13:07:37.016490 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:37.016191 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jh77v" event={"ID":"0b82f214-ed29-4b52-8974-b1f8e4fd9a14","Type":"ContainerStarted","Data":"3437714e84619ac75a37fafd385892d34e8a7177d5db6d321e7b717d75d279d6"} Jun 08 13:07:37.899169 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:37.899137 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:37.965741 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:37.965706 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:38.022054 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:38.022014 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jh77v" event={"ID":"0b82f214-ed29-4b52-8974-b1f8e4fd9a14","Type":"ContainerStarted","Data":"6ec343585954bc266ab09bd159ba6c92bac4095cac37bddc8c0e0358937f039c"} Jun 08 13:07:38.043514 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:38.043445 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jh77v" podStartSLOduration=375.187676677 podStartE2EDuration="6m16.043430092s" totalImagesPullingTime="855.753415ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:07:38.042080114 +0000 UTC m=+376.610489196" watchObservedRunningTime="2026-06-08 13:07:38.043430092 +0000 UTC m=+376.611839173" Jun 08 13:07:38.154573 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:38.154439 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:38.265936 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:38.265886 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:38.338624 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:38.338593 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:39.866294 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:39.866254 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:39.866732 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:39.866370 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:39.871252 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:39.871230 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:40.033464 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:40.033438 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-887747894-b9tzk" Jun 08 13:07:40.087967 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:40.087938 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f899575cb-fw8cz"] Jun 08 13:07:40.209221 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:40.209186 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:40.315597 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:40.315561 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:40.377893 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:40.377862 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:58.672969 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:58.672936 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:07:58.754970 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:07:58.754923 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:05.109433 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.109391 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f899575cb-fw8cz" podUID="27d45d6c-a73a-4c45-9072-d8f8e0c004fe" containerName="console" containerID="cri-o://8b2caf2d581ee3db7374d82610dea565805d035cd61aa0494cc7571524ae4869" gracePeriod=15 Jun 08 13:08:05.361694 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.361632 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:08:05.499780 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.499734 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-oauth-serving-cert\") pod \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " Jun 08 13:08:05.499780 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.499795 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-trusted-ca-bundle\") pod \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " Jun 08 13:08:05.499993 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.499921 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-serving-cert\") pod \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " Jun 08 13:08:05.499993 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.499952 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-oauth-config\") pod \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " Jun 08 13:08:05.499993 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.499980 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccr8g\" (UniqueName: \"kubernetes.io/projected/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-kube-api-access-ccr8g\") pod \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " Jun 08 13:08:05.500141 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.500007 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-config\") pod \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " Jun 08 13:08:05.500141 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.500056 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-service-ca\") pod \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\" (UID: \"27d45d6c-a73a-4c45-9072-d8f8e0c004fe\") " Jun 08 13:08:05.500247 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.500134 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "27d45d6c-a73a-4c45-9072-d8f8e0c004fe" (UID: "27d45d6c-a73a-4c45-9072-d8f8e0c004fe"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:08:05.500247 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.500190 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "27d45d6c-a73a-4c45-9072-d8f8e0c004fe" (UID: "27d45d6c-a73a-4c45-9072-d8f8e0c004fe"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:08:05.500513 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.500463 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-oauth-serving-cert\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:08:05.500513 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.500504 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-service-ca" (OuterVolumeSpecName: "service-ca") pod "27d45d6c-a73a-4c45-9072-d8f8e0c004fe" (UID: "27d45d6c-a73a-4c45-9072-d8f8e0c004fe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:08:05.500513 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.500516 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-trusted-ca-bundle\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:08:05.500749 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.500524 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-config" (OuterVolumeSpecName: "console-config") pod "27d45d6c-a73a-4c45-9072-d8f8e0c004fe" (UID: "27d45d6c-a73a-4c45-9072-d8f8e0c004fe"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:08:05.502101 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.502073 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "27d45d6c-a73a-4c45-9072-d8f8e0c004fe" (UID: "27d45d6c-a73a-4c45-9072-d8f8e0c004fe"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:08:05.502196 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.502110 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "27d45d6c-a73a-4c45-9072-d8f8e0c004fe" (UID: "27d45d6c-a73a-4c45-9072-d8f8e0c004fe"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:08:05.502196 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.502125 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-kube-api-access-ccr8g" (OuterVolumeSpecName: "kube-api-access-ccr8g") pod "27d45d6c-a73a-4c45-9072-d8f8e0c004fe" (UID: "27d45d6c-a73a-4c45-9072-d8f8e0c004fe"). InnerVolumeSpecName "kube-api-access-ccr8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:08:05.601185 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.601152 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-serving-cert\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:08:05.601185 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.601178 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-oauth-config\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:08:05.601185 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.601188 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccr8g\" (UniqueName: \"kubernetes.io/projected/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-kube-api-access-ccr8g\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:08:05.601392 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.601197 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-console-config\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:08:05.601392 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:05.601206 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27d45d6c-a73a-4c45-9072-d8f8e0c004fe-service-ca\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:08:06.126880 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:06.126848 2564 generic.go:356] "Generic (PLEG): container finished" podID="27d45d6c-a73a-4c45-9072-d8f8e0c004fe" containerID="8b2caf2d581ee3db7374d82610dea565805d035cd61aa0494cc7571524ae4869" exitCode=0 Jun 08 13:08:06.127306 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:06.126896 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f899575cb-fw8cz" Jun 08 13:08:06.127306 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:06.126904 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f899575cb-fw8cz" event={"ID":"27d45d6c-a73a-4c45-9072-d8f8e0c004fe","Type":"ContainerDied","Data":"8b2caf2d581ee3db7374d82610dea565805d035cd61aa0494cc7571524ae4869"} Jun 08 13:08:06.127306 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:06.126943 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f899575cb-fw8cz" event={"ID":"27d45d6c-a73a-4c45-9072-d8f8e0c004fe","Type":"ContainerDied","Data":"c4b098848f0d242c51732e4d539eae6052654f62bb38a71118b75d2399709405"} Jun 08 13:08:06.127306 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:06.126961 2564 scope.go:117] "RemoveContainer" containerID="8b2caf2d581ee3db7374d82610dea565805d035cd61aa0494cc7571524ae4869" Jun 08 13:08:06.134759 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:06.134738 2564 scope.go:117] "RemoveContainer" containerID="8b2caf2d581ee3db7374d82610dea565805d035cd61aa0494cc7571524ae4869" Jun 08 13:08:06.135006 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:08:06.134988 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b2caf2d581ee3db7374d82610dea565805d035cd61aa0494cc7571524ae4869\": container with ID starting with 8b2caf2d581ee3db7374d82610dea565805d035cd61aa0494cc7571524ae4869 not found: ID does not exist" containerID="8b2caf2d581ee3db7374d82610dea565805d035cd61aa0494cc7571524ae4869" Jun 08 13:08:06.135061 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:06.135013 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b2caf2d581ee3db7374d82610dea565805d035cd61aa0494cc7571524ae4869"} err="failed to get container status \"8b2caf2d581ee3db7374d82610dea565805d035cd61aa0494cc7571524ae4869\": rpc error: code = NotFound desc = could not find container \"8b2caf2d581ee3db7374d82610dea565805d035cd61aa0494cc7571524ae4869\": container with ID starting with 8b2caf2d581ee3db7374d82610dea565805d035cd61aa0494cc7571524ae4869 not found: ID does not exist" Jun 08 13:08:06.142024 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:06.141998 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f899575cb-fw8cz"] Jun 08 13:08:06.145541 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:06.145519 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f899575cb-fw8cz"] Jun 08 13:08:07.823583 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:07.823553 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27d45d6c-a73a-4c45-9072-d8f8e0c004fe" path="/var/lib/kubelet/pods/27d45d6c-a73a-4c45-9072-d8f8e0c004fe/volumes" Jun 08 13:08:21.740798 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:21.740766 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:34.795429 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:34.795393 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:34.853900 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:34.853869 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:46.670021 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:46.669990 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:46.727638 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:46.727612 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:54.990840 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:54.990802 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:55.091839 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:55.091809 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:08:55.418964 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:08:55.418929 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:02.422416 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.422379 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c7f968d55-zttlm"] Jun 08 13:09:02.422803 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.422673 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d45d6c-a73a-4c45-9072-d8f8e0c004fe" containerName="console" Jun 08 13:09:02.422803 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.422684 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d45d6c-a73a-4c45-9072-d8f8e0c004fe" containerName="console" Jun 08 13:09:02.422803 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.422739 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="27d45d6c-a73a-4c45-9072-d8f8e0c004fe" containerName="console" Jun 08 13:09:02.425653 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.425628 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.441700 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.441678 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7f968d55-zttlm"] Jun 08 13:09:02.482057 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.482017 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:02.562296 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.562259 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-service-ca\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.562466 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.562311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4d28141-deea-45ff-bf95-4d93275172dc-console-serving-cert\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.562466 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.562346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdw7z\" (UniqueName: \"kubernetes.io/projected/a4d28141-deea-45ff-bf95-4d93275172dc-kube-api-access-gdw7z\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.562466 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.562383 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-trusted-ca-bundle\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.562679 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.562501 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-console-config\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.562679 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.562544 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-oauth-serving-cert\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.562679 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.562576 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4d28141-deea-45ff-bf95-4d93275172dc-console-oauth-config\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.582336 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.582295 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:02.663982 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.663943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdw7z\" (UniqueName: \"kubernetes.io/projected/a4d28141-deea-45ff-bf95-4d93275172dc-kube-api-access-gdw7z\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.664188 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.664004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-trusted-ca-bundle\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.664188 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.664051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-console-config\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.664188 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.664073 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-oauth-serving-cert\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.664188 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.664098 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4d28141-deea-45ff-bf95-4d93275172dc-console-oauth-config\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.664188 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.664122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-service-ca\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.664188 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.664164 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4d28141-deea-45ff-bf95-4d93275172dc-console-serving-cert\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.665008 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.664977 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-console-config\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.665140 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.664991 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-oauth-serving-cert\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.665140 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.665027 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-service-ca\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.665140 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.665035 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-trusted-ca-bundle\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.666671 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.666641 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4d28141-deea-45ff-bf95-4d93275172dc-console-serving-cert\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.666774 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.666684 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4d28141-deea-45ff-bf95-4d93275172dc-console-oauth-config\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.673903 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.673851 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdw7z\" (UniqueName: \"kubernetes.io/projected/a4d28141-deea-45ff-bf95-4d93275172dc-kube-api-access-gdw7z\") pod \"console-5c7f968d55-zttlm\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.736067 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.736033 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:02.873403 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:02.873371 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7f968d55-zttlm"] Jun 08 13:09:02.876448 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:09:02.876420 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d28141_deea_45ff_bf95_4d93275172dc.slice/crio-4073d586fb8d8c6f534aa338071dc120790f908896f02214e077acedc423ad2c WatchSource:0}: Error finding container 4073d586fb8d8c6f534aa338071dc120790f908896f02214e077acedc423ad2c: Status 404 returned error can't find the container with id 4073d586fb8d8c6f534aa338071dc120790f908896f02214e077acedc423ad2c Jun 08 13:09:03.330060 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:03.329971 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7f968d55-zttlm" event={"ID":"a4d28141-deea-45ff-bf95-4d93275172dc","Type":"ContainerStarted","Data":"8280f5aa8ae3aebd14dae46179cd35ffcb160d97462b2714850b6a25f585afdf"} Jun 08 13:09:03.330060 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:03.330031 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7f968d55-zttlm" event={"ID":"a4d28141-deea-45ff-bf95-4d93275172dc","Type":"ContainerStarted","Data":"4073d586fb8d8c6f534aa338071dc120790f908896f02214e077acedc423ad2c"} Jun 08 13:09:03.348951 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:03.348894 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c7f968d55-zttlm" podStartSLOduration=1.348876591 podStartE2EDuration="1.348876591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:09:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:09:03.347782507 +0000 UTC m=+461.916191588" watchObservedRunningTime="2026-06-08 13:09:03.348876591 +0000 UTC m=+461.917285673" Jun 08 13:09:12.736934 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:12.736897 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:12.737412 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:12.736955 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:12.741643 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:12.741620 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:13.369879 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:13.369853 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:09:13.427233 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:13.427201 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-887747894-b9tzk"] Jun 08 13:09:13.539659 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:13.539620 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:13.599789 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:13.599755 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:13.680691 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:13.680660 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:09:38.447579 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.447537 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-887747894-b9tzk" podUID="74b1b296-baeb-4a7d-b18a-47fb72bfa264" containerName="console" containerID="cri-o://0e81a5d84efad9994706b3a1b6ab8cf10352e3ec1d5fd7e81c7150887bbb2769" gracePeriod=15 Jun 08 13:09:38.678913 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.678882 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-887747894-b9tzk" Jun 08 13:09:38.743213 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.743135 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-trusted-ca-bundle\") pod \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " Jun 08 13:09:38.743213 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.743184 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-serving-cert\") pod \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " Jun 08 13:09:38.743213 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.743202 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-oauth-config\") pod \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " Jun 08 13:09:38.743513 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.743221 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7j4q\" (UniqueName: \"kubernetes.io/projected/74b1b296-baeb-4a7d-b18a-47fb72bfa264-kube-api-access-w7j4q\") pod \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " Jun 08 13:09:38.743513 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.743254 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-service-ca\") pod \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " Jun 08 13:09:38.743513 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.743270 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-config\") pod \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " Jun 08 13:09:38.743513 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.743391 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-oauth-serving-cert\") pod \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\" (UID: \"74b1b296-baeb-4a7d-b18a-47fb72bfa264\") " Jun 08 13:09:38.743739 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.743562 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "74b1b296-baeb-4a7d-b18a-47fb72bfa264" (UID: "74b1b296-baeb-4a7d-b18a-47fb72bfa264"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:09:38.743739 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.743684 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-trusted-ca-bundle\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:09:38.743939 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.743911 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-config" (OuterVolumeSpecName: "console-config") pod "74b1b296-baeb-4a7d-b18a-47fb72bfa264" (UID: "74b1b296-baeb-4a7d-b18a-47fb72bfa264"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:09:38.744053 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.743954 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-service-ca" (OuterVolumeSpecName: "service-ca") pod "74b1b296-baeb-4a7d-b18a-47fb72bfa264" (UID: "74b1b296-baeb-4a7d-b18a-47fb72bfa264"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:09:38.744053 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.744032 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "74b1b296-baeb-4a7d-b18a-47fb72bfa264" (UID: "74b1b296-baeb-4a7d-b18a-47fb72bfa264"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:09:38.745415 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.745393 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "74b1b296-baeb-4a7d-b18a-47fb72bfa264" (UID: "74b1b296-baeb-4a7d-b18a-47fb72bfa264"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:09:38.745518 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.745422 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74b1b296-baeb-4a7d-b18a-47fb72bfa264-kube-api-access-w7j4q" (OuterVolumeSpecName: "kube-api-access-w7j4q") pod "74b1b296-baeb-4a7d-b18a-47fb72bfa264" (UID: "74b1b296-baeb-4a7d-b18a-47fb72bfa264"). InnerVolumeSpecName "kube-api-access-w7j4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:09:38.745618 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.745599 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "74b1b296-baeb-4a7d-b18a-47fb72bfa264" (UID: "74b1b296-baeb-4a7d-b18a-47fb72bfa264"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:09:38.844239 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.844206 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-serving-cert\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:09:38.844239 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.844232 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-oauth-config\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:09:38.844239 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.844247 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7j4q\" (UniqueName: \"kubernetes.io/projected/74b1b296-baeb-4a7d-b18a-47fb72bfa264-kube-api-access-w7j4q\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:09:38.844454 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.844256 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-service-ca\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:09:38.844454 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.844264 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-console-config\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:09:38.844454 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:38.844272 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74b1b296-baeb-4a7d-b18a-47fb72bfa264-oauth-serving-cert\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:09:39.465135 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:39.465100 2564 generic.go:356] "Generic (PLEG): container finished" podID="74b1b296-baeb-4a7d-b18a-47fb72bfa264" containerID="0e81a5d84efad9994706b3a1b6ab8cf10352e3ec1d5fd7e81c7150887bbb2769" exitCode=0 Jun 08 13:09:39.465575 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:39.465146 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-887747894-b9tzk" Jun 08 13:09:39.465575 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:39.465180 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-887747894-b9tzk" event={"ID":"74b1b296-baeb-4a7d-b18a-47fb72bfa264","Type":"ContainerDied","Data":"0e81a5d84efad9994706b3a1b6ab8cf10352e3ec1d5fd7e81c7150887bbb2769"} Jun 08 13:09:39.465575 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:39.465226 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-887747894-b9tzk" event={"ID":"74b1b296-baeb-4a7d-b18a-47fb72bfa264","Type":"ContainerDied","Data":"1fd257597f41df2f6d900d7c57413f19439995999633e6c724f2931237f5e92f"} Jun 08 13:09:39.465575 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:39.465246 2564 scope.go:117] "RemoveContainer" containerID="0e81a5d84efad9994706b3a1b6ab8cf10352e3ec1d5fd7e81c7150887bbb2769" Jun 08 13:09:39.474220 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:39.474199 2564 scope.go:117] "RemoveContainer" containerID="0e81a5d84efad9994706b3a1b6ab8cf10352e3ec1d5fd7e81c7150887bbb2769" Jun 08 13:09:39.474492 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:09:39.474461 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e81a5d84efad9994706b3a1b6ab8cf10352e3ec1d5fd7e81c7150887bbb2769\": container with ID starting with 0e81a5d84efad9994706b3a1b6ab8cf10352e3ec1d5fd7e81c7150887bbb2769 not found: ID does not exist" containerID="0e81a5d84efad9994706b3a1b6ab8cf10352e3ec1d5fd7e81c7150887bbb2769" Jun 08 13:09:39.474568 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:39.474502 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e81a5d84efad9994706b3a1b6ab8cf10352e3ec1d5fd7e81c7150887bbb2769"} err="failed to get container status \"0e81a5d84efad9994706b3a1b6ab8cf10352e3ec1d5fd7e81c7150887bbb2769\": rpc error: code = NotFound desc = could not find container \"0e81a5d84efad9994706b3a1b6ab8cf10352e3ec1d5fd7e81c7150887bbb2769\": container with ID starting with 0e81a5d84efad9994706b3a1b6ab8cf10352e3ec1d5fd7e81c7150887bbb2769 not found: ID does not exist" Jun 08 13:09:39.495226 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:39.495198 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-887747894-b9tzk"] Jun 08 13:09:39.503429 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:39.503403 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-887747894-b9tzk"] Jun 08 13:09:39.822648 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:09:39.822573 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74b1b296-baeb-4a7d-b18a-47fb72bfa264" path="/var/lib/kubelet/pods/74b1b296-baeb-4a7d-b18a-47fb72bfa264/volumes" Jun 08 13:10:10.857857 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:10.857771 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:10:10.955371 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:10.955341 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:10:11.694539 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.694509 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977"] Jun 08 13:10:11.694770 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.694759 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b1b296-baeb-4a7d-b18a-47fb72bfa264" containerName="console" Jun 08 13:10:11.694818 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.694772 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b1b296-baeb-4a7d-b18a-47fb72bfa264" containerName="console" Jun 08 13:10:11.694892 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.694882 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b1b296-baeb-4a7d-b18a-47fb72bfa264" containerName="console" Jun 08 13:10:11.697825 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.697809 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" Jun 08 13:10:11.703812 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.703784 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:10:11.703812 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.703806 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:10:11.704876 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.704861 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8tv44\"" Jun 08 13:10:11.717366 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.717344 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977"] Jun 08 13:10:11.813043 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.813010 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmbms\" (UniqueName: \"kubernetes.io/projected/09588739-b026-48e3-9eb5-b62af9e2d262-kube-api-access-pmbms\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977\" (UID: \"09588739-b026-48e3-9eb5-b62af9e2d262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" Jun 08 13:10:11.813186 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.813061 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09588739-b026-48e3-9eb5-b62af9e2d262-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977\" (UID: \"09588739-b026-48e3-9eb5-b62af9e2d262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" Jun 08 13:10:11.813186 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.813132 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09588739-b026-48e3-9eb5-b62af9e2d262-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977\" (UID: \"09588739-b026-48e3-9eb5-b62af9e2d262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" Jun 08 13:10:11.913455 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.913424 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmbms\" (UniqueName: \"kubernetes.io/projected/09588739-b026-48e3-9eb5-b62af9e2d262-kube-api-access-pmbms\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977\" (UID: \"09588739-b026-48e3-9eb5-b62af9e2d262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" Jun 08 13:10:11.913875 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.913491 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09588739-b026-48e3-9eb5-b62af9e2d262-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977\" (UID: \"09588739-b026-48e3-9eb5-b62af9e2d262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" Jun 08 13:10:11.913875 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.913522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09588739-b026-48e3-9eb5-b62af9e2d262-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977\" (UID: \"09588739-b026-48e3-9eb5-b62af9e2d262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" Jun 08 13:10:11.913968 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.913894 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09588739-b026-48e3-9eb5-b62af9e2d262-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977\" (UID: \"09588739-b026-48e3-9eb5-b62af9e2d262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" Jun 08 13:10:11.913968 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.913929 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09588739-b026-48e3-9eb5-b62af9e2d262-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977\" (UID: \"09588739-b026-48e3-9eb5-b62af9e2d262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" Jun 08 13:10:11.922323 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:11.922303 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmbms\" (UniqueName: \"kubernetes.io/projected/09588739-b026-48e3-9eb5-b62af9e2d262-kube-api-access-pmbms\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977\" (UID: \"09588739-b026-48e3-9eb5-b62af9e2d262\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" Jun 08 13:10:12.006274 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:12.006210 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" Jun 08 13:10:12.136146 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:12.136116 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977"] Jun 08 13:10:12.139312 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:10:12.139283 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09588739_b026_48e3_9eb5_b62af9e2d262.slice/crio-2f4d2f085aa5a7974e277902b471607b65f84f938943fb17553027e268ef180f WatchSource:0}: Error finding container 2f4d2f085aa5a7974e277902b471607b65f84f938943fb17553027e268ef180f: Status 404 returned error can't find the container with id 2f4d2f085aa5a7974e277902b471607b65f84f938943fb17553027e268ef180f Jun 08 13:10:12.590503 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:12.590453 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" event={"ID":"09588739-b026-48e3-9eb5-b62af9e2d262","Type":"ContainerStarted","Data":"2f4d2f085aa5a7974e277902b471607b65f84f938943fb17553027e268ef180f"} Jun 08 13:10:23.632978 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:23.632948 2564 generic.go:356] "Generic (PLEG): container finished" podID="09588739-b026-48e3-9eb5-b62af9e2d262" containerID="0f0f90ac37ef027f5e4d518d1513622451e4095c9257e0fe2c392a7bd2e11a26" exitCode=0 Jun 08 13:10:23.633280 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:23.633006 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" event={"ID":"09588739-b026-48e3-9eb5-b62af9e2d262","Type":"ContainerDied","Data":"0f0f90ac37ef027f5e4d518d1513622451e4095c9257e0fe2c392a7bd2e11a26"} Jun 08 13:10:26.647138 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:26.647100 2564 generic.go:356] "Generic (PLEG): container finished" podID="09588739-b026-48e3-9eb5-b62af9e2d262" containerID="2902b238db893fd998c98c7dc5708817557d5411557bd77188837a41c6e4b8af" exitCode=0 Jun 08 13:10:26.647628 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:26.647184 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" event={"ID":"09588739-b026-48e3-9eb5-b62af9e2d262","Type":"ContainerDied","Data":"2902b238db893fd998c98c7dc5708817557d5411557bd77188837a41c6e4b8af"} Jun 08 13:10:34.680913 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:34.680881 2564 generic.go:356] "Generic (PLEG): container finished" podID="09588739-b026-48e3-9eb5-b62af9e2d262" containerID="d1b81ff3aeaae77d2691a87abf77056c3554ce2d859b02012746630fe4d5878c" exitCode=0 Jun 08 13:10:34.681317 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:34.680960 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" event={"ID":"09588739-b026-48e3-9eb5-b62af9e2d262","Type":"ContainerDied","Data":"d1b81ff3aeaae77d2691a87abf77056c3554ce2d859b02012746630fe4d5878c"} Jun 08 13:10:35.851047 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:35.851024 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" Jun 08 13:10:35.915565 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:35.915535 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09588739-b026-48e3-9eb5-b62af9e2d262-util\") pod \"09588739-b026-48e3-9eb5-b62af9e2d262\" (UID: \"09588739-b026-48e3-9eb5-b62af9e2d262\") " Jun 08 13:10:35.915720 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:35.915606 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmbms\" (UniqueName: \"kubernetes.io/projected/09588739-b026-48e3-9eb5-b62af9e2d262-kube-api-access-pmbms\") pod \"09588739-b026-48e3-9eb5-b62af9e2d262\" (UID: \"09588739-b026-48e3-9eb5-b62af9e2d262\") " Jun 08 13:10:35.915720 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:35.915651 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09588739-b026-48e3-9eb5-b62af9e2d262-bundle\") pod \"09588739-b026-48e3-9eb5-b62af9e2d262\" (UID: \"09588739-b026-48e3-9eb5-b62af9e2d262\") " Jun 08 13:10:35.916282 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:35.916257 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09588739-b026-48e3-9eb5-b62af9e2d262-bundle" (OuterVolumeSpecName: "bundle") pod "09588739-b026-48e3-9eb5-b62af9e2d262" (UID: "09588739-b026-48e3-9eb5-b62af9e2d262"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:10:35.917766 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:35.917738 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09588739-b026-48e3-9eb5-b62af9e2d262-kube-api-access-pmbms" (OuterVolumeSpecName: "kube-api-access-pmbms") pod "09588739-b026-48e3-9eb5-b62af9e2d262" (UID: "09588739-b026-48e3-9eb5-b62af9e2d262"). InnerVolumeSpecName "kube-api-access-pmbms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:10:35.919589 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:35.919568 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09588739-b026-48e3-9eb5-b62af9e2d262-util" (OuterVolumeSpecName: "util") pod "09588739-b026-48e3-9eb5-b62af9e2d262" (UID: "09588739-b026-48e3-9eb5-b62af9e2d262"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:10:36.016227 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:36.016161 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09588739-b026-48e3-9eb5-b62af9e2d262-util\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:10:36.016227 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:36.016187 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmbms\" (UniqueName: \"kubernetes.io/projected/09588739-b026-48e3-9eb5-b62af9e2d262-kube-api-access-pmbms\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:10:36.016227 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:36.016197 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09588739-b026-48e3-9eb5-b62af9e2d262-bundle\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:10:36.690019 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:36.689993 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" Jun 08 13:10:36.690184 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:36.689989 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5n977" event={"ID":"09588739-b026-48e3-9eb5-b62af9e2d262","Type":"ContainerDied","Data":"2f4d2f085aa5a7974e277902b471607b65f84f938943fb17553027e268ef180f"} Jun 08 13:10:36.690184 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:36.690114 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f4d2f085aa5a7974e277902b471607b65f84f938943fb17553027e268ef180f" Jun 08 13:10:38.076118 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:38.076085 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:10:39.278182 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:39.278149 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:10:46.159449 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:46.159417 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:10:47.911158 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:47.911125 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:10:48.164290 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.164221 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t2sf5"] Jun 08 13:10:48.164499 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.164487 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09588739-b026-48e3-9eb5-b62af9e2d262" containerName="extract" Jun 08 13:10:48.164548 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.164500 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="09588739-b026-48e3-9eb5-b62af9e2d262" containerName="extract" Jun 08 13:10:48.164548 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.164512 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09588739-b026-48e3-9eb5-b62af9e2d262" containerName="util" Jun 08 13:10:48.164548 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.164517 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="09588739-b026-48e3-9eb5-b62af9e2d262" containerName="util" Jun 08 13:10:48.164548 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.164525 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09588739-b026-48e3-9eb5-b62af9e2d262" containerName="pull" Jun 08 13:10:48.164548 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.164531 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="09588739-b026-48e3-9eb5-b62af9e2d262" containerName="pull" Jun 08 13:10:48.164714 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.164583 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="09588739-b026-48e3-9eb5-b62af9e2d262" containerName="extract" Jun 08 13:10:48.166709 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.166694 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t2sf5" Jun 08 13:10:48.169635 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.169620 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hfnv4\"" Jun 08 13:10:48.169940 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.169916 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 08 13:10:48.170148 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.170130 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:10:48.182981 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.182959 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t2sf5"] Jun 08 13:10:48.213643 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.213616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnp4t\" (UniqueName: \"kubernetes.io/projected/020b14c6-06a2-4ef6-a8ff-c2e292e32f6c-kube-api-access-qnp4t\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t2sf5\" (UID: \"020b14c6-06a2-4ef6-a8ff-c2e292e32f6c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t2sf5" Jun 08 13:10:48.213740 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.213646 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/020b14c6-06a2-4ef6-a8ff-c2e292e32f6c-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t2sf5\" (UID: \"020b14c6-06a2-4ef6-a8ff-c2e292e32f6c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t2sf5" Jun 08 13:10:48.314084 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.314060 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnp4t\" (UniqueName: \"kubernetes.io/projected/020b14c6-06a2-4ef6-a8ff-c2e292e32f6c-kube-api-access-qnp4t\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t2sf5\" (UID: \"020b14c6-06a2-4ef6-a8ff-c2e292e32f6c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t2sf5" Jun 08 13:10:48.314174 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.314087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/020b14c6-06a2-4ef6-a8ff-c2e292e32f6c-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t2sf5\" (UID: \"020b14c6-06a2-4ef6-a8ff-c2e292e32f6c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t2sf5" Jun 08 13:10:48.314416 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.314401 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/020b14c6-06a2-4ef6-a8ff-c2e292e32f6c-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t2sf5\" (UID: \"020b14c6-06a2-4ef6-a8ff-c2e292e32f6c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t2sf5" Jun 08 13:10:48.325187 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.325169 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnp4t\" (UniqueName: \"kubernetes.io/projected/020b14c6-06a2-4ef6-a8ff-c2e292e32f6c-kube-api-access-qnp4t\") pod \"cert-manager-operator-controller-manager-57757f7cfc-t2sf5\" (UID: \"020b14c6-06a2-4ef6-a8ff-c2e292e32f6c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t2sf5" Jun 08 13:10:48.475179 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.475114 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t2sf5" Jun 08 13:10:48.612101 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.612065 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t2sf5"] Jun 08 13:10:48.618266 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:10:48.618193 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod020b14c6_06a2_4ef6_a8ff_c2e292e32f6c.slice/crio-482d7e7c3498919ab8791e658d4ce8ef7cb6d042f0da391af69157db0b7e5d02 WatchSource:0}: Error finding container 482d7e7c3498919ab8791e658d4ce8ef7cb6d042f0da391af69157db0b7e5d02: Status 404 returned error can't find the container with id 482d7e7c3498919ab8791e658d4ce8ef7cb6d042f0da391af69157db0b7e5d02 Jun 08 13:10:48.735110 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:48.735046 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t2sf5" event={"ID":"020b14c6-06a2-4ef6-a8ff-c2e292e32f6c","Type":"ContainerStarted","Data":"482d7e7c3498919ab8791e658d4ce8ef7cb6d042f0da391af69157db0b7e5d02"} Jun 08 13:10:49.747295 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:49.747262 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:10:49.856987 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:49.856951 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:10:50.745576 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:50.745544 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t2sf5" event={"ID":"020b14c6-06a2-4ef6-a8ff-c2e292e32f6c","Type":"ContainerStarted","Data":"5e2146176ffa1f8e2ff20f22c262e0a2d269c621eb8a64b81ad32bd0073d760e"} Jun 08 13:10:50.772670 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:50.772627 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-t2sf5" podStartSLOduration=1.233834308 podStartE2EDuration="2.772612618s" totalImagesPullingTime="1.53877831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:10:50.770613164 +0000 UTC m=+569.339022246" watchObservedRunningTime="2026-06-08 13:10:50.772612618 +0000 UTC m=+569.341021700" Jun 08 13:10:51.159106 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:51.159069 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:10:51.301719 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:51.301682 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:10:52.565978 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:52.565943 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8"] Jun 08 13:10:52.569517 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:52.569495 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" Jun 08 13:10:52.572160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:52.572137 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:10:52.572287 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:52.572164 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:10:52.572287 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:52.572245 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8tv44\"" Jun 08 13:10:52.579626 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:52.579604 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8"] Jun 08 13:10:52.652305 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:52.652278 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hckg8\" (UniqueName: \"kubernetes.io/projected/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-kube-api-access-hckg8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8\" (UID: \"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" Jun 08 13:10:52.652457 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:52.652342 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8\" (UID: \"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" Jun 08 13:10:52.652457 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:52.652362 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8\" (UID: \"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" Jun 08 13:10:52.753414 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:52.753383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hckg8\" (UniqueName: \"kubernetes.io/projected/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-kube-api-access-hckg8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8\" (UID: \"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" Jun 08 13:10:52.753589 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:52.753497 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8\" (UID: \"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" Jun 08 13:10:52.753589 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:52.753528 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8\" (UID: \"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" Jun 08 13:10:52.753898 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:52.753879 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8\" (UID: \"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" Jun 08 13:10:52.753960 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:52.753941 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8\" (UID: \"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" Jun 08 13:10:52.762181 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:52.762155 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hckg8\" (UniqueName: \"kubernetes.io/projected/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-kube-api-access-hckg8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8\" (UID: \"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" Jun 08 13:10:52.878882 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:52.878856 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" Jun 08 13:10:53.005669 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:53.005640 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8"] Jun 08 13:10:53.009049 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:10:53.009022 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59fe988_ac6f_4083_8f7a_d46bdb3d8a86.slice/crio-7ceaca1fae7e8e25cea67d7fb059fdff40154c4ddbef77286cec181df8de9fad WatchSource:0}: Error finding container 7ceaca1fae7e8e25cea67d7fb059fdff40154c4ddbef77286cec181df8de9fad: Status 404 returned error can't find the container with id 7ceaca1fae7e8e25cea67d7fb059fdff40154c4ddbef77286cec181df8de9fad Jun 08 13:10:53.759915 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:53.759878 2564 generic.go:356] "Generic (PLEG): container finished" podID="c59fe988-ac6f-4083-8f7a-d46bdb3d8a86" containerID="c91e49b0b942b1cfdef34003879b8d8442837a460f09d80fb4ce4b890db8cbf3" exitCode=0 Jun 08 13:10:53.760359 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:53.759963 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" event={"ID":"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86","Type":"ContainerDied","Data":"c91e49b0b942b1cfdef34003879b8d8442837a460f09d80fb4ce4b890db8cbf3"} Jun 08 13:10:53.760359 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:53.760042 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" event={"ID":"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86","Type":"ContainerStarted","Data":"7ceaca1fae7e8e25cea67d7fb059fdff40154c4ddbef77286cec181df8de9fad"} Jun 08 13:10:54.648855 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:54.648812 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:10:54.667647 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:54.667614 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8hxp4"] Jun 08 13:10:54.670902 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:54.670881 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8hxp4" Jun 08 13:10:54.673572 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:54.673546 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 13:10:54.673689 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:54.673595 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vmbnz\"" Jun 08 13:10:54.674515 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:54.674497 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 13:10:54.692759 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:54.692733 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8hxp4"] Jun 08 13:10:54.771404 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:54.771374 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98dxx\" (UniqueName: \"kubernetes.io/projected/cd69c877-1985-4ef3-98b2-f66cc501bc34-kube-api-access-98dxx\") pod \"cert-manager-cainjector-5d99449ffd-8hxp4\" (UID: \"cd69c877-1985-4ef3-98b2-f66cc501bc34\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8hxp4" Jun 08 13:10:54.771799 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:54.771421 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd69c877-1985-4ef3-98b2-f66cc501bc34-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8hxp4\" (UID: \"cd69c877-1985-4ef3-98b2-f66cc501bc34\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8hxp4" Jun 08 13:10:54.872598 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:54.872566 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98dxx\" (UniqueName: \"kubernetes.io/projected/cd69c877-1985-4ef3-98b2-f66cc501bc34-kube-api-access-98dxx\") pod \"cert-manager-cainjector-5d99449ffd-8hxp4\" (UID: \"cd69c877-1985-4ef3-98b2-f66cc501bc34\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8hxp4" Jun 08 13:10:54.872777 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:54.872636 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd69c877-1985-4ef3-98b2-f66cc501bc34-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8hxp4\" (UID: \"cd69c877-1985-4ef3-98b2-f66cc501bc34\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8hxp4" Jun 08 13:10:54.894877 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:54.894852 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd69c877-1985-4ef3-98b2-f66cc501bc34-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-8hxp4\" (UID: \"cd69c877-1985-4ef3-98b2-f66cc501bc34\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8hxp4" Jun 08 13:10:54.895204 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:54.895186 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98dxx\" (UniqueName: \"kubernetes.io/projected/cd69c877-1985-4ef3-98b2-f66cc501bc34-kube-api-access-98dxx\") pod \"cert-manager-cainjector-5d99449ffd-8hxp4\" (UID: \"cd69c877-1985-4ef3-98b2-f66cc501bc34\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-8hxp4" Jun 08 13:10:54.985677 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:54.985597 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:10:54.993363 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:54.993338 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8hxp4" Jun 08 13:10:55.136410 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:55.136378 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-8hxp4"] Jun 08 13:10:55.811212 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:10:55.811182 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd69c877_1985_4ef3_98b2_f66cc501bc34.slice/crio-ecef4af8bf61429d8404cab40f940d0ac1af710938690f4e69ad6499685ca86c WatchSource:0}: Error finding container ecef4af8bf61429d8404cab40f940d0ac1af710938690f4e69ad6499685ca86c: Status 404 returned error can't find the container with id ecef4af8bf61429d8404cab40f940d0ac1af710938690f4e69ad6499685ca86c Jun 08 13:10:56.739663 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:56.739622 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:10:56.774907 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:56.774860 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8hxp4" event={"ID":"cd69c877-1985-4ef3-98b2-f66cc501bc34","Type":"ContainerStarted","Data":"ecef4af8bf61429d8404cab40f940d0ac1af710938690f4e69ad6499685ca86c"} Jun 08 13:10:56.776982 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:56.776952 2564 generic.go:356] "Generic (PLEG): container finished" podID="c59fe988-ac6f-4083-8f7a-d46bdb3d8a86" containerID="ff1a46fdd786503269115c0a0423e4a5fd965f98455fa1d997e720bce160144b" exitCode=0 Jun 08 13:10:56.777125 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:56.777001 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" event={"ID":"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86","Type":"ContainerDied","Data":"ff1a46fdd786503269115c0a0423e4a5fd965f98455fa1d997e720bce160144b"} Jun 08 13:10:56.807849 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:56.807800 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:10:57.785709 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:57.785674 2564 generic.go:356] "Generic (PLEG): container finished" podID="c59fe988-ac6f-4083-8f7a-d46bdb3d8a86" containerID="b638e3954c8aaf958361ea595643b4c95ba3ac4c6e89ec6591fbacb83a180417" exitCode=0 Jun 08 13:10:57.786098 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:57.785770 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" event={"ID":"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86","Type":"ContainerDied","Data":"b638e3954c8aaf958361ea595643b4c95ba3ac4c6e89ec6591fbacb83a180417"} Jun 08 13:10:58.791711 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:58.791675 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8hxp4" event={"ID":"cd69c877-1985-4ef3-98b2-f66cc501bc34","Type":"ContainerStarted","Data":"2667e33ec72010de37ff9f20e8b936d5a0cd2b96cde4bcf26a39aa81ebe2ebf4"} Jun 08 13:10:58.811119 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:58.811067 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-8hxp4" podStartSLOduration=2.430381539 podStartE2EDuration="4.811049805s" totalImagesPullingTime="2.380668266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:10:58.810821751 +0000 UTC m=+577.379230832" watchObservedRunningTime="2026-06-08 13:10:58.811049805 +0000 UTC m=+577.379458886" Jun 08 13:10:58.924721 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:58.924694 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" Jun 08 13:10:59.012072 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:59.012039 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hckg8\" (UniqueName: \"kubernetes.io/projected/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-kube-api-access-hckg8\") pod \"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86\" (UID: \"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86\") " Jun 08 13:10:59.012223 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:59.012078 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-bundle\") pod \"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86\" (UID: \"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86\") " Jun 08 13:10:59.012223 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:59.012136 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-util\") pod \"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86\" (UID: \"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86\") " Jun 08 13:10:59.012496 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:59.012451 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-bundle" (OuterVolumeSpecName: "bundle") pod "c59fe988-ac6f-4083-8f7a-d46bdb3d8a86" (UID: "c59fe988-ac6f-4083-8f7a-d46bdb3d8a86"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:10:59.014075 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:59.014047 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-kube-api-access-hckg8" (OuterVolumeSpecName: "kube-api-access-hckg8") pod "c59fe988-ac6f-4083-8f7a-d46bdb3d8a86" (UID: "c59fe988-ac6f-4083-8f7a-d46bdb3d8a86"). InnerVolumeSpecName "kube-api-access-hckg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:10:59.017274 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:59.017249 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-util" (OuterVolumeSpecName: "util") pod "c59fe988-ac6f-4083-8f7a-d46bdb3d8a86" (UID: "c59fe988-ac6f-4083-8f7a-d46bdb3d8a86"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:10:59.113653 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:59.113582 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-util\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:10:59.113653 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:59.113611 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hckg8\" (UniqueName: \"kubernetes.io/projected/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-kube-api-access-hckg8\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:10:59.113653 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:59.113625 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c59fe988-ac6f-4083-8f7a-d46bdb3d8a86-bundle\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:10:59.797258 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:59.797234 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" Jun 08 13:10:59.797725 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:59.797263 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flhqg8" event={"ID":"c59fe988-ac6f-4083-8f7a-d46bdb3d8a86","Type":"ContainerDied","Data":"7ceaca1fae7e8e25cea67d7fb059fdff40154c4ddbef77286cec181df8de9fad"} Jun 08 13:10:59.797725 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:10:59.797334 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ceaca1fae7e8e25cea67d7fb059fdff40154c4ddbef77286cec181df8de9fad" Jun 08 13:11:00.592197 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:00.592164 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:00.659367 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:00.659341 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:02.188247 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:02.188207 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:05.184870 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:05.184838 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:05.324086 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:05.324056 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:11.282319 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:11.282279 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:11.382618 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:11.382583 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:12.830067 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.830033 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8"] Jun 08 13:11:12.830551 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.830434 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c59fe988-ac6f-4083-8f7a-d46bdb3d8a86" containerName="util" Jun 08 13:11:12.830551 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.830451 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c59fe988-ac6f-4083-8f7a-d46bdb3d8a86" containerName="util" Jun 08 13:11:12.830551 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.830461 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c59fe988-ac6f-4083-8f7a-d46bdb3d8a86" containerName="extract" Jun 08 13:11:12.830551 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.830488 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c59fe988-ac6f-4083-8f7a-d46bdb3d8a86" containerName="extract" Jun 08 13:11:12.830551 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.830502 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c59fe988-ac6f-4083-8f7a-d46bdb3d8a86" containerName="pull" Jun 08 13:11:12.830551 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.830511 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c59fe988-ac6f-4083-8f7a-d46bdb3d8a86" containerName="pull" Jun 08 13:11:12.830866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.830599 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c59fe988-ac6f-4083-8f7a-d46bdb3d8a86" containerName="extract" Jun 08 13:11:12.833068 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.833047 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" Jun 08 13:11:12.838149 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.838121 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:11:12.838267 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.838152 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:11:12.838564 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.838548 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8tv44\"" Jun 08 13:11:12.843162 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.843141 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8"] Jun 08 13:11:12.923400 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.923376 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e480c51-6d2c-41ce-b6db-89da45875079-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8\" (UID: \"1e480c51-6d2c-41ce-b6db-89da45875079\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" Jun 08 13:11:12.923526 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.923416 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm257\" (UniqueName: \"kubernetes.io/projected/1e480c51-6d2c-41ce-b6db-89da45875079-kube-api-access-jm257\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8\" (UID: \"1e480c51-6d2c-41ce-b6db-89da45875079\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" Jun 08 13:11:12.923526 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.923441 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e480c51-6d2c-41ce-b6db-89da45875079-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8\" (UID: \"1e480c51-6d2c-41ce-b6db-89da45875079\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" Jun 08 13:11:12.988761 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:12.988722 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:13.024034 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:13.024009 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm257\" (UniqueName: \"kubernetes.io/projected/1e480c51-6d2c-41ce-b6db-89da45875079-kube-api-access-jm257\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8\" (UID: \"1e480c51-6d2c-41ce-b6db-89da45875079\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" Jun 08 13:11:13.024155 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:13.024047 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e480c51-6d2c-41ce-b6db-89da45875079-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8\" (UID: \"1e480c51-6d2c-41ce-b6db-89da45875079\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" Jun 08 13:11:13.024155 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:13.024094 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e480c51-6d2c-41ce-b6db-89da45875079-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8\" (UID: \"1e480c51-6d2c-41ce-b6db-89da45875079\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" Jun 08 13:11:13.024408 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:13.024392 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e480c51-6d2c-41ce-b6db-89da45875079-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8\" (UID: \"1e480c51-6d2c-41ce-b6db-89da45875079\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" Jun 08 13:11:13.024459 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:13.024442 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e480c51-6d2c-41ce-b6db-89da45875079-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8\" (UID: \"1e480c51-6d2c-41ce-b6db-89da45875079\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" Jun 08 13:11:13.031966 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:13.031947 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm257\" (UniqueName: \"kubernetes.io/projected/1e480c51-6d2c-41ce-b6db-89da45875079-kube-api-access-jm257\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8\" (UID: \"1e480c51-6d2c-41ce-b6db-89da45875079\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" Jun 08 13:11:13.141316 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:13.141279 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" Jun 08 13:11:13.266420 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:13.266384 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8"] Jun 08 13:11:13.268927 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:11:13.268896 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e480c51_6d2c_41ce_b6db_89da45875079.slice/crio-8b51faef0a71d6e2dcb26165fed5dce44ff7655539461e108f889f5495a13f99 WatchSource:0}: Error finding container 8b51faef0a71d6e2dcb26165fed5dce44ff7655539461e108f889f5495a13f99: Status 404 returned error can't find the container with id 8b51faef0a71d6e2dcb26165fed5dce44ff7655539461e108f889f5495a13f99 Jun 08 13:11:13.855811 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:13.855776 2564 generic.go:356] "Generic (PLEG): container finished" podID="1e480c51-6d2c-41ce-b6db-89da45875079" containerID="3f005df5776ffbd5bfbf416631c8395c3123d9417906f90381001e7e7f1ab7cc" exitCode=0 Jun 08 13:11:13.856285 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:13.855866 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" event={"ID":"1e480c51-6d2c-41ce-b6db-89da45875079","Type":"ContainerDied","Data":"3f005df5776ffbd5bfbf416631c8395c3123d9417906f90381001e7e7f1ab7cc"} Jun 08 13:11:13.856285 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:13.855926 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" event={"ID":"1e480c51-6d2c-41ce-b6db-89da45875079","Type":"ContainerStarted","Data":"8b51faef0a71d6e2dcb26165fed5dce44ff7655539461e108f889f5495a13f99"} Jun 08 13:11:14.861697 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:14.861621 2564 generic.go:356] "Generic (PLEG): container finished" podID="1e480c51-6d2c-41ce-b6db-89da45875079" containerID="9453dee6212d2a1c27fe06c48f034790d31c3101946b1dc981712e20f17ef0cd" exitCode=0 Jun 08 13:11:14.862049 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:14.861692 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" event={"ID":"1e480c51-6d2c-41ce-b6db-89da45875079","Type":"ContainerDied","Data":"9453dee6212d2a1c27fe06c48f034790d31c3101946b1dc981712e20f17ef0cd"} Jun 08 13:11:15.867921 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:15.867885 2564 generic.go:356] "Generic (PLEG): container finished" podID="1e480c51-6d2c-41ce-b6db-89da45875079" containerID="7e07881b64442954546f0bf5fee50cb1c4ec0fd8341ef640aad3760ccbf01885" exitCode=0 Jun 08 13:11:15.868277 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:15.867927 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" event={"ID":"1e480c51-6d2c-41ce-b6db-89da45875079","Type":"ContainerDied","Data":"7e07881b64442954546f0bf5fee50cb1c4ec0fd8341ef640aad3760ccbf01885"} Jun 08 13:11:17.005381 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:17.005355 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" Jun 08 13:11:17.157579 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:17.157495 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e480c51-6d2c-41ce-b6db-89da45875079-util\") pod \"1e480c51-6d2c-41ce-b6db-89da45875079\" (UID: \"1e480c51-6d2c-41ce-b6db-89da45875079\") " Jun 08 13:11:17.157579 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:17.157553 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e480c51-6d2c-41ce-b6db-89da45875079-bundle\") pod \"1e480c51-6d2c-41ce-b6db-89da45875079\" (UID: \"1e480c51-6d2c-41ce-b6db-89da45875079\") " Jun 08 13:11:17.157795 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:17.157607 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm257\" (UniqueName: \"kubernetes.io/projected/1e480c51-6d2c-41ce-b6db-89da45875079-kube-api-access-jm257\") pod \"1e480c51-6d2c-41ce-b6db-89da45875079\" (UID: \"1e480c51-6d2c-41ce-b6db-89da45875079\") " Jun 08 13:11:17.158378 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:17.158326 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e480c51-6d2c-41ce-b6db-89da45875079-bundle" (OuterVolumeSpecName: "bundle") pod "1e480c51-6d2c-41ce-b6db-89da45875079" (UID: "1e480c51-6d2c-41ce-b6db-89da45875079"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:11:17.159626 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:17.159595 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e480c51-6d2c-41ce-b6db-89da45875079-kube-api-access-jm257" (OuterVolumeSpecName: "kube-api-access-jm257") pod "1e480c51-6d2c-41ce-b6db-89da45875079" (UID: "1e480c51-6d2c-41ce-b6db-89da45875079"). InnerVolumeSpecName "kube-api-access-jm257". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:11:17.163024 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:17.163004 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e480c51-6d2c-41ce-b6db-89da45875079-util" (OuterVolumeSpecName: "util") pod "1e480c51-6d2c-41ce-b6db-89da45875079" (UID: "1e480c51-6d2c-41ce-b6db-89da45875079"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:11:17.258380 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:17.258343 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e480c51-6d2c-41ce-b6db-89da45875079-util\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:11:17.258380 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:17.258376 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e480c51-6d2c-41ce-b6db-89da45875079-bundle\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:11:17.258551 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:17.258388 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm257\" (UniqueName: \"kubernetes.io/projected/1e480c51-6d2c-41ce-b6db-89da45875079-kube-api-access-jm257\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:11:17.606495 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:17.606388 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:17.664281 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:17.664251 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:17.878328 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:17.878299 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" event={"ID":"1e480c51-6d2c-41ce-b6db-89da45875079","Type":"ContainerDied","Data":"8b51faef0a71d6e2dcb26165fed5dce44ff7655539461e108f889f5495a13f99"} Jun 08 13:11:17.878481 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:17.878343 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b51faef0a71d6e2dcb26165fed5dce44ff7655539461e108f889f5495a13f99" Jun 08 13:11:17.878481 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:17.878313 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd599z8" Jun 08 13:11:29.174039 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:29.174006 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:29.302959 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:29.302927 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:29.774452 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:29.774421 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:30.132503 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.132452 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:30.232552 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.232519 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:30.264705 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.264683 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5"] Jun 08 13:11:30.264955 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.264944 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e480c51-6d2c-41ce-b6db-89da45875079" containerName="extract" Jun 08 13:11:30.264997 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.264957 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e480c51-6d2c-41ce-b6db-89da45875079" containerName="extract" Jun 08 13:11:30.264997 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.264968 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e480c51-6d2c-41ce-b6db-89da45875079" containerName="util" Jun 08 13:11:30.264997 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.264974 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e480c51-6d2c-41ce-b6db-89da45875079" containerName="util" Jun 08 13:11:30.264997 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.264981 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e480c51-6d2c-41ce-b6db-89da45875079" containerName="pull" Jun 08 13:11:30.264997 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.264987 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e480c51-6d2c-41ce-b6db-89da45875079" containerName="pull" Jun 08 13:11:30.265144 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.265042 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e480c51-6d2c-41ce-b6db-89da45875079" containerName="extract" Jun 08 13:11:30.267794 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.267778 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.270684 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.270663 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pt5pq\"" Jun 08 13:11:30.270816 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.270774 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 13:11:30.271060 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.271038 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 13:11:30.271060 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.271054 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 13:11:30.271237 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.271138 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 13:11:30.287956 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.287936 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5"] Jun 08 13:11:30.351657 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.351634 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f-webhook-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-cgvp5\" (UID: \"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.351759 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.351672 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c4zz\" (UniqueName: \"kubernetes.io/projected/7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f-kube-api-access-2c4zz\") pod \"opendatahub-operator-controller-manager-677cd7f45-cgvp5\" (UID: \"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.351759 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.351704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f-tmp\") pod \"opendatahub-operator-controller-manager-677cd7f45-cgvp5\" (UID: \"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.351759 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.351751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f-manifests\") pod \"opendatahub-operator-controller-manager-677cd7f45-cgvp5\" (UID: \"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.351863 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.351794 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-cgvp5\" (UID: \"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.411960 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.411890 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:30.452228 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.452207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f-manifests\") pod \"opendatahub-operator-controller-manager-677cd7f45-cgvp5\" (UID: \"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.452285 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.452244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-cgvp5\" (UID: \"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.452285 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.452268 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f-webhook-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-cgvp5\" (UID: \"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.452402 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.452299 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c4zz\" (UniqueName: \"kubernetes.io/projected/7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f-kube-api-access-2c4zz\") pod \"opendatahub-operator-controller-manager-677cd7f45-cgvp5\" (UID: \"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.452439 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.452408 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f-tmp\") pod \"opendatahub-operator-controller-manager-677cd7f45-cgvp5\" (UID: \"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.452686 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.452667 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f-manifests\") pod \"opendatahub-operator-controller-manager-677cd7f45-cgvp5\" (UID: \"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.454655 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.454630 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f-tmp\") pod \"opendatahub-operator-controller-manager-677cd7f45-cgvp5\" (UID: \"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.454757 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.454676 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-cgvp5\" (UID: \"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.454811 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.454760 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f-webhook-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-cgvp5\" (UID: \"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.461847 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.461826 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c4zz\" (UniqueName: \"kubernetes.io/projected/7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f-kube-api-access-2c4zz\") pod \"opendatahub-operator-controller-manager-677cd7f45-cgvp5\" (UID: \"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.517609 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.517584 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:30.577794 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.577771 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:30.610455 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.610427 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:30.712726 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.712656 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5"] Jun 08 13:11:30.713865 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.713841 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:30.716530 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:11:30.716508 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4b582c_2c01_4bd8_ae68_d1e2718dfe8f.slice/crio-dd16b5a0f423984cf41af9f2a254c326af113916f8b518caf2a9ed995f689be1 WatchSource:0}: Error finding container dd16b5a0f423984cf41af9f2a254c326af113916f8b518caf2a9ed995f689be1: Status 404 returned error can't find the container with id dd16b5a0f423984cf41af9f2a254c326af113916f8b518caf2a9ed995f689be1 Jun 08 13:11:30.817189 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.817163 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:30.930750 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:30.930718 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" event={"ID":"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f","Type":"ContainerStarted","Data":"dd16b5a0f423984cf41af9f2a254c326af113916f8b518caf2a9ed995f689be1"} Jun 08 13:11:33.945824 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:33.945790 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" event={"ID":"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f","Type":"ContainerStarted","Data":"2cebc469f37a7079b56394479a516b29c0b5e4c8cd98bc666295bbbb3f869989"} Jun 08 13:11:34.951895 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:34.951862 2564 generic.go:356] "Generic (PLEG): container finished" podID="7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f" containerID="2cebc469f37a7079b56394479a516b29c0b5e4c8cd98bc666295bbbb3f869989" exitCode=0 Jun 08 13:11:34.952239 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:34.951931 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" event={"ID":"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f","Type":"ContainerDied","Data":"2cebc469f37a7079b56394479a516b29c0b5e4c8cd98bc666295bbbb3f869989"} Jun 08 13:11:35.957872 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:35.957841 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" event={"ID":"7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f","Type":"ContainerStarted","Data":"0351a8990ab2d5a94b54df3ba0c2e4034ac96472fa7bcc102a659a926d78bfaf"} Jun 08 13:11:35.958263 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:35.957975 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:35.982671 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:35.982627 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" podStartSLOduration=1.639290301 podStartE2EDuration="5.982611456s" totalImagesPullingTime="3.398531696s" totalInitContainerRuntime="944.789459ms" isStatefulPod=false podCreationTimestamp="2026-06-08 13:11:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:11:35.980569727 +0000 UTC m=+614.548978809" watchObservedRunningTime="2026-06-08 13:11:35.982611456 +0000 UTC m=+614.551020538" Jun 08 13:11:39.242739 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:39.242667 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:39.343753 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:39.343721 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:46.965290 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:46.965254 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-cgvp5" Jun 08 13:11:49.057041 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:49.057006 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:49.206965 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:49.206932 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:50.044596 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:50.044563 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:50.183079 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:50.183043 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:50.297145 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:50.297068 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:50.526638 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:50.526609 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:50.894111 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:50.894080 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-gnwvj"] Jun 08 13:11:50.903566 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:50.903543 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-gnwvj" Jun 08 13:11:50.904451 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:50.904427 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:50.909262 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:50.909241 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-v7xdt\"" Jun 08 13:11:50.910742 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:50.910464 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 08 13:11:50.910867 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:50.910842 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-gnwvj"] Jun 08 13:11:51.011742 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.011710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdxcn\" (UniqueName: \"kubernetes.io/projected/b41be4f1-b2dd-473a-9977-f232520d86a3-kube-api-access-zdxcn\") pod \"model-serving-api-5dd488fc48-gnwvj\" (UID: \"b41be4f1-b2dd-473a-9977-f232520d86a3\") " pod="opendatahub/model-serving-api-5dd488fc48-gnwvj" Jun 08 13:11:51.011894 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.011751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b41be4f1-b2dd-473a-9977-f232520d86a3-tls-certs\") pod \"model-serving-api-5dd488fc48-gnwvj\" (UID: \"b41be4f1-b2dd-473a-9977-f232520d86a3\") " pod="opendatahub/model-serving-api-5dd488fc48-gnwvj" Jun 08 13:11:51.023172 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.023147 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:51.111451 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.111419 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:51.112627 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.112597 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdxcn\" (UniqueName: \"kubernetes.io/projected/b41be4f1-b2dd-473a-9977-f232520d86a3-kube-api-access-zdxcn\") pod \"model-serving-api-5dd488fc48-gnwvj\" (UID: \"b41be4f1-b2dd-473a-9977-f232520d86a3\") " pod="opendatahub/model-serving-api-5dd488fc48-gnwvj" Jun 08 13:11:51.112751 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.112633 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b41be4f1-b2dd-473a-9977-f232520d86a3-tls-certs\") pod \"model-serving-api-5dd488fc48-gnwvj\" (UID: \"b41be4f1-b2dd-473a-9977-f232520d86a3\") " pod="opendatahub/model-serving-api-5dd488fc48-gnwvj" Jun 08 13:11:51.115008 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.114988 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b41be4f1-b2dd-473a-9977-f232520d86a3-tls-certs\") pod \"model-serving-api-5dd488fc48-gnwvj\" (UID: \"b41be4f1-b2dd-473a-9977-f232520d86a3\") " pod="opendatahub/model-serving-api-5dd488fc48-gnwvj" Jun 08 13:11:51.125605 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.125585 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdxcn\" (UniqueName: \"kubernetes.io/projected/b41be4f1-b2dd-473a-9977-f232520d86a3-kube-api-access-zdxcn\") pod \"model-serving-api-5dd488fc48-gnwvj\" (UID: \"b41be4f1-b2dd-473a-9977-f232520d86a3\") " pod="opendatahub/model-serving-api-5dd488fc48-gnwvj" Jun 08 13:11:51.192690 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.192624 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686"] Jun 08 13:11:51.195915 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.195900 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" Jun 08 13:11:51.199642 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.199623 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:11:51.199740 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.199718 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8tv44\"" Jun 08 13:11:51.199978 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.199956 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:11:51.210236 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.210211 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686"] Jun 08 13:11:51.214527 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.214507 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-gnwvj" Jun 08 13:11:51.305885 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.305855 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:51.314988 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.314948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5wmg\" (UniqueName: \"kubernetes.io/projected/25312e3a-e07f-4cff-b0a5-5f77d184b043-kube-api-access-q5wmg\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686\" (UID: \"25312e3a-e07f-4cff-b0a5-5f77d184b043\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" Jun 08 13:11:51.315127 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.315033 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25312e3a-e07f-4cff-b0a5-5f77d184b043-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686\" (UID: \"25312e3a-e07f-4cff-b0a5-5f77d184b043\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" Jun 08 13:11:51.315127 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.315067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25312e3a-e07f-4cff-b0a5-5f77d184b043-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686\" (UID: \"25312e3a-e07f-4cff-b0a5-5f77d184b043\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" Jun 08 13:11:51.351039 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.350898 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-gnwvj"] Jun 08 13:11:51.353757 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:11:51.353729 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41be4f1_b2dd_473a_9977_f232520d86a3.slice/crio-fd3c79220c62394388fffd6e68892e7e3d6a5228aed3b102f1daeec97b1f272b WatchSource:0}: Error finding container fd3c79220c62394388fffd6e68892e7e3d6a5228aed3b102f1daeec97b1f272b: Status 404 returned error can't find the container with id fd3c79220c62394388fffd6e68892e7e3d6a5228aed3b102f1daeec97b1f272b Jun 08 13:11:51.415643 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.415617 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5wmg\" (UniqueName: \"kubernetes.io/projected/25312e3a-e07f-4cff-b0a5-5f77d184b043-kube-api-access-q5wmg\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686\" (UID: \"25312e3a-e07f-4cff-b0a5-5f77d184b043\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" Jun 08 13:11:51.415794 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.415684 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25312e3a-e07f-4cff-b0a5-5f77d184b043-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686\" (UID: \"25312e3a-e07f-4cff-b0a5-5f77d184b043\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" Jun 08 13:11:51.415794 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.415721 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25312e3a-e07f-4cff-b0a5-5f77d184b043-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686\" (UID: \"25312e3a-e07f-4cff-b0a5-5f77d184b043\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" Jun 08 13:11:51.416069 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.416051 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25312e3a-e07f-4cff-b0a5-5f77d184b043-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686\" (UID: \"25312e3a-e07f-4cff-b0a5-5f77d184b043\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" Jun 08 13:11:51.416119 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.416099 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25312e3a-e07f-4cff-b0a5-5f77d184b043-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686\" (UID: \"25312e3a-e07f-4cff-b0a5-5f77d184b043\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" Jun 08 13:11:51.443464 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.443403 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5wmg\" (UniqueName: \"kubernetes.io/projected/25312e3a-e07f-4cff-b0a5-5f77d184b043-kube-api-access-q5wmg\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686\" (UID: \"25312e3a-e07f-4cff-b0a5-5f77d184b043\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" Jun 08 13:11:51.496582 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.496550 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:11:51.505487 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.505449 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" Jun 08 13:11:51.648546 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.648523 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686"] Jun 08 13:11:51.650112 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:11:51.650089 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25312e3a_e07f_4cff_b0a5_5f77d184b043.slice/crio-598e36e7a032b24ead4be50f5e87b319de46c63e454bd66cf58c713a5d70d147 WatchSource:0}: Error finding container 598e36e7a032b24ead4be50f5e87b319de46c63e454bd66cf58c713a5d70d147: Status 404 returned error can't find the container with id 598e36e7a032b24ead4be50f5e87b319de46c63e454bd66cf58c713a5d70d147 Jun 08 13:11:51.661447 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.661423 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j"] Jun 08 13:11:51.665225 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.665206 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j" Jun 08 13:11:51.668341 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.668320 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 08 13:11:51.668614 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.668358 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 08 13:11:51.668686 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.668669 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6pvl2\"" Jun 08 13:11:51.677226 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.677202 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j"] Jun 08 13:11:51.717983 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.717960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30bac540-4e08-4df1-9840-e456b7a66e51-tmp\") pod \"kube-auth-proxy-7cd48f9f86-nsr6j\" (UID: \"30bac540-4e08-4df1-9840-e456b7a66e51\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j" Jun 08 13:11:51.718064 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.718021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30bac540-4e08-4df1-9840-e456b7a66e51-tls-certs\") pod \"kube-auth-proxy-7cd48f9f86-nsr6j\" (UID: \"30bac540-4e08-4df1-9840-e456b7a66e51\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j" Jun 08 13:11:51.718126 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.718110 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnjd8\" (UniqueName: \"kubernetes.io/projected/30bac540-4e08-4df1-9840-e456b7a66e51-kube-api-access-cnjd8\") pod \"kube-auth-proxy-7cd48f9f86-nsr6j\" (UID: \"30bac540-4e08-4df1-9840-e456b7a66e51\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j" Jun 08 13:11:51.818735 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.818707 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30bac540-4e08-4df1-9840-e456b7a66e51-tmp\") pod \"kube-auth-proxy-7cd48f9f86-nsr6j\" (UID: \"30bac540-4e08-4df1-9840-e456b7a66e51\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j" Jun 08 13:11:51.818859 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.818750 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30bac540-4e08-4df1-9840-e456b7a66e51-tls-certs\") pod \"kube-auth-proxy-7cd48f9f86-nsr6j\" (UID: \"30bac540-4e08-4df1-9840-e456b7a66e51\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j" Jun 08 13:11:51.818859 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.818816 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnjd8\" (UniqueName: \"kubernetes.io/projected/30bac540-4e08-4df1-9840-e456b7a66e51-kube-api-access-cnjd8\") pod \"kube-auth-proxy-7cd48f9f86-nsr6j\" (UID: \"30bac540-4e08-4df1-9840-e456b7a66e51\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j" Jun 08 13:11:51.820806 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.820782 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30bac540-4e08-4df1-9840-e456b7a66e51-tmp\") pod \"kube-auth-proxy-7cd48f9f86-nsr6j\" (UID: \"30bac540-4e08-4df1-9840-e456b7a66e51\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j" Jun 08 13:11:51.821119 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.821103 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30bac540-4e08-4df1-9840-e456b7a66e51-tls-certs\") pod \"kube-auth-proxy-7cd48f9f86-nsr6j\" (UID: \"30bac540-4e08-4df1-9840-e456b7a66e51\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j" Jun 08 13:11:51.828272 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.828249 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnjd8\" (UniqueName: \"kubernetes.io/projected/30bac540-4e08-4df1-9840-e456b7a66e51-kube-api-access-cnjd8\") pod \"kube-auth-proxy-7cd48f9f86-nsr6j\" (UID: \"30bac540-4e08-4df1-9840-e456b7a66e51\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j" Jun 08 13:11:51.986592 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:51.986514 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j" Jun 08 13:11:52.030151 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:52.030099 2564 generic.go:356] "Generic (PLEG): container finished" podID="25312e3a-e07f-4cff-b0a5-5f77d184b043" containerID="c9d71910b41da7912e2e1ce573c569f7cecc60e92776af158592a80eec8482e1" exitCode=0 Jun 08 13:11:52.030318 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:52.030173 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" event={"ID":"25312e3a-e07f-4cff-b0a5-5f77d184b043","Type":"ContainerDied","Data":"c9d71910b41da7912e2e1ce573c569f7cecc60e92776af158592a80eec8482e1"} Jun 08 13:11:52.030390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:52.030330 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" event={"ID":"25312e3a-e07f-4cff-b0a5-5f77d184b043","Type":"ContainerStarted","Data":"598e36e7a032b24ead4be50f5e87b319de46c63e454bd66cf58c713a5d70d147"} Jun 08 13:11:52.031803 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:52.031781 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-gnwvj" event={"ID":"b41be4f1-b2dd-473a-9977-f232520d86a3","Type":"ContainerStarted","Data":"fd3c79220c62394388fffd6e68892e7e3d6a5228aed3b102f1daeec97b1f272b"} Jun 08 13:11:52.156023 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:52.155987 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j"] Jun 08 13:11:52.157878 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:11:52.157852 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30bac540_4e08_4df1_9840_e456b7a66e51.slice/crio-f6a3a490eb94b2a85d027e68682f5d5e740f1bb2446f7c8e5ec88dd9d5e28466 WatchSource:0}: Error finding container f6a3a490eb94b2a85d027e68682f5d5e740f1bb2446f7c8e5ec88dd9d5e28466: Status 404 returned error can't find the container with id f6a3a490eb94b2a85d027e68682f5d5e740f1bb2446f7c8e5ec88dd9d5e28466 Jun 08 13:11:53.042084 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:53.041987 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j" event={"ID":"30bac540-4e08-4df1-9840-e456b7a66e51","Type":"ContainerStarted","Data":"f6a3a490eb94b2a85d027e68682f5d5e740f1bb2446f7c8e5ec88dd9d5e28466"} Jun 08 13:11:55.057040 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:55.056997 2564 generic.go:356] "Generic (PLEG): container finished" podID="25312e3a-e07f-4cff-b0a5-5f77d184b043" containerID="41cc92867381e2b55ff51a012e29294f9a838dcdfdc1fdca21b6e81bb38ae1fd" exitCode=0 Jun 08 13:11:55.057547 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:55.057084 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" event={"ID":"25312e3a-e07f-4cff-b0a5-5f77d184b043","Type":"ContainerDied","Data":"41cc92867381e2b55ff51a012e29294f9a838dcdfdc1fdca21b6e81bb38ae1fd"} Jun 08 13:11:55.059062 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:55.059038 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-gnwvj" event={"ID":"b41be4f1-b2dd-473a-9977-f232520d86a3","Type":"ContainerStarted","Data":"985cd26e81742c3ab0491f35106241fff7df2376bb024b6c6bcb47fca86a7454"} Jun 08 13:11:55.059160 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:55.059089 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-gnwvj" Jun 08 13:11:55.095647 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:55.095600 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-gnwvj" podStartSLOduration=2.468295674 podStartE2EDuration="5.09558443s" totalImagesPullingTime="2.627288756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:11:55.095258126 +0000 UTC m=+633.663667207" watchObservedRunningTime="2026-06-08 13:11:55.09558443 +0000 UTC m=+633.663993511" Jun 08 13:11:56.066162 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:56.066130 2564 generic.go:356] "Generic (PLEG): container finished" podID="25312e3a-e07f-4cff-b0a5-5f77d184b043" containerID="aa85ca18bf8bdd4d09ac44705d40e3c06c5b10d8262814c448fd0bc332f2895e" exitCode=0 Jun 08 13:11:56.066611 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:56.066215 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" event={"ID":"25312e3a-e07f-4cff-b0a5-5f77d184b043","Type":"ContainerDied","Data":"aa85ca18bf8bdd4d09ac44705d40e3c06c5b10d8262814c448fd0bc332f2895e"} Jun 08 13:11:56.067770 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:56.067748 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j" event={"ID":"30bac540-4e08-4df1-9840-e456b7a66e51","Type":"ContainerStarted","Data":"45eb872049d262198209ef0f0a554508e63831280cee51bfa19e330b76e5c181"} Jun 08 13:11:56.109272 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:56.109227 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-nsr6j" podStartSLOduration=2.132347807 podStartE2EDuration="5.109215419s" totalImagesPullingTime="2.976867612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:11:56.107945603 +0000 UTC m=+634.676354684" watchObservedRunningTime="2026-06-08 13:11:56.109215419 +0000 UTC m=+634.677624499" Jun 08 13:11:57.202347 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:57.202320 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" Jun 08 13:11:57.267413 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:57.267382 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25312e3a-e07f-4cff-b0a5-5f77d184b043-util\") pod \"25312e3a-e07f-4cff-b0a5-5f77d184b043\" (UID: \"25312e3a-e07f-4cff-b0a5-5f77d184b043\") " Jun 08 13:11:57.267601 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:57.267491 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25312e3a-e07f-4cff-b0a5-5f77d184b043-bundle\") pod \"25312e3a-e07f-4cff-b0a5-5f77d184b043\" (UID: \"25312e3a-e07f-4cff-b0a5-5f77d184b043\") " Jun 08 13:11:57.267601 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:57.267564 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5wmg\" (UniqueName: \"kubernetes.io/projected/25312e3a-e07f-4cff-b0a5-5f77d184b043-kube-api-access-q5wmg\") pod \"25312e3a-e07f-4cff-b0a5-5f77d184b043\" (UID: \"25312e3a-e07f-4cff-b0a5-5f77d184b043\") " Jun 08 13:11:57.268540 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:57.268508 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25312e3a-e07f-4cff-b0a5-5f77d184b043-bundle" (OuterVolumeSpecName: "bundle") pod "25312e3a-e07f-4cff-b0a5-5f77d184b043" (UID: "25312e3a-e07f-4cff-b0a5-5f77d184b043"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:11:57.269926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:57.269897 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25312e3a-e07f-4cff-b0a5-5f77d184b043-kube-api-access-q5wmg" (OuterVolumeSpecName: "kube-api-access-q5wmg") pod "25312e3a-e07f-4cff-b0a5-5f77d184b043" (UID: "25312e3a-e07f-4cff-b0a5-5f77d184b043"). InnerVolumeSpecName "kube-api-access-q5wmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:11:57.271547 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:57.271523 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25312e3a-e07f-4cff-b0a5-5f77d184b043-util" (OuterVolumeSpecName: "util") pod "25312e3a-e07f-4cff-b0a5-5f77d184b043" (UID: "25312e3a-e07f-4cff-b0a5-5f77d184b043"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:11:57.368338 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:57.368273 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25312e3a-e07f-4cff-b0a5-5f77d184b043-bundle\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:11:57.368338 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:57.368304 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5wmg\" (UniqueName: \"kubernetes.io/projected/25312e3a-e07f-4cff-b0a5-5f77d184b043-kube-api-access-q5wmg\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:11:57.368338 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:57.368314 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25312e3a-e07f-4cff-b0a5-5f77d184b043-util\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:11:58.078544 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:58.078521 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" Jun 08 13:11:58.078544 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:58.078531 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06bw686" event={"ID":"25312e3a-e07f-4cff-b0a5-5f77d184b043","Type":"ContainerDied","Data":"598e36e7a032b24ead4be50f5e87b319de46c63e454bd66cf58c713a5d70d147"} Jun 08 13:11:58.078738 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:11:58.078579 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="598e36e7a032b24ead4be50f5e87b319de46c63e454bd66cf58c713a5d70d147" Jun 08 13:12:00.238678 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.238648 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2"] Jun 08 13:12:00.239051 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.238946 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25312e3a-e07f-4cff-b0a5-5f77d184b043" containerName="util" Jun 08 13:12:00.239051 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.238956 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="25312e3a-e07f-4cff-b0a5-5f77d184b043" containerName="util" Jun 08 13:12:00.239051 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.238964 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25312e3a-e07f-4cff-b0a5-5f77d184b043" containerName="pull" Jun 08 13:12:00.239051 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.238971 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="25312e3a-e07f-4cff-b0a5-5f77d184b043" containerName="pull" Jun 08 13:12:00.239051 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.238979 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25312e3a-e07f-4cff-b0a5-5f77d184b043" containerName="extract" Jun 08 13:12:00.239051 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.238984 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="25312e3a-e07f-4cff-b0a5-5f77d184b043" containerName="extract" Jun 08 13:12:00.239051 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.239047 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="25312e3a-e07f-4cff-b0a5-5f77d184b043" containerName="extract" Jun 08 13:12:00.242841 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.242824 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" Jun 08 13:12:00.247640 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.247618 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 13:12:00.247758 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.247688 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:12:00.248879 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.248859 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 13:12:00.248879 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.248871 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 13:12:00.249035 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.248864 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bmj75\"" Jun 08 13:12:00.250596 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.250579 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 13:12:00.258522 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.258502 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2"] Jun 08 13:12:00.291202 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.291179 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/720c42ac-2048-439e-94a6-e475f3bf3552-metrics-cert\") pod \"lws-controller-manager-5cf59b74dc-qrqd2\" (UID: \"720c42ac-2048-439e-94a6-e475f3bf3552\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" Jun 08 13:12:00.291293 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.291221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/720c42ac-2048-439e-94a6-e475f3bf3552-manager-config\") pod \"lws-controller-manager-5cf59b74dc-qrqd2\" (UID: \"720c42ac-2048-439e-94a6-e475f3bf3552\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" Jun 08 13:12:00.291293 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.291248 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx7jf\" (UniqueName: \"kubernetes.io/projected/720c42ac-2048-439e-94a6-e475f3bf3552-kube-api-access-zx7jf\") pod \"lws-controller-manager-5cf59b74dc-qrqd2\" (UID: \"720c42ac-2048-439e-94a6-e475f3bf3552\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" Jun 08 13:12:00.291293 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.291271 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/720c42ac-2048-439e-94a6-e475f3bf3552-cert\") pod \"lws-controller-manager-5cf59b74dc-qrqd2\" (UID: \"720c42ac-2048-439e-94a6-e475f3bf3552\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" Jun 08 13:12:00.392487 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.392446 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/720c42ac-2048-439e-94a6-e475f3bf3552-manager-config\") pod \"lws-controller-manager-5cf59b74dc-qrqd2\" (UID: \"720c42ac-2048-439e-94a6-e475f3bf3552\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" Jun 08 13:12:00.392581 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.392506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx7jf\" (UniqueName: \"kubernetes.io/projected/720c42ac-2048-439e-94a6-e475f3bf3552-kube-api-access-zx7jf\") pod \"lws-controller-manager-5cf59b74dc-qrqd2\" (UID: \"720c42ac-2048-439e-94a6-e475f3bf3552\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" Jun 08 13:12:00.392581 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.392528 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/720c42ac-2048-439e-94a6-e475f3bf3552-cert\") pod \"lws-controller-manager-5cf59b74dc-qrqd2\" (UID: \"720c42ac-2048-439e-94a6-e475f3bf3552\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" Jun 08 13:12:00.392581 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.392564 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/720c42ac-2048-439e-94a6-e475f3bf3552-metrics-cert\") pod \"lws-controller-manager-5cf59b74dc-qrqd2\" (UID: \"720c42ac-2048-439e-94a6-e475f3bf3552\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" Jun 08 13:12:00.393112 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.393092 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/720c42ac-2048-439e-94a6-e475f3bf3552-manager-config\") pod \"lws-controller-manager-5cf59b74dc-qrqd2\" (UID: \"720c42ac-2048-439e-94a6-e475f3bf3552\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" Jun 08 13:12:00.394892 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.394874 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/720c42ac-2048-439e-94a6-e475f3bf3552-cert\") pod \"lws-controller-manager-5cf59b74dc-qrqd2\" (UID: \"720c42ac-2048-439e-94a6-e475f3bf3552\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" Jun 08 13:12:00.394988 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.394912 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/720c42ac-2048-439e-94a6-e475f3bf3552-metrics-cert\") pod \"lws-controller-manager-5cf59b74dc-qrqd2\" (UID: \"720c42ac-2048-439e-94a6-e475f3bf3552\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" Jun 08 13:12:00.426242 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.426223 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx7jf\" (UniqueName: \"kubernetes.io/projected/720c42ac-2048-439e-94a6-e475f3bf3552-kube-api-access-zx7jf\") pod \"lws-controller-manager-5cf59b74dc-qrqd2\" (UID: \"720c42ac-2048-439e-94a6-e475f3bf3552\") " pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" Jun 08 13:12:00.552684 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.552628 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" Jun 08 13:12:00.689053 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.689026 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2"] Jun 08 13:12:00.691676 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:12:00.691649 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720c42ac_2048_439e_94a6_e475f3bf3552.slice/crio-00bbabcfc0aae647f911efe48066f81931950833f436875b28fbf310c9f9b628 WatchSource:0}: Error finding container 00bbabcfc0aae647f911efe48066f81931950833f436875b28fbf310c9f9b628: Status 404 returned error can't find the container with id 00bbabcfc0aae647f911efe48066f81931950833f436875b28fbf310c9f9b628 Jun 08 13:12:00.998640 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:00.998580 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:01.094800 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:01.094770 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" event={"ID":"720c42ac-2048-439e-94a6-e475f3bf3552","Type":"ContainerStarted","Data":"00bbabcfc0aae647f911efe48066f81931950833f436875b28fbf310c9f9b628"} Jun 08 13:12:01.111449 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:01.111422 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:01.215836 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:01.215797 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:02.399328 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:02.399302 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:02.676581 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:02.676160 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:02.814660 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:02.814624 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:03.106622 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:03.106515 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" event={"ID":"720c42ac-2048-439e-94a6-e475f3bf3552","Type":"ContainerStarted","Data":"e7e2ad2aa31f2a17ef7048f959b0aa8683582ee65f3853be50a83245bb59e5db"} Jun 08 13:12:03.106622 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:03.106600 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" Jun 08 13:12:03.134626 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:03.134581 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" podStartSLOduration=1.46431779 podStartE2EDuration="3.134566489s" totalImagesPullingTime="1.670248699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:12:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:12:03.132463528 +0000 UTC m=+641.700872639" watchObservedRunningTime="2026-06-08 13:12:03.134566489 +0000 UTC m=+641.702975571" Jun 08 13:12:04.659531 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:04.659498 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:04.805654 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:04.805627 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:06.004101 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.004066 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj"] Jun 08 13:12:06.007804 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.007788 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" Jun 08 13:12:06.013301 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.013277 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:12:06.013443 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.013424 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8tv44\"" Jun 08 13:12:06.014195 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.014170 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:12:06.019827 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.019807 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj"] Jun 08 13:12:06.071726 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.071702 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-gnwvj" Jun 08 13:12:06.143125 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.143090 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smqvz\" (UniqueName: \"kubernetes.io/projected/db26c943-35cf-44dc-b43b-db143c0c14ad-kube-api-access-smqvz\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj\" (UID: \"db26c943-35cf-44dc-b43b-db143c0c14ad\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" Jun 08 13:12:06.143280 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.143131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db26c943-35cf-44dc-b43b-db143c0c14ad-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj\" (UID: \"db26c943-35cf-44dc-b43b-db143c0c14ad\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" Jun 08 13:12:06.143280 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.143196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db26c943-35cf-44dc-b43b-db143c0c14ad-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj\" (UID: \"db26c943-35cf-44dc-b43b-db143c0c14ad\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" Jun 08 13:12:06.244020 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.243983 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smqvz\" (UniqueName: \"kubernetes.io/projected/db26c943-35cf-44dc-b43b-db143c0c14ad-kube-api-access-smqvz\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj\" (UID: \"db26c943-35cf-44dc-b43b-db143c0c14ad\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" Jun 08 13:12:06.244020 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.244023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db26c943-35cf-44dc-b43b-db143c0c14ad-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj\" (UID: \"db26c943-35cf-44dc-b43b-db143c0c14ad\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" Jun 08 13:12:06.244259 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.244145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db26c943-35cf-44dc-b43b-db143c0c14ad-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj\" (UID: \"db26c943-35cf-44dc-b43b-db143c0c14ad\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" Jun 08 13:12:06.244381 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.244363 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db26c943-35cf-44dc-b43b-db143c0c14ad-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj\" (UID: \"db26c943-35cf-44dc-b43b-db143c0c14ad\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" Jun 08 13:12:06.244530 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.244510 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db26c943-35cf-44dc-b43b-db143c0c14ad-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj\" (UID: \"db26c943-35cf-44dc-b43b-db143c0c14ad\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" Jun 08 13:12:06.261870 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.261800 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smqvz\" (UniqueName: \"kubernetes.io/projected/db26c943-35cf-44dc-b43b-db143c0c14ad-kube-api-access-smqvz\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj\" (UID: \"db26c943-35cf-44dc-b43b-db143c0c14ad\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" Jun 08 13:12:06.289075 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.289047 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:06.316996 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.316964 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" Jun 08 13:12:06.455227 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.455191 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:06.470499 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.470426 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj"] Jun 08 13:12:06.472928 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:12:06.472902 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb26c943_35cf_44dc_b43b_db143c0c14ad.slice/crio-fbedd3cfc7334aa7714583f3ae8f5212e74b6f3e18589ba44f02afb14ea4e9ac WatchSource:0}: Error finding container fbedd3cfc7334aa7714583f3ae8f5212e74b6f3e18589ba44f02afb14ea4e9ac: Status 404 returned error can't find the container with id fbedd3cfc7334aa7714583f3ae8f5212e74b6f3e18589ba44f02afb14ea4e9ac Jun 08 13:12:06.917466 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:06.917432 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:07.125094 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:07.125064 2564 generic.go:356] "Generic (PLEG): container finished" podID="db26c943-35cf-44dc-b43b-db143c0c14ad" containerID="b3ce5ec675da04c07594edbeaf4e42a00a0103de107742e7061fc1ffec64fcf7" exitCode=0 Jun 08 13:12:07.125506 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:07.125152 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" event={"ID":"db26c943-35cf-44dc-b43b-db143c0c14ad","Type":"ContainerDied","Data":"b3ce5ec675da04c07594edbeaf4e42a00a0103de107742e7061fc1ffec64fcf7"} Jun 08 13:12:07.125506 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:07.125204 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" event={"ID":"db26c943-35cf-44dc-b43b-db143c0c14ad","Type":"ContainerStarted","Data":"fbedd3cfc7334aa7714583f3ae8f5212e74b6f3e18589ba44f02afb14ea4e9ac"} Jun 08 13:12:07.326465 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:07.326434 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:07.714085 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:07.714051 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:08.131406 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:08.131371 2564 generic.go:356] "Generic (PLEG): container finished" podID="db26c943-35cf-44dc-b43b-db143c0c14ad" containerID="3c5de47270a852aec777d83b4c7a74d12e0ffda546e74e513ec901dc5722ca98" exitCode=0 Jun 08 13:12:08.131892 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:08.131429 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" event={"ID":"db26c943-35cf-44dc-b43b-db143c0c14ad","Type":"ContainerDied","Data":"3c5de47270a852aec777d83b4c7a74d12e0ffda546e74e513ec901dc5722ca98"} Jun 08 13:12:09.137752 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:09.137717 2564 generic.go:356] "Generic (PLEG): container finished" podID="db26c943-35cf-44dc-b43b-db143c0c14ad" containerID="17f89c97ad92a849f7391e97559f705d89dc4a13f1b1be7b0b0b3dbe97d89587" exitCode=0 Jun 08 13:12:09.138133 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:09.137754 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" event={"ID":"db26c943-35cf-44dc-b43b-db143c0c14ad","Type":"ContainerDied","Data":"17f89c97ad92a849f7391e97559f705d89dc4a13f1b1be7b0b0b3dbe97d89587"} Jun 08 13:12:10.266574 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:10.266551 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" Jun 08 13:12:10.380222 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:10.380182 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db26c943-35cf-44dc-b43b-db143c0c14ad-util\") pod \"db26c943-35cf-44dc-b43b-db143c0c14ad\" (UID: \"db26c943-35cf-44dc-b43b-db143c0c14ad\") " Jun 08 13:12:10.380222 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:10.380232 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smqvz\" (UniqueName: \"kubernetes.io/projected/db26c943-35cf-44dc-b43b-db143c0c14ad-kube-api-access-smqvz\") pod \"db26c943-35cf-44dc-b43b-db143c0c14ad\" (UID: \"db26c943-35cf-44dc-b43b-db143c0c14ad\") " Jun 08 13:12:10.380418 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:10.380314 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db26c943-35cf-44dc-b43b-db143c0c14ad-bundle\") pod \"db26c943-35cf-44dc-b43b-db143c0c14ad\" (UID: \"db26c943-35cf-44dc-b43b-db143c0c14ad\") " Jun 08 13:12:10.387076 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:10.381767 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db26c943-35cf-44dc-b43b-db143c0c14ad-bundle" (OuterVolumeSpecName: "bundle") pod "db26c943-35cf-44dc-b43b-db143c0c14ad" (UID: "db26c943-35cf-44dc-b43b-db143c0c14ad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:12:10.387881 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:10.387850 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db26c943-35cf-44dc-b43b-db143c0c14ad-kube-api-access-smqvz" (OuterVolumeSpecName: "kube-api-access-smqvz") pod "db26c943-35cf-44dc-b43b-db143c0c14ad" (UID: "db26c943-35cf-44dc-b43b-db143c0c14ad"). InnerVolumeSpecName "kube-api-access-smqvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:12:10.388164 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:10.388129 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db26c943-35cf-44dc-b43b-db143c0c14ad-util" (OuterVolumeSpecName: "util") pod "db26c943-35cf-44dc-b43b-db143c0c14ad" (UID: "db26c943-35cf-44dc-b43b-db143c0c14ad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:12:10.481816 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:10.481761 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/db26c943-35cf-44dc-b43b-db143c0c14ad-bundle\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:12:10.481816 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:10.481783 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/db26c943-35cf-44dc-b43b-db143c0c14ad-util\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:12:10.481816 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:10.481792 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smqvz\" (UniqueName: \"kubernetes.io/projected/db26c943-35cf-44dc-b43b-db143c0c14ad-kube-api-access-smqvz\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:12:11.148496 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:11.148442 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" event={"ID":"db26c943-35cf-44dc-b43b-db143c0c14ad","Type":"ContainerDied","Data":"fbedd3cfc7334aa7714583f3ae8f5212e74b6f3e18589ba44f02afb14ea4e9ac"} Jun 08 13:12:11.148496 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:11.148493 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762az4kvj" Jun 08 13:12:11.148715 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:11.148512 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbedd3cfc7334aa7714583f3ae8f5212e74b6f3e18589ba44f02afb14ea4e9ac" Jun 08 13:12:14.113048 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:14.113016 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cf59b74dc-qrqd2" Jun 08 13:12:17.908619 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:17.908584 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:18.005541 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:18.005510 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:22.458405 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:22.458358 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:22.535686 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:22.535635 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:23.030018 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:23.029988 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:26.011677 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:26.011624 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:26.107372 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:26.107341 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:26.333188 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:26.333113 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:26.599958 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:26.599874 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:26.703837 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:26.703806 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:30.843600 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:30.843547 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:35.607208 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:35.607162 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:39.084400 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:39.084364 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:39.184893 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:39.184866 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:50.713769 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:50.713733 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:50.806009 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:50.805977 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:50.905629 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:50.905597 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:51.647089 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:51.647057 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:12:51.844447 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:12:51.844397 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:06.473092 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.473012 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p"] Jun 08 13:13:06.473453 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.473329 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db26c943-35cf-44dc-b43b-db143c0c14ad" containerName="extract" Jun 08 13:13:06.473453 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.473340 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="db26c943-35cf-44dc-b43b-db143c0c14ad" containerName="extract" Jun 08 13:13:06.473453 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.473362 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db26c943-35cf-44dc-b43b-db143c0c14ad" containerName="pull" Jun 08 13:13:06.473453 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.473367 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="db26c943-35cf-44dc-b43b-db143c0c14ad" containerName="pull" Jun 08 13:13:06.473453 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.473377 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db26c943-35cf-44dc-b43b-db143c0c14ad" containerName="util" Jun 08 13:13:06.473453 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.473387 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="db26c943-35cf-44dc-b43b-db143c0c14ad" containerName="util" Jun 08 13:13:06.473453 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.473440 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="db26c943-35cf-44dc-b43b-db143c0c14ad" containerName="extract" Jun 08 13:13:06.477913 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.477896 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" Jun 08 13:13:06.480753 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.480731 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 13:13:06.480885 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.480770 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 13:13:06.481900 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.481883 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vgs9d\"" Jun 08 13:13:06.487751 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.487731 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p"] Jun 08 13:13:06.645961 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.645922 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f22e2396-1ef7-4391-96e1-5288affe1530-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p\" (UID: \"f22e2396-1ef7-4391-96e1-5288affe1530\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" Jun 08 13:13:06.645961 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.645964 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f22e2396-1ef7-4391-96e1-5288affe1530-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p\" (UID: \"f22e2396-1ef7-4391-96e1-5288affe1530\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" Jun 08 13:13:06.646168 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.646087 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26v8g\" (UniqueName: \"kubernetes.io/projected/f22e2396-1ef7-4391-96e1-5288affe1530-kube-api-access-26v8g\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p\" (UID: \"f22e2396-1ef7-4391-96e1-5288affe1530\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" Jun 08 13:13:06.747152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.747072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f22e2396-1ef7-4391-96e1-5288affe1530-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p\" (UID: \"f22e2396-1ef7-4391-96e1-5288affe1530\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" Jun 08 13:13:06.747152 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.747121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f22e2396-1ef7-4391-96e1-5288affe1530-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p\" (UID: \"f22e2396-1ef7-4391-96e1-5288affe1530\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" Jun 08 13:13:06.747295 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.747170 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26v8g\" (UniqueName: \"kubernetes.io/projected/f22e2396-1ef7-4391-96e1-5288affe1530-kube-api-access-26v8g\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p\" (UID: \"f22e2396-1ef7-4391-96e1-5288affe1530\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" Jun 08 13:13:06.747503 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.747459 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f22e2396-1ef7-4391-96e1-5288affe1530-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p\" (UID: \"f22e2396-1ef7-4391-96e1-5288affe1530\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" Jun 08 13:13:06.747550 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.747512 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f22e2396-1ef7-4391-96e1-5288affe1530-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p\" (UID: \"f22e2396-1ef7-4391-96e1-5288affe1530\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" Jun 08 13:13:06.755944 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.755923 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26v8g\" (UniqueName: \"kubernetes.io/projected/f22e2396-1ef7-4391-96e1-5288affe1530-kube-api-access-26v8g\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p\" (UID: \"f22e2396-1ef7-4391-96e1-5288affe1530\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" Jun 08 13:13:06.788570 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.788542 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" Jun 08 13:13:06.933383 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:06.933353 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p"] Jun 08 13:13:06.935193 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:13:06.935164 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22e2396_1ef7_4391_96e1_5288affe1530.slice/crio-f3a0a8028e9302dd3684d89f11b69e28b1af672deb2abb4e118efe13f8ef3f06 WatchSource:0}: Error finding container f3a0a8028e9302dd3684d89f11b69e28b1af672deb2abb4e118efe13f8ef3f06: Status 404 returned error can't find the container with id f3a0a8028e9302dd3684d89f11b69e28b1af672deb2abb4e118efe13f8ef3f06 Jun 08 13:13:07.282833 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.282796 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn"] Jun 08 13:13:07.286243 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.286228 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" Jun 08 13:13:07.297629 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.297602 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn"] Jun 08 13:13:07.403235 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.403200 2564 generic.go:356] "Generic (PLEG): container finished" podID="f22e2396-1ef7-4391-96e1-5288affe1530" containerID="0ffca3817c40dfd14a4da0de41c5718a3f104601e282608572b1b0439821bab3" exitCode=0 Jun 08 13:13:07.403404 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.403240 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" event={"ID":"f22e2396-1ef7-4391-96e1-5288affe1530","Type":"ContainerDied","Data":"0ffca3817c40dfd14a4da0de41c5718a3f104601e282608572b1b0439821bab3"} Jun 08 13:13:07.403404 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.403307 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" event={"ID":"f22e2396-1ef7-4391-96e1-5288affe1530","Type":"ContainerStarted","Data":"f3a0a8028e9302dd3684d89f11b69e28b1af672deb2abb4e118efe13f8ef3f06"} Jun 08 13:13:07.403813 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.403798 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:13:07.453666 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.453630 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7xbk\" (UniqueName: \"kubernetes.io/projected/fd77bc71-5d85-4fae-ab23-aa341fe55983-kube-api-access-h7xbk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn\" (UID: \"fd77bc71-5d85-4fae-ab23-aa341fe55983\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" Jun 08 13:13:07.453805 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.453682 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd77bc71-5d85-4fae-ab23-aa341fe55983-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn\" (UID: \"fd77bc71-5d85-4fae-ab23-aa341fe55983\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" Jun 08 13:13:07.453805 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.453755 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd77bc71-5d85-4fae-ab23-aa341fe55983-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn\" (UID: \"fd77bc71-5d85-4fae-ab23-aa341fe55983\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" Jun 08 13:13:07.555056 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.554966 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd77bc71-5d85-4fae-ab23-aa341fe55983-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn\" (UID: \"fd77bc71-5d85-4fae-ab23-aa341fe55983\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" Jun 08 13:13:07.555056 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.555015 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7xbk\" (UniqueName: \"kubernetes.io/projected/fd77bc71-5d85-4fae-ab23-aa341fe55983-kube-api-access-h7xbk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn\" (UID: \"fd77bc71-5d85-4fae-ab23-aa341fe55983\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" Jun 08 13:13:07.555056 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.555051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd77bc71-5d85-4fae-ab23-aa341fe55983-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn\" (UID: \"fd77bc71-5d85-4fae-ab23-aa341fe55983\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" Jun 08 13:13:07.555520 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.555420 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd77bc71-5d85-4fae-ab23-aa341fe55983-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn\" (UID: \"fd77bc71-5d85-4fae-ab23-aa341fe55983\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" Jun 08 13:13:07.555520 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.555442 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd77bc71-5d85-4fae-ab23-aa341fe55983-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn\" (UID: \"fd77bc71-5d85-4fae-ab23-aa341fe55983\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" Jun 08 13:13:07.563803 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.563780 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7xbk\" (UniqueName: \"kubernetes.io/projected/fd77bc71-5d85-4fae-ab23-aa341fe55983-kube-api-access-h7xbk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn\" (UID: \"fd77bc71-5d85-4fae-ab23-aa341fe55983\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" Jun 08 13:13:07.595333 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.595303 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" Jun 08 13:13:07.728628 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.728607 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn"] Jun 08 13:13:07.731033 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:13:07.731001 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd77bc71_5d85_4fae_ab23_aa341fe55983.slice/crio-dbd2c9d8a37a413ba46aae522837286eab50bdace0922335f0e66211cd4d8662 WatchSource:0}: Error finding container dbd2c9d8a37a413ba46aae522837286eab50bdace0922335f0e66211cd4d8662: Status 404 returned error can't find the container with id dbd2c9d8a37a413ba46aae522837286eab50bdace0922335f0e66211cd4d8662 Jun 08 13:13:07.867616 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.867587 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6"] Jun 08 13:13:07.870945 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.870929 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" Jun 08 13:13:07.881005 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.880981 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6"] Jun 08 13:13:07.957610 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.957583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77fced7d-5786-41d8-a4c0-067124c067be-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6\" (UID: \"77fced7d-5786-41d8-a4c0-067124c067be\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" Jun 08 13:13:07.957780 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.957629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77fced7d-5786-41d8-a4c0-067124c067be-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6\" (UID: \"77fced7d-5786-41d8-a4c0-067124c067be\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" Jun 08 13:13:07.957780 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:07.957721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9nxl\" (UniqueName: \"kubernetes.io/projected/77fced7d-5786-41d8-a4c0-067124c067be-kube-api-access-w9nxl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6\" (UID: \"77fced7d-5786-41d8-a4c0-067124c067be\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" Jun 08 13:13:08.058912 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.058857 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77fced7d-5786-41d8-a4c0-067124c067be-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6\" (UID: \"77fced7d-5786-41d8-a4c0-067124c067be\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" Jun 08 13:13:08.058996 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.058966 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9nxl\" (UniqueName: \"kubernetes.io/projected/77fced7d-5786-41d8-a4c0-067124c067be-kube-api-access-w9nxl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6\" (UID: \"77fced7d-5786-41d8-a4c0-067124c067be\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" Jun 08 13:13:08.059037 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.059028 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77fced7d-5786-41d8-a4c0-067124c067be-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6\" (UID: \"77fced7d-5786-41d8-a4c0-067124c067be\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" Jun 08 13:13:08.059238 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.059217 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77fced7d-5786-41d8-a4c0-067124c067be-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6\" (UID: \"77fced7d-5786-41d8-a4c0-067124c067be\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" Jun 08 13:13:08.059300 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.059280 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77fced7d-5786-41d8-a4c0-067124c067be-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6\" (UID: \"77fced7d-5786-41d8-a4c0-067124c067be\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" Jun 08 13:13:08.069813 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.069792 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9nxl\" (UniqueName: \"kubernetes.io/projected/77fced7d-5786-41d8-a4c0-067124c067be-kube-api-access-w9nxl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6\" (UID: \"77fced7d-5786-41d8-a4c0-067124c067be\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" Jun 08 13:13:08.204735 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.204707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" Jun 08 13:13:08.268640 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.268615 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp"] Jun 08 13:13:08.273150 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.273133 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" Jun 08 13:13:08.284218 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.284192 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp"] Jun 08 13:13:08.341908 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.341880 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6"] Jun 08 13:13:08.343454 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:13:08.343426 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77fced7d_5786_41d8_a4c0_067124c067be.slice/crio-2dc681e117505e903546e80b1c2ab12e93266fc704abb14effaaed9fb154bbdb WatchSource:0}: Error finding container 2dc681e117505e903546e80b1c2ab12e93266fc704abb14effaaed9fb154bbdb: Status 404 returned error can't find the container with id 2dc681e117505e903546e80b1c2ab12e93266fc704abb14effaaed9fb154bbdb Jun 08 13:13:08.361229 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.361208 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxsgj\" (UniqueName: \"kubernetes.io/projected/3b847695-abfe-41cd-bf9f-481a8c6ca93d-kube-api-access-rxsgj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp\" (UID: \"3b847695-abfe-41cd-bf9f-481a8c6ca93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" Jun 08 13:13:08.361328 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.361257 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b847695-abfe-41cd-bf9f-481a8c6ca93d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp\" (UID: \"3b847695-abfe-41cd-bf9f-481a8c6ca93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" Jun 08 13:13:08.361328 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.361275 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b847695-abfe-41cd-bf9f-481a8c6ca93d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp\" (UID: \"3b847695-abfe-41cd-bf9f-481a8c6ca93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" Jun 08 13:13:08.410139 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.410112 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" event={"ID":"77fced7d-5786-41d8-a4c0-067124c067be","Type":"ContainerStarted","Data":"34f8fe816252c6b057bac3f285dc533b83477ca992484d598aa7fab7ff181f65"} Jun 08 13:13:08.410277 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.410164 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" event={"ID":"77fced7d-5786-41d8-a4c0-067124c067be","Type":"ContainerStarted","Data":"2dc681e117505e903546e80b1c2ab12e93266fc704abb14effaaed9fb154bbdb"} Jun 08 13:13:08.411846 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.411821 2564 generic.go:356] "Generic (PLEG): container finished" podID="fd77bc71-5d85-4fae-ab23-aa341fe55983" containerID="c9f06d1b2cbf11676bbe698650ff3bc3159522e12a16e35e49975445672261fb" exitCode=0 Jun 08 13:13:08.411951 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.411879 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" event={"ID":"fd77bc71-5d85-4fae-ab23-aa341fe55983","Type":"ContainerDied","Data":"c9f06d1b2cbf11676bbe698650ff3bc3159522e12a16e35e49975445672261fb"} Jun 08 13:13:08.411951 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.411933 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" event={"ID":"fd77bc71-5d85-4fae-ab23-aa341fe55983","Type":"ContainerStarted","Data":"dbd2c9d8a37a413ba46aae522837286eab50bdace0922335f0e66211cd4d8662"} Jun 08 13:13:08.414055 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.414032 2564 generic.go:356] "Generic (PLEG): container finished" podID="f22e2396-1ef7-4391-96e1-5288affe1530" containerID="a0a045f789831be9ccd70b2b32750594e61e1164b8ee077be8ae2d5e099a1753" exitCode=0 Jun 08 13:13:08.414154 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.414083 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" event={"ID":"f22e2396-1ef7-4391-96e1-5288affe1530","Type":"ContainerDied","Data":"a0a045f789831be9ccd70b2b32750594e61e1164b8ee077be8ae2d5e099a1753"} Jun 08 13:13:08.461874 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.461850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxsgj\" (UniqueName: \"kubernetes.io/projected/3b847695-abfe-41cd-bf9f-481a8c6ca93d-kube-api-access-rxsgj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp\" (UID: \"3b847695-abfe-41cd-bf9f-481a8c6ca93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" Jun 08 13:13:08.461970 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.461901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b847695-abfe-41cd-bf9f-481a8c6ca93d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp\" (UID: \"3b847695-abfe-41cd-bf9f-481a8c6ca93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" Jun 08 13:13:08.461970 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.461921 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b847695-abfe-41cd-bf9f-481a8c6ca93d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp\" (UID: \"3b847695-abfe-41cd-bf9f-481a8c6ca93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" Jun 08 13:13:08.462268 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.462244 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b847695-abfe-41cd-bf9f-481a8c6ca93d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp\" (UID: \"3b847695-abfe-41cd-bf9f-481a8c6ca93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" Jun 08 13:13:08.462268 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.462253 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b847695-abfe-41cd-bf9f-481a8c6ca93d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp\" (UID: \"3b847695-abfe-41cd-bf9f-481a8c6ca93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" Jun 08 13:13:08.469767 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.469747 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxsgj\" (UniqueName: \"kubernetes.io/projected/3b847695-abfe-41cd-bf9f-481a8c6ca93d-kube-api-access-rxsgj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp\" (UID: \"3b847695-abfe-41cd-bf9f-481a8c6ca93d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" Jun 08 13:13:08.582846 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.582819 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" Jun 08 13:13:08.722975 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:08.722947 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp"] Jun 08 13:13:08.725461 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:13:08.725434 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b847695_abfe_41cd_bf9f_481a8c6ca93d.slice/crio-db70afc94511ae71def3e996730669fcaf4cddd9d1a430377223eb890ebbdc11 WatchSource:0}: Error finding container db70afc94511ae71def3e996730669fcaf4cddd9d1a430377223eb890ebbdc11: Status 404 returned error can't find the container with id db70afc94511ae71def3e996730669fcaf4cddd9d1a430377223eb890ebbdc11 Jun 08 13:13:09.420736 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:09.420644 2564 generic.go:356] "Generic (PLEG): container finished" podID="f22e2396-1ef7-4391-96e1-5288affe1530" containerID="e6a653798ea996570558243935f7733e1c723b639060d7435b98bc7ad1894c19" exitCode=0 Jun 08 13:13:09.420736 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:09.420674 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" event={"ID":"f22e2396-1ef7-4391-96e1-5288affe1530","Type":"ContainerDied","Data":"e6a653798ea996570558243935f7733e1c723b639060d7435b98bc7ad1894c19"} Jun 08 13:13:09.422221 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:09.422196 2564 generic.go:356] "Generic (PLEG): container finished" podID="77fced7d-5786-41d8-a4c0-067124c067be" containerID="34f8fe816252c6b057bac3f285dc533b83477ca992484d598aa7fab7ff181f65" exitCode=0 Jun 08 13:13:09.422343 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:09.422283 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" event={"ID":"77fced7d-5786-41d8-a4c0-067124c067be","Type":"ContainerDied","Data":"34f8fe816252c6b057bac3f285dc533b83477ca992484d598aa7fab7ff181f65"} Jun 08 13:13:09.424032 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:09.424011 2564 generic.go:356] "Generic (PLEG): container finished" podID="fd77bc71-5d85-4fae-ab23-aa341fe55983" containerID="470f4851927c92eb256221df643f7d1b45c87c33abd8b9c54c404407dcb190c7" exitCode=0 Jun 08 13:13:09.424145 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:09.424073 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" event={"ID":"fd77bc71-5d85-4fae-ab23-aa341fe55983","Type":"ContainerDied","Data":"470f4851927c92eb256221df643f7d1b45c87c33abd8b9c54c404407dcb190c7"} Jun 08 13:13:09.425697 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:09.425685 2564 generic.go:356] "Generic (PLEG): container finished" podID="3b847695-abfe-41cd-bf9f-481a8c6ca93d" containerID="6b982001dd8410a333d800bff0af6da3e2defe1ae0fc0fe515688fdd847b0efe" exitCode=0 Jun 08 13:13:09.425776 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:09.425733 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" event={"ID":"3b847695-abfe-41cd-bf9f-481a8c6ca93d","Type":"ContainerDied","Data":"6b982001dd8410a333d800bff0af6da3e2defe1ae0fc0fe515688fdd847b0efe"} Jun 08 13:13:09.425776 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:09.425768 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" event={"ID":"3b847695-abfe-41cd-bf9f-481a8c6ca93d","Type":"ContainerStarted","Data":"db70afc94511ae71def3e996730669fcaf4cddd9d1a430377223eb890ebbdc11"} Jun 08 13:13:10.432305 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:10.432277 2564 generic.go:356] "Generic (PLEG): container finished" podID="77fced7d-5786-41d8-a4c0-067124c067be" containerID="6c6b1cc8210185454d685c6c61abc4fc3fa9b8c59517bac60f37a941c65c98a7" exitCode=0 Jun 08 13:13:10.432705 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:10.432338 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" event={"ID":"77fced7d-5786-41d8-a4c0-067124c067be","Type":"ContainerDied","Data":"6c6b1cc8210185454d685c6c61abc4fc3fa9b8c59517bac60f37a941c65c98a7"} Jun 08 13:13:10.434603 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:10.434581 2564 generic.go:356] "Generic (PLEG): container finished" podID="fd77bc71-5d85-4fae-ab23-aa341fe55983" containerID="e6ffe44275f2b93d97eb180c9c841977a390d851195ff75dd56d918bd80aedbb" exitCode=0 Jun 08 13:13:10.434702 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:10.434662 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" event={"ID":"fd77bc71-5d85-4fae-ab23-aa341fe55983","Type":"ContainerDied","Data":"e6ffe44275f2b93d97eb180c9c841977a390d851195ff75dd56d918bd80aedbb"} Jun 08 13:13:10.436363 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:10.436344 2564 generic.go:356] "Generic (PLEG): container finished" podID="3b847695-abfe-41cd-bf9f-481a8c6ca93d" containerID="9703ddfcc3d50041a4e967b3f73d28c30551e57a0fe8479f5b7abe66c784a8f2" exitCode=0 Jun 08 13:13:10.436459 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:10.436423 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" event={"ID":"3b847695-abfe-41cd-bf9f-481a8c6ca93d","Type":"ContainerDied","Data":"9703ddfcc3d50041a4e967b3f73d28c30551e57a0fe8479f5b7abe66c784a8f2"} Jun 08 13:13:10.574822 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:10.574801 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" Jun 08 13:13:10.679626 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:10.679598 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26v8g\" (UniqueName: \"kubernetes.io/projected/f22e2396-1ef7-4391-96e1-5288affe1530-kube-api-access-26v8g\") pod \"f22e2396-1ef7-4391-96e1-5288affe1530\" (UID: \"f22e2396-1ef7-4391-96e1-5288affe1530\") " Jun 08 13:13:10.679760 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:10.679633 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f22e2396-1ef7-4391-96e1-5288affe1530-util\") pod \"f22e2396-1ef7-4391-96e1-5288affe1530\" (UID: \"f22e2396-1ef7-4391-96e1-5288affe1530\") " Jun 08 13:13:10.679760 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:10.679736 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f22e2396-1ef7-4391-96e1-5288affe1530-bundle\") pod \"f22e2396-1ef7-4391-96e1-5288affe1530\" (UID: \"f22e2396-1ef7-4391-96e1-5288affe1530\") " Jun 08 13:13:10.680223 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:10.680194 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f22e2396-1ef7-4391-96e1-5288affe1530-bundle" (OuterVolumeSpecName: "bundle") pod "f22e2396-1ef7-4391-96e1-5288affe1530" (UID: "f22e2396-1ef7-4391-96e1-5288affe1530"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:13:10.681719 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:10.681699 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f22e2396-1ef7-4391-96e1-5288affe1530-kube-api-access-26v8g" (OuterVolumeSpecName: "kube-api-access-26v8g") pod "f22e2396-1ef7-4391-96e1-5288affe1530" (UID: "f22e2396-1ef7-4391-96e1-5288affe1530"). InnerVolumeSpecName "kube-api-access-26v8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:13:10.685632 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:10.685613 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f22e2396-1ef7-4391-96e1-5288affe1530-util" (OuterVolumeSpecName: "util") pod "f22e2396-1ef7-4391-96e1-5288affe1530" (UID: "f22e2396-1ef7-4391-96e1-5288affe1530"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:13:10.780443 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:10.780422 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f22e2396-1ef7-4391-96e1-5288affe1530-bundle\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:13:10.780443 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:10.780443 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26v8g\" (UniqueName: \"kubernetes.io/projected/f22e2396-1ef7-4391-96e1-5288affe1530-kube-api-access-26v8g\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:13:10.780601 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:10.780451 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f22e2396-1ef7-4391-96e1-5288affe1530-util\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:13:11.447005 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.446974 2564 generic.go:356] "Generic (PLEG): container finished" podID="3b847695-abfe-41cd-bf9f-481a8c6ca93d" containerID="56fdb7febc965f021fdb96e42d8a496bccc14ce9278b698514f90d281dcdfc44" exitCode=0 Jun 08 13:13:11.447414 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.447066 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" event={"ID":"3b847695-abfe-41cd-bf9f-481a8c6ca93d","Type":"ContainerDied","Data":"56fdb7febc965f021fdb96e42d8a496bccc14ce9278b698514f90d281dcdfc44"} Jun 08 13:13:11.448929 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.448913 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" Jun 08 13:13:11.449013 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.448929 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p" event={"ID":"f22e2396-1ef7-4391-96e1-5288affe1530","Type":"ContainerDied","Data":"f3a0a8028e9302dd3684d89f11b69e28b1af672deb2abb4e118efe13f8ef3f06"} Jun 08 13:13:11.449013 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.448968 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3a0a8028e9302dd3684d89f11b69e28b1af672deb2abb4e118efe13f8ef3f06" Jun 08 13:13:11.451054 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.451032 2564 generic.go:356] "Generic (PLEG): container finished" podID="77fced7d-5786-41d8-a4c0-067124c067be" containerID="e54ca785399cd2a6fd9bd7dfa3f8a1370376b447ab96edb14821dc295551a488" exitCode=0 Jun 08 13:13:11.451168 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.451096 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" event={"ID":"77fced7d-5786-41d8-a4c0-067124c067be","Type":"ContainerDied","Data":"e54ca785399cd2a6fd9bd7dfa3f8a1370376b447ab96edb14821dc295551a488"} Jun 08 13:13:11.577635 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.577614 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" Jun 08 13:13:11.688820 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.688785 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd77bc71-5d85-4fae-ab23-aa341fe55983-util\") pod \"fd77bc71-5d85-4fae-ab23-aa341fe55983\" (UID: \"fd77bc71-5d85-4fae-ab23-aa341fe55983\") " Jun 08 13:13:11.689001 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.688844 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7xbk\" (UniqueName: \"kubernetes.io/projected/fd77bc71-5d85-4fae-ab23-aa341fe55983-kube-api-access-h7xbk\") pod \"fd77bc71-5d85-4fae-ab23-aa341fe55983\" (UID: \"fd77bc71-5d85-4fae-ab23-aa341fe55983\") " Jun 08 13:13:11.689001 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.688949 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd77bc71-5d85-4fae-ab23-aa341fe55983-bundle\") pod \"fd77bc71-5d85-4fae-ab23-aa341fe55983\" (UID: \"fd77bc71-5d85-4fae-ab23-aa341fe55983\") " Jun 08 13:13:11.689554 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.689351 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd77bc71-5d85-4fae-ab23-aa341fe55983-bundle" (OuterVolumeSpecName: "bundle") pod "fd77bc71-5d85-4fae-ab23-aa341fe55983" (UID: "fd77bc71-5d85-4fae-ab23-aa341fe55983"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:13:11.690826 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.690802 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd77bc71-5d85-4fae-ab23-aa341fe55983-kube-api-access-h7xbk" (OuterVolumeSpecName: "kube-api-access-h7xbk") pod "fd77bc71-5d85-4fae-ab23-aa341fe55983" (UID: "fd77bc71-5d85-4fae-ab23-aa341fe55983"). InnerVolumeSpecName "kube-api-access-h7xbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:13:11.693976 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.693941 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd77bc71-5d85-4fae-ab23-aa341fe55983-util" (OuterVolumeSpecName: "util") pod "fd77bc71-5d85-4fae-ab23-aa341fe55983" (UID: "fd77bc71-5d85-4fae-ab23-aa341fe55983"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:13:11.790405 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.790329 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd77bc71-5d85-4fae-ab23-aa341fe55983-util\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:13:11.790405 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.790355 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7xbk\" (UniqueName: \"kubernetes.io/projected/fd77bc71-5d85-4fae-ab23-aa341fe55983-kube-api-access-h7xbk\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:13:11.790405 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:11.790365 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd77bc71-5d85-4fae-ab23-aa341fe55983-bundle\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:13:12.457606 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.457569 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" event={"ID":"fd77bc71-5d85-4fae-ab23-aa341fe55983","Type":"ContainerDied","Data":"dbd2c9d8a37a413ba46aae522837286eab50bdace0922335f0e66211cd4d8662"} Jun 08 13:13:12.458017 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.457620 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbd2c9d8a37a413ba46aae522837286eab50bdace0922335f0e66211cd4d8662" Jun 08 13:13:12.458017 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.457911 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn" Jun 08 13:13:12.593028 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.593009 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" Jun 08 13:13:12.617233 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.617209 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" Jun 08 13:13:12.698656 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.698626 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b847695-abfe-41cd-bf9f-481a8c6ca93d-bundle\") pod \"3b847695-abfe-41cd-bf9f-481a8c6ca93d\" (UID: \"3b847695-abfe-41cd-bf9f-481a8c6ca93d\") " Jun 08 13:13:12.698656 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.698654 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b847695-abfe-41cd-bf9f-481a8c6ca93d-util\") pod \"3b847695-abfe-41cd-bf9f-481a8c6ca93d\" (UID: \"3b847695-abfe-41cd-bf9f-481a8c6ca93d\") " Jun 08 13:13:12.698854 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.698730 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxsgj\" (UniqueName: \"kubernetes.io/projected/3b847695-abfe-41cd-bf9f-481a8c6ca93d-kube-api-access-rxsgj\") pod \"3b847695-abfe-41cd-bf9f-481a8c6ca93d\" (UID: \"3b847695-abfe-41cd-bf9f-481a8c6ca93d\") " Jun 08 13:13:12.699208 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.699181 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b847695-abfe-41cd-bf9f-481a8c6ca93d-bundle" (OuterVolumeSpecName: "bundle") pod "3b847695-abfe-41cd-bf9f-481a8c6ca93d" (UID: "3b847695-abfe-41cd-bf9f-481a8c6ca93d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:13:12.700871 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.700847 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b847695-abfe-41cd-bf9f-481a8c6ca93d-kube-api-access-rxsgj" (OuterVolumeSpecName: "kube-api-access-rxsgj") pod "3b847695-abfe-41cd-bf9f-481a8c6ca93d" (UID: "3b847695-abfe-41cd-bf9f-481a8c6ca93d"). InnerVolumeSpecName "kube-api-access-rxsgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:13:12.704082 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.704062 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b847695-abfe-41cd-bf9f-481a8c6ca93d-util" (OuterVolumeSpecName: "util") pod "3b847695-abfe-41cd-bf9f-481a8c6ca93d" (UID: "3b847695-abfe-41cd-bf9f-481a8c6ca93d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:13:12.799732 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.799633 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77fced7d-5786-41d8-a4c0-067124c067be-util\") pod \"77fced7d-5786-41d8-a4c0-067124c067be\" (UID: \"77fced7d-5786-41d8-a4c0-067124c067be\") " Jun 08 13:13:12.799732 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.799697 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77fced7d-5786-41d8-a4c0-067124c067be-bundle\") pod \"77fced7d-5786-41d8-a4c0-067124c067be\" (UID: \"77fced7d-5786-41d8-a4c0-067124c067be\") " Jun 08 13:13:12.799954 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.799763 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9nxl\" (UniqueName: \"kubernetes.io/projected/77fced7d-5786-41d8-a4c0-067124c067be-kube-api-access-w9nxl\") pod \"77fced7d-5786-41d8-a4c0-067124c067be\" (UID: \"77fced7d-5786-41d8-a4c0-067124c067be\") " Jun 08 13:13:12.804495 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.800718 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxsgj\" (UniqueName: \"kubernetes.io/projected/3b847695-abfe-41cd-bf9f-481a8c6ca93d-kube-api-access-rxsgj\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:13:12.804495 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.800761 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b847695-abfe-41cd-bf9f-481a8c6ca93d-bundle\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:13:12.804495 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.800777 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b847695-abfe-41cd-bf9f-481a8c6ca93d-util\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:13:12.804495 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.800961 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77fced7d-5786-41d8-a4c0-067124c067be-bundle" (OuterVolumeSpecName: "bundle") pod "77fced7d-5786-41d8-a4c0-067124c067be" (UID: "77fced7d-5786-41d8-a4c0-067124c067be"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:13:12.804495 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.802736 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77fced7d-5786-41d8-a4c0-067124c067be-kube-api-access-w9nxl" (OuterVolumeSpecName: "kube-api-access-w9nxl") pod "77fced7d-5786-41d8-a4c0-067124c067be" (UID: "77fced7d-5786-41d8-a4c0-067124c067be"). InnerVolumeSpecName "kube-api-access-w9nxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:13:12.807771 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.807736 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77fced7d-5786-41d8-a4c0-067124c067be-util" (OuterVolumeSpecName: "util") pod "77fced7d-5786-41d8-a4c0-067124c067be" (UID: "77fced7d-5786-41d8-a4c0-067124c067be"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:13:12.901449 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.901416 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9nxl\" (UniqueName: \"kubernetes.io/projected/77fced7d-5786-41d8-a4c0-067124c067be-kube-api-access-w9nxl\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:13:12.901449 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.901448 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77fced7d-5786-41d8-a4c0-067124c067be-util\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:13:12.901449 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:12.901459 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77fced7d-5786-41d8-a4c0-067124c067be-bundle\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:13:13.464026 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:13.463997 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" Jun 08 13:13:13.464442 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:13.464033 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6" event={"ID":"77fced7d-5786-41d8-a4c0-067124c067be","Type":"ContainerDied","Data":"2dc681e117505e903546e80b1c2ab12e93266fc704abb14effaaed9fb154bbdb"} Jun 08 13:13:13.464442 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:13.464089 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2dc681e117505e903546e80b1c2ab12e93266fc704abb14effaaed9fb154bbdb" Jun 08 13:13:13.465919 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:13.465899 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" Jun 08 13:13:13.466028 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:13.465898 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp" event={"ID":"3b847695-abfe-41cd-bf9f-481a8c6ca93d","Type":"ContainerDied","Data":"db70afc94511ae71def3e996730669fcaf4cddd9d1a430377223eb890ebbdc11"} Jun 08 13:13:13.466028 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:13.466015 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db70afc94511ae71def3e996730669fcaf4cddd9d1a430377223eb890ebbdc11" Jun 08 13:13:20.339718 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:20.339682 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:23.623097 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:23.623064 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:25.673946 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:25.673908 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:26.032213 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:26.032120 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:26.390617 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:26.390584 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:26.784671 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:26.784579 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:28.629339 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:28.629305 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:30.540135 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:30.540105 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:30.658527 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:30.658494 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:32.946064 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:32.946025 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:35.058964 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.058932 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:35.171892 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.171862 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:35.365862 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.365788 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn"] Jun 08 13:13:35.366094 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366083 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd77bc71-5d85-4fae-ab23-aa341fe55983" containerName="extract" Jun 08 13:13:35.366141 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366096 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd77bc71-5d85-4fae-ab23-aa341fe55983" containerName="extract" Jun 08 13:13:35.366141 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366105 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f22e2396-1ef7-4391-96e1-5288affe1530" containerName="util" Jun 08 13:13:35.366141 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366111 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f22e2396-1ef7-4391-96e1-5288affe1530" containerName="util" Jun 08 13:13:35.366141 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366117 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f22e2396-1ef7-4391-96e1-5288affe1530" containerName="pull" Jun 08 13:13:35.366141 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366123 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f22e2396-1ef7-4391-96e1-5288affe1530" containerName="pull" Jun 08 13:13:35.366141 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366130 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd77bc71-5d85-4fae-ab23-aa341fe55983" containerName="util" Jun 08 13:13:35.366141 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366135 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd77bc71-5d85-4fae-ab23-aa341fe55983" containerName="util" Jun 08 13:13:35.366141 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366141 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f22e2396-1ef7-4391-96e1-5288affe1530" containerName="extract" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366146 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f22e2396-1ef7-4391-96e1-5288affe1530" containerName="extract" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366152 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b847695-abfe-41cd-bf9f-481a8c6ca93d" containerName="pull" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366157 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b847695-abfe-41cd-bf9f-481a8c6ca93d" containerName="pull" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366165 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77fced7d-5786-41d8-a4c0-067124c067be" containerName="util" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366170 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="77fced7d-5786-41d8-a4c0-067124c067be" containerName="util" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366177 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd77bc71-5d85-4fae-ab23-aa341fe55983" containerName="pull" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366181 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd77bc71-5d85-4fae-ab23-aa341fe55983" containerName="pull" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366188 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b847695-abfe-41cd-bf9f-481a8c6ca93d" containerName="extract" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366193 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b847695-abfe-41cd-bf9f-481a8c6ca93d" containerName="extract" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366203 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b847695-abfe-41cd-bf9f-481a8c6ca93d" containerName="util" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366207 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b847695-abfe-41cd-bf9f-481a8c6ca93d" containerName="util" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366214 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77fced7d-5786-41d8-a4c0-067124c067be" containerName="pull" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366219 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="77fced7d-5786-41d8-a4c0-067124c067be" containerName="pull" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366231 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77fced7d-5786-41d8-a4c0-067124c067be" containerName="extract" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366237 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="77fced7d-5786-41d8-a4c0-067124c067be" containerName="extract" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366286 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f22e2396-1ef7-4391-96e1-5288affe1530" containerName="extract" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366294 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="77fced7d-5786-41d8-a4c0-067124c067be" containerName="extract" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366301 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b847695-abfe-41cd-bf9f-481a8c6ca93d" containerName="extract" Jun 08 13:13:35.366390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.366308 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd77bc71-5d85-4fae-ab23-aa341fe55983" containerName="extract" Jun 08 13:13:35.370663 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.370641 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn" Jun 08 13:13:35.373780 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.373755 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 13:13:35.373996 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.373982 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 08 13:13:35.374209 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.374190 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vgs9d\"" Jun 08 13:13:35.374209 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.374206 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 08 13:13:35.374378 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.374322 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 13:13:35.391458 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.391440 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn"] Jun 08 13:13:35.408739 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.408709 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:35.483682 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.483650 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4kxb\" (UniqueName: \"kubernetes.io/projected/35007f5b-0d42-4d8e-9ccd-d11f1f7f614e-kube-api-access-z4kxb\") pod \"kuadrant-console-plugin-66b5774985-n5nbn\" (UID: \"35007f5b-0d42-4d8e-9ccd-d11f1f7f614e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn" Jun 08 13:13:35.483830 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.483685 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/35007f5b-0d42-4d8e-9ccd-d11f1f7f614e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n5nbn\" (UID: \"35007f5b-0d42-4d8e-9ccd-d11f1f7f614e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn" Jun 08 13:13:35.483830 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.483706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/35007f5b-0d42-4d8e-9ccd-d11f1f7f614e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n5nbn\" (UID: \"35007f5b-0d42-4d8e-9ccd-d11f1f7f614e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn" Jun 08 13:13:35.556352 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.556318 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:35.585107 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.585078 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4kxb\" (UniqueName: \"kubernetes.io/projected/35007f5b-0d42-4d8e-9ccd-d11f1f7f614e-kube-api-access-z4kxb\") pod \"kuadrant-console-plugin-66b5774985-n5nbn\" (UID: \"35007f5b-0d42-4d8e-9ccd-d11f1f7f614e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn" Jun 08 13:13:35.585248 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.585118 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/35007f5b-0d42-4d8e-9ccd-d11f1f7f614e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n5nbn\" (UID: \"35007f5b-0d42-4d8e-9ccd-d11f1f7f614e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn" Jun 08 13:13:35.585248 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.585145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/35007f5b-0d42-4d8e-9ccd-d11f1f7f614e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n5nbn\" (UID: \"35007f5b-0d42-4d8e-9ccd-d11f1f7f614e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn" Jun 08 13:13:35.585902 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.585883 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/35007f5b-0d42-4d8e-9ccd-d11f1f7f614e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-n5nbn\" (UID: \"35007f5b-0d42-4d8e-9ccd-d11f1f7f614e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn" Jun 08 13:13:35.587555 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.587535 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/35007f5b-0d42-4d8e-9ccd-d11f1f7f614e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-n5nbn\" (UID: \"35007f5b-0d42-4d8e-9ccd-d11f1f7f614e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn" Jun 08 13:13:35.611708 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.611689 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4kxb\" (UniqueName: \"kubernetes.io/projected/35007f5b-0d42-4d8e-9ccd-d11f1f7f614e-kube-api-access-z4kxb\") pod \"kuadrant-console-plugin-66b5774985-n5nbn\" (UID: \"35007f5b-0d42-4d8e-9ccd-d11f1f7f614e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn" Jun 08 13:13:35.679739 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.679715 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn" Jun 08 13:13:35.824800 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:35.824775 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn"] Jun 08 13:13:35.825485 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:13:35.825450 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35007f5b_0d42_4d8e_9ccd_d11f1f7f614e.slice/crio-8ca3ae31a6073d6f4d5e66f1cd40549e7f727008cad1b277f3754e2f5e3cd801 WatchSource:0}: Error finding container 8ca3ae31a6073d6f4d5e66f1cd40549e7f727008cad1b277f3754e2f5e3cd801: Status 404 returned error can't find the container with id 8ca3ae31a6073d6f4d5e66f1cd40549e7f727008cad1b277f3754e2f5e3cd801 Jun 08 13:13:36.577322 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:36.577285 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn" event={"ID":"35007f5b-0d42-4d8e-9ccd-d11f1f7f614e","Type":"ContainerStarted","Data":"8ca3ae31a6073d6f4d5e66f1cd40549e7f727008cad1b277f3754e2f5e3cd801"} Jun 08 13:13:45.176977 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:45.176939 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:45.405248 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:45.405211 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:45.765318 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:45.765285 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:47.949344 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:47.949308 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:48.401455 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:48.401420 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:52.368335 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:52.368298 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:52.591724 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:52.591684 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:56.755895 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:56.755853 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:13:56.923794 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:13:56.923755 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:00.721877 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:00.721845 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn" event={"ID":"35007f5b-0d42-4d8e-9ccd-d11f1f7f614e","Type":"ContainerStarted","Data":"7c2d889849854334ea59b3b78606fa155e839149482d4fa2f9a0bb19c72d2306"} Jun 08 13:14:00.756398 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:00.756341 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-n5nbn" podStartSLOduration=1.038259806 podStartE2EDuration="25.756326509s" totalImagesPullingTime="24.718066703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:14:00.754097018 +0000 UTC m=+759.322506099" watchObservedRunningTime="2026-06-08 13:14:00.756326509 +0000 UTC m=+759.324735589" Jun 08 13:14:02.234964 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:02.234927 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:02.317495 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:02.317441 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:05.671242 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:05.671197 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:05.766194 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:05.766165 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:05.833856 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:05.833830 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:08.143426 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:08.143391 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:08.244398 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:08.244357 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:12.936486 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:12.936435 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:13.120304 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:13.120251 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:14.656531 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:14.656497 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:19.410735 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:19.410701 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:19.510194 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:19.510167 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:23.093086 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:23.093059 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:23.526380 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:23.526346 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:23.624523 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:23.624489 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:23.698506 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:23.698458 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:24.042206 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.042176 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:14:24.112571 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.112545 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:14:24.112963 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.112633 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-6wbdd" Jun 08 13:14:24.115781 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.115754 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 08 13:14:24.118216 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.118193 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:14:24.207051 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.207023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pqsv\" (UniqueName: \"kubernetes.io/projected/8ee141f7-edc1-447e-b364-97abed6c3645-kube-api-access-8pqsv\") pod \"limitador-limitador-54d6d988d5-6wbdd\" (UID: \"8ee141f7-edc1-447e-b364-97abed6c3645\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6wbdd" Jun 08 13:14:24.207173 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.207072 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8ee141f7-edc1-447e-b364-97abed6c3645-config-file\") pod \"limitador-limitador-54d6d988d5-6wbdd\" (UID: \"8ee141f7-edc1-447e-b364-97abed6c3645\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6wbdd" Jun 08 13:14:24.307644 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.307576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pqsv\" (UniqueName: \"kubernetes.io/projected/8ee141f7-edc1-447e-b364-97abed6c3645-kube-api-access-8pqsv\") pod \"limitador-limitador-54d6d988d5-6wbdd\" (UID: \"8ee141f7-edc1-447e-b364-97abed6c3645\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6wbdd" Jun 08 13:14:24.307644 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.307630 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8ee141f7-edc1-447e-b364-97abed6c3645-config-file\") pod \"limitador-limitador-54d6d988d5-6wbdd\" (UID: \"8ee141f7-edc1-447e-b364-97abed6c3645\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6wbdd" Jun 08 13:14:24.308223 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.308199 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8ee141f7-edc1-447e-b364-97abed6c3645-config-file\") pod \"limitador-limitador-54d6d988d5-6wbdd\" (UID: \"8ee141f7-edc1-447e-b364-97abed6c3645\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6wbdd" Jun 08 13:14:24.318059 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.318037 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pqsv\" (UniqueName: \"kubernetes.io/projected/8ee141f7-edc1-447e-b364-97abed6c3645-kube-api-access-8pqsv\") pod \"limitador-limitador-54d6d988d5-6wbdd\" (UID: \"8ee141f7-edc1-447e-b364-97abed6c3645\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6wbdd" Jun 08 13:14:24.424645 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.424627 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-6wbdd" Jun 08 13:14:24.445524 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.445501 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:24.525049 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.524681 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:24.564387 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.564367 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:14:24.566506 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:14:24.566463 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee141f7_edc1_447e_b364_97abed6c3645.slice/crio-9acc988d226f78a7a338561e72c6248b6754ffe898be96efe06670a39446e3a6 WatchSource:0}: Error finding container 9acc988d226f78a7a338561e72c6248b6754ffe898be96efe06670a39446e3a6: Status 404 returned error can't find the container with id 9acc988d226f78a7a338561e72c6248b6754ffe898be96efe06670a39446e3a6 Jun 08 13:14:24.578466 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.578444 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-mn5nw"] Jun 08 13:14:24.582954 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.582935 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mn5nw" Jun 08 13:14:24.585720 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.585704 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-td5zj\"" Jun 08 13:14:24.596060 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.596038 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mn5nw"] Jun 08 13:14:24.710306 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.710276 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdvqm\" (UniqueName: \"kubernetes.io/projected/3e47f758-3147-4c55-ba91-9fdcdef116ce-kube-api-access-kdvqm\") pod \"authorino-75d556bd77-mn5nw\" (UID: \"3e47f758-3147-4c55-ba91-9fdcdef116ce\") " pod="kuadrant-system/authorino-75d556bd77-mn5nw" Jun 08 13:14:24.811108 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.811082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdvqm\" (UniqueName: \"kubernetes.io/projected/3e47f758-3147-4c55-ba91-9fdcdef116ce-kube-api-access-kdvqm\") pod \"authorino-75d556bd77-mn5nw\" (UID: \"3e47f758-3147-4c55-ba91-9fdcdef116ce\") " pod="kuadrant-system/authorino-75d556bd77-mn5nw" Jun 08 13:14:24.820904 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.820852 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdvqm\" (UniqueName: \"kubernetes.io/projected/3e47f758-3147-4c55-ba91-9fdcdef116ce-kube-api-access-kdvqm\") pod \"authorino-75d556bd77-mn5nw\" (UID: \"3e47f758-3147-4c55-ba91-9fdcdef116ce\") " pod="kuadrant-system/authorino-75d556bd77-mn5nw" Jun 08 13:14:24.841080 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.841056 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-6wbdd" event={"ID":"8ee141f7-edc1-447e-b364-97abed6c3645","Type":"ContainerStarted","Data":"9acc988d226f78a7a338561e72c6248b6754ffe898be96efe06670a39446e3a6"} Jun 08 13:14:24.892281 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:24.892258 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mn5nw" Jun 08 13:14:25.040566 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:25.040516 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mn5nw"] Jun 08 13:14:25.040882 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:14:25.040855 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e47f758_3147_4c55_ba91_9fdcdef116ce.slice/crio-f34b173a804cdd7c515eb22dde9abbdc6d615af82350e6797de26540ead04851 WatchSource:0}: Error finding container f34b173a804cdd7c515eb22dde9abbdc6d615af82350e6797de26540ead04851: Status 404 returned error can't find the container with id f34b173a804cdd7c515eb22dde9abbdc6d615af82350e6797de26540ead04851 Jun 08 13:14:25.851278 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:25.851212 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mn5nw" event={"ID":"3e47f758-3147-4c55-ba91-9fdcdef116ce","Type":"ContainerStarted","Data":"f34b173a804cdd7c515eb22dde9abbdc6d615af82350e6797de26540ead04851"} Jun 08 13:14:29.590016 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:29.589984 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:29.661645 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:29.661601 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:29.875853 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:29.875817 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-6wbdd" event={"ID":"8ee141f7-edc1-447e-b364-97abed6c3645","Type":"ContainerStarted","Data":"c90c2a570d751ea701e27af312871b8f9b51d0282375ffbe38988378eab21cd8"} Jun 08 13:14:29.876029 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:29.875882 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-6wbdd" Jun 08 13:14:29.877211 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:29.877182 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mn5nw" event={"ID":"3e47f758-3147-4c55-ba91-9fdcdef116ce","Type":"ContainerStarted","Data":"a22338c8a30663104617c77263ee333699d9a3ee1ca5ef9d4958d6502876aed3"} Jun 08 13:14:29.901815 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:29.901772 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-6wbdd" podStartSLOduration=1.6214894549999999 podStartE2EDuration="5.90175875s" totalImagesPullingTime="4.280269295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:14:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:14:29.898553342 +0000 UTC m=+788.466962424" watchObservedRunningTime="2026-06-08 13:14:29.90175875 +0000 UTC m=+788.470168173" Jun 08 13:14:40.818917 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:40.818843 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:40.883622 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:40.883589 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-6wbdd" Jun 08 13:14:40.904426 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:40.904380 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-mn5nw" podStartSLOduration=13.097066712 podStartE2EDuration="16.904364569s" totalImagesPullingTime="3.807297857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:14:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:14:29.92799841 +0000 UTC m=+788.496407491" watchObservedRunningTime="2026-06-08 13:14:40.904364569 +0000 UTC m=+799.472773652" Jun 08 13:14:44.734423 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:44.734390 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:54.852169 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:54.852136 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:54.959986 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:54.959953 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:55.094613 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:55.094584 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:14:56.189487 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.189438 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh"] Jun 08 13:14:56.192901 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.192884 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" Jun 08 13:14:56.195580 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.195557 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8tv44\"" Jun 08 13:14:56.195699 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.195587 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 13:14:56.196559 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.196540 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 13:14:56.203313 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.203292 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh"] Jun 08 13:14:56.381843 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.381811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c66b9657-2ece-47fb-a815-c4689ffd0b3b-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh\" (UID: \"c66b9657-2ece-47fb-a815-c4689ffd0b3b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" Jun 08 13:14:56.382031 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.381879 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c66b9657-2ece-47fb-a815-c4689ffd0b3b-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh\" (UID: \"c66b9657-2ece-47fb-a815-c4689ffd0b3b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" Jun 08 13:14:56.382031 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.381955 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r8kc\" (UniqueName: \"kubernetes.io/projected/c66b9657-2ece-47fb-a815-c4689ffd0b3b-kube-api-access-4r8kc\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh\" (UID: \"c66b9657-2ece-47fb-a815-c4689ffd0b3b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" Jun 08 13:14:56.483297 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.483208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c66b9657-2ece-47fb-a815-c4689ffd0b3b-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh\" (UID: \"c66b9657-2ece-47fb-a815-c4689ffd0b3b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" Jun 08 13:14:56.483297 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.483277 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c66b9657-2ece-47fb-a815-c4689ffd0b3b-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh\" (UID: \"c66b9657-2ece-47fb-a815-c4689ffd0b3b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" Jun 08 13:14:56.483547 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.483309 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r8kc\" (UniqueName: \"kubernetes.io/projected/c66b9657-2ece-47fb-a815-c4689ffd0b3b-kube-api-access-4r8kc\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh\" (UID: \"c66b9657-2ece-47fb-a815-c4689ffd0b3b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" Jun 08 13:14:56.483696 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.483672 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c66b9657-2ece-47fb-a815-c4689ffd0b3b-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh\" (UID: \"c66b9657-2ece-47fb-a815-c4689ffd0b3b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" Jun 08 13:14:56.483761 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.483696 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c66b9657-2ece-47fb-a815-c4689ffd0b3b-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh\" (UID: \"c66b9657-2ece-47fb-a815-c4689ffd0b3b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" Jun 08 13:14:56.497512 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.497490 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r8kc\" (UniqueName: \"kubernetes.io/projected/c66b9657-2ece-47fb-a815-c4689ffd0b3b-kube-api-access-4r8kc\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh\" (UID: \"c66b9657-2ece-47fb-a815-c4689ffd0b3b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" Jun 08 13:14:56.503352 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.503327 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" Jun 08 13:14:56.637521 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:56.637499 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh"] Jun 08 13:14:56.638887 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:14:56.638859 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc66b9657_2ece_47fb_a815_c4689ffd0b3b.slice/crio-f3edafff5cb00c5260f7bb34dd30a564ded86781a28a1a733f068204a7a3de11 WatchSource:0}: Error finding container f3edafff5cb00c5260f7bb34dd30a564ded86781a28a1a733f068204a7a3de11: Status 404 returned error can't find the container with id f3edafff5cb00c5260f7bb34dd30a564ded86781a28a1a733f068204a7a3de11 Jun 08 13:14:57.019456 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:57.019385 2564 generic.go:356] "Generic (PLEG): container finished" podID="c66b9657-2ece-47fb-a815-c4689ffd0b3b" containerID="90fc1b248ee5cdd035664e5a02d49c8a5cd3645d75b1dda5ca9b75b711b0f777" exitCode=0 Jun 08 13:14:57.019456 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:57.019489 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" event={"ID":"c66b9657-2ece-47fb-a815-c4689ffd0b3b","Type":"ContainerDied","Data":"90fc1b248ee5cdd035664e5a02d49c8a5cd3645d75b1dda5ca9b75b711b0f777"} Jun 08 13:14:57.019708 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:57.019535 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" event={"ID":"c66b9657-2ece-47fb-a815-c4689ffd0b3b","Type":"ContainerStarted","Data":"f3edafff5cb00c5260f7bb34dd30a564ded86781a28a1a733f068204a7a3de11"} Jun 08 13:14:58.026239 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:58.026209 2564 generic.go:356] "Generic (PLEG): container finished" podID="c66b9657-2ece-47fb-a815-c4689ffd0b3b" containerID="aeaba3195ff9a191b1e69e6bce87952e62ec78ffdbd5a84116b96fc8cbf30da3" exitCode=0 Jun 08 13:14:58.026668 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:58.026261 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" event={"ID":"c66b9657-2ece-47fb-a815-c4689ffd0b3b","Type":"ContainerDied","Data":"aeaba3195ff9a191b1e69e6bce87952e62ec78ffdbd5a84116b96fc8cbf30da3"} Jun 08 13:14:59.032993 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:59.032960 2564 generic.go:356] "Generic (PLEG): container finished" podID="c66b9657-2ece-47fb-a815-c4689ffd0b3b" containerID="7f7e8f1a79dba0a5ad9c755a7c2fb4b8aca2cd2fc432c24e946195334ad0b2d4" exitCode=0 Jun 08 13:14:59.032993 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:14:59.032996 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" event={"ID":"c66b9657-2ece-47fb-a815-c4689ffd0b3b","Type":"ContainerDied","Data":"7f7e8f1a79dba0a5ad9c755a7c2fb4b8aca2cd2fc432c24e946195334ad0b2d4"} Jun 08 13:15:00.172375 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:00.172346 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" Jun 08 13:15:00.211177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:00.211141 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c66b9657-2ece-47fb-a815-c4689ffd0b3b-util\") pod \"c66b9657-2ece-47fb-a815-c4689ffd0b3b\" (UID: \"c66b9657-2ece-47fb-a815-c4689ffd0b3b\") " Jun 08 13:15:00.211177 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:00.211192 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4r8kc\" (UniqueName: \"kubernetes.io/projected/c66b9657-2ece-47fb-a815-c4689ffd0b3b-kube-api-access-4r8kc\") pod \"c66b9657-2ece-47fb-a815-c4689ffd0b3b\" (UID: \"c66b9657-2ece-47fb-a815-c4689ffd0b3b\") " Jun 08 13:15:00.211382 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:00.211224 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c66b9657-2ece-47fb-a815-c4689ffd0b3b-bundle\") pod \"c66b9657-2ece-47fb-a815-c4689ffd0b3b\" (UID: \"c66b9657-2ece-47fb-a815-c4689ffd0b3b\") " Jun 08 13:15:00.211763 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:00.211728 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c66b9657-2ece-47fb-a815-c4689ffd0b3b-bundle" (OuterVolumeSpecName: "bundle") pod "c66b9657-2ece-47fb-a815-c4689ffd0b3b" (UID: "c66b9657-2ece-47fb-a815-c4689ffd0b3b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:15:00.213345 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:00.213311 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c66b9657-2ece-47fb-a815-c4689ffd0b3b-kube-api-access-4r8kc" (OuterVolumeSpecName: "kube-api-access-4r8kc") pod "c66b9657-2ece-47fb-a815-c4689ffd0b3b" (UID: "c66b9657-2ece-47fb-a815-c4689ffd0b3b"). InnerVolumeSpecName "kube-api-access-4r8kc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:15:00.217426 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:00.217403 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c66b9657-2ece-47fb-a815-c4689ffd0b3b-util" (OuterVolumeSpecName: "util") pod "c66b9657-2ece-47fb-a815-c4689ffd0b3b" (UID: "c66b9657-2ece-47fb-a815-c4689ffd0b3b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 13:15:00.312765 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:00.312685 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c66b9657-2ece-47fb-a815-c4689ffd0b3b-util\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:15:00.312765 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:00.312714 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4r8kc\" (UniqueName: \"kubernetes.io/projected/c66b9657-2ece-47fb-a815-c4689ffd0b3b-kube-api-access-4r8kc\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:15:00.312765 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:00.312729 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c66b9657-2ece-47fb-a815-c4689ffd0b3b-bundle\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:15:01.045486 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:01.045440 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" event={"ID":"c66b9657-2ece-47fb-a815-c4689ffd0b3b","Type":"ContainerDied","Data":"f3edafff5cb00c5260f7bb34dd30a564ded86781a28a1a733f068204a7a3de11"} Jun 08 13:15:01.045661 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:01.045500 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3edafff5cb00c5260f7bb34dd30a564ded86781a28a1a733f068204a7a3de11" Jun 08 13:15:01.045661 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:01.045500 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485fwdh" Jun 08 13:15:19.193188 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:19.193160 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:15:19.294737 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:19.294702 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:15:35.092569 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:35.092530 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:15:48.817599 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:48.817567 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:15:49.066135 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.066100 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gd8sj"] Jun 08 13:15:49.066440 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.066428 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c66b9657-2ece-47fb-a815-c4689ffd0b3b" containerName="util" Jun 08 13:15:49.066515 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.066441 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c66b9657-2ece-47fb-a815-c4689ffd0b3b" containerName="util" Jun 08 13:15:49.066515 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.066457 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c66b9657-2ece-47fb-a815-c4689ffd0b3b" containerName="extract" Jun 08 13:15:49.066515 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.066462 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c66b9657-2ece-47fb-a815-c4689ffd0b3b" containerName="extract" Jun 08 13:15:49.066515 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.066485 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c66b9657-2ece-47fb-a815-c4689ffd0b3b" containerName="pull" Jun 08 13:15:49.066515 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.066492 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c66b9657-2ece-47fb-a815-c4689ffd0b3b" containerName="pull" Jun 08 13:15:49.066683 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.066541 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c66b9657-2ece-47fb-a815-c4689ffd0b3b" containerName="extract" Jun 08 13:15:49.069508 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.069458 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gd8sj" Jun 08 13:15:49.074800 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.074774 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gd8sj"] Jun 08 13:15:49.224649 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.224606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj7ld\" (UniqueName: \"kubernetes.io/projected/cf1429d0-3c83-47ea-b4f8-ab1e1322025c-kube-api-access-gj7ld\") pod \"authorino-5d4b67c446-gd8sj\" (UID: \"cf1429d0-3c83-47ea-b4f8-ab1e1322025c\") " pod="kuadrant-system/authorino-5d4b67c446-gd8sj" Jun 08 13:15:49.299946 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.299902 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gd8sj"] Jun 08 13:15:49.300181 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:15:49.300161 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gj7ld], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-gd8sj" podUID="cf1429d0-3c83-47ea-b4f8-ab1e1322025c" Jun 08 13:15:49.325905 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.325834 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj7ld\" (UniqueName: \"kubernetes.io/projected/cf1429d0-3c83-47ea-b4f8-ab1e1322025c-kube-api-access-gj7ld\") pod \"authorino-5d4b67c446-gd8sj\" (UID: \"cf1429d0-3c83-47ea-b4f8-ab1e1322025c\") " pod="kuadrant-system/authorino-5d4b67c446-gd8sj" Jun 08 13:15:49.329135 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.329114 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-766d6594b6-vxl6q"] Jun 08 13:15:49.332244 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.332229 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-766d6594b6-vxl6q" Jun 08 13:15:49.340722 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.340699 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-766d6594b6-vxl6q"] Jun 08 13:15:49.342465 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.342443 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj7ld\" (UniqueName: \"kubernetes.io/projected/cf1429d0-3c83-47ea-b4f8-ab1e1322025c-kube-api-access-gj7ld\") pod \"authorino-5d4b67c446-gd8sj\" (UID: \"cf1429d0-3c83-47ea-b4f8-ab1e1322025c\") " pod="kuadrant-system/authorino-5d4b67c446-gd8sj" Jun 08 13:15:49.527800 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.527759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvtfp\" (UniqueName: \"kubernetes.io/projected/0f367239-e3a4-4a24-aaa1-cf370fc5f029-kube-api-access-lvtfp\") pod \"authorino-766d6594b6-vxl6q\" (UID: \"0f367239-e3a4-4a24-aaa1-cf370fc5f029\") " pod="kuadrant-system/authorino-766d6594b6-vxl6q" Jun 08 13:15:49.567905 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.567874 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-766d6594b6-vxl6q"] Jun 08 13:15:49.568133 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:15:49.568112 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lvtfp], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-766d6594b6-vxl6q" podUID="0f367239-e3a4-4a24-aaa1-cf370fc5f029" Jun 08 13:15:49.596822 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.596755 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-768d68549d-kmbcm"] Jun 08 13:15:49.600086 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.600069 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768d68549d-kmbcm" Jun 08 13:15:49.602595 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.602577 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 08 13:15:49.608978 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.608954 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-768d68549d-kmbcm"] Jun 08 13:15:49.628389 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.628364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvtfp\" (UniqueName: \"kubernetes.io/projected/0f367239-e3a4-4a24-aaa1-cf370fc5f029-kube-api-access-lvtfp\") pod \"authorino-766d6594b6-vxl6q\" (UID: \"0f367239-e3a4-4a24-aaa1-cf370fc5f029\") " pod="kuadrant-system/authorino-766d6594b6-vxl6q" Jun 08 13:15:49.636682 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.636663 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvtfp\" (UniqueName: \"kubernetes.io/projected/0f367239-e3a4-4a24-aaa1-cf370fc5f029-kube-api-access-lvtfp\") pod \"authorino-766d6594b6-vxl6q\" (UID: \"0f367239-e3a4-4a24-aaa1-cf370fc5f029\") " pod="kuadrant-system/authorino-766d6594b6-vxl6q" Jun 08 13:15:49.728946 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.728912 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8-tls-cert\") pod \"authorino-768d68549d-kmbcm\" (UID: \"e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8\") " pod="kuadrant-system/authorino-768d68549d-kmbcm" Jun 08 13:15:49.729086 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.728966 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svcb9\" (UniqueName: \"kubernetes.io/projected/e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8-kube-api-access-svcb9\") pod \"authorino-768d68549d-kmbcm\" (UID: \"e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8\") " pod="kuadrant-system/authorino-768d68549d-kmbcm" Jun 08 13:15:49.829808 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.829770 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8-tls-cert\") pod \"authorino-768d68549d-kmbcm\" (UID: \"e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8\") " pod="kuadrant-system/authorino-768d68549d-kmbcm" Jun 08 13:15:49.830183 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.829830 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svcb9\" (UniqueName: \"kubernetes.io/projected/e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8-kube-api-access-svcb9\") pod \"authorino-768d68549d-kmbcm\" (UID: \"e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8\") " pod="kuadrant-system/authorino-768d68549d-kmbcm" Jun 08 13:15:49.832154 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.832126 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8-tls-cert\") pod \"authorino-768d68549d-kmbcm\" (UID: \"e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8\") " pod="kuadrant-system/authorino-768d68549d-kmbcm" Jun 08 13:15:49.840684 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.840663 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svcb9\" (UniqueName: \"kubernetes.io/projected/e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8-kube-api-access-svcb9\") pod \"authorino-768d68549d-kmbcm\" (UID: \"e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8\") " pod="kuadrant-system/authorino-768d68549d-kmbcm" Jun 08 13:15:49.853994 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.853927 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:15:49.909641 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:49.909608 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768d68549d-kmbcm" Jun 08 13:15:50.042213 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:50.042185 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-768d68549d-kmbcm"] Jun 08 13:15:50.044003 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:15:50.043973 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode85e0cba_10b6_4ad5_a0cf_5f7bc2e0d7f8.slice/crio-d76754b1aa03547b4e232873575499c0b55056784eec144a04f772fc6bfc60a2 WatchSource:0}: Error finding container d76754b1aa03547b4e232873575499c0b55056784eec144a04f772fc6bfc60a2: Status 404 returned error can't find the container with id d76754b1aa03547b4e232873575499c0b55056784eec144a04f772fc6bfc60a2 Jun 08 13:15:50.296352 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:50.296324 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gd8sj" Jun 08 13:15:50.296352 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:50.296337 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-768d68549d-kmbcm" event={"ID":"e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8","Type":"ContainerStarted","Data":"d76754b1aa03547b4e232873575499c0b55056784eec144a04f772fc6bfc60a2"} Jun 08 13:15:50.296600 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:50.296352 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-766d6594b6-vxl6q" Jun 08 13:15:50.304756 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:50.304736 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gd8sj" Jun 08 13:15:50.306745 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:50.306732 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-766d6594b6-vxl6q" Jun 08 13:15:50.434318 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:50.434291 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj7ld\" (UniqueName: \"kubernetes.io/projected/cf1429d0-3c83-47ea-b4f8-ab1e1322025c-kube-api-access-gj7ld\") pod \"cf1429d0-3c83-47ea-b4f8-ab1e1322025c\" (UID: \"cf1429d0-3c83-47ea-b4f8-ab1e1322025c\") " Jun 08 13:15:50.434435 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:50.434330 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvtfp\" (UniqueName: \"kubernetes.io/projected/0f367239-e3a4-4a24-aaa1-cf370fc5f029-kube-api-access-lvtfp\") pod \"0f367239-e3a4-4a24-aaa1-cf370fc5f029\" (UID: \"0f367239-e3a4-4a24-aaa1-cf370fc5f029\") " Jun 08 13:15:50.436281 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:50.436248 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf1429d0-3c83-47ea-b4f8-ab1e1322025c-kube-api-access-gj7ld" (OuterVolumeSpecName: "kube-api-access-gj7ld") pod "cf1429d0-3c83-47ea-b4f8-ab1e1322025c" (UID: "cf1429d0-3c83-47ea-b4f8-ab1e1322025c"). InnerVolumeSpecName "kube-api-access-gj7ld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:15:50.436769 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:50.436725 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f367239-e3a4-4a24-aaa1-cf370fc5f029-kube-api-access-lvtfp" (OuterVolumeSpecName: "kube-api-access-lvtfp") pod "0f367239-e3a4-4a24-aaa1-cf370fc5f029" (UID: "0f367239-e3a4-4a24-aaa1-cf370fc5f029"). InnerVolumeSpecName "kube-api-access-lvtfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:15:50.535758 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:50.535721 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj7ld\" (UniqueName: \"kubernetes.io/projected/cf1429d0-3c83-47ea-b4f8-ab1e1322025c-kube-api-access-gj7ld\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:15:50.535758 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:50.535762 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvtfp\" (UniqueName: \"kubernetes.io/projected/0f367239-e3a4-4a24-aaa1-cf370fc5f029-kube-api-access-lvtfp\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:15:51.303045 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:51.303009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-766d6594b6-vxl6q" Jun 08 13:15:51.303045 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:51.303035 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-768d68549d-kmbcm" event={"ID":"e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8","Type":"ContainerStarted","Data":"82c0d7e28b73713afac0172d60df65841ea60457fb43c478a70a971536b302ef"} Jun 08 13:15:51.303621 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:51.303186 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gd8sj" Jun 08 13:15:51.348839 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:51.348793 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-768d68549d-kmbcm" podStartSLOduration=2.006682241 podStartE2EDuration="2.348776577s" totalImagesPullingTime="342.094336ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:15:51.348290864 +0000 UTC m=+869.916699945" watchObservedRunningTime="2026-06-08 13:15:51.348776577 +0000 UTC m=+869.917185657" Jun 08 13:15:51.396086 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:51.396056 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mn5nw"] Jun 08 13:15:51.396258 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:51.396209 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-mn5nw" podUID="3e47f758-3147-4c55-ba91-9fdcdef116ce" containerName="authorino" containerID="cri-o://a22338c8a30663104617c77263ee333699d9a3ee1ca5ef9d4958d6502876aed3" gracePeriod=30 Jun 08 13:15:51.400425 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:51.400399 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-766d6594b6-vxl6q"] Jun 08 13:15:51.406345 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:51.406319 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-766d6594b6-vxl6q"] Jun 08 13:15:51.431904 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:51.431872 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gd8sj"] Jun 08 13:15:51.434115 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:51.434091 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gd8sj"] Jun 08 13:15:51.645213 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:51.645187 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mn5nw" Jun 08 13:15:51.745860 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:51.745829 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdvqm\" (UniqueName: \"kubernetes.io/projected/3e47f758-3147-4c55-ba91-9fdcdef116ce-kube-api-access-kdvqm\") pod \"3e47f758-3147-4c55-ba91-9fdcdef116ce\" (UID: \"3e47f758-3147-4c55-ba91-9fdcdef116ce\") " Jun 08 13:15:51.747909 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:51.747875 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e47f758-3147-4c55-ba91-9fdcdef116ce-kube-api-access-kdvqm" (OuterVolumeSpecName: "kube-api-access-kdvqm") pod "3e47f758-3147-4c55-ba91-9fdcdef116ce" (UID: "3e47f758-3147-4c55-ba91-9fdcdef116ce"). InnerVolumeSpecName "kube-api-access-kdvqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:15:51.824295 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:51.824217 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f367239-e3a4-4a24-aaa1-cf370fc5f029" path="/var/lib/kubelet/pods/0f367239-e3a4-4a24-aaa1-cf370fc5f029/volumes" Jun 08 13:15:51.824446 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:51.824434 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf1429d0-3c83-47ea-b4f8-ab1e1322025c" path="/var/lib/kubelet/pods/cf1429d0-3c83-47ea-b4f8-ab1e1322025c/volumes" Jun 08 13:15:51.846903 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:51.846870 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdvqm\" (UniqueName: \"kubernetes.io/projected/3e47f758-3147-4c55-ba91-9fdcdef116ce-kube-api-access-kdvqm\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:15:52.309668 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:52.309631 2564 generic.go:356] "Generic (PLEG): container finished" podID="3e47f758-3147-4c55-ba91-9fdcdef116ce" containerID="a22338c8a30663104617c77263ee333699d9a3ee1ca5ef9d4958d6502876aed3" exitCode=0 Jun 08 13:15:52.310090 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:52.309692 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mn5nw" Jun 08 13:15:52.310090 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:52.309716 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mn5nw" event={"ID":"3e47f758-3147-4c55-ba91-9fdcdef116ce","Type":"ContainerDied","Data":"a22338c8a30663104617c77263ee333699d9a3ee1ca5ef9d4958d6502876aed3"} Jun 08 13:15:52.310090 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:52.309766 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mn5nw" event={"ID":"3e47f758-3147-4c55-ba91-9fdcdef116ce","Type":"ContainerDied","Data":"f34b173a804cdd7c515eb22dde9abbdc6d615af82350e6797de26540ead04851"} Jun 08 13:15:52.310090 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:52.309786 2564 scope.go:117] "RemoveContainer" containerID="a22338c8a30663104617c77263ee333699d9a3ee1ca5ef9d4958d6502876aed3" Jun 08 13:15:52.318435 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:52.318415 2564 scope.go:117] "RemoveContainer" containerID="a22338c8a30663104617c77263ee333699d9a3ee1ca5ef9d4958d6502876aed3" Jun 08 13:15:52.318718 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:15:52.318688 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a22338c8a30663104617c77263ee333699d9a3ee1ca5ef9d4958d6502876aed3\": container with ID starting with a22338c8a30663104617c77263ee333699d9a3ee1ca5ef9d4958d6502876aed3 not found: ID does not exist" containerID="a22338c8a30663104617c77263ee333699d9a3ee1ca5ef9d4958d6502876aed3" Jun 08 13:15:52.318787 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:52.318715 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a22338c8a30663104617c77263ee333699d9a3ee1ca5ef9d4958d6502876aed3"} err="failed to get container status \"a22338c8a30663104617c77263ee333699d9a3ee1ca5ef9d4958d6502876aed3\": rpc error: code = NotFound desc = could not find container \"a22338c8a30663104617c77263ee333699d9a3ee1ca5ef9d4958d6502876aed3\": container with ID starting with a22338c8a30663104617c77263ee333699d9a3ee1ca5ef9d4958d6502876aed3 not found: ID does not exist" Jun 08 13:15:52.327752 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:52.327728 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mn5nw"] Jun 08 13:15:52.331138 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:52.331117 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mn5nw"] Jun 08 13:15:53.824190 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:53.824155 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e47f758-3147-4c55-ba91-9fdcdef116ce" path="/var/lib/kubelet/pods/3e47f758-3147-4c55-ba91-9fdcdef116ce/volumes" Jun 08 13:15:55.061132 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:55.061103 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:15:55.166979 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:55.166949 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:15:55.248631 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:55.248596 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:15:58.446590 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:58.446527 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:15:58.522694 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:15:58.522657 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:16:15.049834 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:16:15.049755 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:16:15.145466 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:16:15.145432 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:16:31.839517 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:16:31.839483 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:16:32.426923 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:16:32.426887 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:16:32.532071 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:16:32.532032 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:16:32.646557 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:16:32.646525 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:17:21.302331 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.302289 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-768b8f666d-vgfgp"] Jun 08 13:17:21.302814 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.302629 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e47f758-3147-4c55-ba91-9fdcdef116ce" containerName="authorino" Jun 08 13:17:21.302814 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.302642 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e47f758-3147-4c55-ba91-9fdcdef116ce" containerName="authorino" Jun 08 13:17:21.302814 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.302695 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e47f758-3147-4c55-ba91-9fdcdef116ce" containerName="authorino" Jun 08 13:17:21.305704 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.305689 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768b8f666d-vgfgp" Jun 08 13:17:21.310264 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.310246 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 08 13:17:21.322105 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.322081 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-768b8f666d-vgfgp"] Jun 08 13:17:21.399844 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.399807 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-tls-cert\") pod \"authorino-768b8f666d-vgfgp\" (UID: \"3bf4d5be-d63d-4b94-8b53-f6220e3cf255\") " pod="kuadrant-system/authorino-768b8f666d-vgfgp" Jun 08 13:17:21.400039 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.399864 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-oidc-ca\") pod \"authorino-768b8f666d-vgfgp\" (UID: \"3bf4d5be-d63d-4b94-8b53-f6220e3cf255\") " pod="kuadrant-system/authorino-768b8f666d-vgfgp" Jun 08 13:17:21.400039 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.399961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r4nt\" (UniqueName: \"kubernetes.io/projected/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-kube-api-access-2r4nt\") pod \"authorino-768b8f666d-vgfgp\" (UID: \"3bf4d5be-d63d-4b94-8b53-f6220e3cf255\") " pod="kuadrant-system/authorino-768b8f666d-vgfgp" Jun 08 13:17:21.501218 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.501167 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-oidc-ca\") pod \"authorino-768b8f666d-vgfgp\" (UID: \"3bf4d5be-d63d-4b94-8b53-f6220e3cf255\") " pod="kuadrant-system/authorino-768b8f666d-vgfgp" Jun 08 13:17:21.501348 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.501263 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r4nt\" (UniqueName: \"kubernetes.io/projected/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-kube-api-access-2r4nt\") pod \"authorino-768b8f666d-vgfgp\" (UID: \"3bf4d5be-d63d-4b94-8b53-f6220e3cf255\") " pod="kuadrant-system/authorino-768b8f666d-vgfgp" Jun 08 13:17:21.501348 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.501316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-tls-cert\") pod \"authorino-768b8f666d-vgfgp\" (UID: \"3bf4d5be-d63d-4b94-8b53-f6220e3cf255\") " pod="kuadrant-system/authorino-768b8f666d-vgfgp" Jun 08 13:17:21.501961 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.501942 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-oidc-ca\") pod \"authorino-768b8f666d-vgfgp\" (UID: \"3bf4d5be-d63d-4b94-8b53-f6220e3cf255\") " pod="kuadrant-system/authorino-768b8f666d-vgfgp" Jun 08 13:17:21.503694 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.503673 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-tls-cert\") pod \"authorino-768b8f666d-vgfgp\" (UID: \"3bf4d5be-d63d-4b94-8b53-f6220e3cf255\") " pod="kuadrant-system/authorino-768b8f666d-vgfgp" Jun 08 13:17:21.509303 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.509280 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r4nt\" (UniqueName: \"kubernetes.io/projected/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-kube-api-access-2r4nt\") pod \"authorino-768b8f666d-vgfgp\" (UID: \"3bf4d5be-d63d-4b94-8b53-f6220e3cf255\") " pod="kuadrant-system/authorino-768b8f666d-vgfgp" Jun 08 13:17:21.614688 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.614630 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768b8f666d-vgfgp" Jun 08 13:17:21.741830 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.741807 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-768b8f666d-vgfgp"] Jun 08 13:17:21.743967 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:17:21.743931 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3bf4d5be_d63d_4b94_8b53_f6220e3cf255.slice/crio-4bdffbc3680a21a32020189b43890558db535fec0ddc70b9deb3604a72984fee WatchSource:0}: Error finding container 4bdffbc3680a21a32020189b43890558db535fec0ddc70b9deb3604a72984fee: Status 404 returned error can't find the container with id 4bdffbc3680a21a32020189b43890558db535fec0ddc70b9deb3604a72984fee Jun 08 13:17:21.770986 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:21.770959 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-768b8f666d-vgfgp" event={"ID":"3bf4d5be-d63d-4b94-8b53-f6220e3cf255","Type":"ContainerStarted","Data":"4bdffbc3680a21a32020189b43890558db535fec0ddc70b9deb3604a72984fee"} Jun 08 13:17:22.778097 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:22.778059 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-768b8f666d-vgfgp" event={"ID":"3bf4d5be-d63d-4b94-8b53-f6220e3cf255","Type":"ContainerStarted","Data":"af43db0ad76fb366c47076e1a1011d5b138d2cb997b5bbefb6ec5f5858c619bd"} Jun 08 13:17:22.795258 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:22.795205 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-768b8f666d-vgfgp" podStartSLOduration=1.35690168 podStartE2EDuration="1.795192156s" totalImagesPullingTime="438.290476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:17:22.793771014 +0000 UTC m=+961.362180094" watchObservedRunningTime="2026-06-08 13:17:22.795192156 +0000 UTC m=+961.363601243" Jun 08 13:17:22.830772 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:22.830741 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-768d68549d-kmbcm"] Jun 08 13:17:22.830964 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:22.830928 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-768d68549d-kmbcm" podUID="e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8" containerName="authorino" containerID="cri-o://82c0d7e28b73713afac0172d60df65841ea60457fb43c478a70a971536b302ef" gracePeriod=30 Jun 08 13:17:23.073630 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.073606 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768d68549d-kmbcm" Jun 08 13:17:23.217942 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.217906 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svcb9\" (UniqueName: \"kubernetes.io/projected/e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8-kube-api-access-svcb9\") pod \"e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8\" (UID: \"e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8\") " Jun 08 13:17:23.218153 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.217975 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8-tls-cert\") pod \"e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8\" (UID: \"e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8\") " Jun 08 13:17:23.220098 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.220060 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8-kube-api-access-svcb9" (OuterVolumeSpecName: "kube-api-access-svcb9") pod "e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8" (UID: "e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8"). InnerVolumeSpecName "kube-api-access-svcb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:17:23.227456 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.227433 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8" (UID: "e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:17:23.256870 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.256832 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:17:23.318933 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.318849 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8-tls-cert\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:17:23.318933 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.318893 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svcb9\" (UniqueName: \"kubernetes.io/projected/e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8-kube-api-access-svcb9\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:17:23.359292 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.359266 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:17:23.784814 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.784780 2564 generic.go:356] "Generic (PLEG): container finished" podID="e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8" containerID="82c0d7e28b73713afac0172d60df65841ea60457fb43c478a70a971536b302ef" exitCode=0 Jun 08 13:17:23.785217 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.784822 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768d68549d-kmbcm" Jun 08 13:17:23.785217 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.784869 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-768d68549d-kmbcm" event={"ID":"e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8","Type":"ContainerDied","Data":"82c0d7e28b73713afac0172d60df65841ea60457fb43c478a70a971536b302ef"} Jun 08 13:17:23.785217 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.784910 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-768d68549d-kmbcm" event={"ID":"e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8","Type":"ContainerDied","Data":"d76754b1aa03547b4e232873575499c0b55056784eec144a04f772fc6bfc60a2"} Jun 08 13:17:23.785217 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.784930 2564 scope.go:117] "RemoveContainer" containerID="82c0d7e28b73713afac0172d60df65841ea60457fb43c478a70a971536b302ef" Jun 08 13:17:23.794274 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.794258 2564 scope.go:117] "RemoveContainer" containerID="82c0d7e28b73713afac0172d60df65841ea60457fb43c478a70a971536b302ef" Jun 08 13:17:23.794547 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:17:23.794531 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82c0d7e28b73713afac0172d60df65841ea60457fb43c478a70a971536b302ef\": container with ID starting with 82c0d7e28b73713afac0172d60df65841ea60457fb43c478a70a971536b302ef not found: ID does not exist" containerID="82c0d7e28b73713afac0172d60df65841ea60457fb43c478a70a971536b302ef" Jun 08 13:17:23.794602 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.794555 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82c0d7e28b73713afac0172d60df65841ea60457fb43c478a70a971536b302ef"} err="failed to get container status \"82c0d7e28b73713afac0172d60df65841ea60457fb43c478a70a971536b302ef\": rpc error: code = NotFound desc = could not find container \"82c0d7e28b73713afac0172d60df65841ea60457fb43c478a70a971536b302ef\": container with ID starting with 82c0d7e28b73713afac0172d60df65841ea60457fb43c478a70a971536b302ef not found: ID does not exist" Jun 08 13:17:23.807762 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.807742 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-768d68549d-kmbcm"] Jun 08 13:17:23.814070 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.814050 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-768d68549d-kmbcm"] Jun 08 13:17:23.822950 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:23.822929 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8" path="/var/lib/kubelet/pods/e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8/volumes" Jun 08 13:17:31.691887 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:31.691842 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:17:32.104742 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:32.104666 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:17:46.402127 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:46.402093 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:17:46.808196 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:46.808100 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:17:53.367086 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.367054 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd"] Jun 08 13:17:53.367680 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.367374 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8" containerName="authorino" Jun 08 13:17:53.367680 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.367384 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8" containerName="authorino" Jun 08 13:17:53.367680 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.367440 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e85e0cba-10b6-4ad5-a0cf-5f7bc2e0d7f8" containerName="authorino" Jun 08 13:17:53.370774 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.370754 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.374200 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.374176 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 13:17:53.374315 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.374216 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 13:17:53.374315 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.374181 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-46d5k\"" Jun 08 13:17:53.374315 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.374181 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 08 13:17:53.380902 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.380879 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd"] Jun 08 13:17:53.458058 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.457998 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43d6b69e-f09e-4be6-bfe9-608757df6fad-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.458058 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.458023 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:17:53.458058 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.458055 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43d6b69e-f09e-4be6-bfe9-608757df6fad-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.458318 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.458075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43d6b69e-f09e-4be6-bfe9-608757df6fad-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.458318 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.458144 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrkdz\" (UniqueName: \"kubernetes.io/projected/43d6b69e-f09e-4be6-bfe9-608757df6fad-kube-api-access-mrkdz\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.458318 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.458191 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43d6b69e-f09e-4be6-bfe9-608757df6fad-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.458318 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.458227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/43d6b69e-f09e-4be6-bfe9-608757df6fad-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.558774 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.558743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43d6b69e-f09e-4be6-bfe9-608757df6fad-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.558917 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.558782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43d6b69e-f09e-4be6-bfe9-608757df6fad-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.558917 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.558803 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43d6b69e-f09e-4be6-bfe9-608757df6fad-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.558917 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.558864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrkdz\" (UniqueName: \"kubernetes.io/projected/43d6b69e-f09e-4be6-bfe9-608757df6fad-kube-api-access-mrkdz\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.558917 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.558899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43d6b69e-f09e-4be6-bfe9-608757df6fad-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.559091 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.558931 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/43d6b69e-f09e-4be6-bfe9-608757df6fad-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.559205 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.559184 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43d6b69e-f09e-4be6-bfe9-608757df6fad-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.559262 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.559224 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43d6b69e-f09e-4be6-bfe9-608757df6fad-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.559318 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.559266 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/43d6b69e-f09e-4be6-bfe9-608757df6fad-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.561100 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.561076 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43d6b69e-f09e-4be6-bfe9-608757df6fad-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.561321 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.561302 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43d6b69e-f09e-4be6-bfe9-608757df6fad-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.573999 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.573977 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrkdz\" (UniqueName: \"kubernetes.io/projected/43d6b69e-f09e-4be6-bfe9-608757df6fad-kube-api-access-mrkdz\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd\" (UID: \"43d6b69e-f09e-4be6-bfe9-608757df6fad\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.681760 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.681734 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:17:53.815351 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.815101 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd"] Jun 08 13:17:53.817367 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:17:53.817331 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d6b69e_f09e_4be6_bfe9_608757df6fad.slice/crio-2d4caaf61e21eb5b768420f13668dbe556256a9f84efbd352b13b633c376bd58 WatchSource:0}: Error finding container 2d4caaf61e21eb5b768420f13668dbe556256a9f84efbd352b13b633c376bd58: Status 404 returned error can't find the container with id 2d4caaf61e21eb5b768420f13668dbe556256a9f84efbd352b13b633c376bd58 Jun 08 13:17:53.890888 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.890856 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:17:53.938520 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:53.938422 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" event={"ID":"43d6b69e-f09e-4be6-bfe9-608757df6fad","Type":"ContainerStarted","Data":"2d4caaf61e21eb5b768420f13668dbe556256a9f84efbd352b13b633c376bd58"} Jun 08 13:17:57.963106 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:57.963072 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" event={"ID":"43d6b69e-f09e-4be6-bfe9-608757df6fad","Type":"ContainerStarted","Data":"f0732b7baa852fdee924f0ceb893b42ade9e603d562670bf67e3127feaccc4e8"} Jun 08 13:17:58.969929 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:58.969853 2564 generic.go:356] "Generic (PLEG): container finished" podID="43d6b69e-f09e-4be6-bfe9-608757df6fad" containerID="f0732b7baa852fdee924f0ceb893b42ade9e603d562670bf67e3127feaccc4e8" exitCode=0 Jun 08 13:17:58.969929 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:17:58.969889 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" event={"ID":"43d6b69e-f09e-4be6-bfe9-608757df6fad","Type":"ContainerDied","Data":"f0732b7baa852fdee924f0ceb893b42ade9e603d562670bf67e3127feaccc4e8"} Jun 08 13:18:00.983195 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:00.983160 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" event={"ID":"43d6b69e-f09e-4be6-bfe9-608757df6fad","Type":"ContainerStarted","Data":"31d6ed9cbee8c190c610852c46cbfcbb08ce100c0f4fc12458943bd36caefe4b"} Jun 08 13:18:01.012035 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:01.011985 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" podStartSLOduration=2.053630006 podStartE2EDuration="8.011969581s" totalImagesPullingTime="4.706792784s" totalInitContainerRuntime="1.251546791s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:17:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:18:01.010164131 +0000 UTC m=+999.578573213" watchObservedRunningTime="2026-06-08 13:18:01.011969581 +0000 UTC m=+999.580378661" Jun 08 13:18:02.968014 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:02.967979 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ff7fddf9c-xnfvs"] Jun 08 13:18:02.971509 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:02.971489 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:02.989641 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:02.989621 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff7fddf9c-xnfvs"] Jun 08 13:18:03.043592 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.043548 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:18:03.046686 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.046667 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-oauth-serving-cert\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.046770 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.046696 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgcq6\" (UniqueName: \"kubernetes.io/projected/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-kube-api-access-bgcq6\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.046770 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.046726 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-console-config\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.046842 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.046812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-service-ca\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.046880 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.046849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-trusted-ca-bundle\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.046880 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.046873 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-console-serving-cert\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.046957 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.046935 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-console-oauth-config\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.147648 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.147614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-oauth-serving-cert\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.147648 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.147645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgcq6\" (UniqueName: \"kubernetes.io/projected/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-kube-api-access-bgcq6\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.147883 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.147681 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-console-config\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.147883 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.147859 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-service-ca\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.148008 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.147905 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-trusted-ca-bundle\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.148008 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.147933 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-console-serving-cert\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.148008 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.147990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-console-oauth-config\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.148427 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.148398 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-oauth-serving-cert\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.148427 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.148419 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-console-config\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.148635 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.148540 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-service-ca\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.148723 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.148700 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-trusted-ca-bundle\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.150369 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.150347 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-console-serving-cert\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.150498 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.150426 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-console-oauth-config\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.159210 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.159181 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:18:03.161449 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.161425 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgcq6\" (UniqueName: \"kubernetes.io/projected/27ef4b49-ff69-41fe-83ba-0c700c2d38cd-kube-api-access-bgcq6\") pod \"console-6ff7fddf9c-xnfvs\" (UID: \"27ef4b49-ff69-41fe-83ba-0c700c2d38cd\") " pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.281139 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.281043 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:03.424633 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.424611 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff7fddf9c-xnfvs"] Jun 08 13:18:03.426305 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:18:03.426271 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ef4b49_ff69_41fe_83ba_0c700c2d38cd.slice/crio-963cf514187d229dbb42a45396df206b899a558f72468b7be00428b16227c841 WatchSource:0}: Error finding container 963cf514187d229dbb42a45396df206b899a558f72468b7be00428b16227c841: Status 404 returned error can't find the container with id 963cf514187d229dbb42a45396df206b899a558f72468b7be00428b16227c841 Jun 08 13:18:03.682415 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.682372 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:18:03.682599 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.682439 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:18:03.695079 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:03.695054 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:18:04.002102 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:04.002012 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff7fddf9c-xnfvs" event={"ID":"27ef4b49-ff69-41fe-83ba-0c700c2d38cd","Type":"ContainerStarted","Data":"6c17a3814bc22062f28eb9df0474f9da5ec3de115b340ca8146effa78a78219b"} Jun 08 13:18:04.002102 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:04.002060 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff7fddf9c-xnfvs" event={"ID":"27ef4b49-ff69-41fe-83ba-0c700c2d38cd","Type":"ContainerStarted","Data":"963cf514187d229dbb42a45396df206b899a558f72468b7be00428b16227c841"} Jun 08 13:18:04.013422 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:04.013398 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd" Jun 08 13:18:04.024210 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:04.024169 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ff7fddf9c-xnfvs" podStartSLOduration=2.024156606 podStartE2EDuration="2.024156606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:18:04.020982137 +0000 UTC m=+1002.589391231" watchObservedRunningTime="2026-06-08 13:18:04.024156606 +0000 UTC m=+1002.592565758" Jun 08 13:18:04.096343 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:04.096312 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:18:04.594521 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:04.594467 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:18:13.281396 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:13.281361 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:13.281875 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:13.281425 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:13.286280 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:13.286260 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:14.060085 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:14.060058 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ff7fddf9c-xnfvs" Jun 08 13:18:14.115868 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:14.115837 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c7f968d55-zttlm"] Jun 08 13:18:14.296154 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:14.296117 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:18:14.396704 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:14.396673 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:18:14.461422 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:14.461390 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:18:30.772510 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.772466 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j"] Jun 08 13:18:30.792460 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.792434 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.793801 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.793776 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j"] Jun 08 13:18:30.795539 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.795510 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 08 13:18:30.826593 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.826569 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:18:30.881847 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.881817 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3ca2c0d-6038-4f69-bea6-6e532870679c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.881998 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.881850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3ca2c0d-6038-4f69-bea6-6e532870679c-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.881998 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.881871 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3ca2c0d-6038-4f69-bea6-6e532870679c-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.881998 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.881887 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3ca2c0d-6038-4f69-bea6-6e532870679c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.881998 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.881977 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b5kr\" (UniqueName: \"kubernetes.io/projected/a3ca2c0d-6038-4f69-bea6-6e532870679c-kube-api-access-7b5kr\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.882279 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.882119 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a3ca2c0d-6038-4f69-bea6-6e532870679c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.983343 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.983304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3ca2c0d-6038-4f69-bea6-6e532870679c-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.983343 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.983346 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3ca2c0d-6038-4f69-bea6-6e532870679c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.983620 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.983490 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b5kr\" (UniqueName: \"kubernetes.io/projected/a3ca2c0d-6038-4f69-bea6-6e532870679c-kube-api-access-7b5kr\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.983683 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.983619 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a3ca2c0d-6038-4f69-bea6-6e532870679c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.983740 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.983702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3ca2c0d-6038-4f69-bea6-6e532870679c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.983795 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.983737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3ca2c0d-6038-4f69-bea6-6e532870679c-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.984028 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.983993 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a3ca2c0d-6038-4f69-bea6-6e532870679c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.984129 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.984034 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3ca2c0d-6038-4f69-bea6-6e532870679c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.984129 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.984052 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3ca2c0d-6038-4f69-bea6-6e532870679c-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.985679 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.985661 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3ca2c0d-6038-4f69-bea6-6e532870679c-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.986073 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.986052 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3ca2c0d-6038-4f69-bea6-6e532870679c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:30.992340 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:30.992314 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b5kr\" (UniqueName: \"kubernetes.io/projected/a3ca2c0d-6038-4f69-bea6-6e532870679c-kube-api-access-7b5kr\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j\" (UID: \"a3ca2c0d-6038-4f69-bea6-6e532870679c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:31.102991 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:31.102915 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:18:31.260694 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:31.260672 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j"] Jun 08 13:18:31.262727 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:18:31.262691 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3ca2c0d_6038_4f69_bea6_6e532870679c.slice/crio-92d028aeceea68562076a211b68bc28b4b44f0deaa2f8b3b8d1fa27aa2787e63 WatchSource:0}: Error finding container 92d028aeceea68562076a211b68bc28b4b44f0deaa2f8b3b8d1fa27aa2787e63: Status 404 returned error can't find the container with id 92d028aeceea68562076a211b68bc28b4b44f0deaa2f8b3b8d1fa27aa2787e63 Jun 08 13:18:31.487532 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:31.487494 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:18:32.157223 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:32.157189 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" event={"ID":"a3ca2c0d-6038-4f69-bea6-6e532870679c","Type":"ContainerStarted","Data":"4788e77a3635fd73b6b2ab959a06867e5df09b5975bf2281364336b049fb4f9b"} Jun 08 13:18:32.157605 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:32.157245 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" event={"ID":"a3ca2c0d-6038-4f69-bea6-6e532870679c","Type":"ContainerStarted","Data":"92d028aeceea68562076a211b68bc28b4b44f0deaa2f8b3b8d1fa27aa2787e63"} Jun 08 13:18:39.138230 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.138183 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c7f968d55-zttlm" podUID="a4d28141-deea-45ff-bf95-4d93275172dc" containerName="console" containerID="cri-o://8280f5aa8ae3aebd14dae46179cd35ffcb160d97462b2714850b6a25f585afdf" gracePeriod=15 Jun 08 13:18:39.385838 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.385816 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:18:39.459664 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.459606 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-console-config\") pod \"a4d28141-deea-45ff-bf95-4d93275172dc\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " Jun 08 13:18:39.459664 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.459641 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-oauth-serving-cert\") pod \"a4d28141-deea-45ff-bf95-4d93275172dc\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " Jun 08 13:18:39.459823 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.459686 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4d28141-deea-45ff-bf95-4d93275172dc-console-serving-cert\") pod \"a4d28141-deea-45ff-bf95-4d93275172dc\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " Jun 08 13:18:39.459823 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.459702 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4d28141-deea-45ff-bf95-4d93275172dc-console-oauth-config\") pod \"a4d28141-deea-45ff-bf95-4d93275172dc\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " Jun 08 13:18:39.459823 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.459739 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-trusted-ca-bundle\") pod \"a4d28141-deea-45ff-bf95-4d93275172dc\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " Jun 08 13:18:39.459823 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.459801 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-service-ca\") pod \"a4d28141-deea-45ff-bf95-4d93275172dc\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " Jun 08 13:18:39.460013 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.459828 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdw7z\" (UniqueName: \"kubernetes.io/projected/a4d28141-deea-45ff-bf95-4d93275172dc-kube-api-access-gdw7z\") pod \"a4d28141-deea-45ff-bf95-4d93275172dc\" (UID: \"a4d28141-deea-45ff-bf95-4d93275172dc\") " Jun 08 13:18:39.460013 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.459935 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-console-config" (OuterVolumeSpecName: "console-config") pod "a4d28141-deea-45ff-bf95-4d93275172dc" (UID: "a4d28141-deea-45ff-bf95-4d93275172dc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:18:39.460423 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.460387 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a4d28141-deea-45ff-bf95-4d93275172dc" (UID: "a4d28141-deea-45ff-bf95-4d93275172dc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:18:39.460727 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.460681 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-service-ca" (OuterVolumeSpecName: "service-ca") pod "a4d28141-deea-45ff-bf95-4d93275172dc" (UID: "a4d28141-deea-45ff-bf95-4d93275172dc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:18:39.460853 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.460777 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a4d28141-deea-45ff-bf95-4d93275172dc" (UID: "a4d28141-deea-45ff-bf95-4d93275172dc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:18:39.461446 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.460915 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-console-config\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:18:39.468573 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.468548 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4d28141-deea-45ff-bf95-4d93275172dc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a4d28141-deea-45ff-bf95-4d93275172dc" (UID: "a4d28141-deea-45ff-bf95-4d93275172dc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:18:39.468684 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.468615 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4d28141-deea-45ff-bf95-4d93275172dc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a4d28141-deea-45ff-bf95-4d93275172dc" (UID: "a4d28141-deea-45ff-bf95-4d93275172dc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:18:39.468869 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.468842 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4d28141-deea-45ff-bf95-4d93275172dc-kube-api-access-gdw7z" (OuterVolumeSpecName: "kube-api-access-gdw7z") pod "a4d28141-deea-45ff-bf95-4d93275172dc" (UID: "a4d28141-deea-45ff-bf95-4d93275172dc"). InnerVolumeSpecName "kube-api-access-gdw7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:18:39.561245 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.561223 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-oauth-serving-cert\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:18:39.561245 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.561241 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4d28141-deea-45ff-bf95-4d93275172dc-console-serving-cert\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:18:39.561364 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.561250 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4d28141-deea-45ff-bf95-4d93275172dc-console-oauth-config\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:18:39.561364 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.561259 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-trusted-ca-bundle\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:18:39.561364 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.561267 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4d28141-deea-45ff-bf95-4d93275172dc-service-ca\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:18:39.561364 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:39.561275 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdw7z\" (UniqueName: \"kubernetes.io/projected/a4d28141-deea-45ff-bf95-4d93275172dc-kube-api-access-gdw7z\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:18:40.201017 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:40.200974 2564 generic.go:356] "Generic (PLEG): container finished" podID="a4d28141-deea-45ff-bf95-4d93275172dc" containerID="8280f5aa8ae3aebd14dae46179cd35ffcb160d97462b2714850b6a25f585afdf" exitCode=0 Jun 08 13:18:40.201439 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:40.201042 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7f968d55-zttlm" Jun 08 13:18:40.201439 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:40.201054 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7f968d55-zttlm" event={"ID":"a4d28141-deea-45ff-bf95-4d93275172dc","Type":"ContainerDied","Data":"8280f5aa8ae3aebd14dae46179cd35ffcb160d97462b2714850b6a25f585afdf"} Jun 08 13:18:40.201439 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:40.201108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7f968d55-zttlm" event={"ID":"a4d28141-deea-45ff-bf95-4d93275172dc","Type":"ContainerDied","Data":"4073d586fb8d8c6f534aa338071dc120790f908896f02214e077acedc423ad2c"} Jun 08 13:18:40.201439 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:40.201128 2564 scope.go:117] "RemoveContainer" containerID="8280f5aa8ae3aebd14dae46179cd35ffcb160d97462b2714850b6a25f585afdf" Jun 08 13:18:40.209897 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:40.209866 2564 scope.go:117] "RemoveContainer" containerID="8280f5aa8ae3aebd14dae46179cd35ffcb160d97462b2714850b6a25f585afdf" Jun 08 13:18:40.210146 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:18:40.210127 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8280f5aa8ae3aebd14dae46179cd35ffcb160d97462b2714850b6a25f585afdf\": container with ID starting with 8280f5aa8ae3aebd14dae46179cd35ffcb160d97462b2714850b6a25f585afdf not found: ID does not exist" containerID="8280f5aa8ae3aebd14dae46179cd35ffcb160d97462b2714850b6a25f585afdf" Jun 08 13:18:40.210211 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:40.210158 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8280f5aa8ae3aebd14dae46179cd35ffcb160d97462b2714850b6a25f585afdf"} err="failed to get container status \"8280f5aa8ae3aebd14dae46179cd35ffcb160d97462b2714850b6a25f585afdf\": rpc error: code = NotFound desc = could not find container \"8280f5aa8ae3aebd14dae46179cd35ffcb160d97462b2714850b6a25f585afdf\": container with ID starting with 8280f5aa8ae3aebd14dae46179cd35ffcb160d97462b2714850b6a25f585afdf not found: ID does not exist" Jun 08 13:18:40.219399 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:40.219376 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c7f968d55-zttlm"] Jun 08 13:18:40.223485 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:40.223452 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c7f968d55-zttlm"] Jun 08 13:18:41.825345 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:41.825313 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4d28141-deea-45ff-bf95-4d93275172dc" path="/var/lib/kubelet/pods/a4d28141-deea-45ff-bf95-4d93275172dc/volumes" Jun 08 13:18:43.358695 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.358659 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7"] Jun 08 13:18:43.359059 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.359009 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4d28141-deea-45ff-bf95-4d93275172dc" containerName="console" Jun 08 13:18:43.359059 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.359022 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4d28141-deea-45ff-bf95-4d93275172dc" containerName="console" Jun 08 13:18:43.359131 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.359073 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4d28141-deea-45ff-bf95-4d93275172dc" containerName="console" Jun 08 13:18:43.362203 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.362187 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.364740 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.364717 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 08 13:18:43.372523 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.372502 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7"] Jun 08 13:18:43.394431 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.394410 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f184bb5d-2160-49a6-b5c5-d20576df7946-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.394562 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.394457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f184bb5d-2160-49a6-b5c5-d20576df7946-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.394562 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.394498 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f184bb5d-2160-49a6-b5c5-d20576df7946-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.394562 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.394521 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29q2j\" (UniqueName: \"kubernetes.io/projected/f184bb5d-2160-49a6-b5c5-d20576df7946-kube-api-access-29q2j\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.394562 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.394540 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f184bb5d-2160-49a6-b5c5-d20576df7946-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.394710 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.394607 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f184bb5d-2160-49a6-b5c5-d20576df7946-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.446868 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.446841 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:18:43.495295 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.495269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29q2j\" (UniqueName: \"kubernetes.io/projected/f184bb5d-2160-49a6-b5c5-d20576df7946-kube-api-access-29q2j\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.495400 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.495305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f184bb5d-2160-49a6-b5c5-d20576df7946-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.495400 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.495332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f184bb5d-2160-49a6-b5c5-d20576df7946-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.495400 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.495379 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f184bb5d-2160-49a6-b5c5-d20576df7946-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.495570 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.495416 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f184bb5d-2160-49a6-b5c5-d20576df7946-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.495570 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.495436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f184bb5d-2160-49a6-b5c5-d20576df7946-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.495818 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.495795 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f184bb5d-2160-49a6-b5c5-d20576df7946-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.495818 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.495807 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f184bb5d-2160-49a6-b5c5-d20576df7946-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.495913 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.495873 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f184bb5d-2160-49a6-b5c5-d20576df7946-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.497635 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.497615 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f184bb5d-2160-49a6-b5c5-d20576df7946-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.497869 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.497850 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f184bb5d-2160-49a6-b5c5-d20576df7946-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.502851 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.502828 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29q2j\" (UniqueName: \"kubernetes.io/projected/f184bb5d-2160-49a6-b5c5-d20576df7946-kube-api-access-29q2j\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-wxfm7\" (UID: \"f184bb5d-2160-49a6-b5c5-d20576df7946\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.672308 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.672282 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:43.806953 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:43.806932 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7"] Jun 08 13:18:43.809507 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:18:43.809457 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf184bb5d_2160_49a6_b5c5_d20576df7946.slice/crio-9a122d5f586b1eb370e3095100d09013d2602f450c806bf2b5799206dc4f95b9 WatchSource:0}: Error finding container 9a122d5f586b1eb370e3095100d09013d2602f450c806bf2b5799206dc4f95b9: Status 404 returned error can't find the container with id 9a122d5f586b1eb370e3095100d09013d2602f450c806bf2b5799206dc4f95b9 Jun 08 13:18:44.199008 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:44.198972 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:18:44.229665 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:44.229630 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" event={"ID":"f184bb5d-2160-49a6-b5c5-d20576df7946","Type":"ContainerStarted","Data":"7a8ce17736ccec31894c3a00c2c626482b6a050f6d512415b8e7b3dfac9a0e68"} Jun 08 13:18:44.229844 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:44.229675 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" event={"ID":"f184bb5d-2160-49a6-b5c5-d20576df7946","Type":"ContainerStarted","Data":"9a122d5f586b1eb370e3095100d09013d2602f450c806bf2b5799206dc4f95b9"} Jun 08 13:18:45.236694 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:45.236659 2564 generic.go:356] "Generic (PLEG): container finished" podID="f184bb5d-2160-49a6-b5c5-d20576df7946" containerID="7a8ce17736ccec31894c3a00c2c626482b6a050f6d512415b8e7b3dfac9a0e68" exitCode=0 Jun 08 13:18:45.237055 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:45.236721 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" event={"ID":"f184bb5d-2160-49a6-b5c5-d20576df7946","Type":"ContainerDied","Data":"7a8ce17736ccec31894c3a00c2c626482b6a050f6d512415b8e7b3dfac9a0e68"} Jun 08 13:18:45.237240 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:45.237226 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:18:46.243509 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:46.243460 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" event={"ID":"f184bb5d-2160-49a6-b5c5-d20576df7946","Type":"ContainerStarted","Data":"70eca213decf55376669f1854fb4ae68971e54d4c2be2007e19cec8caa33b977"} Jun 08 13:18:46.270567 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:46.270520 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" podStartSLOduration=1.723683652 podStartE2EDuration="3.270507637s" totalImagesPullingTime="221.936646ms" totalInitContainerRuntime="1.324887339s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:18:46.267610717 +0000 UTC m=+1044.836019810" watchObservedRunningTime="2026-06-08 13:18:46.270507637 +0000 UTC m=+1044.838916717" Jun 08 13:18:53.672900 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:53.672861 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:53.673294 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:53.672910 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:53.685623 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:53.685595 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:18:54.304671 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:18:54.304646 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-wxfm7" Jun 08 13:19:26.463518 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:26.463458 2564 generic.go:356] "Generic (PLEG): container finished" podID="a3ca2c0d-6038-4f69-bea6-6e532870679c" containerID="4788e77a3635fd73b6b2ab959a06867e5df09b5975bf2281364336b049fb4f9b" exitCode=0 Jun 08 13:19:26.463518 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:26.463507 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" event={"ID":"a3ca2c0d-6038-4f69-bea6-6e532870679c","Type":"ContainerDied","Data":"4788e77a3635fd73b6b2ab959a06867e5df09b5975bf2281364336b049fb4f9b"} Jun 08 13:19:27.471006 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:27.470974 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" event={"ID":"a3ca2c0d-6038-4f69-bea6-6e532870679c","Type":"ContainerStarted","Data":"d89f6ec9bac72bda5fb079b65f4c1276e77e6b31c737d7246f38d468ce309f54"} Jun 08 13:19:27.493685 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:27.493638 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" podStartSLOduration=2.84498323 podStartE2EDuration="57.493625242s" totalImagesPullingTime="341.763722ms" totalInitContainerRuntime="54.30687829s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:18:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:19:27.491729753 +0000 UTC m=+1086.060138882" watchObservedRunningTime="2026-06-08 13:19:27.493625242 +0000 UTC m=+1086.062034322" Jun 08 13:19:31.103813 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:31.103777 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:19:31.104307 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:31.103849 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:19:31.116241 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:31.116216 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:19:31.503291 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:31.503263 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j" Jun 08 13:19:48.014705 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:48.014670 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:19:48.117416 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:48.117387 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:19:48.701230 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:48.698310 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-768b8f666d-vgfgp"] Jun 08 13:19:48.701230 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:48.698590 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-768b8f666d-vgfgp" podUID="3bf4d5be-d63d-4b94-8b53-f6220e3cf255" containerName="authorino" containerID="cri-o://af43db0ad76fb366c47076e1a1011d5b138d2cb997b5bbefb6ec5f5858c619bd" gracePeriod=30 Jun 08 13:19:48.944248 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:48.944218 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768b8f666d-vgfgp" Jun 08 13:19:48.975517 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:48.975445 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-oidc-ca\") pod \"3bf4d5be-d63d-4b94-8b53-f6220e3cf255\" (UID: \"3bf4d5be-d63d-4b94-8b53-f6220e3cf255\") " Jun 08 13:19:48.975517 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:48.975514 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r4nt\" (UniqueName: \"kubernetes.io/projected/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-kube-api-access-2r4nt\") pod \"3bf4d5be-d63d-4b94-8b53-f6220e3cf255\" (UID: \"3bf4d5be-d63d-4b94-8b53-f6220e3cf255\") " Jun 08 13:19:48.975715 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:48.975564 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-tls-cert\") pod \"3bf4d5be-d63d-4b94-8b53-f6220e3cf255\" (UID: \"3bf4d5be-d63d-4b94-8b53-f6220e3cf255\") " Jun 08 13:19:48.977570 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:48.977531 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-kube-api-access-2r4nt" (OuterVolumeSpecName: "kube-api-access-2r4nt") pod "3bf4d5be-d63d-4b94-8b53-f6220e3cf255" (UID: "3bf4d5be-d63d-4b94-8b53-f6220e3cf255"). InnerVolumeSpecName "kube-api-access-2r4nt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:19:48.979950 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:48.979924 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "3bf4d5be-d63d-4b94-8b53-f6220e3cf255" (UID: "3bf4d5be-d63d-4b94-8b53-f6220e3cf255"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:19:48.986088 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:48.986064 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "3bf4d5be-d63d-4b94-8b53-f6220e3cf255" (UID: "3bf4d5be-d63d-4b94-8b53-f6220e3cf255"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 13:19:49.076723 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:49.076697 2564 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-oidc-ca\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:19:49.076723 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:49.076720 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r4nt\" (UniqueName: \"kubernetes.io/projected/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-kube-api-access-2r4nt\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:19:49.077048 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:49.076729 2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3bf4d5be-d63d-4b94-8b53-f6220e3cf255-tls-cert\") on node \"ip-10-0-129-96.ec2.internal\" DevicePath \"\"" Jun 08 13:19:49.179665 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:49.179640 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:19:49.313699 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:49.313605 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:19:49.586610 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:49.586520 2564 generic.go:356] "Generic (PLEG): container finished" podID="3bf4d5be-d63d-4b94-8b53-f6220e3cf255" containerID="af43db0ad76fb366c47076e1a1011d5b138d2cb997b5bbefb6ec5f5858c619bd" exitCode=0 Jun 08 13:19:49.586610 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:49.586568 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768b8f666d-vgfgp" Jun 08 13:19:49.586811 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:49.586610 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-768b8f666d-vgfgp" event={"ID":"3bf4d5be-d63d-4b94-8b53-f6220e3cf255","Type":"ContainerDied","Data":"af43db0ad76fb366c47076e1a1011d5b138d2cb997b5bbefb6ec5f5858c619bd"} Jun 08 13:19:49.586811 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:49.586654 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-768b8f666d-vgfgp" event={"ID":"3bf4d5be-d63d-4b94-8b53-f6220e3cf255","Type":"ContainerDied","Data":"4bdffbc3680a21a32020189b43890558db535fec0ddc70b9deb3604a72984fee"} Jun 08 13:19:49.586811 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:49.586671 2564 scope.go:117] "RemoveContainer" containerID="af43db0ad76fb366c47076e1a1011d5b138d2cb997b5bbefb6ec5f5858c619bd" Jun 08 13:19:49.596303 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:49.596281 2564 scope.go:117] "RemoveContainer" containerID="af43db0ad76fb366c47076e1a1011d5b138d2cb997b5bbefb6ec5f5858c619bd" Jun 08 13:19:49.596618 ip-10-0-129-96 kubenswrapper[2564]: E0608 13:19:49.596599 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af43db0ad76fb366c47076e1a1011d5b138d2cb997b5bbefb6ec5f5858c619bd\": container with ID starting with af43db0ad76fb366c47076e1a1011d5b138d2cb997b5bbefb6ec5f5858c619bd not found: ID does not exist" containerID="af43db0ad76fb366c47076e1a1011d5b138d2cb997b5bbefb6ec5f5858c619bd" Jun 08 13:19:49.596694 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:49.596630 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af43db0ad76fb366c47076e1a1011d5b138d2cb997b5bbefb6ec5f5858c619bd"} err="failed to get container status \"af43db0ad76fb366c47076e1a1011d5b138d2cb997b5bbefb6ec5f5858c619bd\": rpc error: code = NotFound desc = could not find container \"af43db0ad76fb366c47076e1a1011d5b138d2cb997b5bbefb6ec5f5858c619bd\": container with ID starting with af43db0ad76fb366c47076e1a1011d5b138d2cb997b5bbefb6ec5f5858c619bd not found: ID does not exist" Jun 08 13:19:49.654822 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:49.654802 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-768b8f666d-vgfgp"] Jun 08 13:19:49.676159 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:49.676134 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-768b8f666d-vgfgp"] Jun 08 13:19:49.824703 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:19:49.824670 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bf4d5be-d63d-4b94-8b53-f6220e3cf255" path="/var/lib/kubelet/pods/3bf4d5be-d63d-4b94-8b53-f6220e3cf255/volumes" Jun 08 13:20:01.928714 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:20:01.928668 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:20:20.703425 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:20:20.703393 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:20:23.495619 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:20:23.495580 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:20:24.498713 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:20:24.498680 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:20:32.206176 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:20:32.206135 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:20:36.994873 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:20:36.994780 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:20:37.093966 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:20:37.093935 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:20:41.898791 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:20:41.898754 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:20:47.707276 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:20:47.707232 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:20:51.697731 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:20:51.697701 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:21:01.297292 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:21:01.297254 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:21:10.796978 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:21:10.796942 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:21:20.896257 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:21:20.896215 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:21:28.625492 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:21:28.625437 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:21:29.884075 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:21:29.884042 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:21:53.192506 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:21:53.192460 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:21:56.294035 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:21:56.294005 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:22:01.902640 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:22:01.902603 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:22:04.395910 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:22:04.395871 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:22:09.893427 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:22:09.893345 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:22:09.992823 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:22:09.992794 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:22:16.924945 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:22:16.924909 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:22:18.414140 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:22:18.414105 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:22:24.680024 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:22:24.679993 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:22:24.747483 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:22:24.747445 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:22:33.603048 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:22:33.603009 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:22:50.102954 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:22:50.102920 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:22:56.798285 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:22:56.798220 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:22:56.901868 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:22:56.901834 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:23:20.829195 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:20.829161 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:23:26.784591 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:26.784558 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:23:26.853626 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:26.853596 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:23:26.976814 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:26.976782 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:23:27.079428 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:27.079340 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:23:27.252712 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:27.252677 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:23:27.440635 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:27.440592 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:23:28.299522 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:28.299486 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:23:43.853435 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:43.853392 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:23:43.981805 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:43.981770 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:23:44.082857 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:44.082819 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:23:45.200038 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:45.200005 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:23:48.191361 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:48.191325 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:23:50.634008 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:50.633958 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:23:50.709793 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:50.709759 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:23:58.797699 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:58.797660 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:23:58.892352 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:58.892315 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:23:58.991759 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:58.991721 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:23:59.092981 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:23:59.092897 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:24:00.297256 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:00.297218 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:24:15.492578 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:15.492546 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:24:15.528335 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:15.528300 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:24:15.635138 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:15.635104 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:24:15.748884 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:15.748808 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:24:18.190638 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:18.190601 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:24:21.895733 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:21.895698 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:24:21.962545 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:21.962510 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:24:42.426308 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:42.426278 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:24:42.528685 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:42.528616 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:24:42.704451 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:42.704364 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:24:48.486408 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:48.486359 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:24:48.586288 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:48.586257 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:24:48.686753 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:48.686721 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:24:48.842788 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:48.842705 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:24:54.944223 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:54.944188 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:24:55.046141 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:55.046106 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:24:55.800088 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:55.800041 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:24:58.990158 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:24:58.990127 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:25:21.192459 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:25:21.192383 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:25:30.409757 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:25:30.409724 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:25:47.101723 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:25:47.101689 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:25:55.889123 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:25:55.889095 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:25:59.708701 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:25:59.708666 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:25:59.809607 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:25:59.809569 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:26:12.930096 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:26:12.930068 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:26:21.203206 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:26:21.203170 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:26:52.458609 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:26:52.458526 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:26:53.891101 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:26:53.891063 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:27:03.412275 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:27:03.412240 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:27:10.700845 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:27:10.700810 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:27:19.100929 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:27:19.100893 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:27:27.591799 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:27:27.591759 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:27:35.894251 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:27:35.894214 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:27:38.702711 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:27:38.702676 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:27:44.796036 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:27:44.796000 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:27:56.002608 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:27:56.002575 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:28:35.302907 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:28:35.302828 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:28:37.407490 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:28:37.407433 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:28:45.631312 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:28:45.631270 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:28:50.001580 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:28:50.001546 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:28:56.389964 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:28:56.389927 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:29:04.799313 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:29:04.799278 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:29:14.794824 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:29:14.794790 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:29:23.602900 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:29:23.602866 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:29:32.235391 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:29:32.235358 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:29:35.603022 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:29:35.602982 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:29:40.693067 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:29:40.692988 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:29:50.299237 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:29:50.299198 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:29:58.495318 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:29:58.495278 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:30:08.721467 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:30:08.721436 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:30:16.497741 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:30:16.497704 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:30:25.991847 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:30:25.991809 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:30:33.418110 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:30:33.418077 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:30:42.897872 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:30:42.897840 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:30:50.900812 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:30:50.900771 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:31:00.393974 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:31:00.393938 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:31:08.392577 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:31:08.392492 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:33:20.625850 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:33:20.625816 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:33:21.986490 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:33:21.986439 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:33:28.497592 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:33:28.497558 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:33:33.194898 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:33:33.194864 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:33:59.501351 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:33:59.501309 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:34:03.792716 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:34:03.792679 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:34:13.694370 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:34:13.694337 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:34:16.212151 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:34:16.212116 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:34:23.395636 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:34:23.395604 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:34:32.299285 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:34:32.299242 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:34:43.310406 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:34:43.310370 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:34:52.593191 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:34:52.593159 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:34:52.891455 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:34:52.891422 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:35:02.701550 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:35:02.701514 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:35:10.904281 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:35:10.904246 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:35:21.103030 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:35:21.102991 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:35:30.802457 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:35:30.802418 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:35:34.493289 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:35:34.493251 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:36:03.594831 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:36:03.594794 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:36:07.246455 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:36:07.246422 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:36:47.521437 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:36:47.521400 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:36:54.835467 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:36:54.835434 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:37:05.121014 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:37:05.120986 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:37:12.903023 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:37:12.902989 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:37:21.303096 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:37:21.303063 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:37:31.991952 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:37:31.991920 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:37:40.895066 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:37:40.895032 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:37:46.591390 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:37:46.591357 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:37:56.203725 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:37:56.203692 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:38:03.400277 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:38:03.400242 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:38:12.402556 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:38:12.402522 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:38:22.945456 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:38:22.945413 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:38:41.626451 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:38:41.626370 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:38:49.508809 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:38:49.508773 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:38:58.006759 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:38:58.006723 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:39:06.925388 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:39:06.925344 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:39:24.303158 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:39:24.303120 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:39:32.292409 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:39:32.292379 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:39:40.798034 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:39:40.798001 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:39:49.486120 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:39:49.486087 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:39:59.184887 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:39:59.184852 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:40:06.799301 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:40:06.799218 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:40:17.101488 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:40:17.101444 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:40:29.189422 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:40:29.189390 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:40:39.385621 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:40:39.385585 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:40:51.486264 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:40:51.486232 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:40:55.131939 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:40:55.131901 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:40:56.192174 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:40:56.192142 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:41:01.899366 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:41:01.899330 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:41:05.989723 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:41:05.989682 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:41:15.183093 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:41:15.183059 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:41:22.787897 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:41:22.787843 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:41:39.316450 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:41:39.316371 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:41:47.795599 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:41:47.795562 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:41:55.809001 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:41:55.808966 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:41:56.791230 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:41:56.791194 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:42:01.310139 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:01.310100 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:02.599528 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:02.599497 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:42:25.488561 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:25.488526 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:26.590563 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:26.590531 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:42:34.306724 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:34.306689 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:38.568007 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:38.567970 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:39.583312 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:39.583282 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:42:40.307235 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:40.307200 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:40.402114 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:40.402078 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:40.502896 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:40.502812 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:43.788999 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:43.788959 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6wbdd"] Jun 08 13:42:44.184587 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:44.184563 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:46.466114 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:46.466082 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:46.664356 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:46.664320 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:46.760607 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:46.760527 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:49.162636 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:49.162607 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:52.695361 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:52.695331 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:52.752822 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:52.752796 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:52.965050 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:52.964975 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:53.073680 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:53.073651 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:53.164235 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:53.164200 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:56.984758 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:56.984726 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:42:59.222305 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:42:59.222249 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:00.401619 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:00.401579 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:00.502985 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:00.502947 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:03.941334 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:03.941308 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:06.483716 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:06.483637 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:06.581676 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:06.581644 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:18.289317 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:18.289292 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-gnwvj_b41be4f1-b2dd-473a-9977-f232520d86a3/server/0.log" Jun 08 13:43:18.783984 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:18.783958 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-677cd7f45-cgvp5_7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f/copy-manifests/0.log" Jun 08 13:43:18.792209 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:18.792189 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-677cd7f45-cgvp5_7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f/manager/0.log" Jun 08 13:43:19.712204 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:19.712172 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn_fd77bc71-5d85-4fae-ab23-aa341fe55983/pull/0.log" Jun 08 13:43:19.719380 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:19.719357 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn_fd77bc71-5d85-4fae-ab23-aa341fe55983/extract/0.log" Jun 08 13:43:19.727709 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:19.727690 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn_fd77bc71-5d85-4fae-ab23-aa341fe55983/util/0.log" Jun 08 13:43:19.846493 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:19.846448 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p_f22e2396-1ef7-4391-96e1-5288affe1530/pull/0.log" Jun 08 13:43:19.853302 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:19.853282 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p_f22e2396-1ef7-4391-96e1-5288affe1530/extract/0.log" Jun 08 13:43:19.860361 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:19.860341 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p_f22e2396-1ef7-4391-96e1-5288affe1530/util/0.log" Jun 08 13:43:19.969666 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:19.969602 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6_77fced7d-5786-41d8-a4c0-067124c067be/util/0.log" Jun 08 13:43:19.977012 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:19.976984 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6_77fced7d-5786-41d8-a4c0-067124c067be/pull/0.log" Jun 08 13:43:19.984237 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:19.984219 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6_77fced7d-5786-41d8-a4c0-067124c067be/extract/0.log" Jun 08 13:43:20.097729 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:20.097703 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp_3b847695-abfe-41cd-bf9f-481a8c6ca93d/util/0.log" Jun 08 13:43:20.104646 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:20.104629 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp_3b847695-abfe-41cd-bf9f-481a8c6ca93d/pull/0.log" Jun 08 13:43:20.111244 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:20.111229 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp_3b847695-abfe-41cd-bf9f-481a8c6ca93d/extract/0.log" Jun 08 13:43:20.627516 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:20.627490 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-n5nbn_35007f5b-0d42-4d8e-9ccd-d11f1f7f614e/kuadrant-console-plugin/0.log" Jun 08 13:43:20.994455 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:20.994374 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-6wbdd_8ee141f7-edc1-447e-b364-97abed6c3645/limitador/0.log" Jun 08 13:43:21.806882 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:21.806854 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cd48f9f86-nsr6j_30bac540-4e08-4df1-9840-e456b7a66e51/kube-auth-proxy/0.log" Jun 08 13:43:22.314608 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:22.314572 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5595dd76b9-v9wcr_50e14859-9356-4e8c-bf60-beb946fea0b3/router/0.log" Jun 08 13:43:22.912746 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:22.912721 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd_43d6b69e-f09e-4be6-bfe9-608757df6fad/storage-initializer/0.log" Jun 08 13:43:22.921759 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:22.921740 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-5vswd_43d6b69e-f09e-4be6-bfe9-608757df6fad/main/0.log" Jun 08 13:43:23.154993 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:23.154962 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j_a3ca2c0d-6038-4f69-bea6-6e532870679c/storage-initializer/0.log" Jun 08 13:43:23.162522 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:23.162494 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-n9f7j_a3ca2c0d-6038-4f69-bea6-6e532870679c/main/0.log" Jun 08 13:43:23.274941 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:23.274857 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-wxfm7_f184bb5d-2160-49a6-b5c5-d20576df7946/storage-initializer/0.log" Jun 08 13:43:23.283861 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:23.283837 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-wxfm7_f184bb5d-2160-49a6-b5c5-d20576df7946/main/0.log" Jun 08 13:43:27.208016 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.207980 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-flk4d/must-gather-vsjqx"] Jun 08 13:43:27.208401 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.208333 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf4d5be-d63d-4b94-8b53-f6220e3cf255" containerName="authorino" Jun 08 13:43:27.208401 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.208345 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf4d5be-d63d-4b94-8b53-f6220e3cf255" containerName="authorino" Jun 08 13:43:27.208509 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.208420 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bf4d5be-d63d-4b94-8b53-f6220e3cf255" containerName="authorino" Jun 08 13:43:27.211601 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.211583 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flk4d/must-gather-vsjqx" Jun 08 13:43:27.219343 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.219305 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-flk4d\"/\"default-dockercfg-mqgqd\"" Jun 08 13:43:27.219343 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.219314 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-flk4d\"/\"openshift-service-ca.crt\"" Jun 08 13:43:27.219553 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.219343 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-flk4d\"/\"kube-root-ca.crt\"" Jun 08 13:43:27.235414 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.235385 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0c25ae12-66d2-4102-b644-beaeb762b1a8-must-gather-output\") pod \"must-gather-vsjqx\" (UID: \"0c25ae12-66d2-4102-b644-beaeb762b1a8\") " pod="openshift-must-gather-flk4d/must-gather-vsjqx" Jun 08 13:43:27.235559 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.235492 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74b8j\" (UniqueName: \"kubernetes.io/projected/0c25ae12-66d2-4102-b644-beaeb762b1a8-kube-api-access-74b8j\") pod \"must-gather-vsjqx\" (UID: \"0c25ae12-66d2-4102-b644-beaeb762b1a8\") " pod="openshift-must-gather-flk4d/must-gather-vsjqx" Jun 08 13:43:27.238424 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.238398 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flk4d/must-gather-vsjqx"] Jun 08 13:43:27.280061 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.280033 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:27.336921 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.336890 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0c25ae12-66d2-4102-b644-beaeb762b1a8-must-gather-output\") pod \"must-gather-vsjqx\" (UID: \"0c25ae12-66d2-4102-b644-beaeb762b1a8\") " pod="openshift-must-gather-flk4d/must-gather-vsjqx" Jun 08 13:43:27.337090 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.336952 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74b8j\" (UniqueName: \"kubernetes.io/projected/0c25ae12-66d2-4102-b644-beaeb762b1a8-kube-api-access-74b8j\") pod \"must-gather-vsjqx\" (UID: \"0c25ae12-66d2-4102-b644-beaeb762b1a8\") " pod="openshift-must-gather-flk4d/must-gather-vsjqx" Jun 08 13:43:27.337265 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.337243 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0c25ae12-66d2-4102-b644-beaeb762b1a8-must-gather-output\") pod \"must-gather-vsjqx\" (UID: \"0c25ae12-66d2-4102-b644-beaeb762b1a8\") " pod="openshift-must-gather-flk4d/must-gather-vsjqx" Jun 08 13:43:27.345305 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.345277 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74b8j\" (UniqueName: \"kubernetes.io/projected/0c25ae12-66d2-4102-b644-beaeb762b1a8-kube-api-access-74b8j\") pod \"must-gather-vsjqx\" (UID: \"0c25ae12-66d2-4102-b644-beaeb762b1a8\") " pod="openshift-must-gather-flk4d/must-gather-vsjqx" Jun 08 13:43:27.354829 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.354808 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" limit=1024 Jun 08 13:43:27.520401 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.520323 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flk4d/must-gather-vsjqx" Jun 08 13:43:27.659375 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.659353 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flk4d/must-gather-vsjqx"] Jun 08 13:43:27.661225 ip-10-0-129-96 kubenswrapper[2564]: W0608 13:43:27.661190 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c25ae12_66d2_4102_b644_beaeb762b1a8.slice/crio-dd8ea3c14c6d9bcde8f13bff7c2bd50542351b3aabb8d1993c81f391050d5723 WatchSource:0}: Error finding container dd8ea3c14c6d9bcde8f13bff7c2bd50542351b3aabb8d1993c81f391050d5723: Status 404 returned error can't find the container with id dd8ea3c14c6d9bcde8f13bff7c2bd50542351b3aabb8d1993c81f391050d5723 Jun 08 13:43:27.663017 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:27.662998 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:43:28.063926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:28.063893 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flk4d/must-gather-vsjqx" event={"ID":"0c25ae12-66d2-4102-b644-beaeb762b1a8","Type":"ContainerStarted","Data":"dd8ea3c14c6d9bcde8f13bff7c2bd50542351b3aabb8d1993c81f391050d5723"} Jun 08 13:43:29.072187 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:29.072150 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flk4d/must-gather-vsjqx" event={"ID":"0c25ae12-66d2-4102-b644-beaeb762b1a8","Type":"ContainerStarted","Data":"4afc33a906d975314f6750e32c46dd3bdf9088a12085b922096744ac4279f655"} Jun 08 13:43:29.072692 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:29.072201 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flk4d/must-gather-vsjqx" event={"ID":"0c25ae12-66d2-4102-b644-beaeb762b1a8","Type":"ContainerStarted","Data":"5228a4d0ad6713d220202adfd2a9d5b908216e3d5dc64c6062a10ba86787db70"} Jun 08 13:43:29.090674 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:29.090621 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-flk4d/must-gather-vsjqx" podStartSLOduration=1.302828227 podStartE2EDuration="2.090601997s" totalImagesPullingTime="787.77377ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:29.088146219 +0000 UTC m=+2527.656555317" watchObservedRunningTime="2026-06-08 13:43:29.090601997 +0000 UTC m=+2527.659011089" Jun 08 13:43:30.268913 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:30.268884 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4s2t4_65844758-3d62-45e6-93a7-44543a222e80/global-pull-secret-syncer/0.log" Jun 08 13:43:30.406866 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:30.406835 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bjxm8_b6d2bcc5-1d0a-46f1-9e91-32b5b22c943c/konnectivity-agent/0.log" Jun 08 13:43:30.513740 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:30.513706 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-96.ec2.internal_2ca2e778a4908d259d8d0253f0a8ed1a/haproxy/0.log" Jun 08 13:43:34.681466 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:34.681434 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn_fd77bc71-5d85-4fae-ab23-aa341fe55983/extract/0.log" Jun 08 13:43:34.710576 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:34.710537 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn_fd77bc71-5d85-4fae-ab23-aa341fe55983/util/0.log" Jun 08 13:43:34.735632 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:34.735579 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rbtsn_fd77bc71-5d85-4fae-ab23-aa341fe55983/pull/0.log" Jun 08 13:43:34.768299 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:34.768265 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p_f22e2396-1ef7-4391-96e1-5288affe1530/extract/0.log" Jun 08 13:43:34.793169 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:34.793133 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p_f22e2396-1ef7-4391-96e1-5288affe1530/util/0.log" Jun 08 13:43:34.822943 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:34.822855 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0smx8p_f22e2396-1ef7-4391-96e1-5288affe1530/pull/0.log" Jun 08 13:43:34.857579 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:34.857549 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6_77fced7d-5786-41d8-a4c0-067124c067be/extract/0.log" Jun 08 13:43:34.893327 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:34.893300 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6_77fced7d-5786-41d8-a4c0-067124c067be/util/0.log" Jun 08 13:43:34.925660 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:34.925635 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkfh6_77fced7d-5786-41d8-a4c0-067124c067be/pull/0.log" Jun 08 13:43:34.963624 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:34.963599 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp_3b847695-abfe-41cd-bf9f-481a8c6ca93d/extract/0.log" Jun 08 13:43:34.994346 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:34.994216 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp_3b847695-abfe-41cd-bf9f-481a8c6ca93d/util/0.log" Jun 08 13:43:35.020333 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:35.020306 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s8dp_3b847695-abfe-41cd-bf9f-481a8c6ca93d/pull/0.log" Jun 08 13:43:35.292805 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:35.292769 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-n5nbn_35007f5b-0d42-4d8e-9ccd-d11f1f7f614e/kuadrant-console-plugin/0.log" Jun 08 13:43:35.436171 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:35.436142 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-6wbdd_8ee141f7-edc1-447e-b364-97abed6c3645/limitador/0.log" Jun 08 13:43:37.043842 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:37.043810 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a39daf39-648d-4878-b65b-fe5a05841353/alertmanager/0.log" Jun 08 13:43:37.070571 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:37.070540 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a39daf39-648d-4878-b65b-fe5a05841353/config-reloader/0.log" Jun 08 13:43:37.097926 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:37.097900 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a39daf39-648d-4878-b65b-fe5a05841353/kube-rbac-proxy-web/0.log" Jun 08 13:43:37.121388 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:37.121359 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a39daf39-648d-4878-b65b-fe5a05841353/kube-rbac-proxy/0.log" Jun 08 13:43:37.149750 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:37.149610 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a39daf39-648d-4878-b65b-fe5a05841353/kube-rbac-proxy-metric/0.log" Jun 08 13:43:37.212063 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:37.212038 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a39daf39-648d-4878-b65b-fe5a05841353/prom-label-proxy/0.log" Jun 08 13:43:37.249659 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:37.249630 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a39daf39-648d-4878-b65b-fe5a05841353/init-config-reloader/0.log" Jun 08 13:43:37.454662 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:37.454600 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f4d69dd8d-kftjv_74eb20df-e068-433e-a818-03c2668fa939/metrics-server/0.log" Jun 08 13:43:37.619012 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:37.618980 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rrgzc_98cf22d5-33d5-4d84-9476-96fd1b7a73cd/node-exporter/0.log" Jun 08 13:43:37.657113 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:37.657067 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rrgzc_98cf22d5-33d5-4d84-9476-96fd1b7a73cd/kube-rbac-proxy/0.log" Jun 08 13:43:37.697943 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:37.697913 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rrgzc_98cf22d5-33d5-4d84-9476-96fd1b7a73cd/init-textfile/0.log" Jun 08 13:43:38.496525 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:38.496389 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8476b8f769-f42z4_198708ad-d8ec-4170-b122-61ce2d6e876f/telemeter-client/0.log" Jun 08 13:43:38.523879 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:38.523828 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8476b8f769-f42z4_198708ad-d8ec-4170-b122-61ce2d6e876f/reload/0.log" Jun 08 13:43:38.554539 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:38.554435 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8476b8f769-f42z4_198708ad-d8ec-4170-b122-61ce2d6e876f/kube-rbac-proxy/0.log" Jun 08 13:43:41.485528 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:41.485491 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6ff7fddf9c-xnfvs_27ef4b49-ff69-41fe-83ba-0c700c2d38cd/console/0.log" Jun 08 13:43:41.928065 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:41.928031 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz"] Jun 08 13:43:41.936984 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:41.936953 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:41.946911 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:41.946886 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz"] Jun 08 13:43:42.000494 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.000440 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e64af2cb-1711-479d-bad9-7d54420f50ad-proc\") pod \"perf-node-gather-daemonset-v8ltz\" (UID: \"e64af2cb-1711-479d-bad9-7d54420f50ad\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:42.000689 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.000529 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e64af2cb-1711-479d-bad9-7d54420f50ad-lib-modules\") pod \"perf-node-gather-daemonset-v8ltz\" (UID: \"e64af2cb-1711-479d-bad9-7d54420f50ad\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:42.000689 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.000559 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e64af2cb-1711-479d-bad9-7d54420f50ad-podres\") pod \"perf-node-gather-daemonset-v8ltz\" (UID: \"e64af2cb-1711-479d-bad9-7d54420f50ad\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:42.000689 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.000612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scjnn\" (UniqueName: \"kubernetes.io/projected/e64af2cb-1711-479d-bad9-7d54420f50ad-kube-api-access-scjnn\") pod \"perf-node-gather-daemonset-v8ltz\" (UID: \"e64af2cb-1711-479d-bad9-7d54420f50ad\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:42.000853 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.000708 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e64af2cb-1711-479d-bad9-7d54420f50ad-sys\") pod \"perf-node-gather-daemonset-v8ltz\" (UID: \"e64af2cb-1711-479d-bad9-7d54420f50ad\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:42.102104 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.102068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e64af2cb-1711-479d-bad9-7d54420f50ad-sys\") pod \"perf-node-gather-daemonset-v8ltz\" (UID: \"e64af2cb-1711-479d-bad9-7d54420f50ad\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:42.102298 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.102168 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e64af2cb-1711-479d-bad9-7d54420f50ad-proc\") pod \"perf-node-gather-daemonset-v8ltz\" (UID: \"e64af2cb-1711-479d-bad9-7d54420f50ad\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:42.102298 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.102207 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e64af2cb-1711-479d-bad9-7d54420f50ad-sys\") pod \"perf-node-gather-daemonset-v8ltz\" (UID: \"e64af2cb-1711-479d-bad9-7d54420f50ad\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:42.102298 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.102214 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e64af2cb-1711-479d-bad9-7d54420f50ad-lib-modules\") pod \"perf-node-gather-daemonset-v8ltz\" (UID: \"e64af2cb-1711-479d-bad9-7d54420f50ad\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:42.102298 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.102273 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e64af2cb-1711-479d-bad9-7d54420f50ad-podres\") pod \"perf-node-gather-daemonset-v8ltz\" (UID: \"e64af2cb-1711-479d-bad9-7d54420f50ad\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:42.102298 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.102278 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e64af2cb-1711-479d-bad9-7d54420f50ad-proc\") pod \"perf-node-gather-daemonset-v8ltz\" (UID: \"e64af2cb-1711-479d-bad9-7d54420f50ad\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:42.102602 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.102345 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scjnn\" (UniqueName: \"kubernetes.io/projected/e64af2cb-1711-479d-bad9-7d54420f50ad-kube-api-access-scjnn\") pod \"perf-node-gather-daemonset-v8ltz\" (UID: \"e64af2cb-1711-479d-bad9-7d54420f50ad\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:42.102602 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.102385 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e64af2cb-1711-479d-bad9-7d54420f50ad-podres\") pod \"perf-node-gather-daemonset-v8ltz\" (UID: \"e64af2cb-1711-479d-bad9-7d54420f50ad\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:42.102602 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.102348 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e64af2cb-1711-479d-bad9-7d54420f50ad-lib-modules\") pod \"perf-node-gather-daemonset-v8ltz\" (UID: \"e64af2cb-1711-479d-bad9-7d54420f50ad\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:42.111888 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.111852 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scjnn\" (UniqueName: \"kubernetes.io/projected/e64af2cb-1711-479d-bad9-7d54420f50ad-kube-api-access-scjnn\") pod \"perf-node-gather-daemonset-v8ltz\" (UID: \"e64af2cb-1711-479d-bad9-7d54420f50ad\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:42.252015 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.251919 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:42.448731 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:42.448532 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz"] Jun 08 13:43:43.184342 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:43.184290 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" event={"ID":"e64af2cb-1711-479d-bad9-7d54420f50ad","Type":"ContainerStarted","Data":"6d015671f583e37c1035ec917491f4d1dc9d4e88f7c3d02062683215c56edf6e"} Jun 08 13:43:43.184856 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:43.184362 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" event={"ID":"e64af2cb-1711-479d-bad9-7d54420f50ad","Type":"ContainerStarted","Data":"971d5d80b189aad81dda02a3d0938ed087d19b3d488f1200da611668da944616"} Jun 08 13:43:43.184856 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:43.184485 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:43.202157 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:43.202095 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" podStartSLOduration=2.20207385 podStartE2EDuration="2.20207385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:43.201818389 +0000 UTC m=+2541.770227473" watchObservedRunningTime="2026-06-08 13:43:43.20207385 +0000 UTC m=+2541.770482932" Jun 08 13:43:43.545750 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:43.545669 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wc4l8_2a6e9a0a-4cff-4501-88d4-ff243a63a8b1/dns/0.log" Jun 08 13:43:43.571286 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:43.571262 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wc4l8_2a6e9a0a-4cff-4501-88d4-ff243a63a8b1/kube-rbac-proxy/0.log" Jun 08 13:43:43.630910 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:43.630876 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pkk6k_be941842-dde4-47f6-9308-75450cdd10b6/dns-node-resolver/0.log" Jun 08 13:43:44.220507 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:44.220460 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-58dff7d848-97qq4_68aef9b0-125e-408f-a4e2-9fda3d8eb111/registry/0.log" Jun 08 13:43:44.243951 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:44.243922 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qffqs_5b4d19e3-e415-4cd0-90f3-076ab16ff1dc/node-ca/0.log" Jun 08 13:43:45.453213 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:45.453180 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cd48f9f86-nsr6j_30bac540-4e08-4df1-9840-e456b7a66e51/kube-auth-proxy/0.log" Jun 08 13:43:45.654882 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:45.654855 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5595dd76b9-v9wcr_50e14859-9356-4e8c-bf60-beb946fea0b3/router/0.log" Jun 08 13:43:46.351256 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:46.351226 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r4ngf_4fcf4863-891b-4b40-b03b-b5a139f5b1d8/serve-healthcheck-canary/0.log" Jun 08 13:43:47.074819 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:47.074794 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kv8tp_2b562dbc-4104-43fd-b271-5435f01b9fb7/kube-rbac-proxy/0.log" Jun 08 13:43:47.099243 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:47.099219 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kv8tp_2b562dbc-4104-43fd-b271-5435f01b9fb7/exporter/0.log" Jun 08 13:43:47.123439 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:47.123415 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kv8tp_2b562dbc-4104-43fd-b271-5435f01b9fb7/extractor/0.log" Jun 08 13:43:49.200718 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:49.200691 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-v8ltz" Jun 08 13:43:49.783759 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:49.783725 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-gnwvj_b41be4f1-b2dd-473a-9977-f232520d86a3/server/0.log" Jun 08 13:43:50.062284 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:50.062185 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-677cd7f45-cgvp5_7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f/manager/0.log" Jun 08 13:43:50.087969 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:50.087871 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-677cd7f45-cgvp5_7b4b582c-2c01-4bd8-ae68-d1e2718dfe8f/copy-manifests/0.log" Jun 08 13:43:51.910329 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:51.910274 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cf59b74dc-qrqd2_720c42ac-2048-439e-94a6-e475f3bf3552/manager/0.log" Jun 08 13:43:55.126315 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:55.126264 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cd48f9f86-nsr6j_30bac540-4e08-4df1-9840-e456b7a66e51/kube-auth-proxy/0.log" Jun 08 13:43:55.289200 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:55.289163 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5595dd76b9-v9wcr_50e14859-9356-4e8c-bf60-beb946fea0b3/router/0.log" Jun 08 13:43:56.517538 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:56.517463 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cd48f9f86-nsr6j_30bac540-4e08-4df1-9840-e456b7a66e51/kube-auth-proxy/0.log" Jun 08 13:43:56.672667 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:56.672557 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5595dd76b9-v9wcr_50e14859-9356-4e8c-bf60-beb946fea0b3/router/0.log" Jun 08 13:43:58.492828 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:58.492800 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cd48f9f86-nsr6j_30bac540-4e08-4df1-9840-e456b7a66e51/kube-auth-proxy/0.log" Jun 08 13:43:58.642425 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:58.642399 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5595dd76b9-v9wcr_50e14859-9356-4e8c-bf60-beb946fea0b3/router/0.log" Jun 08 13:43:59.323841 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:59.323803 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8h6z8_2eff2662-ab9b-4b82-9015-cf14f65fffb0/kube-multus/0.log" Jun 08 13:43:59.348397 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:59.348373 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjnpd_453df3f1-2f91-4834-a7fd-db011cba44d9/kube-multus-additional-cni-plugins/0.log" Jun 08 13:43:59.373329 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:59.373293 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjnpd_453df3f1-2f91-4834-a7fd-db011cba44d9/egress-router-binary-copy/0.log" Jun 08 13:43:59.397091 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:59.397065 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjnpd_453df3f1-2f91-4834-a7fd-db011cba44d9/cni-plugins/0.log" Jun 08 13:43:59.421419 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:59.421393 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjnpd_453df3f1-2f91-4834-a7fd-db011cba44d9/bond-cni-plugin/0.log" Jun 08 13:43:59.445265 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:59.445236 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjnpd_453df3f1-2f91-4834-a7fd-db011cba44d9/routeoverride-cni/0.log" Jun 08 13:43:59.467913 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:59.467848 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjnpd_453df3f1-2f91-4834-a7fd-db011cba44d9/whereabouts-cni-bincopy/0.log" Jun 08 13:43:59.490413 ip-10-0-129-96 kubenswrapper[2564]: I0608 13:43:59.490385 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjnpd_453df3f1-2f91-4834-a7fd-db011cba44d9/whereabouts-cni/0.log"